Jun 02 04:39:16.903619 ip-10-0-137-68 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 04:39:16.903631 ip-10-0-137-68 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 04:39:16.903640 ip-10-0-137-68 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 04:39:16.903954 ip-10-0-137-68 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 04:39:26.033219 ip-10-0-137-68 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 02 04:39:26.033234 ip-10-0-137-68 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a8b42bc350134353a36ff97ddf2dbdb8 -- Jun 02 04:41:47.179927 ip-10-0-137-68 systemd[1]: Starting Kubernetes Kubelet... Jun 02 04:41:47.554883 ip-10-0-137-68 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 04:41:47.554883 ip-10-0-137-68 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 04:41:47.554883 ip-10-0-137-68 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 04:41:47.554883 ip-10-0-137-68 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 04:41:47.554883 ip-10-0-137-68 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 04:41:47.557614 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.557530 2581 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 04:41:47.563963 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563942 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:41:47.563963 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563961 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:41:47.563963 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563965 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:41:47.563963 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563968 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:41:47.563963 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563971 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563977 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563981 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563984 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563987 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563989 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563992 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563995 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.563997 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564001 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564005 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564008 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564011 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564014 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564017 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564020 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564022 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564025 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564035 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:41:47.564160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564038 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564040 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564043 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564046 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564048 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564051 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564053 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564055 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564058 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564061 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564063 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564066 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564068 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564071 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564073 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564076 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564079 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564082 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564084 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564087 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:41:47.564617 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564090 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564093 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564095 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564098 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564101 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564111 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564115 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564118 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564121 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564124 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564126 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564129 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564132 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564134 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564137 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564140 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564142 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564145 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564147 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564150 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:41:47.565131 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564152 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564155 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564157 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564159 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564162 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564165 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564167 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564172 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564175 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564177 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564180 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564182 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564185 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564188 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564190 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564195 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564198 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564200 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564203 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564206 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:41:47.565649 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564209 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564212 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564214 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564601 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564606 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564609 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564612 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564615 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564617 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564620 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564624 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564627 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564630 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564632 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564635 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564638 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564640 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564643 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564646 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564649 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:41:47.566158 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564651 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564672 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564676 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564679 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564682 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564684 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564687 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564690 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564693 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564696 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564698 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564701 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564703 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564706 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564708 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564711 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564713 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564716 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564718 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564721 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:41:47.566631 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564723 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564725 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564728 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564731 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564734 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564736 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564739 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564741 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564744 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564747 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564750 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564752 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564755 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564758 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564760 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564762 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564765 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564770 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564774 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:41:47.567140 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564777 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564781 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564783 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564786 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564789 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564792 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564794 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564797 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564800 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564802 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564805 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564807 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564810 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564813 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564815 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564818 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564820 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564823 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564825 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:41:47.567611 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564828 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564830 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564832 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564836 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564840 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564842 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564845 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564848 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564851 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564854 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.564857 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566100 2581 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566111 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566117 2581 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566121 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566127 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566130 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566135 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566139 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566142 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566145 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 04:41:47.568094 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566151 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566154 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566157 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566161 2581 flags.go:64] FLAG: --cgroup-root="" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566164 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566167 2581 flags.go:64] FLAG: --client-ca-file="" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566170 2581 flags.go:64] FLAG: --cloud-config="" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566172 2581 flags.go:64] FLAG: --cloud-provider="external" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566175 2581 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566180 2581 flags.go:64] FLAG: --cluster-domain="" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566184 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566187 2581 flags.go:64] FLAG: --config-dir="" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566190 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566193 2581 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566197 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566200 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566203 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566206 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566209 2581 flags.go:64] FLAG: --contention-profiling="false" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566212 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566215 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566218 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566221 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566225 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566228 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 04:41:47.568620 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566231 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566234 2581 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566237 2581 flags.go:64] FLAG: --enable-server="true" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566240 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566245 2581 flags.go:64] FLAG: --event-burst="100" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566247 2581 flags.go:64] FLAG: --event-qps="50" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566250 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566254 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566257 2581 flags.go:64] FLAG: --eviction-hard="" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566261 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566263 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566266 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566269 2581 flags.go:64] FLAG: --eviction-soft="" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566272 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566275 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566278 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566281 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566284 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566288 2581 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566290 2581 flags.go:64] FLAG: --feature-gates="" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566294 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566297 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566300 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566304 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566307 2581 flags.go:64] FLAG: --healthz-port="10248" Jun 02 04:41:47.569236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566309 2581 flags.go:64] FLAG: --help="false" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566312 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566315 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566318 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566321 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566325 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566328 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566331 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566334 2581 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566337 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566340 2581 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566343 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566347 2581 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566350 2581 flags.go:64] FLAG: --kube-reserved="" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566353 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566356 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566359 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566361 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566364 2581 flags.go:64] FLAG: --lock-file="" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566367 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566370 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566373 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566378 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 04:41:47.569854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566381 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566384 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566387 2581 flags.go:64] FLAG: --logging-format="text" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566390 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566393 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566396 2581 flags.go:64] FLAG: --manifest-url="" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566399 2581 flags.go:64] FLAG: --manifest-url-header="" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566403 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566407 2581 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566411 2581 flags.go:64] FLAG: --max-pods="110" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566414 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566417 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566420 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566423 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566426 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566429 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566432 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566439 2581 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566442 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566446 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566449 2581 flags.go:64] FLAG: --pod-cidr="" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566452 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566458 2581 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566461 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 04:41:47.570459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566464 2581 flags.go:64] FLAG: --pods-per-core="0" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566467 2581 flags.go:64] FLAG: --port="10250" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566470 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566473 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c6b380b1bfb75b8b" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566476 2581 flags.go:64] FLAG: --qos-reserved="" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566479 2581 flags.go:64] FLAG: --read-only-port="10255" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566482 2581 flags.go:64] FLAG: --register-node="true" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566484 2581 flags.go:64] FLAG: --register-schedulable="true" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566488 2581 flags.go:64] FLAG: --register-with-taints="" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566491 2581 flags.go:64] FLAG: --registry-burst="10" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566494 2581 flags.go:64] FLAG: --registry-qps="5" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566497 2581 flags.go:64] FLAG: --reserved-cpus="" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566500 2581 flags.go:64] FLAG: --reserved-memory="" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566504 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566507 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566510 2581 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566512 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566515 2581 flags.go:64] FLAG: --runonce="false" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566518 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566521 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566524 2581 flags.go:64] FLAG: --seccomp-default="false" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566526 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566529 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566532 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566535 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566538 2581 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 04:41:47.571060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566541 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566544 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566546 2581 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566550 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566553 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566556 2581 flags.go:64] FLAG: --system-cgroups="" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566559 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566564 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566567 2581 flags.go:64] FLAG: --tls-cert-file="" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566569 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566573 2581 flags.go:64] FLAG: --tls-min-version="" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566576 2581 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566579 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566582 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566586 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566589 2581 flags.go:64] FLAG: --v="2" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566593 2581 flags.go:64] FLAG: --version="false" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566597 2581 flags.go:64] FLAG: --vmodule="" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566602 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566605 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566708 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566711 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566714 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566717 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:41:47.571687 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566720 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566723 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566726 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566728 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566732 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566734 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566737 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566740 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566742 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566745 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566748 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566751 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566755 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566758 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566760 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566763 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566766 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566768 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566771 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566773 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:41:47.572292 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566776 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566778 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566782 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566785 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566787 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566790 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566793 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566795 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566798 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566801 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566803 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566806 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566808 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566811 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566814 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566816 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566819 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566822 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566824 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566827 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566829 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:41:47.572909 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566832 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566835 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566837 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566841 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566844 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566846 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566849 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566851 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566854 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566856 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566859 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566861 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566864 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566869 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566871 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566874 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566878 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566882 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566885 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566888 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:41:47.573424 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566891 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566893 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566896 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566898 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566901 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566904 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566906 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566909 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566911 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566914 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566916 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566919 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566922 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566924 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566927 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566930 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566933 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566936 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566938 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:41:47.573974 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566942 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.566946 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.566951 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.574286 2581 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.574304 2581 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574352 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574357 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574361 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574363 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574367 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574369 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574372 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574375 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574377 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574380 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574382 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:41:47.574443 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574385 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574387 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574390 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574392 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574395 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574398 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574400 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574404 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574407 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574409 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574412 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574414 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574417 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574419 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574422 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574424 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574428 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574431 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574433 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574436 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:41:47.574869 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574439 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574442 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574446 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574449 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574452 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574454 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574457 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574460 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574462 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574465 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574467 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574470 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574474 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574478 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574482 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574485 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574488 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574490 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574493 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:41:47.575357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574496 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574500 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574502 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574505 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574508 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574510 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574513 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574515 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574518 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574521 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574523 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574526 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574528 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574532 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574535 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574538 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574541 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574543 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574546 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574548 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:41:47.575852 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574552 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574554 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574557 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574559 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574562 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574564 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574567 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574569 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574573 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574576 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574579 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574582 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574584 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574587 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574589 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:41:47.576340 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574592 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.574597 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574707 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574712 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574716 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574719 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574722 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574724 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574727 2581 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574730 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574733 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574737 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574742 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574746 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574749 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574752 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:41:47.576720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574755 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574757 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574761 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574764 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574767 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574770 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574774 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574776 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574779 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574781 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574784 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574787 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574789 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574792 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574794 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574797 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574800 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574802 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574804 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:41:47.577119 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574807 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574810 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574812 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574815 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574817 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574820 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574822 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574825 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574828 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574830 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574833 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574836 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574838 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574841 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574843 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574846 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574848 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574851 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574853 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574856 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:41:47.577618 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574859 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574861 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574864 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574866 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574869 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574871 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574874 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574876 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574879 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574882 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574884 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574887 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574889 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574892 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574895 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574897 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574900 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574902 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574905 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574907 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:41:47.578117 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574911 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574913 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574916 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574919 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574921 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574924 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574926 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574929 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574931 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574934 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574936 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574938 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:47.574941 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.574946 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.575684 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 04:41:47.578605 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.577777 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 04:41:47.579064 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.578602 2581 server.go:1019] "Starting client certificate rotation" Jun 02 04:41:47.579064 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.578701 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 04:41:47.579407 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.579396 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 04:41:47.599151 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.599129 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 04:41:47.601080 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.601059 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 04:41:47.614105 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.614087 2581 log.go:25] "Validated CRI v1 runtime API" Jun 02 04:41:47.619781 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.619764 2581 log.go:25] "Validated CRI v1 image API" Jun 02 04:41:47.621828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.621805 2581 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 04:41:47.623935 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.623907 2581 fs.go:135] Filesystem UUIDs: map[06705719-ddbf-4875-b7b3-bf1f5f7be72c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 de7d4eb9-60cc-41cb-bff5-bc0f35b2279b:/dev/nvme0n1p3] Jun 02 04:41:47.624007 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.623933 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 04:41:47.628754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.628624 2581 manager.go:217] Machine: {Timestamp:2026-06-02 04:41:47.628016251 +0000 UTC m=+0.348097313 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094177 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22c06f8e21088fb1286246366a599c SystemUUID:ec22c06f-8e21-088f-b128-6246366a599c BootID:a8b42bc3-5013-4353-a36f-f97ddf2dbdb8 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d7:89:23:1d:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d7:89:23:1d:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:8c:a8:50:cb:85 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 04:41:47.629399 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.629389 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 04:41:47.629488 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.629477 2581 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 04:41:47.630494 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.630478 2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 04:41:47.632199 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.632174 2581 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 04:41:47.632347 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.632204 2581 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 04:41:47.632391 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.632358 2581 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 04:41:47.632391 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.632367 2581 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 04:41:47.632391 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.632375 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 04:41:47.633000 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.632989 2581 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 04:41:47.634501 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.634491 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 02 04:41:47.634612 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.634604 2581 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 04:41:47.636603 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.636592 2581 kubelet.go:491] "Attempting to sync node with API server" Jun 02 04:41:47.636641 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.636608 2581 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 04:41:47.636641 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.636619 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 04:41:47.636641 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.636628 2581 kubelet.go:397] "Adding apiserver pod source" Jun 02 04:41:47.636641 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.636637 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 04:41:47.637774 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.637761 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 04:41:47.637819 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.637788 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 04:41:47.640357 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.640342 2581 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 04:41:47.642239 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.642226 2581 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 04:41:47.644349 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644336 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 04:41:47.644402 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644353 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 04:41:47.644402 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644359 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 04:41:47.644402 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644365 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 04:41:47.644402 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644375 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 04:41:47.644402 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644384 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 04:41:47.644402 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644392 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 04:41:47.644402 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644399 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 04:41:47.644590 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644407 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 04:41:47.644590 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644413 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 04:41:47.644590 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644427 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 04:41:47.644590 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.644432 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 04:41:47.645607 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.645598 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 04:41:47.645648 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.645635 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 04:41:47.648026 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.648007 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 04:41:47.648532 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.648513 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 04:41:47.648590 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.648514 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 04:41:47.649089 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.649077 2581 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 04:41:47.649137 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.649112 2581 server.go:1295] "Started kubelet" Jun 02 04:41:47.649228 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.649182 2581 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 04:41:47.649313 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.649244 2581 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 04:41:47.649313 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.649234 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 04:41:47.649866 ip-10-0-137-68 systemd[1]: Started Kubernetes Kubelet. Jun 02 04:41:47.653236 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.653211 2581 server.go:317] "Adding debug handlers to kubelet server" Jun 02 04:41:47.653331 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.653309 2581 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 04:41:47.655990 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.655969 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-prl7b" Jun 02 04:41:47.656955 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.656180 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-68.ec2.internal.18b529e8d34d0219 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-68.ec2.internal,UID:ip-10-0-137-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-68.ec2.internal,},FirstTimestamp:2026-06-02 04:41:47.649090073 +0000 UTC m=+0.369171136,LastTimestamp:2026-06-02 04:41:47.649090073 +0000 UTC m=+0.369171136,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-68.ec2.internal,}" Jun 02 04:41:47.657146 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.657129 2581 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 04:41:47.659357 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.659336 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 04:41:47.659940 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.659923 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 04:41:47.660040 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660023 2581 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 04:41:47.660097 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660042 2581 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 04:41:47.660218 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660190 2581 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 04:41:47.660218 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660217 2581 reconstruct.go:97] "Volume reconstruction finished" Jun 02 04:41:47.660341 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660227 2581 reconciler.go:26] "Reconciler: start to sync state" Jun 02 04:41:47.660499 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660482 2581 factory.go:55] Registering systemd factory Jun 02 04:41:47.660580 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660540 2581 factory.go:223] Registration of the systemd container factory successfully Jun 02 04:41:47.660774 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660761 2581 factory.go:153] Registering CRI-O factory Jun 02 04:41:47.660840 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660778 2581 factory.go:223] Registration of the crio container factory successfully Jun 02 04:41:47.660840 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.660801 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:47.660840 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660829 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 04:41:47.660991 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660849 2581 factory.go:103] Registering Raw factory Jun 02 04:41:47.660991 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.660863 2581 manager.go:1196] Started watching for new ooms in manager Jun 02 04:41:47.661220 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.661207 2581 manager.go:319] Starting recovery of all containers Jun 02 04:41:47.663966 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.663933 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 04:41:47.664064 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.664027 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 04:41:47.664458 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.664435 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-prl7b" Jun 02 04:41:47.668006 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.667887 2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 04:41:47.670114 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.670097 2581 manager.go:324] Recovery completed Jun 02 04:41:47.675103 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.675090 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:41:47.676805 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.676792 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:41:47.676870 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.676820 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:41:47.676870 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.676830 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:41:47.677287 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.677274 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 04:41:47.677335 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.677288 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 04:41:47.677335 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.677303 2581 state_mem.go:36] "Initialized new in-memory state store" Jun 02 04:41:47.679602 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.679588 2581 policy_none.go:49] "None policy: Start" Jun 02 04:41:47.679672 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.679606 2581 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 04:41:47.679672 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.679617 2581 state_mem.go:35] "Initializing new in-memory state store" Jun 02 04:41:47.714330 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.714314 2581 manager.go:341] "Starting Device Plugin manager" Jun 02 04:41:47.714410 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.714348 2581 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 04:41:47.714410 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.714360 2581 server.go:85] "Starting device plugin registration server" Jun 02 04:41:47.714582 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.714569 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 04:41:47.714677 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.714586 2581 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 04:41:47.714771 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.714758 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 04:41:47.714844 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.714828 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 04:41:47.714844 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.714841 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 04:41:47.715302 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.715284 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 04:41:47.715382 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.715320 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:47.727651 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.727630 2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 04:41:47.727651 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.727669 2581 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 04:41:47.746152 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.727695 2581 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 04:41:47.746152 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.727704 2581 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 04:41:47.746152 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.727737 2581 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 04:41:47.746152 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.730797 2581 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:41:47.815790 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.815712 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:41:47.816961 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.816945 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:41:47.817033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.816977 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:41:47.817033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.816990 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:41:47.817033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.817018 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.825215 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.825199 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.825264 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.825223 2581 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-68.ec2.internal\": node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:47.828086 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.828068 2581 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal"] Jun 02 04:41:47.828174 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.828163 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:41:47.828973 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.828949 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:41:47.829060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.828978 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:41:47.829060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.828991 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:41:47.830246 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.830232 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:41:47.830400 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.830388 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.830435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.830417 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:41:47.831826 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.831063 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:41:47.831826 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.831087 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:41:47.831826 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.831100 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:41:47.831826 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.831406 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:41:47.831826 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.831422 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:41:47.831826 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.831453 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:41:47.832773 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.832758 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.832826 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.832784 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:41:47.833800 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.833785 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:41:47.833855 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.833813 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:41:47.833855 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.833823 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:41:47.843316 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.843302 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:47.861106 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.861088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21f9de860893d0dc1f71b43e21b59dae-config\") pod \"kube-apiserver-proxy-ip-10-0-137-68.ec2.internal\" (UID: \"21f9de860893d0dc1f71b43e21b59dae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.861160 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.861110 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fe343db05fa4626f38aa74a44959e77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"4fe343db05fa4626f38aa74a44959e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.861160 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.861127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fe343db05fa4626f38aa74a44959e77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"4fe343db05fa4626f38aa74a44959e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.864308 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.864292 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-68.ec2.internal\" not found" node="ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.868691 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.868672 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-68.ec2.internal\" not found" node="ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.943775 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:47.943748 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:47.962167 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.962132 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fe343db05fa4626f38aa74a44959e77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"4fe343db05fa4626f38aa74a44959e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.962167 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.962174 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fe343db05fa4626f38aa74a44959e77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"4fe343db05fa4626f38aa74a44959e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.962311 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.962197 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21f9de860893d0dc1f71b43e21b59dae-config\") pod \"kube-apiserver-proxy-ip-10-0-137-68.ec2.internal\" (UID: \"21f9de860893d0dc1f71b43e21b59dae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.962311 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.962236 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/21f9de860893d0dc1f71b43e21b59dae-config\") pod \"kube-apiserver-proxy-ip-10-0-137-68.ec2.internal\" (UID: \"21f9de860893d0dc1f71b43e21b59dae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.962311 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.962240 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4fe343db05fa4626f38aa74a44959e77-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"4fe343db05fa4626f38aa74a44959e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 02 04:41:47.962311 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:47.962254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fe343db05fa4626f38aa74a44959e77-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal\" (UID: \"4fe343db05fa4626f38aa74a44959e77\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 02 04:41:48.044298 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:48.044265 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:48.145075 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:48.145015 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:48.166448 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.166431 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 02 04:41:48.172055 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.172036 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 02 04:41:48.245762 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:48.245734 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:48.346245 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:48.346218 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:48.446752 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:48.446686 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:48.547272 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:48.547245 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:48.578665 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.578641 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 04:41:48.579256 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.578793 2581 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 04:41:48.590576 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:48.590532 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe343db05fa4626f38aa74a44959e77.slice/crio-237e5f20d2a4d15f317e24ec36e6ba167fbf932cb818b41bb7de53c2189c7506 WatchSource:0}: Error finding container 237e5f20d2a4d15f317e24ec36e6ba167fbf932cb818b41bb7de53c2189c7506: Status 404 returned error can't find the container with id 237e5f20d2a4d15f317e24ec36e6ba167fbf932cb818b41bb7de53c2189c7506 Jun 02 04:41:48.594398 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:48.594375 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f9de860893d0dc1f71b43e21b59dae.slice/crio-75e86caee8889b1334c6daa4d5c3921d9221ec263bf867ec087272b5897aa000 WatchSource:0}: Error finding container 75e86caee8889b1334c6daa4d5c3921d9221ec263bf867ec087272b5897aa000: Status 404 returned error can't find the container with id 75e86caee8889b1334c6daa4d5c3921d9221ec263bf867ec087272b5897aa000 Jun 02 04:41:48.595417 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.595394 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 04:41:48.647797 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:48.647760 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:48.660004 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.659983 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 04:41:48.666019 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.665991 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 04:36:47 +0000 UTC" deadline="2027-12-17 06:10:29.681683974 +0000 UTC" Jun 02 04:41:48.666019 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.666016 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13513h28m41.015670726s" Jun 02 04:41:48.669024 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.669009 2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 04:41:48.694162 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.694146 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m9dzs" Jun 02 04:41:48.706351 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.706297 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m9dzs" Jun 02 04:41:48.730493 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.730445 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" event={"ID":"21f9de860893d0dc1f71b43e21b59dae","Type":"ContainerStarted","Data":"75e86caee8889b1334c6daa4d5c3921d9221ec263bf867ec087272b5897aa000"} Jun 02 04:41:48.731315 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:48.731293 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" event={"ID":"4fe343db05fa4626f38aa74a44959e77","Type":"ContainerStarted","Data":"237e5f20d2a4d15f317e24ec36e6ba167fbf932cb818b41bb7de53c2189c7506"} Jun 02 04:41:48.748480 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:48.748449 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:48.848969 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:48.848940 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:48.949414 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:48.949374 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-68.ec2.internal\" not found" Jun 02 04:41:49.005875 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.005807 2581 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:41:49.060443 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.060395 2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" Jun 02 04:41:49.073873 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.073847 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 04:41:49.075403 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.075383 2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" Jun 02 04:41:49.086617 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.086597 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 04:41:49.171197 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.171168 2581 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:41:49.231170 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.231140 2581 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:41:49.638552 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.638519 2581 apiserver.go:52] "Watching apiserver" Jun 02 04:41:49.645517 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.645489 2581 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 04:41:49.646576 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.646550 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz","openshift-multus/multus-knmg7","openshift-network-diagnostics/network-check-target-df4cx","openshift-network-operator/iptables-alerter-qv2r8","kube-system/konnectivity-agent-g5669","openshift-cluster-node-tuning-operator/tuned-dmm6j","openshift-dns/node-resolver-zr99x","openshift-image-registry/node-ca-gk7dh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal","openshift-multus/multus-additional-cni-plugins-sx2t5","openshift-multus/network-metrics-daemon-7cswx","openshift-ovn-kubernetes/ovnkube-node-4wgp9","kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal"] Jun 02 04:41:49.649302 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.649203 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zr99x" Jun 02 04:41:49.649302 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.649216 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.651717 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.651696 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:49.651824 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:49.651782 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:41:49.652495 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.652221 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 04:41:49.652495 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.652238 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 04:41:49.652495 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.652248 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 04:41:49.652495 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.652383 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m7t4t\"" Jun 02 04:41:49.652495 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.652383 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 04:41:49.652827 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.652506 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6lj2s\"" Jun 02 04:41:49.652827 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.652614 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 04:41:49.653582 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.653564 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qv2r8" Jun 02 04:41:49.653875 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.653566 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 04:41:49.655015 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.654998 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g5669" Jun 02 04:41:49.655971 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.655945 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hgsft\"" Jun 02 04:41:49.656075 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.656058 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.656163 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.656149 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:41:49.656246 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.656150 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 04:41:49.656486 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.656471 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 04:41:49.657122 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.657105 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.657591 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.657578 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 04:41:49.658339 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.658224 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gk7dh" Jun 02 04:41:49.659490 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.659314 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hz5kw\"" Jun 02 04:41:49.659623 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.659597 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 04:41:49.660930 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.660906 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.661258 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.661083 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:49.661258 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:49.661146 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:41:49.662298 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.662281 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.662812 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.662796 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:41:49.663107 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.663039 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 04:41:49.663542 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.663528 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 04:41:49.663619 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.663566 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 04:41:49.664627 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.664609 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 04:41:49.664840 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.664821 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 04:41:49.664927 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.664843 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kv2dd\"" Jun 02 04:41:49.664927 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.664881 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fgl8l\"" Jun 02 04:41:49.665038 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.664930 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 04:41:49.665038 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.664949 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 04:41:49.665038 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.664888 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w92zj\"" Jun 02 04:41:49.665158 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.665135 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 04:41:49.665446 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.665431 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 04:41:49.665546 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.665449 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 04:41:49.665546 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.665473 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 04:41:49.665546 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.665487 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 04:41:49.665726 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.665695 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 04:41:49.665890 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.665865 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 04:41:49.665953 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.665893 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kzzcd\"" Jun 02 04:41:49.666129 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.666112 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qv7cw\"" Jun 02 04:41:49.666198 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.666173 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 04:41:49.671409 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03b4fee0-4026-402e-a447-bf848b78a6e3-serviceca\") pod \"node-ca-gk7dh\" (UID: \"03b4fee0-4026-402e-a447-bf848b78a6e3\") " pod="openshift-image-registry/node-ca-gk7dh" Jun 02 04:41:49.671488 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671435 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-multus-conf-dir\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.671488 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c81af97d-0b33-4eb4-8232-77194832e87d-konnectivity-ca\") pod \"konnectivity-agent-g5669\" (UID: \"c81af97d-0b33-4eb4-8232-77194832e87d\") " pod="kube-system/konnectivity-agent-g5669" Jun 02 04:41:49.671571 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-sys-fs\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.671571 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-var-lib-kubelet\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.671571 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-etc-kubernetes\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.671675 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.671675 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-registration-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.671675 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-multus-cni-dir\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.671675 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671642 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-var-lib-cni-bin\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.671803 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671675 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-run\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.671803 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q48s\" (UniqueName: \"kubernetes.io/projected/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-kube-api-access-6q48s\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.671803 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08b299c5-733d-4d30-8a80-9868860022d9-multus-daemon-config\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.671942 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-sysctl-d\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.671942 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671853 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-host\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.671942 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671901 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7bsg\" (UniqueName: \"kubernetes.io/projected/03b4fee0-4026-402e-a447-bf848b78a6e3-kube-api-access-s7bsg\") pod \"node-ca-gk7dh\" (UID: \"03b4fee0-4026-402e-a447-bf848b78a6e3\") " pod="openshift-image-registry/node-ca-gk7dh" Jun 02 04:41:49.671942 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/047f2a29-9c7b-426c-baf2-fa0fdcb85a5b-host-slash\") pod \"iptables-alerter-qv2r8\" (UID: \"047f2a29-9c7b-426c-baf2-fa0fdcb85a5b\") " pod="openshift-network-operator/iptables-alerter-qv2r8" Jun 02 04:41:49.672083 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-cnibin\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.672083 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.671987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-systemd\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.672083 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c5xw\" (UniqueName: \"kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw\") pod \"network-check-target-df4cx\" (UID: \"ce169576-918f-475b-b1ba-72aff9e873c4\") " pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:49.672083 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672042 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:49.672083 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672069 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c81af97d-0b33-4eb4-8232-77194832e87d-agent-certs\") pod \"konnectivity-agent-g5669\" (UID: \"c81af97d-0b33-4eb4-8232-77194832e87d\") " pod="kube-system/konnectivity-agent-g5669" Jun 02 04:41:49.672315 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672096 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-run-k8s-cni-cncf-io\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.672315 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672142 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-var-lib-cni-multus\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.672315 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-modprobe-d\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.672315 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-device-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.672315 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6cf0d89-0b9e-4497-97a9-adf610a691eb-tmp-dir\") pod \"node-resolver-zr99x\" (UID: \"c6cf0d89-0b9e-4497-97a9-adf610a691eb\") " pod="openshift-dns/node-resolver-zr99x" Jun 02 04:41:49.672315 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672254 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-system-cni-dir\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.672315 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-hostroot\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.672754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-run-multus-certs\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.672754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672358 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-949hp\" (UniqueName: \"kubernetes.io/projected/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-kube-api-access-949hp\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.672754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672396 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2328f71-aef7-4be0-b956-7543e950f3a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.672754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-multus-socket-dir-parent\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.672754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-run-netns\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.672754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbv2g\" (UniqueName: \"kubernetes.io/projected/08b299c5-733d-4d30-8a80-9868860022d9-kube-api-access-wbv2g\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.672754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6cf0d89-0b9e-4497-97a9-adf610a691eb-hosts-file\") pod \"node-resolver-zr99x\" (UID: \"c6cf0d89-0b9e-4497-97a9-adf610a691eb\") " pod="openshift-dns/node-resolver-zr99x" Jun 02 04:41:49.672754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672618 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-system-cni-dir\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.672754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672644 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-cnibin\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.672754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkfkb\" (UniqueName: \"kubernetes.io/projected/d2328f71-aef7-4be0-b956-7543e950f3a3-kube-api-access-kkfkb\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.672754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmvwh\" (UniqueName: \"kubernetes.io/projected/047f2a29-9c7b-426c-baf2-fa0fdcb85a5b-kube-api-access-jmvwh\") pod \"iptables-alerter-qv2r8\" (UID: \"047f2a29-9c7b-426c-baf2-fa0fdcb85a5b\") " pod="openshift-network-operator/iptables-alerter-qv2r8" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672761 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-os-release\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-os-release\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672820 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/047f2a29-9c7b-426c-baf2-fa0fdcb85a5b-iptables-alerter-script\") pod \"iptables-alerter-qv2r8\" (UID: \"047f2a29-9c7b-426c-baf2-fa0fdcb85a5b\") " pod="openshift-network-operator/iptables-alerter-qv2r8" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672845 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672867 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-sysctl-conf\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4pg5\" (UniqueName: \"kubernetes.io/projected/dd76ba94-c5d3-4336-b699-b07e5b707ba5-kube-api-access-h4pg5\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-sysconfig\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672964 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-var-lib-kubelet\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-tmp\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.672999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2328f71-aef7-4be0-b956-7543e950f3a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.673037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-socket-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.673073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.673098 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2328f71-aef7-4be0-b956-7543e950f3a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.673125 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-kubernetes\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.673181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.673163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-sys\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.673711 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.673191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03b4fee0-4026-402e-a447-bf848b78a6e3-host\") pod \"node-ca-gk7dh\" (UID: \"03b4fee0-4026-402e-a447-bf848b78a6e3\") " pod="openshift-image-registry/node-ca-gk7dh" Jun 02 04:41:49.673711 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.673224 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7ct6\" (UniqueName: \"kubernetes.io/projected/c6cf0d89-0b9e-4497-97a9-adf610a691eb-kube-api-access-q7ct6\") pod \"node-resolver-zr99x\" (UID: \"c6cf0d89-0b9e-4497-97a9-adf610a691eb\") " pod="openshift-dns/node-resolver-zr99x" Jun 02 04:41:49.673711 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.673246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08b299c5-733d-4d30-8a80-9868860022d9-cni-binary-copy\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.673711 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.673269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-lib-modules\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.673711 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.673290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-tuned\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.707044 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.707014 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 04:36:48 +0000 UTC" deadline="2028-03-07 07:24:55.019682804 +0000 UTC" Jun 02 04:41:49.707125 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.707043 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15458h43m5.312643338s" Jun 02 04:41:49.761594 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.761569 2581 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 04:41:49.774460 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774425 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-var-lib-kubelet\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.774460 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774466 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-etc-kubernetes\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.774698 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774492 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.774698 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774570 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-var-lib-kubelet\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.774698 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774580 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-etc-kubernetes\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.774698 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774617 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-registration-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.774698 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774629 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.774698 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774678 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-multus-cni-dir\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.774698 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774700 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-var-lib-cni-bin\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774724 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-run\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774704 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-registration-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774752 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6q48s\" (UniqueName: \"kubernetes.io/projected/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-kube-api-access-6q48s\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774774 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-var-lib-cni-bin\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774798 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-multus-cni-dir\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774800 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-cni-netd\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774848 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08b299c5-733d-4d30-8a80-9868860022d9-multus-daemon-config\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774874 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-sysctl-d\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774908 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-run\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774918 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-host\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774944 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7bsg\" (UniqueName: \"kubernetes.io/projected/03b4fee0-4026-402e-a447-bf848b78a6e3-kube-api-access-s7bsg\") pod \"node-ca-gk7dh\" (UID: \"03b4fee0-4026-402e-a447-bf848b78a6e3\") " pod="openshift-image-registry/node-ca-gk7dh" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774986 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/047f2a29-9c7b-426c-baf2-fa0fdcb85a5b-host-slash\") pod \"iptables-alerter-qv2r8\" (UID: \"047f2a29-9c7b-426c-baf2-fa0fdcb85a5b\") " pod="openshift-network-operator/iptables-alerter-qv2r8" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.774998 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-host\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.775011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775013 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-cnibin\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775053 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-sysctl-d\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775061 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/047f2a29-9c7b-426c-baf2-fa0fdcb85a5b-host-slash\") pod \"iptables-alerter-qv2r8\" (UID: \"047f2a29-9c7b-426c-baf2-fa0fdcb85a5b\") " pod="openshift-network-operator/iptables-alerter-qv2r8" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775040 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-systemd\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775108 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xw\" (UniqueName: \"kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw\") pod \"network-check-target-df4cx\" (UID: \"ce169576-918f-475b-b1ba-72aff9e873c4\") " pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775115 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-cnibin\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-log-socket\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775140 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-systemd\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775182 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-env-overrides\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775214 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775247 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c81af97d-0b33-4eb4-8232-77194832e87d-agent-certs\") pod \"konnectivity-agent-g5669\" (UID: \"c81af97d-0b33-4eb4-8232-77194832e87d\") " pod="kube-system/konnectivity-agent-g5669" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775277 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-run-k8s-cni-cncf-io\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775302 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-var-lib-cni-multus\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:49.775349 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-var-lib-cni-multus\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775387 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-run-k8s-cni-cncf-io\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:49.775422 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs podName:dd76ba94-c5d3-4336-b699-b07e5b707ba5 nodeName:}" failed. No retries permitted until 2026-06-02 04:41:50.275399572 +0000 UTC m=+2.995480641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs") pod "network-metrics-daemon-7cswx" (UID: "dd76ba94-c5d3-4336-b699-b07e5b707ba5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:41:49.775560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775439 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-modprobe-d\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775458 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-device-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775480 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08b299c5-733d-4d30-8a80-9868860022d9-multus-daemon-config\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-run-netns\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775540 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6cf0d89-0b9e-4497-97a9-adf610a691eb-tmp-dir\") pod \"node-resolver-zr99x\" (UID: \"c6cf0d89-0b9e-4497-97a9-adf610a691eb\") " pod="openshift-dns/node-resolver-zr99x" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775538 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-device-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775562 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-system-cni-dir\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775584 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-modprobe-d\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775602 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-hostroot\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775628 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-run-multus-certs\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775634 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-system-cni-dir\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775652 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-949hp\" (UniqueName: \"kubernetes.io/projected/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-kube-api-access-949hp\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775650 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775695 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2328f71-aef7-4be0-b956-7543e950f3a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-ovnkube-script-lib\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-hostroot\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775759 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-multus-socket-dir-parent\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775859 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-run-netns\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.776312 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775866 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-run-multus-certs\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775888 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbv2g\" (UniqueName: \"kubernetes.io/projected/08b299c5-733d-4d30-8a80-9868860022d9-kube-api-access-wbv2g\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775902 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6cf0d89-0b9e-4497-97a9-adf610a691eb-tmp-dir\") pod \"node-resolver-zr99x\" (UID: \"c6cf0d89-0b9e-4497-97a9-adf610a691eb\") " pod="openshift-dns/node-resolver-zr99x" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-run-systemd\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775956 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-multus-socket-dir-parent\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775965 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-host-run-netns\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.775986 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-run-openvswitch\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776014 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6cf0d89-0b9e-4497-97a9-adf610a691eb-hosts-file\") pod \"node-resolver-zr99x\" (UID: \"c6cf0d89-0b9e-4497-97a9-adf610a691eb\") " pod="openshift-dns/node-resolver-zr99x" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776038 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-system-cni-dir\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776062 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-cnibin\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776086 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkfkb\" (UniqueName: \"kubernetes.io/projected/d2328f71-aef7-4be0-b956-7543e950f3a3-kube-api-access-kkfkb\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-system-cni-dir\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776125 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmvwh\" (UniqueName: \"kubernetes.io/projected/047f2a29-9c7b-426c-baf2-fa0fdcb85a5b-kube-api-access-jmvwh\") pod \"iptables-alerter-qv2r8\" (UID: \"047f2a29-9c7b-426c-baf2-fa0fdcb85a5b\") " pod="openshift-network-operator/iptables-alerter-qv2r8" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776146 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-cnibin\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776152 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776123 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6cf0d89-0b9e-4497-97a9-adf610a691eb-hosts-file\") pod \"node-resolver-zr99x\" (UID: \"c6cf0d89-0b9e-4497-97a9-adf610a691eb\") " pod="openshift-dns/node-resolver-zr99x" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776199 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-os-release\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.777033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776232 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-os-release\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776272 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/047f2a29-9c7b-426c-baf2-fa0fdcb85a5b-iptables-alerter-script\") pod \"iptables-alerter-qv2r8\" (UID: \"047f2a29-9c7b-426c-baf2-fa0fdcb85a5b\") " pod="openshift-network-operator/iptables-alerter-qv2r8" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-os-release\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776299 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776340 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2328f71-aef7-4be0-b956-7543e950f3a3-os-release\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776345 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776380 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-sysctl-conf\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776388 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2328f71-aef7-4be0-b956-7543e950f3a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776407 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4pg5\" (UniqueName: \"kubernetes.io/projected/dd76ba94-c5d3-4336-b699-b07e5b707ba5-kube-api-access-h4pg5\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-systemd-units\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776471 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-sysconfig\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776479 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-sysctl-conf\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776497 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-var-lib-kubelet\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-slash\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-run-ovn\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776546 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-sysconfig\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.777828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-ovnkube-config\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776604 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-var-lib-kubelet\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776609 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-tmp\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776635 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2328f71-aef7-4be0-b956-7543e950f3a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776675 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-socket-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776699 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776715 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2328f71-aef7-4be0-b956-7543e950f3a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776737 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-kubernetes\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776754 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-sys\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776769 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03b4fee0-4026-402e-a447-bf848b78a6e3-host\") pod \"node-ca-gk7dh\" (UID: \"03b4fee0-4026-402e-a447-bf848b78a6e3\") " pod="openshift-image-registry/node-ca-gk7dh" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776790 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-ovn-node-metrics-cert\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776806 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7ct6\" (UniqueName: \"kubernetes.io/projected/c6cf0d89-0b9e-4497-97a9-adf610a691eb-kube-api-access-q7ct6\") pod \"node-resolver-zr99x\" (UID: \"c6cf0d89-0b9e-4497-97a9-adf610a691eb\") " pod="openshift-dns/node-resolver-zr99x" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776821 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08b299c5-733d-4d30-8a80-9868860022d9-cni-binary-copy\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776835 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-lib-modules\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776845 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776859 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/047f2a29-9c7b-426c-baf2-fa0fdcb85a5b-iptables-alerter-script\") pod \"iptables-alerter-qv2r8\" (UID: \"047f2a29-9c7b-426c-baf2-fa0fdcb85a5b\") " pod="openshift-network-operator/iptables-alerter-qv2r8" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776928 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-kubernetes\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.778577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776999 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-sys\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777050 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03b4fee0-4026-402e-a447-bf848b78a6e3-host\") pod \"node-ca-gk7dh\" (UID: \"03b4fee0-4026-402e-a447-bf848b78a6e3\") " pod="openshift-image-registry/node-ca-gk7dh" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777094 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2328f71-aef7-4be0-b956-7543e950f3a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777214 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-lib-modules\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.776849 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-tuned\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777257 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03b4fee0-4026-402e-a447-bf848b78a6e3-serviceca\") pod \"node-ca-gk7dh\" (UID: \"03b4fee0-4026-402e-a447-bf848b78a6e3\") " pod="openshift-image-registry/node-ca-gk7dh" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777267 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-socket-dir\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-node-log\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmfkc\" (UniqueName: \"kubernetes.io/projected/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-kube-api-access-xmfkc\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777354 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-multus-conf-dir\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777380 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c81af97d-0b33-4eb4-8232-77194832e87d-konnectivity-ca\") pod \"konnectivity-agent-g5669\" (UID: \"c81af97d-0b33-4eb4-8232-77194832e87d\") " pod="kube-system/konnectivity-agent-g5669" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777408 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-etc-openvswitch\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777410 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2328f71-aef7-4be0-b956-7543e950f3a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777435 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-cni-bin\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777461 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-sys-fs\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777476 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08b299c5-733d-4d30-8a80-9868860022d9-multus-conf-dir\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777485 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-kubelet\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.779284 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777510 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-var-lib-openvswitch\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.779970 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777528 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08b299c5-733d-4d30-8a80-9868860022d9-cni-binary-copy\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.779970 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777628 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-sys-fs\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.779970 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.777976 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c81af97d-0b33-4eb4-8232-77194832e87d-konnectivity-ca\") pod \"konnectivity-agent-g5669\" (UID: \"c81af97d-0b33-4eb4-8232-77194832e87d\") " pod="kube-system/konnectivity-agent-g5669" Jun 02 04:41:49.779970 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.778353 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03b4fee0-4026-402e-a447-bf848b78a6e3-serviceca\") pod \"node-ca-gk7dh\" (UID: \"03b4fee0-4026-402e-a447-bf848b78a6e3\") " pod="openshift-image-registry/node-ca-gk7dh" Jun 02 04:41:49.779970 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.779267 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-tmp\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.779970 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.779321 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-etc-tuned\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.779970 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.779608 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c81af97d-0b33-4eb4-8232-77194832e87d-agent-certs\") pod \"konnectivity-agent-g5669\" (UID: \"c81af97d-0b33-4eb4-8232-77194832e87d\") " pod="kube-system/konnectivity-agent-g5669" Jun 02 04:41:49.786582 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:49.786546 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:41:49.786582 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:49.786584 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:41:49.786761 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:49.786599 2581 projected.go:194] Error preparing data for projected volume kube-api-access-8c5xw for pod openshift-network-diagnostics/network-check-target-df4cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:41:49.786761 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:49.786694 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw podName:ce169576-918f-475b-b1ba-72aff9e873c4 nodeName:}" failed. No retries permitted until 2026-06-02 04:41:50.286679001 +0000 UTC m=+3.006760051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xw" (UniqueName: "kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw") pod "network-check-target-df4cx" (UID: "ce169576-918f-475b-b1ba-72aff9e873c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:41:49.787353 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.787314 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q48s\" (UniqueName: \"kubernetes.io/projected/9280b2c1-f7a6-4b91-bc27-1eccff5cd230-kube-api-access-6q48s\") pod \"aws-ebs-csi-driver-node-mh9bz\" (UID: \"9280b2c1-f7a6-4b91-bc27-1eccff5cd230\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:49.788455 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.787910 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkfkb\" (UniqueName: \"kubernetes.io/projected/d2328f71-aef7-4be0-b956-7543e950f3a3-kube-api-access-kkfkb\") pod \"multus-additional-cni-plugins-sx2t5\" (UID: \"d2328f71-aef7-4be0-b956-7543e950f3a3\") " pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:49.788455 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.788354 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7bsg\" (UniqueName: \"kubernetes.io/projected/03b4fee0-4026-402e-a447-bf848b78a6e3-kube-api-access-s7bsg\") pod \"node-ca-gk7dh\" (UID: \"03b4fee0-4026-402e-a447-bf848b78a6e3\") " pod="openshift-image-registry/node-ca-gk7dh" Jun 02 04:41:49.790812 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.789738 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbv2g\" (UniqueName: \"kubernetes.io/projected/08b299c5-733d-4d30-8a80-9868860022d9-kube-api-access-wbv2g\") pod \"multus-knmg7\" (UID: \"08b299c5-733d-4d30-8a80-9868860022d9\") " pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.790812 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.790181 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmvwh\" (UniqueName: \"kubernetes.io/projected/047f2a29-9c7b-426c-baf2-fa0fdcb85a5b-kube-api-access-jmvwh\") pod \"iptables-alerter-qv2r8\" (UID: \"047f2a29-9c7b-426c-baf2-fa0fdcb85a5b\") " pod="openshift-network-operator/iptables-alerter-qv2r8" Jun 02 04:41:49.790812 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.790308 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4pg5\" (UniqueName: \"kubernetes.io/projected/dd76ba94-c5d3-4336-b699-b07e5b707ba5-kube-api-access-h4pg5\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:49.791630 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.791594 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-949hp\" (UniqueName: \"kubernetes.io/projected/f739c4e2-a24e-4ed0-9e9e-7d16355eb33f-kube-api-access-949hp\") pod \"tuned-dmm6j\" (UID: \"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f\") " pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.792626 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.792603 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7ct6\" (UniqueName: \"kubernetes.io/projected/c6cf0d89-0b9e-4497-97a9-adf610a691eb-kube-api-access-q7ct6\") pod \"node-resolver-zr99x\" (UID: \"c6cf0d89-0b9e-4497-97a9-adf610a691eb\") " pod="openshift-dns/node-resolver-zr99x" Jun 02 04:41:49.836727 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.836702 2581 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:41:49.877996 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.877968 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-systemd-units\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.877996 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878000 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-slash\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878180 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878020 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-run-ovn\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878180 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878054 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-ovnkube-config\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878180 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878079 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-ovn-node-metrics-cert\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878180 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878103 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-node-log\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878180 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878156 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmfkc\" (UniqueName: \"kubernetes.io/projected/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-kube-api-access-xmfkc\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878407 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878206 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-node-log\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878407 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-systemd-units\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878407 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878372 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-run-ovn\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878522 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878459 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-slash\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878522 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878500 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-etc-openvswitch\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878604 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878525 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-cni-bin\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878604 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878552 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-kubelet\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878604 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878576 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-var-lib-openvswitch\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878604 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878599 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-cni-netd\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878640 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-cni-netd\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878628 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-cni-bin\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878642 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-etc-openvswitch\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878669 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-kubelet\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878689 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-log-socket\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878695 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-var-lib-openvswitch\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878713 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-env-overrides\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-log-socket\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878745 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-run-netns\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878764 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-ovnkube-script-lib\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878781 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-run-systemd\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.878813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878805 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-run-openvswitch\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.879410 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878801 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-ovnkube-config\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.879410 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878852 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-run-systemd\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.879410 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878892 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-run-netns\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.879410 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878888 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-run-openvswitch\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.879410 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878947 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.879410 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.878985 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.879410 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.879005 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.879410 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.879052 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.879410 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.879094 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-env-overrides\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.879410 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.879277 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-ovnkube-script-lib\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.881000 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.880981 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-ovn-node-metrics-cert\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.887861 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.887841 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmfkc\" (UniqueName: \"kubernetes.io/projected/313dd821-7bd9-454c-b6d5-b19c70e7dbc6-kube-api-access-xmfkc\") pod \"ovnkube-node-4wgp9\" (UID: \"313dd821-7bd9-454c-b6d5-b19c70e7dbc6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:49.962901 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.962820 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-knmg7" Jun 02 04:41:49.969534 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.969512 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zr99x" Jun 02 04:41:49.977123 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.977103 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qv2r8" Jun 02 04:41:49.982863 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.982843 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g5669" Jun 02 04:41:49.990409 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.990391 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" Jun 02 04:41:49.996993 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:49.996969 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" Jun 02 04:41:50.002989 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.002973 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gk7dh" Jun 02 04:41:50.010495 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.010478 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sx2t5" Jun 02 04:41:50.014118 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.014100 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:41:50.177850 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:50.177815 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047f2a29_9c7b_426c_baf2_fa0fdcb85a5b.slice/crio-2ee0c62f5e3564e0f2de323ae33cc17f2a2516e09b7622e75d46a267edd41e08 WatchSource:0}: Error finding container 2ee0c62f5e3564e0f2de323ae33cc17f2a2516e09b7622e75d46a267edd41e08: Status 404 returned error can't find the container with id 2ee0c62f5e3564e0f2de323ae33cc17f2a2516e09b7622e75d46a267edd41e08 Jun 02 04:41:50.178944 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:50.178918 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b299c5_733d_4d30_8a80_9868860022d9.slice/crio-c9c681b244e2f52d1ffd843689ce896a0246e9c24408c0a63696ba2881ef6959 WatchSource:0}: Error finding container c9c681b244e2f52d1ffd843689ce896a0246e9c24408c0a63696ba2881ef6959: Status 404 returned error can't find the container with id c9c681b244e2f52d1ffd843689ce896a0246e9c24408c0a63696ba2881ef6959 Jun 02 04:41:50.179833 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:50.179797 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf739c4e2_a24e_4ed0_9e9e_7d16355eb33f.slice/crio-c812e6ab98f6097c8c34056722e5738c48795c6a5e7f42784e380a7b3174b90e WatchSource:0}: Error finding container c812e6ab98f6097c8c34056722e5738c48795c6a5e7f42784e380a7b3174b90e: Status 404 returned error can't find the container with id c812e6ab98f6097c8c34056722e5738c48795c6a5e7f42784e380a7b3174b90e Jun 02 04:41:50.181441 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:50.180935 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81af97d_0b33_4eb4_8232_77194832e87d.slice/crio-449acdbc9c782f9aed1816b934a148b0bd8c1a6a97132dc77ea0c6ccf50a092f WatchSource:0}: Error finding container 449acdbc9c782f9aed1816b934a148b0bd8c1a6a97132dc77ea0c6ccf50a092f: Status 404 returned error can't find the container with id 449acdbc9c782f9aed1816b934a148b0bd8c1a6a97132dc77ea0c6ccf50a092f Jun 02 04:41:50.182069 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:50.182046 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6cf0d89_0b9e_4497_97a9_adf610a691eb.slice/crio-6828941ed6b3d8b1fa3be200b57b041a7ca150e745226d5859031313817916a9 WatchSource:0}: Error finding container 6828941ed6b3d8b1fa3be200b57b041a7ca150e745226d5859031313817916a9: Status 404 returned error can't find the container with id 6828941ed6b3d8b1fa3be200b57b041a7ca150e745226d5859031313817916a9 Jun 02 04:41:50.184621 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:50.184602 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b4fee0_4026_402e_a447_bf848b78a6e3.slice/crio-1547d6bea65bcc66d0d54c59becce38ed67576562b93291f942a39ddac142efa WatchSource:0}: Error finding container 1547d6bea65bcc66d0d54c59becce38ed67576562b93291f942a39ddac142efa: Status 404 returned error can't find the container with id 1547d6bea65bcc66d0d54c59becce38ed67576562b93291f942a39ddac142efa Jun 02 04:41:50.187282 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:50.186516 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2328f71_aef7_4be0_b956_7543e950f3a3.slice/crio-21b77927dddcfb4f6376320ab7b7553c564fc82e67d94f02f2c0d652a6c38e75 WatchSource:0}: Error finding container 21b77927dddcfb4f6376320ab7b7553c564fc82e67d94f02f2c0d652a6c38e75: Status 404 returned error can't find the container with id 21b77927dddcfb4f6376320ab7b7553c564fc82e67d94f02f2c0d652a6c38e75 Jun 02 04:41:50.187282 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:50.187225 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9280b2c1_f7a6_4b91_bc27_1eccff5cd230.slice/crio-6185a20bec46c62102083fa4c0c2909ec82131d356b3d8d8ce841ca0ec9286a5 WatchSource:0}: Error finding container 6185a20bec46c62102083fa4c0c2909ec82131d356b3d8d8ce841ca0ec9286a5: Status 404 returned error can't find the container with id 6185a20bec46c62102083fa4c0c2909ec82131d356b3d8d8ce841ca0ec9286a5 Jun 02 04:41:50.188865 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:41:50.188843 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313dd821_7bd9_454c_b6d5_b19c70e7dbc6.slice/crio-063d4e128a907ccc1c06aa3afad9a28fe1e7f11f2450a820ab0ba087374e87ab WatchSource:0}: Error finding container 063d4e128a907ccc1c06aa3afad9a28fe1e7f11f2450a820ab0ba087374e87ab: Status 404 returned error can't find the container with id 063d4e128a907ccc1c06aa3afad9a28fe1e7f11f2450a820ab0ba087374e87ab Jun 02 04:41:50.281720 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.281691 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:50.281862 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:50.281839 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:41:50.281931 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:50.281903 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs podName:dd76ba94-c5d3-4336-b699-b07e5b707ba5 nodeName:}" failed. No retries permitted until 2026-06-02 04:41:51.281885912 +0000 UTC m=+4.001966979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs") pod "network-metrics-daemon-7cswx" (UID: "dd76ba94-c5d3-4336-b699-b07e5b707ba5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:41:50.382324 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.382300 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xw\" (UniqueName: \"kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw\") pod \"network-check-target-df4cx\" (UID: \"ce169576-918f-475b-b1ba-72aff9e873c4\") " pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:50.382454 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:50.382440 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:41:50.382521 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:50.382460 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:41:50.382521 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:50.382471 2581 projected.go:194] Error preparing data for projected volume kube-api-access-8c5xw for pod openshift-network-diagnostics/network-check-target-df4cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:41:50.382585 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:50.382522 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw podName:ce169576-918f-475b-b1ba-72aff9e873c4 nodeName:}" failed. No retries permitted until 2026-06-02 04:41:51.382505154 +0000 UTC m=+4.102586206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xw" (UniqueName: "kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw") pod "network-check-target-df4cx" (UID: "ce169576-918f-475b-b1ba-72aff9e873c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:41:50.710469 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.710328 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 04:36:48 +0000 UTC" deadline="2027-11-22 03:45:15.332646426 +0000 UTC" Jun 02 04:41:50.710469 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.710367 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12911h3m24.622282781s" Jun 02 04:41:50.757455 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.757388 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" event={"ID":"21f9de860893d0dc1f71b43e21b59dae","Type":"ContainerStarted","Data":"ce07c184c6d5a9442fa42c40e16b50f341dcc7d59c3128703fa2aea6cfd58839"} Jun 02 04:41:50.767678 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.766934 2581 generic.go:358] "Generic (PLEG): container finished" podID="4fe343db05fa4626f38aa74a44959e77" containerID="44f8b89d9f7201e96a59a16b106dc8dd583e72e988a9d137cfebb9e041b1bd18" exitCode=0 Jun 02 04:41:50.767678 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.767012 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" event={"ID":"4fe343db05fa4626f38aa74a44959e77","Type":"ContainerDied","Data":"44f8b89d9f7201e96a59a16b106dc8dd583e72e988a9d137cfebb9e041b1bd18"} Jun 02 04:41:50.776445 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.776393 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" event={"ID":"313dd821-7bd9-454c-b6d5-b19c70e7dbc6","Type":"ContainerStarted","Data":"063d4e128a907ccc1c06aa3afad9a28fe1e7f11f2450a820ab0ba087374e87ab"} Jun 02 04:41:50.780385 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.780352 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" event={"ID":"9280b2c1-f7a6-4b91-bc27-1eccff5cd230","Type":"ContainerStarted","Data":"6185a20bec46c62102083fa4c0c2909ec82131d356b3d8d8ce841ca0ec9286a5"} Jun 02 04:41:50.786373 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.786344 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx2t5" event={"ID":"d2328f71-aef7-4be0-b956-7543e950f3a3","Type":"ContainerStarted","Data":"21b77927dddcfb4f6376320ab7b7553c564fc82e67d94f02f2c0d652a6c38e75"} Jun 02 04:41:50.792981 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.792930 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-68.ec2.internal" podStartSLOduration=1.792913056 podStartE2EDuration="1.792913056s" podCreationTimestamp="2026-06-02 04:41:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:41:50.774724854 +0000 UTC m=+3.494805908" watchObservedRunningTime="2026-06-02 04:41:50.792913056 +0000 UTC m=+3.512994124" Jun 02 04:41:50.803724 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.803696 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gk7dh" event={"ID":"03b4fee0-4026-402e-a447-bf848b78a6e3","Type":"ContainerStarted","Data":"1547d6bea65bcc66d0d54c59becce38ed67576562b93291f942a39ddac142efa"} Jun 02 04:41:50.823446 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.823360 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g5669" event={"ID":"c81af97d-0b33-4eb4-8232-77194832e87d","Type":"ContainerStarted","Data":"449acdbc9c782f9aed1816b934a148b0bd8c1a6a97132dc77ea0c6ccf50a092f"} Jun 02 04:41:50.840408 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.840346 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" event={"ID":"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f","Type":"ContainerStarted","Data":"c812e6ab98f6097c8c34056722e5738c48795c6a5e7f42784e380a7b3174b90e"} Jun 02 04:41:50.843921 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.843860 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zr99x" event={"ID":"c6cf0d89-0b9e-4497-97a9-adf610a691eb","Type":"ContainerStarted","Data":"6828941ed6b3d8b1fa3be200b57b041a7ca150e745226d5859031313817916a9"} Jun 02 04:41:50.860023 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.859984 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-knmg7" event={"ID":"08b299c5-733d-4d30-8a80-9868860022d9","Type":"ContainerStarted","Data":"c9c681b244e2f52d1ffd843689ce896a0246e9c24408c0a63696ba2881ef6959"} Jun 02 04:41:50.874096 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:50.874066 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qv2r8" event={"ID":"047f2a29-9c7b-426c-baf2-fa0fdcb85a5b","Type":"ContainerStarted","Data":"2ee0c62f5e3564e0f2de323ae33cc17f2a2516e09b7622e75d46a267edd41e08"} Jun 02 04:41:51.294496 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:51.294407 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:51.294696 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:51.294591 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:41:51.294696 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:51.294671 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs podName:dd76ba94-c5d3-4336-b699-b07e5b707ba5 nodeName:}" failed. No retries permitted until 2026-06-02 04:41:53.294636682 +0000 UTC m=+6.014717740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs") pod "network-metrics-daemon-7cswx" (UID: "dd76ba94-c5d3-4336-b699-b07e5b707ba5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:41:51.395535 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:51.394913 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xw\" (UniqueName: \"kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw\") pod \"network-check-target-df4cx\" (UID: \"ce169576-918f-475b-b1ba-72aff9e873c4\") " pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:51.395535 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:51.395092 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:41:51.395535 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:51.395114 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:41:51.395535 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:51.395127 2581 projected.go:194] Error preparing data for projected volume kube-api-access-8c5xw for pod openshift-network-diagnostics/network-check-target-df4cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:41:51.395535 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:51.395184 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw podName:ce169576-918f-475b-b1ba-72aff9e873c4 nodeName:}" failed. No retries permitted until 2026-06-02 04:41:53.395166012 +0000 UTC m=+6.115247075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xw" (UniqueName: "kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw") pod "network-check-target-df4cx" (UID: "ce169576-918f-475b-b1ba-72aff9e873c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:41:51.728813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:51.728740 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:51.729231 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:51.728896 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:41:51.730546 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:51.730284 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:51.730546 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:51.730488 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:41:51.892363 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:51.892323 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" event={"ID":"4fe343db05fa4626f38aa74a44959e77","Type":"ContainerStarted","Data":"2eb2b2db907bb28444be3e47efdc4334c59ff694e6739127c0c4eb45816908dd"} Jun 02 04:41:53.311209 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:53.311099 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:53.311873 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:53.311268 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:41:53.311873 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:53.311360 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs podName:dd76ba94-c5d3-4336-b699-b07e5b707ba5 nodeName:}" failed. No retries permitted until 2026-06-02 04:41:57.311338366 +0000 UTC m=+10.031419431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs") pod "network-metrics-daemon-7cswx" (UID: "dd76ba94-c5d3-4336-b699-b07e5b707ba5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:41:53.412609 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:53.412417 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xw\" (UniqueName: \"kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw\") pod \"network-check-target-df4cx\" (UID: \"ce169576-918f-475b-b1ba-72aff9e873c4\") " pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:53.412816 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:53.412628 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:41:53.412816 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:53.412671 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:41:53.412816 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:53.412686 2581 projected.go:194] Error preparing data for projected volume kube-api-access-8c5xw for pod openshift-network-diagnostics/network-check-target-df4cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:41:53.412816 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:53.412752 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw podName:ce169576-918f-475b-b1ba-72aff9e873c4 nodeName:}" failed. No retries permitted until 2026-06-02 04:41:57.412732875 +0000 UTC m=+10.132813939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xw" (UniqueName: "kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw") pod "network-check-target-df4cx" (UID: "ce169576-918f-475b-b1ba-72aff9e873c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:41:53.730361 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:53.729830 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:53.730361 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:53.729958 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:41:53.730841 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:53.730680 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:53.730841 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:53.730803 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:41:55.728296 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:55.728257 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:55.728771 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:55.728408 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:41:55.728771 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:55.728762 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:55.728880 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:55.728838 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:41:57.345692 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:57.345612 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:57.346265 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:57.345802 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:41:57.346265 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:57.345865 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs podName:dd76ba94-c5d3-4336-b699-b07e5b707ba5 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:05.345847144 +0000 UTC m=+18.065928211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs") pod "network-metrics-daemon-7cswx" (UID: "dd76ba94-c5d3-4336-b699-b07e5b707ba5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:41:57.446791 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:57.446755 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xw\" (UniqueName: \"kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw\") pod \"network-check-target-df4cx\" (UID: \"ce169576-918f-475b-b1ba-72aff9e873c4\") " pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:57.446988 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:57.446937 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:41:57.446988 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:57.446966 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:41:57.446988 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:57.446981 2581 projected.go:194] Error preparing data for projected volume kube-api-access-8c5xw for pod openshift-network-diagnostics/network-check-target-df4cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:41:57.447160 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:57.447047 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw podName:ce169576-918f-475b-b1ba-72aff9e873c4 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:05.447028279 +0000 UTC m=+18.167109342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xw" (UniqueName: "kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw") pod "network-check-target-df4cx" (UID: "ce169576-918f-475b-b1ba-72aff9e873c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:41:57.730361 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:57.730231 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:57.733998 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:57.733448 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:41:57.733998 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:57.733693 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:57.733998 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:57.733837 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:41:58.350860 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:58.350807 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-68.ec2.internal" podStartSLOduration=9.350788867 podStartE2EDuration="9.350788867s" podCreationTimestamp="2026-06-02 04:41:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:41:51.911474537 +0000 UTC m=+4.631555610" watchObservedRunningTime="2026-06-02 04:41:58.350788867 +0000 UTC m=+11.070869941" Jun 02 04:41:58.351462 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:58.351439 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nmvp2"] Jun 02 04:41:58.357597 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:58.357570 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:41:58.357730 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:58.357674 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:41:58.455808 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:58.455765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71c98ea9-8e1e-4212-96dc-145382663a08-dbus\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:41:58.455970 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:58.455826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71c98ea9-8e1e-4212-96dc-145382663a08-kubelet-config\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:41:58.455970 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:58.455866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:41:58.557123 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:58.557082 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71c98ea9-8e1e-4212-96dc-145382663a08-dbus\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:41:58.557301 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:58.557138 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71c98ea9-8e1e-4212-96dc-145382663a08-kubelet-config\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:41:58.557301 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:58.557181 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:41:58.557301 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:58.557291 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:41:58.557458 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:58.557342 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret podName:71c98ea9-8e1e-4212-96dc-145382663a08 nodeName:}" failed. No retries permitted until 2026-06-02 04:41:59.057328064 +0000 UTC m=+11.777409114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret") pod "global-pull-secret-syncer-nmvp2" (UID: "71c98ea9-8e1e-4212-96dc-145382663a08") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:41:58.557616 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:58.557591 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71c98ea9-8e1e-4212-96dc-145382663a08-dbus\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:41:58.557730 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:58.557669 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71c98ea9-8e1e-4212-96dc-145382663a08-kubelet-config\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:41:59.061208 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:59.061168 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:41:59.061402 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:59.061313 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:41:59.061402 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:59.061374 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret podName:71c98ea9-8e1e-4212-96dc-145382663a08 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:00.061358213 +0000 UTC m=+12.781439263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret") pod "global-pull-secret-syncer-nmvp2" (UID: "71c98ea9-8e1e-4212-96dc-145382663a08") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:41:59.728908 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:59.728877 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:41:59.729381 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:59.728877 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:41:59.729381 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:59.729051 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:41:59.729381 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:59.729087 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:41:59.729381 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:41:59.728877 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:41:59.729381 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:41:59.729178 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:00.069141 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:00.069115 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:00.069299 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:00.069277 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:00.069366 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:00.069355 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret podName:71c98ea9-8e1e-4212-96dc-145382663a08 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:02.069335582 +0000 UTC m=+14.789416648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret") pod "global-pull-secret-syncer-nmvp2" (UID: "71c98ea9-8e1e-4212-96dc-145382663a08") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:01.728582 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:01.728489 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:01.729022 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:01.728492 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:01.729022 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:01.728605 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:42:01.729022 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:01.728508 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:01.729022 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:01.728745 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:01.729022 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:01.728853 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:42:02.086542 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:02.086504 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:02.086762 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:02.086672 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:02.086762 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:02.086755 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret podName:71c98ea9-8e1e-4212-96dc-145382663a08 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:06.086733795 +0000 UTC m=+18.806814849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret") pod "global-pull-secret-syncer-nmvp2" (UID: "71c98ea9-8e1e-4212-96dc-145382663a08") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:03.728224 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:03.728137 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:03.728648 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:03.728141 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:03.728648 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:03.728265 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:42:03.728648 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:03.728141 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:03.728648 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:03.728348 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:03.728648 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:03.728487 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:42:05.409644 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:05.409600 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:05.410060 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:05.409808 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:05.410060 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:05.409889 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs podName:dd76ba94-c5d3-4336-b699-b07e5b707ba5 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:21.409867815 +0000 UTC m=+34.129948871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs") pod "network-metrics-daemon-7cswx" (UID: "dd76ba94-c5d3-4336-b699-b07e5b707ba5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:05.510925 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:05.510889 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xw\" (UniqueName: \"kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw\") pod \"network-check-target-df4cx\" (UID: \"ce169576-918f-475b-b1ba-72aff9e873c4\") " pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:05.511114 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:05.511044 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:05.511114 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:05.511061 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:05.511114 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:05.511071 2581 projected.go:194] Error preparing data for projected volume kube-api-access-8c5xw for pod openshift-network-diagnostics/network-check-target-df4cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:05.511267 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:05.511124 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw podName:ce169576-918f-475b-b1ba-72aff9e873c4 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:21.511108012 +0000 UTC m=+34.231189078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xw" (UniqueName: "kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw") pod "network-check-target-df4cx" (UID: "ce169576-918f-475b-b1ba-72aff9e873c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:05.728605 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:05.728520 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:05.728786 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:05.728520 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:05.728786 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:05.728681 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:42:05.728786 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:05.728521 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:05.728936 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:05.728780 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:42:05.728936 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:05.728879 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:06.115632 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:06.115596 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:06.115848 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:06.115740 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:06.115848 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:06.115817 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret podName:71c98ea9-8e1e-4212-96dc-145382663a08 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:14.115793175 +0000 UTC m=+26.835874231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret") pod "global-pull-secret-syncer-nmvp2" (UID: "71c98ea9-8e1e-4212-96dc-145382663a08") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:07.728751 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:07.728718 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:07.729194 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:07.728826 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:42:07.729194 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:07.728913 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:07.729194 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:07.729036 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:42:07.729194 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:07.729084 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:07.729194 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:07.729159 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:08.924749 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.924493 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" event={"ID":"9280b2c1-f7a6-4b91-bc27-1eccff5cd230","Type":"ContainerStarted","Data":"60873936f6a90fc6bb157009511034d6e903d42cb8b6f42c30b8e8037d74044f"} Jun 02 04:42:08.926034 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.926005 2581 generic.go:358] "Generic (PLEG): container finished" podID="d2328f71-aef7-4be0-b956-7543e950f3a3" containerID="5466557282d7c7028a0c218d8b85f2ec44089da27a706405f49e34bb3cebe83f" exitCode=0 Jun 02 04:42:08.926166 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.926080 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx2t5" event={"ID":"d2328f71-aef7-4be0-b956-7543e950f3a3","Type":"ContainerDied","Data":"5466557282d7c7028a0c218d8b85f2ec44089da27a706405f49e34bb3cebe83f"} Jun 02 04:42:08.930540 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.930152 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gk7dh" event={"ID":"03b4fee0-4026-402e-a447-bf848b78a6e3","Type":"ContainerStarted","Data":"c34539ffc88a7d7afac3e1ccd1b82aaaf23bca660279ad435ab27acacf556293"} Jun 02 04:42:08.931781 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.931737 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g5669" event={"ID":"c81af97d-0b33-4eb4-8232-77194832e87d","Type":"ContainerStarted","Data":"248b9631f67e6e15b58f5e0a32c350ba5fe5daa17065f590b5e6230959b08e36"} Jun 02 04:42:08.933302 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.933263 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" event={"ID":"f739c4e2-a24e-4ed0-9e9e-7d16355eb33f","Type":"ContainerStarted","Data":"14e686949c99aa91aa3826012ea781471286da45391dec5095bdc5fd8d570f2c"} Jun 02 04:42:08.934844 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.934820 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zr99x" event={"ID":"c6cf0d89-0b9e-4497-97a9-adf610a691eb","Type":"ContainerStarted","Data":"f742af8369f20ac6719cd96820d159b3b5eeea4589031a6e1e96c19f4ef4926c"} Jun 02 04:42:08.936302 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.936280 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-knmg7" event={"ID":"08b299c5-733d-4d30-8a80-9868860022d9","Type":"ContainerStarted","Data":"75bf8e16fba885085d66977feddd74f83d16bce2bfd3977d4f4865ee4702cf4f"} Jun 02 04:42:08.939355 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.939316 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" event={"ID":"313dd821-7bd9-454c-b6d5-b19c70e7dbc6","Type":"ContainerStarted","Data":"96363fdef6f166838b1f67ad6de0cb6f33ebe03a658423a208f9080972f55190"} Jun 02 04:42:08.939448 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.939359 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" event={"ID":"313dd821-7bd9-454c-b6d5-b19c70e7dbc6","Type":"ContainerStarted","Data":"4aa74d4de27bca9f23c756aa9161433c2bff030f7946ce0582997fa33ed0a566"} Jun 02 04:42:08.939448 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.939370 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" event={"ID":"313dd821-7bd9-454c-b6d5-b19c70e7dbc6","Type":"ContainerStarted","Data":"23ca00d083fbe8daf04abaa92a411f076445dc002cdd4cac3c90888639b28ca7"} Jun 02 04:42:08.939448 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.939383 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" event={"ID":"313dd821-7bd9-454c-b6d5-b19c70e7dbc6","Type":"ContainerStarted","Data":"1c9b6425a19ac174b55f8b39c9d924847529e011147962f038e9b19e4367f2ac"} Jun 02 04:42:08.939448 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.939394 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" event={"ID":"313dd821-7bd9-454c-b6d5-b19c70e7dbc6","Type":"ContainerStarted","Data":"effaea42596d674ce8b456d38e4f388c1caa4fa166b435e7806a2a3ed1ee4db2"} Jun 02 04:42:08.939448 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.939422 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" event={"ID":"313dd821-7bd9-454c-b6d5-b19c70e7dbc6","Type":"ContainerStarted","Data":"2097ad7ff5eccda8b792b4ea3338fb7fd62cb828e79abb6878aa1fcc62ae3b23"} Jun 02 04:42:08.968177 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.968126 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-knmg7" podStartSLOduration=3.865784743 podStartE2EDuration="21.968111926s" podCreationTimestamp="2026-06-02 04:41:47 +0000 UTC" firstStartedPulling="2026-06-02 04:41:50.181151297 +0000 UTC m=+2.901232361" lastFinishedPulling="2026-06-02 04:42:08.283478482 +0000 UTC m=+21.003559544" observedRunningTime="2026-06-02 04:42:08.967893782 +0000 UTC m=+21.687974856" watchObservedRunningTime="2026-06-02 04:42:08.968111926 +0000 UTC m=+21.688192998" Jun 02 04:42:08.983366 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:08.983311 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-zr99x" podStartSLOduration=8.712483366 podStartE2EDuration="21.983295222s" podCreationTimestamp="2026-06-02 04:41:47 +0000 UTC" firstStartedPulling="2026-06-02 04:41:50.183985335 +0000 UTC m=+2.904066405" lastFinishedPulling="2026-06-02 04:42:03.454797208 +0000 UTC m=+16.174878261" observedRunningTime="2026-06-02 04:42:08.983219801 +0000 UTC m=+21.703300876" watchObservedRunningTime="2026-06-02 04:42:08.983295222 +0000 UTC m=+21.703376296" Jun 02 04:42:09.003181 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.003126 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g5669" podStartSLOduration=8.731662956 podStartE2EDuration="22.003112121s" podCreationTimestamp="2026-06-02 04:41:47 +0000 UTC" firstStartedPulling="2026-06-02 04:41:50.183350131 +0000 UTC m=+2.903431183" lastFinishedPulling="2026-06-02 04:42:03.454799273 +0000 UTC m=+16.174880348" observedRunningTime="2026-06-02 04:42:09.002278572 +0000 UTC m=+21.722359645" watchObservedRunningTime="2026-06-02 04:42:09.003112121 +0000 UTC m=+21.723193194" Jun 02 04:42:09.037252 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.037165 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dmm6j" podStartSLOduration=3.975104084 podStartE2EDuration="22.037149541s" podCreationTimestamp="2026-06-02 04:41:47 +0000 UTC" firstStartedPulling="2026-06-02 04:41:50.183339803 +0000 UTC m=+2.903420866" lastFinishedPulling="2026-06-02 04:42:08.245385258 +0000 UTC m=+20.965466323" observedRunningTime="2026-06-02 04:42:09.021380251 +0000 UTC m=+21.741461322" watchObservedRunningTime="2026-06-02 04:42:09.037149541 +0000 UTC m=+21.757230606" Jun 02 04:42:09.037408 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.037288 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gk7dh" podStartSLOduration=3.979755525 podStartE2EDuration="22.037284764s" podCreationTimestamp="2026-06-02 04:41:47 +0000 UTC" firstStartedPulling="2026-06-02 04:41:50.188109343 +0000 UTC m=+2.908190400" lastFinishedPulling="2026-06-02 04:42:08.245638585 +0000 UTC m=+20.965719639" observedRunningTime="2026-06-02 04:42:09.036105571 +0000 UTC m=+21.756186631" watchObservedRunningTime="2026-06-02 04:42:09.037284764 +0000 UTC m=+21.757365834" Jun 02 04:42:09.419401 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.419375 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 04:42:09.726070 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.725954 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T04:42:09.419393612Z","UUID":"b51ab698-8ac8-4a57-96aa-9067cbca9752","Handler":null,"Name":"","Endpoint":""} Jun 02 04:42:09.727978 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.727953 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 04:42:09.727978 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.727984 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 04:42:09.728175 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.728027 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:09.728175 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:09.728138 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:42:09.728278 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.728197 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:09.728278 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.728254 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:09.728371 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:09.728347 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:42:09.728448 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:09.728427 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:09.943216 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.943140 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" event={"ID":"9280b2c1-f7a6-4b91-bc27-1eccff5cd230","Type":"ContainerStarted","Data":"82e1f6e50c983e1753edc1b72ccee5eb6d8525873c45a7403914561c1567d298"} Jun 02 04:42:09.946603 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.945864 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qv2r8" event={"ID":"047f2a29-9c7b-426c-baf2-fa0fdcb85a5b","Type":"ContainerStarted","Data":"251c05acd55cdacab5efb8e8300ad3bf7d7dfa0a6858fc98de2c394eb6cee3b3"} Jun 02 04:42:09.963363 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:09.963325 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qv2r8" podStartSLOduration=4.897740276 podStartE2EDuration="22.963313208s" podCreationTimestamp="2026-06-02 04:41:47 +0000 UTC" firstStartedPulling="2026-06-02 04:41:50.179761037 +0000 UTC m=+2.899842088" lastFinishedPulling="2026-06-02 04:42:08.245333967 +0000 UTC m=+20.965415020" observedRunningTime="2026-06-02 04:42:09.962600818 +0000 UTC m=+22.682681890" watchObservedRunningTime="2026-06-02 04:42:09.963313208 +0000 UTC m=+22.683394280" Jun 02 04:42:10.743762 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:10.743722 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g5669" Jun 02 04:42:10.951122 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:10.951093 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" event={"ID":"313dd821-7bd9-454c-b6d5-b19c70e7dbc6","Type":"ContainerStarted","Data":"2ba1724e7caae52946b339e5602414385b97f0ebbeede300c7dd92227880abdc"} Jun 02 04:42:10.953258 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:10.953231 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" event={"ID":"9280b2c1-f7a6-4b91-bc27-1eccff5cd230","Type":"ContainerStarted","Data":"6f870ad176207dd5f97fad23d529b4b9c154c25e28e4f1c6f95422db5762b62a"} Jun 02 04:42:10.971152 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:10.971116 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh9bz" podStartSLOduration=3.95784269 podStartE2EDuration="23.97110329s" podCreationTimestamp="2026-06-02 04:41:47 +0000 UTC" firstStartedPulling="2026-06-02 04:41:50.191375347 +0000 UTC m=+2.911456402" lastFinishedPulling="2026-06-02 04:42:10.204635949 +0000 UTC m=+22.924717002" observedRunningTime="2026-06-02 04:42:10.970991483 +0000 UTC m=+23.691072568" watchObservedRunningTime="2026-06-02 04:42:10.97110329 +0000 UTC m=+23.691184345" Jun 02 04:42:11.728868 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:11.728832 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:11.728868 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:11.728872 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:11.729089 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:11.728992 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:42:11.729089 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:11.729035 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:42:11.729089 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:11.729071 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:11.729241 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:11.729179 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:13.024314 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:13.024083 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g5669" Jun 02 04:42:13.024727 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:13.024681 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g5669" Jun 02 04:42:13.728317 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:13.728286 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:13.728492 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:13.728286 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:13.728492 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:13.728417 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:42:13.728492 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:13.728286 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:13.728673 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:13.728486 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:42:13.728673 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:13.728604 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:13.958939 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:13.958911 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g5669" Jun 02 04:42:14.174461 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:14.174433 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:14.174959 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:14.174557 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:14.174959 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:14.174617 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret podName:71c98ea9-8e1e-4212-96dc-145382663a08 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:30.174602908 +0000 UTC m=+42.894683959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret") pod "global-pull-secret-syncer-nmvp2" (UID: "71c98ea9-8e1e-4212-96dc-145382663a08") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:14.962767 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:14.962726 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" event={"ID":"313dd821-7bd9-454c-b6d5-b19c70e7dbc6","Type":"ContainerStarted","Data":"f398ef15435da92f304313e7bf60224a1fcad2da8a6cfc250d1f4c2fdd47f7e0"} Jun 02 04:42:14.963015 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:14.962998 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:42:14.964395 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:14.964373 2581 generic.go:358] "Generic (PLEG): container finished" podID="d2328f71-aef7-4be0-b956-7543e950f3a3" containerID="c183beb99d06f2e1c698440ffced1a5212110c2473e0178c825dda5dba4632aa" exitCode=0 Jun 02 04:42:14.964510 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:14.964451 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx2t5" event={"ID":"d2328f71-aef7-4be0-b956-7543e950f3a3","Type":"ContainerDied","Data":"c183beb99d06f2e1c698440ffced1a5212110c2473e0178c825dda5dba4632aa"} Jun 02 04:42:14.977882 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:14.977864 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:42:14.993560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:14.993521 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" podStartSLOduration=9.838635274 podStartE2EDuration="27.993509296s" podCreationTimestamp="2026-06-02 04:41:47 +0000 UTC" firstStartedPulling="2026-06-02 04:41:50.191442647 +0000 UTC m=+2.911523697" lastFinishedPulling="2026-06-02 04:42:08.346316652 +0000 UTC m=+21.066397719" observedRunningTime="2026-06-02 04:42:14.993492602 +0000 UTC m=+27.713573675" watchObservedRunningTime="2026-06-02 04:42:14.993509296 +0000 UTC m=+27.713590363" Jun 02 04:42:15.728445 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:15.728294 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:15.729011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:15.728295 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:15.729011 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:15.728525 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:42:15.729011 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:15.728628 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:15.729011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:15.728296 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:15.729011 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:15.728777 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:42:15.966709 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:15.966686 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:42:15.966823 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:15.966718 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:42:15.982763 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:15.982688 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:42:16.059328 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:16.059303 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nmvp2"] Jun 02 04:42:16.059435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:16.059396 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:16.059499 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:16.059477 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:16.062556 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:16.062527 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-df4cx"] Jun 02 04:42:16.062652 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:16.062614 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:16.062726 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:16.062702 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:42:16.063172 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:16.063149 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7cswx"] Jun 02 04:42:16.063267 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:16.063240 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:16.063365 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:16.063344 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:42:16.969457 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:16.969425 2581 generic.go:358] "Generic (PLEG): container finished" podID="d2328f71-aef7-4be0-b956-7543e950f3a3" containerID="90244a6b5bf440c481fd3dd570fac7d6b27bfc7ef2faf9e4f28b67e32ff14346" exitCode=0 Jun 02 04:42:16.969849 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:16.969500 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx2t5" event={"ID":"d2328f71-aef7-4be0-b956-7543e950f3a3","Type":"ContainerDied","Data":"90244a6b5bf440c481fd3dd570fac7d6b27bfc7ef2faf9e4f28b67e32ff14346"} Jun 02 04:42:17.729127 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:17.729100 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:17.729294 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:17.729187 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:42:17.729294 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:17.729257 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:17.729433 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:17.729337 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:17.729433 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:17.729386 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:17.729546 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:17.729522 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:42:17.973488 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:17.973316 2581 generic.go:358] "Generic (PLEG): container finished" podID="d2328f71-aef7-4be0-b956-7543e950f3a3" containerID="f06c3c5dfb21dd9bb974d52ffc960dcf0054a433df9f9365227c7e6f144488e8" exitCode=0 Jun 02 04:42:17.973488 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:17.973387 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx2t5" event={"ID":"d2328f71-aef7-4be0-b956-7543e950f3a3","Type":"ContainerDied","Data":"f06c3c5dfb21dd9bb974d52ffc960dcf0054a433df9f9365227c7e6f144488e8"} Jun 02 04:42:19.728107 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:19.728068 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:19.728107 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:19.728091 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:19.728609 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:19.728111 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:19.728609 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:19.728180 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-df4cx" podUID="ce169576-918f-475b-b1ba-72aff9e873c4" Jun 02 04:42:19.728609 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:19.728243 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nmvp2" podUID="71c98ea9-8e1e-4212-96dc-145382663a08" Jun 02 04:42:19.728609 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:19.728346 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7cswx" podUID="dd76ba94-c5d3-4336-b699-b07e5b707ba5" Jun 02 04:42:21.148855 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.148777 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-68.ec2.internal" event="NodeReady" Jun 02 04:42:21.149199 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.148933 2581 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 04:42:21.186298 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.186265 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8468664c8c-j92jc"] Jun 02 04:42:21.212999 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.212973 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-48x8n"] Jun 02 04:42:21.213137 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.213007 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.215869 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.215847 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 04:42:21.216214 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.216185 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 04:42:21.216693 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.216671 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 04:42:21.216790 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.216759 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8jbvs\"" Jun 02 04:42:21.221825 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.221805 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 04:42:21.231523 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.231491 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mjqxt"] Jun 02 04:42:21.231672 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.231645 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.233980 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.233949 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 04:42:21.234422 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.234230 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 04:42:21.234422 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.234263 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bzxgr\"" Jun 02 04:42:21.255010 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.254990 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8468664c8c-j92jc"] Jun 02 04:42:21.255122 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.255016 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mjqxt"] Jun 02 04:42:21.255122 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.255029 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-48x8n"] Jun 02 04:42:21.255237 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.255126 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:21.257716 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.257697 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhq2g\"" Jun 02 04:42:21.257819 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.257716 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 04:42:21.257819 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.257758 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 04:42:21.257819 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.257816 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 04:42:21.327065 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-installation-pull-secrets\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.327065 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-tmp-dir\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.327285 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327128 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-bound-sa-token\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.327285 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvktz\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-kube-api-access-bvktz\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.327285 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kbqg\" (UniqueName: \"kubernetes.io/projected/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-kube-api-access-2kbqg\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.327434 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76a6b3b4-8439-4363-b7dd-8824b67eab69-ca-trust-extracted\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.327434 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-config-volume\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.327434 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-certificates\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.327555 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.327555 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327484 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-image-registry-private-configuration\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.327555 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.327683 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.327560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-trusted-ca\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.427936 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.427850 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.428299 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.428269 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:42:21.428299 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.428268 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-image-registry-private-configuration\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.428465 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.428337 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.428465 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.428360 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls podName:0a385c07-c5f3-4ce4-b3ea-17ce928bc66e nodeName:}" failed. No retries permitted until 2026-06-02 04:42:21.928336134 +0000 UTC m=+34.648417200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls") pod "dns-default-48x8n" (UID: "0a385c07-c5f3-4ce4-b3ea-17ce928bc66e") : secret "dns-default-metrics-tls" not found Jun 02 04:42:21.428465 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.428405 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-trusted-ca\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.428465 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.428423 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:42:21.428465 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.428437 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8468664c8c-j92jc: secret "image-registry-tls" not found Jun 02 04:42:21.428465 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.428440 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-installation-pull-secrets\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.428766 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.428483 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-tmp-dir\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.428766 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.428490 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls podName:76a6b3b4-8439-4363-b7dd-8824b67eab69 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:21.928476838 +0000 UTC m=+34.648557901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls") pod "image-registry-8468664c8c-j92jc" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69") : secret "image-registry-tls" not found Jun 02 04:42:21.428871 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.428833 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-tmp-dir\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.430435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.429293 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-bound-sa-token\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.430435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.429357 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvktz\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-kube-api-access-bvktz\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.430435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.429430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:21.430435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.429472 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kbqg\" (UniqueName: \"kubernetes.io/projected/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-kube-api-access-2kbqg\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.430435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.429508 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76a6b3b4-8439-4363-b7dd-8824b67eab69-ca-trust-extracted\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.430435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.429559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5r9r\" (UniqueName: \"kubernetes.io/projected/4c4eacaa-9fc6-403e-a14f-bb9c35340334-kube-api-access-c5r9r\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:21.430435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.429598 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:21.430435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.429647 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-config-volume\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.430435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.429712 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-certificates\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.430435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.430360 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-certificates\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.430435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.430390 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76a6b3b4-8439-4363-b7dd-8824b67eab69-ca-trust-extracted\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.431034 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.430484 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:21.431034 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.430551 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs podName:dd76ba94-c5d3-4336-b699-b07e5b707ba5 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:53.430530578 +0000 UTC m=+66.150611645 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs") pod "network-metrics-daemon-7cswx" (UID: "dd76ba94-c5d3-4336-b699-b07e5b707ba5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:21.431034 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.430988 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-config-volume\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.433377 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.433326 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-trusted-ca\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.433853 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.433828 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-installation-pull-secrets\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.434133 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.434097 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-image-registry-private-configuration\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.444787 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.444766 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvktz\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-kube-api-access-bvktz\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.448674 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.448635 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kbqg\" (UniqueName: \"kubernetes.io/projected/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-kube-api-access-2kbqg\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.448844 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.448825 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-bound-sa-token\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.531017 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.530989 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:21.531017 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.531024 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xw\" (UniqueName: \"kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw\") pod \"network-check-target-df4cx\" (UID: \"ce169576-918f-475b-b1ba-72aff9e873c4\") " pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:21.531227 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.531042 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5r9r\" (UniqueName: \"kubernetes.io/projected/4c4eacaa-9fc6-403e-a14f-bb9c35340334-kube-api-access-c5r9r\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:21.531227 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.531141 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:42:21.531227 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.531201 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert podName:4c4eacaa-9fc6-403e-a14f-bb9c35340334 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:22.03118294 +0000 UTC m=+34.751263994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert") pod "ingress-canary-mjqxt" (UID: "4c4eacaa-9fc6-403e-a14f-bb9c35340334") : secret "canary-serving-cert" not found Jun 02 04:42:21.531227 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.531147 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:21.531410 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.531252 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:21.531410 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.531268 2581 projected.go:194] Error preparing data for projected volume kube-api-access-8c5xw for pod openshift-network-diagnostics/network-check-target-df4cx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:21.531410 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.531328 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw podName:ce169576-918f-475b-b1ba-72aff9e873c4 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:53.531312471 +0000 UTC m=+66.251393536 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8c5xw" (UniqueName: "kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw") pod "network-check-target-df4cx" (UID: "ce169576-918f-475b-b1ba-72aff9e873c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:21.541877 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.541850 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5r9r\" (UniqueName: \"kubernetes.io/projected/4c4eacaa-9fc6-403e-a14f-bb9c35340334-kube-api-access-c5r9r\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:21.728993 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.728905 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:21.729150 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.728906 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:21.729220 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.728909 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:21.732122 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.731861 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2frh\"" Jun 02 04:42:21.732122 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.731878 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rvl8h\"" Jun 02 04:42:21.732122 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.731938 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 04:42:21.732122 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.731983 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 04:42:21.732122 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.731870 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 04:42:21.732493 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.732271 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 04:42:21.934313 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.934276 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:21.934504 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:21.934346 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:21.934504 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.934452 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:42:21.934591 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.934539 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls podName:0a385c07-c5f3-4ce4-b3ea-17ce928bc66e nodeName:}" failed. No retries permitted until 2026-06-02 04:42:22.934521867 +0000 UTC m=+35.654602937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls") pod "dns-default-48x8n" (UID: "0a385c07-c5f3-4ce4-b3ea-17ce928bc66e") : secret "dns-default-metrics-tls" not found Jun 02 04:42:21.934591 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.934455 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:42:21.934591 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.934568 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8468664c8c-j92jc: secret "image-registry-tls" not found Jun 02 04:42:21.934778 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:21.934637 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls podName:76a6b3b4-8439-4363-b7dd-8824b67eab69 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:22.934616541 +0000 UTC m=+35.654697591 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls") pod "image-registry-8468664c8c-j92jc" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69") : secret "image-registry-tls" not found Jun 02 04:42:22.035276 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:22.035235 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:22.035474 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:22.035389 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:42:22.035474 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:22.035455 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert podName:4c4eacaa-9fc6-403e-a14f-bb9c35340334 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:23.035436408 +0000 UTC m=+35.755517472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert") pod "ingress-canary-mjqxt" (UID: "4c4eacaa-9fc6-403e-a14f-bb9c35340334") : secret "canary-serving-cert" not found Jun 02 04:42:22.942843 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:22.942805 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:22.943439 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:22.942855 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:22.943439 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:22.942969 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:42:22.943439 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:22.943029 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls podName:0a385c07-c5f3-4ce4-b3ea-17ce928bc66e nodeName:}" failed. No retries permitted until 2026-06-02 04:42:24.943014472 +0000 UTC m=+37.663095525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls") pod "dns-default-48x8n" (UID: "0a385c07-c5f3-4ce4-b3ea-17ce928bc66e") : secret "dns-default-metrics-tls" not found Jun 02 04:42:22.943439 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:22.942970 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:42:22.943439 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:22.943076 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8468664c8c-j92jc: secret "image-registry-tls" not found Jun 02 04:42:22.943439 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:22.943130 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls podName:76a6b3b4-8439-4363-b7dd-8824b67eab69 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:24.943115512 +0000 UTC m=+37.663196577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls") pod "image-registry-8468664c8c-j92jc" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69") : secret "image-registry-tls" not found Jun 02 04:42:23.043348 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:23.043299 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:23.043532 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:23.043455 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:42:23.043532 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:23.043513 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert podName:4c4eacaa-9fc6-403e-a14f-bb9c35340334 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:25.043495988 +0000 UTC m=+37.763577057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert") pod "ingress-canary-mjqxt" (UID: "4c4eacaa-9fc6-403e-a14f-bb9c35340334") : secret "canary-serving-cert" not found Jun 02 04:42:24.957188 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:24.957148 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:24.957188 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:24.957194 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:24.957812 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:24.957307 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:42:24.957812 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:24.957321 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:42:24.957812 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:24.957333 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8468664c8c-j92jc: secret "image-registry-tls" not found Jun 02 04:42:24.957812 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:24.957376 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls podName:0a385c07-c5f3-4ce4-b3ea-17ce928bc66e nodeName:}" failed. No retries permitted until 2026-06-02 04:42:28.957356859 +0000 UTC m=+41.677437909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls") pod "dns-default-48x8n" (UID: "0a385c07-c5f3-4ce4-b3ea-17ce928bc66e") : secret "dns-default-metrics-tls" not found Jun 02 04:42:24.957812 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:24.957391 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls podName:76a6b3b4-8439-4363-b7dd-8824b67eab69 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:28.957385981 +0000 UTC m=+41.677467031 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls") pod "image-registry-8468664c8c-j92jc" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69") : secret "image-registry-tls" not found Jun 02 04:42:24.991407 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:24.991380 2581 generic.go:358] "Generic (PLEG): container finished" podID="d2328f71-aef7-4be0-b956-7543e950f3a3" containerID="1ae4a9afc0ff261643a9c4ac7de61d34fecf316b9a74b22eb222da0f0fa6792f" exitCode=0 Jun 02 04:42:24.991527 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:24.991418 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx2t5" event={"ID":"d2328f71-aef7-4be0-b956-7543e950f3a3","Type":"ContainerDied","Data":"1ae4a9afc0ff261643a9c4ac7de61d34fecf316b9a74b22eb222da0f0fa6792f"} Jun 02 04:42:25.057725 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:25.057704 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:25.057918 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:25.057844 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:42:25.057918 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:25.057902 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert podName:4c4eacaa-9fc6-403e-a14f-bb9c35340334 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:29.057888227 +0000 UTC m=+41.777969277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert") pod "ingress-canary-mjqxt" (UID: "4c4eacaa-9fc6-403e-a14f-bb9c35340334") : secret "canary-serving-cert" not found Jun 02 04:42:25.995469 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:25.995441 2581 generic.go:358] "Generic (PLEG): container finished" podID="d2328f71-aef7-4be0-b956-7543e950f3a3" containerID="34419b939ebe01b7955eb16e2a179ed3258b2a4c3bad8fea3953f79ea324b424" exitCode=0 Jun 02 04:42:25.995815 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:25.995486 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx2t5" event={"ID":"d2328f71-aef7-4be0-b956-7543e950f3a3","Type":"ContainerDied","Data":"34419b939ebe01b7955eb16e2a179ed3258b2a4c3bad8fea3953f79ea324b424"} Jun 02 04:42:27.000247 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:27.000000 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sx2t5" event={"ID":"d2328f71-aef7-4be0-b956-7543e950f3a3","Type":"ContainerStarted","Data":"731e7484ebd56cf2b7aa7d0c57451d6364f629df9c9ce6f8ecb7497e5272a2e9"} Jun 02 04:42:27.025167 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:27.025018 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sx2t5" podStartSLOduration=6.249219323 podStartE2EDuration="40.025002623s" podCreationTimestamp="2026-06-02 04:41:47 +0000 UTC" firstStartedPulling="2026-06-02 04:41:50.189521081 +0000 UTC m=+2.909602145" lastFinishedPulling="2026-06-02 04:42:23.965304396 +0000 UTC m=+36.685385445" observedRunningTime="2026-06-02 04:42:27.024372372 +0000 UTC m=+39.744453445" watchObservedRunningTime="2026-06-02 04:42:27.025002623 +0000 UTC m=+39.745083696" Jun 02 04:42:28.984792 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:28.984757 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:28.985258 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:28.984799 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:28.985258 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:28.984892 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:42:28.985258 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:28.984939 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:42:28.985258 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:28.984950 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls podName:0a385c07-c5f3-4ce4-b3ea-17ce928bc66e nodeName:}" failed. No retries permitted until 2026-06-02 04:42:36.984934805 +0000 UTC m=+49.705015855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls") pod "dns-default-48x8n" (UID: "0a385c07-c5f3-4ce4-b3ea-17ce928bc66e") : secret "dns-default-metrics-tls" not found Jun 02 04:42:28.985258 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:28.984954 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8468664c8c-j92jc: secret "image-registry-tls" not found Jun 02 04:42:28.985258 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:28.984999 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls podName:76a6b3b4-8439-4363-b7dd-8824b67eab69 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:36.984983919 +0000 UTC m=+49.705064985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls") pod "image-registry-8468664c8c-j92jc" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69") : secret "image-registry-tls" not found Jun 02 04:42:29.085761 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:29.085722 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:29.085907 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:29.085840 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:42:29.085907 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:29.085892 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert podName:4c4eacaa-9fc6-403e-a14f-bb9c35340334 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:37.085876553 +0000 UTC m=+49.805957607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert") pod "ingress-canary-mjqxt" (UID: "4c4eacaa-9fc6-403e-a14f-bb9c35340334") : secret "canary-serving-cert" not found Jun 02 04:42:30.192585 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:30.192538 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:30.195066 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:30.195037 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c98ea9-8e1e-4212-96dc-145382663a08-original-pull-secret\") pod \"global-pull-secret-syncer-nmvp2\" (UID: \"71c98ea9-8e1e-4212-96dc-145382663a08\") " pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:30.447045 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:30.446942 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nmvp2" Jun 02 04:42:30.572000 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:30.571972 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nmvp2"] Jun 02 04:42:30.575051 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:42:30.575021 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c98ea9_8e1e_4212_96dc_145382663a08.slice/crio-10606a6991aa1fa17b60e37e5ef1546a2eafe8f3271a004b1f7e6939a7196fc3 WatchSource:0}: Error finding container 10606a6991aa1fa17b60e37e5ef1546a2eafe8f3271a004b1f7e6939a7196fc3: Status 404 returned error can't find the container with id 10606a6991aa1fa17b60e37e5ef1546a2eafe8f3271a004b1f7e6939a7196fc3 Jun 02 04:42:31.008417 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:31.008366 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nmvp2" event={"ID":"71c98ea9-8e1e-4212-96dc-145382663a08","Type":"ContainerStarted","Data":"10606a6991aa1fa17b60e37e5ef1546a2eafe8f3271a004b1f7e6939a7196fc3"} Jun 02 04:42:35.016952 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:35.016905 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nmvp2" event={"ID":"71c98ea9-8e1e-4212-96dc-145382663a08","Type":"ContainerStarted","Data":"721738d9a576bf3001ca00dafab003ffe43e89163379480c88bbefe65a85ed8b"} Jun 02 04:42:35.032618 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:35.032578 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nmvp2" podStartSLOduration=33.497132788 podStartE2EDuration="37.032566629s" podCreationTimestamp="2026-06-02 04:41:58 +0000 UTC" firstStartedPulling="2026-06-02 04:42:30.576720693 +0000 UTC m=+43.296801743" lastFinishedPulling="2026-06-02 04:42:34.11215452 +0000 UTC m=+46.832235584" observedRunningTime="2026-06-02 04:42:35.03167423 +0000 UTC m=+47.751755302" watchObservedRunningTime="2026-06-02 04:42:35.032566629 +0000 UTC m=+47.752647701" Jun 02 04:42:35.717854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:35.717828 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zr99x_c6cf0d89-0b9e-4497-97a9-adf610a691eb/dns-node-resolver/0.log" Jun 02 04:42:36.308739 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:36.308709 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gk7dh_03b4fee0-4026-402e-a447-bf848b78a6e3/node-ca/0.log" Jun 02 04:42:37.044872 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:37.044843 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:37.045032 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:37.044877 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:37.045032 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:37.044966 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:42:37.045032 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:37.044973 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:42:37.045032 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:37.045027 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls podName:0a385c07-c5f3-4ce4-b3ea-17ce928bc66e nodeName:}" failed. No retries permitted until 2026-06-02 04:42:53.045013018 +0000 UTC m=+65.765094068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls") pod "dns-default-48x8n" (UID: "0a385c07-c5f3-4ce4-b3ea-17ce928bc66e") : secret "dns-default-metrics-tls" not found Jun 02 04:42:37.045166 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:37.044981 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8468664c8c-j92jc: secret "image-registry-tls" not found Jun 02 04:42:37.045166 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:37.045062 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls podName:76a6b3b4-8439-4363-b7dd-8824b67eab69 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:53.045053249 +0000 UTC m=+65.765134299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls") pod "image-registry-8468664c8c-j92jc" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69") : secret "image-registry-tls" not found Jun 02 04:42:37.146024 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:37.146001 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:37.146122 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:37.146111 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:42:37.146168 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:42:37.146162 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert podName:4c4eacaa-9fc6-403e-a14f-bb9c35340334 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:53.146149245 +0000 UTC m=+65.866230294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert") pod "ingress-canary-mjqxt" (UID: "4c4eacaa-9fc6-403e-a14f-bb9c35340334") : secret "canary-serving-cert" not found Jun 02 04:42:47.983869 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:47.983838 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4wgp9" Jun 02 04:42:53.062813 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.062775 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:53.063194 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.062820 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:53.065176 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.065156 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a385c07-c5f3-4ce4-b3ea-17ce928bc66e-metrics-tls\") pod \"dns-default-48x8n\" (UID: \"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e\") " pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:53.065264 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.065220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls\") pod \"image-registry-8468664c8c-j92jc\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:53.163649 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.163616 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:53.165784 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.165758 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c4eacaa-9fc6-403e-a14f-bb9c35340334-cert\") pod \"ingress-canary-mjqxt\" (UID: \"4c4eacaa-9fc6-403e-a14f-bb9c35340334\") " pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:53.327554 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.327479 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8jbvs\"" Jun 02 04:42:53.335779 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.335751 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:53.344129 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.344110 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bzxgr\"" Jun 02 04:42:53.352144 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.352117 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:53.367777 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.367756 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhq2g\"" Jun 02 04:42:53.374871 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.374847 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mjqxt" Jun 02 04:42:53.466134 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.466101 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:53.469459 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.469417 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 04:42:53.478849 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.478829 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd76ba94-c5d3-4336-b699-b07e5b707ba5-metrics-certs\") pod \"network-metrics-daemon-7cswx\" (UID: \"dd76ba94-c5d3-4336-b699-b07e5b707ba5\") " pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:53.480713 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.480694 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8468664c8c-j92jc"] Jun 02 04:42:53.484382 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:42:53.484347 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a6b3b4_8439_4363_b7dd_8824b67eab69.slice/crio-3dbbd84dba0618199223bdf7bed0c3c91f15cb7fe2a09770b3d56853281f44d5 WatchSource:0}: Error finding container 3dbbd84dba0618199223bdf7bed0c3c91f15cb7fe2a09770b3d56853281f44d5: Status 404 returned error can't find the container with id 3dbbd84dba0618199223bdf7bed0c3c91f15cb7fe2a09770b3d56853281f44d5 Jun 02 04:42:53.486842 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.486824 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-48x8n"] Jun 02 04:42:53.490049 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:42:53.490026 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a385c07_c5f3_4ce4_b3ea_17ce928bc66e.slice/crio-5af7c990c0db31f7e75b3f8ba5c0df1c49bc18678aaa2b488b8a20d60fc669cd WatchSource:0}: Error finding container 5af7c990c0db31f7e75b3f8ba5c0df1c49bc18678aaa2b488b8a20d60fc669cd: Status 404 returned error can't find the container with id 5af7c990c0db31f7e75b3f8ba5c0df1c49bc18678aaa2b488b8a20d60fc669cd Jun 02 04:42:53.520222 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.520112 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mjqxt"] Jun 02 04:42:53.522284 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:42:53.522258 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4eacaa_9fc6_403e_a14f_bb9c35340334.slice/crio-2ebe56d0fd45128112a647dcda67561cd1f81caf16351b1ff8ab53bdeeced838 WatchSource:0}: Error finding container 2ebe56d0fd45128112a647dcda67561cd1f81caf16351b1ff8ab53bdeeced838: Status 404 returned error can't find the container with id 2ebe56d0fd45128112a647dcda67561cd1f81caf16351b1ff8ab53bdeeced838 Jun 02 04:42:53.555842 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.555810 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2frh\"" Jun 02 04:42:53.563798 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.563781 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7cswx" Jun 02 04:42:53.566455 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.566424 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5xw\" (UniqueName: \"kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw\") pod \"network-check-target-df4cx\" (UID: \"ce169576-918f-475b-b1ba-72aff9e873c4\") " pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:53.568798 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.568780 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 04:42:53.581608 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.581581 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 04:42:53.589007 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.588983 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c5xw\" (UniqueName: \"kubernetes.io/projected/ce169576-918f-475b-b1ba-72aff9e873c4-kube-api-access-8c5xw\") pod \"network-check-target-df4cx\" (UID: \"ce169576-918f-475b-b1ba-72aff9e873c4\") " pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:53.694240 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.694213 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7cswx"] Jun 02 04:42:53.697373 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:42:53.697345 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd76ba94_c5d3_4336_b699_b07e5b707ba5.slice/crio-1cf04e5f604918fa78bad9bc67df57d9a38ba4390c029b067d861a3f5d4914eb WatchSource:0}: Error finding container 1cf04e5f604918fa78bad9bc67df57d9a38ba4390c029b067d861a3f5d4914eb: Status 404 returned error can't find the container with id 1cf04e5f604918fa78bad9bc67df57d9a38ba4390c029b067d861a3f5d4914eb Jun 02 04:42:53.843068 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.842986 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rvl8h\"" Jun 02 04:42:53.851129 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:53.851091 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:54.039737 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:54.039681 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-df4cx"] Jun 02 04:42:54.043571 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:42:54.043539 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce169576_918f_475b_b1ba_72aff9e873c4.slice/crio-934e4ab30c8ce515945ea89260191bc9a77b593fcbd713a0de348365ca7eb11a WatchSource:0}: Error finding container 934e4ab30c8ce515945ea89260191bc9a77b593fcbd713a0de348365ca7eb11a: Status 404 returned error can't find the container with id 934e4ab30c8ce515945ea89260191bc9a77b593fcbd713a0de348365ca7eb11a Jun 02 04:42:54.056091 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:54.056058 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mjqxt" event={"ID":"4c4eacaa-9fc6-403e-a14f-bb9c35340334","Type":"ContainerStarted","Data":"2ebe56d0fd45128112a647dcda67561cd1f81caf16351b1ff8ab53bdeeced838"} Jun 02 04:42:54.058137 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:54.058050 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" event={"ID":"76a6b3b4-8439-4363-b7dd-8824b67eab69","Type":"ContainerStarted","Data":"c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0"} Jun 02 04:42:54.058137 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:54.058094 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" event={"ID":"76a6b3b4-8439-4363-b7dd-8824b67eab69","Type":"ContainerStarted","Data":"3dbbd84dba0618199223bdf7bed0c3c91f15cb7fe2a09770b3d56853281f44d5"} Jun 02 04:42:54.058137 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:54.058113 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:42:54.059608 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:54.059507 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7cswx" event={"ID":"dd76ba94-c5d3-4336-b699-b07e5b707ba5","Type":"ContainerStarted","Data":"1cf04e5f604918fa78bad9bc67df57d9a38ba4390c029b067d861a3f5d4914eb"} Jun 02 04:42:54.062315 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:54.062290 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-48x8n" event={"ID":"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e","Type":"ContainerStarted","Data":"5af7c990c0db31f7e75b3f8ba5c0df1c49bc18678aaa2b488b8a20d60fc669cd"} Jun 02 04:42:54.063866 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:54.063821 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-df4cx" event={"ID":"ce169576-918f-475b-b1ba-72aff9e873c4","Type":"ContainerStarted","Data":"934e4ab30c8ce515945ea89260191bc9a77b593fcbd713a0de348365ca7eb11a"} Jun 02 04:42:54.082533 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:54.081896 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" podStartSLOduration=38.081881275 podStartE2EDuration="38.081881275s" podCreationTimestamp="2026-06-02 04:42:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:42:54.081350031 +0000 UTC m=+66.801431103" watchObservedRunningTime="2026-06-02 04:42:54.081881275 +0000 UTC m=+66.801962349" Jun 02 04:42:55.973282 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:55.973128 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nk87q"] Jun 02 04:42:56.000932 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.000901 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nk87q"] Jun 02 04:42:56.001089 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.001064 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.004209 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.004180 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v6k97\"" Jun 02 04:42:56.004684 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.004645 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 04:42:56.005811 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.005413 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 04:42:56.005811 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.005450 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 04:42:56.005811 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.005575 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 04:42:56.023643 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.023617 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8468664c8c-j92jc"] Jun 02 04:42:56.054646 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.054607 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6"] Jun 02 04:42:56.072544 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.072520 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-wcfss"] Jun 02 04:42:56.072785 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.072764 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6" Jun 02 04:42:56.075808 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.075785 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 04:42:56.075910 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.075830 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vm7rn\"" Jun 02 04:42:56.083484 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.083465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2651074-4525-4878-a539-7449d7e8d27e-data-volume\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.083600 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.083499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2651074-4525-4878-a539-7449d7e8d27e-crio-socket\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.083600 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.083562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2651074-4525-4878-a539-7449d7e8d27e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.083742 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.083599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz4cq\" (UniqueName: \"kubernetes.io/projected/f2651074-4525-4878-a539-7449d7e8d27e-kube-api-access-lz4cq\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.083742 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.083685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2651074-4525-4878-a539-7449d7e8d27e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.088796 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.088777 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-wcfss" Jun 02 04:42:56.098250 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.098044 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 04:42:56.099029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.098680 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 04:42:56.099029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.098980 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6"] Jun 02 04:42:56.099270 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.099253 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fq2br\"" Jun 02 04:42:56.099942 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.099920 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-wcfss"] Jun 02 04:42:56.184689 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.184641 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2651074-4525-4878-a539-7449d7e8d27e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.184689 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.184690 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lz4cq\" (UniqueName: \"kubernetes.io/projected/f2651074-4525-4878-a539-7449d7e8d27e-kube-api-access-lz4cq\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.184881 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.184715 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2651074-4525-4878-a539-7449d7e8d27e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.184881 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.184822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4c5be880-75fb-4806-9d0c-dd7f6cf3fefa-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-klrb6\" (UID: \"4c5be880-75fb-4806-9d0c-dd7f6cf3fefa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6" Jun 02 04:42:56.184881 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.184858 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2651074-4525-4878-a539-7449d7e8d27e-data-volume\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.185026 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.184890 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2651074-4525-4878-a539-7449d7e8d27e-crio-socket\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.185026 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.184917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jv57\" (UniqueName: \"kubernetes.io/projected/be93c146-0e91-4c06-91b1-6855da536ab3-kube-api-access-7jv57\") pod \"downloads-c65b8dc4b-wcfss\" (UID: \"be93c146-0e91-4c06-91b1-6855da536ab3\") " pod="openshift-console/downloads-c65b8dc4b-wcfss" Jun 02 04:42:56.185026 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.184971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2651074-4525-4878-a539-7449d7e8d27e-crio-socket\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.185138 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.185122 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2651074-4525-4878-a539-7449d7e8d27e-data-volume\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.185176 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.185140 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2651074-4525-4878-a539-7449d7e8d27e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.186905 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.186886 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2651074-4525-4878-a539-7449d7e8d27e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.205214 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.205194 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz4cq\" (UniqueName: \"kubernetes.io/projected/f2651074-4525-4878-a539-7449d7e8d27e-kube-api-access-lz4cq\") pod \"insights-runtime-extractor-nk87q\" (UID: \"f2651074-4525-4878-a539-7449d7e8d27e\") " pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.286326 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.286006 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4c5be880-75fb-4806-9d0c-dd7f6cf3fefa-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-klrb6\" (UID: \"4c5be880-75fb-4806-9d0c-dd7f6cf3fefa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6" Jun 02 04:42:56.286326 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.286056 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jv57\" (UniqueName: \"kubernetes.io/projected/be93c146-0e91-4c06-91b1-6855da536ab3-kube-api-access-7jv57\") pod \"downloads-c65b8dc4b-wcfss\" (UID: \"be93c146-0e91-4c06-91b1-6855da536ab3\") " pod="openshift-console/downloads-c65b8dc4b-wcfss" Jun 02 04:42:56.288897 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.288874 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4c5be880-75fb-4806-9d0c-dd7f6cf3fefa-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-klrb6\" (UID: \"4c5be880-75fb-4806-9d0c-dd7f6cf3fefa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6" Jun 02 04:42:56.297807 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.297761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jv57\" (UniqueName: \"kubernetes.io/projected/be93c146-0e91-4c06-91b1-6855da536ab3-kube-api-access-7jv57\") pod \"downloads-c65b8dc4b-wcfss\" (UID: \"be93c146-0e91-4c06-91b1-6855da536ab3\") " pod="openshift-console/downloads-c65b8dc4b-wcfss" Jun 02 04:42:56.313651 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.313628 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nk87q" Jun 02 04:42:56.381677 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.381575 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6" Jun 02 04:42:56.405484 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.405439 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-wcfss" Jun 02 04:42:56.515276 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.515189 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nk87q"] Jun 02 04:42:56.523831 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:42:56.523723 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2651074_4525_4878_a539_7449d7e8d27e.slice/crio-31cff610430774d2acbfc6600d73133b09d230cd5c138c7e5cdfa3bafc3a0cfd WatchSource:0}: Error finding container 31cff610430774d2acbfc6600d73133b09d230cd5c138c7e5cdfa3bafc3a0cfd: Status 404 returned error can't find the container with id 31cff610430774d2acbfc6600d73133b09d230cd5c138c7e5cdfa3bafc3a0cfd Jun 02 04:42:56.627567 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.627545 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-wcfss"] Jun 02 04:42:56.635279 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:56.634623 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6"] Jun 02 04:42:57.073759 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:57.073713 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk87q" event={"ID":"f2651074-4525-4878-a539-7449d7e8d27e","Type":"ContainerStarted","Data":"2c9a2a3163bf9350b7ef5e21bda860830157d515b75bbcf6ce5a7ce0d12c4db0"} Jun 02 04:42:57.073759 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:57.073758 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk87q" event={"ID":"f2651074-4525-4878-a539-7449d7e8d27e","Type":"ContainerStarted","Data":"31cff610430774d2acbfc6600d73133b09d230cd5c138c7e5cdfa3bafc3a0cfd"} Jun 02 04:42:57.075513 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:57.075486 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7cswx" event={"ID":"dd76ba94-c5d3-4336-b699-b07e5b707ba5","Type":"ContainerStarted","Data":"1485c6df5277148b8180f260050cde87bb1c18dd0cbd0840d1346c6e326f58ba"} Jun 02 04:42:57.075635 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:57.075519 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7cswx" event={"ID":"dd76ba94-c5d3-4336-b699-b07e5b707ba5","Type":"ContainerStarted","Data":"d87d5b6e51863529633f7def327d82a89b1390eeace829a46064d403f5f5f41d"} Jun 02 04:42:57.077281 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:57.077227 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-48x8n" event={"ID":"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e","Type":"ContainerStarted","Data":"4cc7555d4a00df6f51e6afb147a433c1c809ea14019602e39858d74b05fa7fdf"} Jun 02 04:42:57.077281 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:57.077261 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-48x8n" event={"ID":"0a385c07-c5f3-4ce4-b3ea-17ce928bc66e","Type":"ContainerStarted","Data":"560d8d682ffd51333e2fa2510922f393bb8696fdcb0a58276c3d43b5e6b61b20"} Jun 02 04:42:57.077445 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:57.077316 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-48x8n" Jun 02 04:42:57.078597 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:57.078577 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mjqxt" event={"ID":"4c4eacaa-9fc6-403e-a14f-bb9c35340334","Type":"ContainerStarted","Data":"9f66f1b4dcd038dc9be1a675178802dd42677ff5f5c5ae4b6d2b7cb756f3aeae"} Jun 02 04:42:57.091285 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:57.091239 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7cswx" podStartSLOduration=67.541140288 podStartE2EDuration="1m10.091224056s" podCreationTimestamp="2026-06-02 04:41:47 +0000 UTC" firstStartedPulling="2026-06-02 04:42:53.699541751 +0000 UTC m=+66.419622801" lastFinishedPulling="2026-06-02 04:42:56.249625519 +0000 UTC m=+68.969706569" observedRunningTime="2026-06-02 04:42:57.09109063 +0000 UTC m=+69.811171703" watchObservedRunningTime="2026-06-02 04:42:57.091224056 +0000 UTC m=+69.811305132" Jun 02 04:42:57.107451 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:57.107397 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-48x8n" podStartSLOduration=33.350058008 podStartE2EDuration="36.107381499s" podCreationTimestamp="2026-06-02 04:42:21 +0000 UTC" firstStartedPulling="2026-06-02 04:42:53.491810647 +0000 UTC m=+66.211891701" lastFinishedPulling="2026-06-02 04:42:56.249134129 +0000 UTC m=+68.969215192" observedRunningTime="2026-06-02 04:42:57.107039027 +0000 UTC m=+69.827120100" watchObservedRunningTime="2026-06-02 04:42:57.107381499 +0000 UTC m=+69.827462572" Jun 02 04:42:57.123434 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:57.123390 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mjqxt" podStartSLOduration=33.39055297 podStartE2EDuration="36.123373406s" podCreationTimestamp="2026-06-02 04:42:21 +0000 UTC" firstStartedPulling="2026-06-02 04:42:53.523999622 +0000 UTC m=+66.244080673" lastFinishedPulling="2026-06-02 04:42:56.256820059 +0000 UTC m=+68.976901109" observedRunningTime="2026-06-02 04:42:57.122532552 +0000 UTC m=+69.842613627" watchObservedRunningTime="2026-06-02 04:42:57.123373406 +0000 UTC m=+69.843454480" Jun 02 04:42:57.533150 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:42:57.533114 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe93c146_0e91_4c06_91b1_6855da536ab3.slice/crio-ef8f716497fa5ccb1f7637df4273aa8efb3ac750112a90a6332f134a073f5ff5 WatchSource:0}: Error finding container ef8f716497fa5ccb1f7637df4273aa8efb3ac750112a90a6332f134a073f5ff5: Status 404 returned error can't find the container with id ef8f716497fa5ccb1f7637df4273aa8efb3ac750112a90a6332f134a073f5ff5 Jun 02 04:42:57.534116 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:42:57.533903 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5be880_75fb_4806_9d0c_dd7f6cf3fefa.slice/crio-e11ab18c6162e6e1be1bbf4bdda1aa6a5197e1b3aaeec715736516a9d9935e4a WatchSource:0}: Error finding container e11ab18c6162e6e1be1bbf4bdda1aa6a5197e1b3aaeec715736516a9d9935e4a: Status 404 returned error can't find the container with id e11ab18c6162e6e1be1bbf4bdda1aa6a5197e1b3aaeec715736516a9d9935e4a Jun 02 04:42:58.083272 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:58.083179 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-df4cx" event={"ID":"ce169576-918f-475b-b1ba-72aff9e873c4","Type":"ContainerStarted","Data":"2abf7f2ddbc3b2d5b042c2493cd42b310efe3e1011bcbea5ea1750e896ed4acd"} Jun 02 04:42:58.083716 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:58.083346 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:42:58.084368 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:58.084346 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6" event={"ID":"4c5be880-75fb-4806-9d0c-dd7f6cf3fefa","Type":"ContainerStarted","Data":"e11ab18c6162e6e1be1bbf4bdda1aa6a5197e1b3aaeec715736516a9d9935e4a"} Jun 02 04:42:58.085502 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:58.085481 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-wcfss" event={"ID":"be93c146-0e91-4c06-91b1-6855da536ab3","Type":"ContainerStarted","Data":"ef8f716497fa5ccb1f7637df4273aa8efb3ac750112a90a6332f134a073f5ff5"} Jun 02 04:42:58.087313 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:58.087293 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk87q" event={"ID":"f2651074-4525-4878-a539-7449d7e8d27e","Type":"ContainerStarted","Data":"d53f169a5e7e1010ea49b21891018a7d6238552402f8d3a6df1054ea45cecba5"} Jun 02 04:42:58.104608 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:42:58.104562 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-df4cx" podStartSLOduration=67.568223261 podStartE2EDuration="1m11.104522719s" podCreationTimestamp="2026-06-02 04:41:47 +0000 UTC" firstStartedPulling="2026-06-02 04:42:54.046453716 +0000 UTC m=+66.766534778" lastFinishedPulling="2026-06-02 04:42:57.582753186 +0000 UTC m=+70.302834236" observedRunningTime="2026-06-02 04:42:58.103905138 +0000 UTC m=+70.823986211" watchObservedRunningTime="2026-06-02 04:42:58.104522719 +0000 UTC m=+70.824603792" Jun 02 04:43:00.094924 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:00.094882 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nk87q" event={"ID":"f2651074-4525-4878-a539-7449d7e8d27e","Type":"ContainerStarted","Data":"91dd68fb2b00ef823c6b1469d8b7e497c58ca6c4547c0f979f365407a2bd7c91"} Jun 02 04:43:00.096407 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:00.096378 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6" event={"ID":"4c5be880-75fb-4806-9d0c-dd7f6cf3fefa","Type":"ContainerStarted","Data":"764fe729eb377a52b9ce7925dbd28908b369c41fbd5573590cbaa7e46731f93b"} Jun 02 04:43:00.096619 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:00.096592 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6" Jun 02 04:43:00.102436 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:00.102413 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6" Jun 02 04:43:00.124966 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:00.124916 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nk87q" podStartSLOduration=2.405443839 podStartE2EDuration="5.124900527s" podCreationTimestamp="2026-06-02 04:42:55 +0000 UTC" firstStartedPulling="2026-06-02 04:42:56.622644295 +0000 UTC m=+69.342725344" lastFinishedPulling="2026-06-02 04:42:59.34210098 +0000 UTC m=+72.062182032" observedRunningTime="2026-06-02 04:43:00.124031745 +0000 UTC m=+72.844112817" watchObservedRunningTime="2026-06-02 04:43:00.124900527 +0000 UTC m=+72.844981644" Jun 02 04:43:00.169064 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:00.169025 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-klrb6" podStartSLOduration=2.409848457 podStartE2EDuration="4.169013165s" podCreationTimestamp="2026-06-02 04:42:56 +0000 UTC" firstStartedPulling="2026-06-02 04:42:57.535761268 +0000 UTC m=+70.255842317" lastFinishedPulling="2026-06-02 04:42:59.29492597 +0000 UTC m=+72.015007025" observedRunningTime="2026-06-02 04:43:00.167380415 +0000 UTC m=+72.887461487" watchObservedRunningTime="2026-06-02 04:43:00.169013165 +0000 UTC m=+72.889094236" Jun 02 04:43:01.005408 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.005364 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t"] Jun 02 04:43:01.008784 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.008761 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.019771 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.019749 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 04:43:01.019896 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.019755 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 04:43:01.020022 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.019997 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 04:43:01.020287 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.020268 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 04:43:01.022282 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.021939 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wbqb7\"" Jun 02 04:43:01.022282 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.022034 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 04:43:01.027763 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.027737 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t"] Jun 02 04:43:01.122291 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.122264 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d211fd61-1fd1-461d-984d-59f066f785d4-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.122720 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.122301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d211fd61-1fd1-461d-984d-59f066f785d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.122720 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.122332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d211fd61-1fd1-461d-984d-59f066f785d4-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.122720 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.122409 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mkgd\" (UniqueName: \"kubernetes.io/projected/d211fd61-1fd1-461d-984d-59f066f785d4-kube-api-access-8mkgd\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.223786 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.223750 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d211fd61-1fd1-461d-984d-59f066f785d4-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.223961 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.223809 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d211fd61-1fd1-461d-984d-59f066f785d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.223961 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.223888 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d211fd61-1fd1-461d-984d-59f066f785d4-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.223961 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.223936 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mkgd\" (UniqueName: \"kubernetes.io/projected/d211fd61-1fd1-461d-984d-59f066f785d4-kube-api-access-8mkgd\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.224141 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:43:01.224104 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 02 04:43:01.224225 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:43:01.224193 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d211fd61-1fd1-461d-984d-59f066f785d4-prometheus-operator-tls podName:d211fd61-1fd1-461d-984d-59f066f785d4 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:01.724171697 +0000 UTC m=+74.444252755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d211fd61-1fd1-461d-984d-59f066f785d4-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-x4p6t" (UID: "d211fd61-1fd1-461d-984d-59f066f785d4") : secret "prometheus-operator-tls" not found Jun 02 04:43:01.224629 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.224607 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d211fd61-1fd1-461d-984d-59f066f785d4-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.226758 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.226734 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d211fd61-1fd1-461d-984d-59f066f785d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.243185 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.243154 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mkgd\" (UniqueName: \"kubernetes.io/projected/d211fd61-1fd1-461d-984d-59f066f785d4-kube-api-access-8mkgd\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.727837 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.727783 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d211fd61-1fd1-461d-984d-59f066f785d4-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.730420 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.730391 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d211fd61-1fd1-461d-984d-59f066f785d4-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-x4p6t\" (UID: \"d211fd61-1fd1-461d-984d-59f066f785d4\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:01.919703 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:01.919639 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" Jun 02 04:43:02.070989 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:02.070866 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t"] Jun 02 04:43:02.072893 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:43:02.072862 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd211fd61_1fd1_461d_984d_59f066f785d4.slice/crio-817390a0a485047a1ad0f7a714770137d04a00a75d16edca7c098ad29a8ba5b9 WatchSource:0}: Error finding container 817390a0a485047a1ad0f7a714770137d04a00a75d16edca7c098ad29a8ba5b9: Status 404 returned error can't find the container with id 817390a0a485047a1ad0f7a714770137d04a00a75d16edca7c098ad29a8ba5b9 Jun 02 04:43:02.102037 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:02.102005 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" event={"ID":"d211fd61-1fd1-461d-984d-59f066f785d4","Type":"ContainerStarted","Data":"817390a0a485047a1ad0f7a714770137d04a00a75d16edca7c098ad29a8ba5b9"} Jun 02 04:43:04.108675 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:04.108631 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" event={"ID":"d211fd61-1fd1-461d-984d-59f066f785d4","Type":"ContainerStarted","Data":"3a687571e4b9da14742f0cd873c33a177edaf98f19bddcca907e021b86a58303"} Jun 02 04:43:04.109083 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:04.108685 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" event={"ID":"d211fd61-1fd1-461d-984d-59f066f785d4","Type":"ContainerStarted","Data":"7cc84d94c4f1aea499b1e8a3c47227be2d431f24f0ac320111ea721b5e5cc8da"} Jun 02 04:43:04.127331 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:04.127264 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-x4p6t" podStartSLOduration=2.774539169 podStartE2EDuration="4.127250113s" podCreationTimestamp="2026-06-02 04:43:00 +0000 UTC" firstStartedPulling="2026-06-02 04:43:02.074676746 +0000 UTC m=+74.794757796" lastFinishedPulling="2026-06-02 04:43:03.427387672 +0000 UTC m=+76.147468740" observedRunningTime="2026-06-02 04:43:04.1261158 +0000 UTC m=+76.846196872" watchObservedRunningTime="2026-06-02 04:43:04.127250113 +0000 UTC m=+76.847331185" Jun 02 04:43:06.444260 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.444223 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-s8plq"] Jun 02 04:43:06.447629 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.447606 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.450529 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.450508 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 04:43:06.450627 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.450610 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 04:43:06.450694 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.450613 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vd62c\"" Jun 02 04:43:06.460026 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.460004 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-tdm72"] Jun 02 04:43:06.462909 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.462894 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.464866 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.464846 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-s8plq"] Jun 02 04:43:06.465751 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.465730 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 04:43:06.465882 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.465782 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 04:43:06.466039 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.466023 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7v5wc\"" Jun 02 04:43:06.466294 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.466278 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 04:43:06.482561 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.482538 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-tdm72"] Jun 02 04:43:06.518985 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.518965 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-588cz"] Jun 02 04:43:06.522600 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.522576 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.534325 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.534306 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 04:43:06.534933 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.534914 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jmbvm\"" Jun 02 04:43:06.535040 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.534931 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 04:43:06.535200 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.535178 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 04:43:06.566729 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.566703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4dn5\" (UniqueName: \"kubernetes.io/projected/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-api-access-p4dn5\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.566859 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.566746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9kkv\" (UniqueName: \"kubernetes.io/projected/e920252e-386d-49aa-8c66-27b8b6d97455-kube-api-access-p9kkv\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.566859 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.566807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d9a19933-7423-4f1a-981c-ace4e3eef7af-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.566859 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.566825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e920252e-386d-49aa-8c66-27b8b6d97455-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.566859 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.566851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.567076 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.566877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.567076 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.566896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9a19933-7423-4f1a-981c-ace4e3eef7af-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.567076 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.566936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e920252e-386d-49aa-8c66-27b8b6d97455-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.567076 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.566975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e920252e-386d-49aa-8c66-27b8b6d97455-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.567076 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.566994 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.667576 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-textfile\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.667714 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667584 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.667714 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667604 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.667714 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89597f8d-7930-4022-b859-dffd05994f4b-root\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.667817 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89597f8d-7930-4022-b859-dffd05994f4b-metrics-client-ca\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.667817 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667778 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.667817 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667802 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9a19933-7423-4f1a-981c-ace4e3eef7af-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.667961 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667827 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e920252e-386d-49aa-8c66-27b8b6d97455-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.667961 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667878 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e920252e-386d-49aa-8c66-27b8b6d97455-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.667961 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:43:06.667889 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 02 04:43:06.667961 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-tls\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.667961 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:43:06.667940 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-tls podName:d9a19933-7423-4f1a-981c-ace4e3eef7af nodeName:}" failed. No retries permitted until 2026-06-02 04:43:07.167923728 +0000 UTC m=+79.888004778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-tdm72" (UID: "d9a19933-7423-4f1a-981c-ace4e3eef7af") : secret "kube-state-metrics-tls" not found Jun 02 04:43:06.668226 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667962 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.668226 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.667999 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4dn5\" (UniqueName: \"kubernetes.io/projected/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-api-access-p4dn5\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.668226 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.668030 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9kkv\" (UniqueName: \"kubernetes.io/projected/e920252e-386d-49aa-8c66-27b8b6d97455-kube-api-access-p9kkv\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.668226 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.668075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-wtmp\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.668226 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.668112 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d9a19933-7423-4f1a-981c-ace4e3eef7af-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.668226 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.668146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89597f8d-7930-4022-b859-dffd05994f4b-sys\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.668226 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.668183 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-accelerators-collector-config\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.668226 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.668208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv25l\" (UniqueName: \"kubernetes.io/projected/89597f8d-7930-4022-b859-dffd05994f4b-kube-api-access-lv25l\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.668616 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.668244 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e920252e-386d-49aa-8c66-27b8b6d97455-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.668616 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.668552 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e920252e-386d-49aa-8c66-27b8b6d97455-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.668616 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.668590 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d9a19933-7423-4f1a-981c-ace4e3eef7af-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.668757 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.668614 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9a19933-7423-4f1a-981c-ace4e3eef7af-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.668757 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.668637 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.670212 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.670192 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.670607 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.670576 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e920252e-386d-49aa-8c66-27b8b6d97455-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.670607 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.670574 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e920252e-386d-49aa-8c66-27b8b6d97455-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.684253 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.684230 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9kkv\" (UniqueName: \"kubernetes.io/projected/e920252e-386d-49aa-8c66-27b8b6d97455-kube-api-access-p9kkv\") pod \"openshift-state-metrics-85658796db-s8plq\" (UID: \"e920252e-386d-49aa-8c66-27b8b6d97455\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.684253 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.684247 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4dn5\" (UniqueName: \"kubernetes.io/projected/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-api-access-p4dn5\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:06.756024 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.755998 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" Jun 02 04:43:06.768973 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.768949 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-wtmp\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.769088 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.768993 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89597f8d-7930-4022-b859-dffd05994f4b-sys\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.769088 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.769023 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-accelerators-collector-config\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.769088 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.769050 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lv25l\" (UniqueName: \"kubernetes.io/projected/89597f8d-7930-4022-b859-dffd05994f4b-kube-api-access-lv25l\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.769088 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.769083 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-textfile\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.769292 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.769112 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.769292 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.769141 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89597f8d-7930-4022-b859-dffd05994f4b-root\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.769292 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.769166 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89597f8d-7930-4022-b859-dffd05994f4b-metrics-client-ca\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.769292 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.769228 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-tls\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.770288 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.769643 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-wtmp\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.770288 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.769737 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/89597f8d-7930-4022-b859-dffd05994f4b-root\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.770288 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.769873 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-textfile\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.770288 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.769894 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89597f8d-7930-4022-b859-dffd05994f4b-sys\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.770288 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.770246 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89597f8d-7930-4022-b859-dffd05994f4b-metrics-client-ca\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.770288 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.770284 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-accelerators-collector-config\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.771903 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.771881 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-tls\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.772010 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.771955 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/89597f8d-7930-4022-b859-dffd05994f4b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.777581 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.777559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv25l\" (UniqueName: \"kubernetes.io/projected/89597f8d-7930-4022-b859-dffd05994f4b-kube-api-access-lv25l\") pod \"node-exporter-588cz\" (UID: \"89597f8d-7930-4022-b859-dffd05994f4b\") " pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.835045 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.834608 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-588cz" Jun 02 04:43:06.853585 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:43:06.853549 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89597f8d_7930_4022_b859_dffd05994f4b.slice/crio-bf209a91876637072b5ac42a5fbe5074296b365320c1cd0599a78d5ae692ff1e WatchSource:0}: Error finding container bf209a91876637072b5ac42a5fbe5074296b365320c1cd0599a78d5ae692ff1e: Status 404 returned error can't find the container with id bf209a91876637072b5ac42a5fbe5074296b365320c1cd0599a78d5ae692ff1e Jun 02 04:43:06.933303 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:06.933184 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-s8plq"] Jun 02 04:43:06.936144 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:43:06.936109 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode920252e_386d_49aa_8c66_27b8b6d97455.slice/crio-0e06fdb7b93c3fe5fd08c252633b1c373ff234815ec1c20c881e6490d74b59c3 WatchSource:0}: Error finding container 0e06fdb7b93c3fe5fd08c252633b1c373ff234815ec1c20c881e6490d74b59c3: Status 404 returned error can't find the container with id 0e06fdb7b93c3fe5fd08c252633b1c373ff234815ec1c20c881e6490d74b59c3 Jun 02 04:43:07.090819 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:07.090554 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-48x8n" Jun 02 04:43:07.119719 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:07.119689 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-588cz" event={"ID":"89597f8d-7930-4022-b859-dffd05994f4b","Type":"ContainerStarted","Data":"bf209a91876637072b5ac42a5fbe5074296b365320c1cd0599a78d5ae692ff1e"} Jun 02 04:43:07.121252 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:07.121223 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" event={"ID":"e920252e-386d-49aa-8c66-27b8b6d97455","Type":"ContainerStarted","Data":"3ba52f6876854756de88fdbc02c545f2d2d79da53b2bc67e552e339ee47db76e"} Jun 02 04:43:07.121342 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:07.121263 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" event={"ID":"e920252e-386d-49aa-8c66-27b8b6d97455","Type":"ContainerStarted","Data":"0e06fdb7b93c3fe5fd08c252633b1c373ff234815ec1c20c881e6490d74b59c3"} Jun 02 04:43:07.171852 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:07.171826 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:07.174445 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:07.174415 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9a19933-7423-4f1a-981c-ace4e3eef7af-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-tdm72\" (UID: \"d9a19933-7423-4f1a-981c-ace4e3eef7af\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:07.373011 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:07.372930 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" Jun 02 04:43:07.569936 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:07.569883 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-tdm72"] Jun 02 04:43:07.573069 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:43:07.573042 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a19933_7423_4f1a_981c_ace4e3eef7af.slice/crio-00a9b36576644e4fde52ce752de44d0d97ce5b5dc4e0ef1b2f0ca9ad69a640af WatchSource:0}: Error finding container 00a9b36576644e4fde52ce752de44d0d97ce5b5dc4e0ef1b2f0ca9ad69a640af: Status 404 returned error can't find the container with id 00a9b36576644e4fde52ce752de44d0d97ce5b5dc4e0ef1b2f0ca9ad69a640af Jun 02 04:43:08.126126 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.126087 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" event={"ID":"e920252e-386d-49aa-8c66-27b8b6d97455","Type":"ContainerStarted","Data":"7c2daf99df1d65dedaf0ecaabd36393c4f1c03698dc808e775dec47ebbf13cac"} Jun 02 04:43:08.127299 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.127265 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" event={"ID":"d9a19933-7423-4f1a-981c-ace4e3eef7af","Type":"ContainerStarted","Data":"00a9b36576644e4fde52ce752de44d0d97ce5b5dc4e0ef1b2f0ca9ad69a640af"} Jun 02 04:43:08.504357 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.504293 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-575c555849-dmm8q"] Jun 02 04:43:08.508089 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.507918 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.510673 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.510632 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 04:43:08.510796 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.510701 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-464gc\"" Jun 02 04:43:08.510971 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.510954 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 04:43:08.511262 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.511026 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-tjuc11f5evte\"" Jun 02 04:43:08.512434 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.512291 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 04:43:08.513266 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.513243 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 04:43:08.515407 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.515388 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 04:43:08.523351 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.522799 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-575c555849-dmm8q"] Jun 02 04:43:08.582764 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.582736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.583118 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.582796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbd675cb-7425-415d-b59c-b88589c29988-metrics-client-ca\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.583118 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.582900 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.583118 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.582944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.583118 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.583002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srcbf\" (UniqueName: \"kubernetes.io/projected/dbd675cb-7425-415d-b59c-b88589c29988-kube-api-access-srcbf\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.583118 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.583036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-tls\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.583118 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.583062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-grpc-tls\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.583405 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.583119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.684366 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.684326 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.684564 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.684384 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.684564 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.684421 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srcbf\" (UniqueName: \"kubernetes.io/projected/dbd675cb-7425-415d-b59c-b88589c29988-kube-api-access-srcbf\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.684564 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.684449 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-tls\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.684564 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.684484 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-grpc-tls\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.684564 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.684550 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.685046 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.684582 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.685046 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.684617 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbd675cb-7425-415d-b59c-b88589c29988-metrics-client-ca\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.685598 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.685352 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbd675cb-7425-415d-b59c-b88589c29988-metrics-client-ca\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.689297 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.689194 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-grpc-tls\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.689297 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.689250 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-tls\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.690205 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.690158 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.690596 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.690570 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.692370 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.692344 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.693033 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.692988 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dbd675cb-7425-415d-b59c-b88589c29988-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.695530 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.695489 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srcbf\" (UniqueName: \"kubernetes.io/projected/dbd675cb-7425-415d-b59c-b88589c29988-kube-api-access-srcbf\") pod \"thanos-querier-575c555849-dmm8q\" (UID: \"dbd675cb-7425-415d-b59c-b88589c29988\") " pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.826673 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.826559 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:08.980227 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:08.980196 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-575c555849-dmm8q"] Jun 02 04:43:09.132420 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:09.132276 2581 generic.go:358] "Generic (PLEG): container finished" podID="89597f8d-7930-4022-b859-dffd05994f4b" containerID="a6e20b7ccb2835573c9a7f8441b6595ebb6cdee0da4fb3420174d230c3df9a48" exitCode=0 Jun 02 04:43:09.132420 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:09.132359 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-588cz" event={"ID":"89597f8d-7930-4022-b859-dffd05994f4b","Type":"ContainerDied","Data":"a6e20b7ccb2835573c9a7f8441b6595ebb6cdee0da4fb3420174d230c3df9a48"} Jun 02 04:43:09.134842 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:09.134813 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" event={"ID":"e920252e-386d-49aa-8c66-27b8b6d97455","Type":"ContainerStarted","Data":"a39ac72dda7b432262e3ade1287aaf2c937b010e36c849e716fc34244acf7717"} Jun 02 04:43:09.172902 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:09.172633 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-s8plq" podStartSLOduration=1.790935862 podStartE2EDuration="3.172616724s" podCreationTimestamp="2026-06-02 04:43:06 +0000 UTC" firstStartedPulling="2026-06-02 04:43:07.217092565 +0000 UTC m=+79.937173618" lastFinishedPulling="2026-06-02 04:43:08.598773413 +0000 UTC m=+81.318854480" observedRunningTime="2026-06-02 04:43:09.17161614 +0000 UTC m=+81.891697214" watchObservedRunningTime="2026-06-02 04:43:09.172616724 +0000 UTC m=+81.892697797" Jun 02 04:43:09.243837 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:43:09.243794 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd675cb_7425_415d_b59c_b88589c29988.slice/crio-26523eea8d46f7094168c298dce20475316e27a62036ff69bbc29b75ed0c8e85 WatchSource:0}: Error finding container 26523eea8d46f7094168c298dce20475316e27a62036ff69bbc29b75ed0c8e85: Status 404 returned error can't find the container with id 26523eea8d46f7094168c298dce20475316e27a62036ff69bbc29b75ed0c8e85 Jun 02 04:43:10.141088 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.140852 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" event={"ID":"d9a19933-7423-4f1a-981c-ace4e3eef7af","Type":"ContainerStarted","Data":"8dd0b32a651bf078d3c247eaa2afbc532fb7cf6ae655d963fbab3277e9c51c24"} Jun 02 04:43:10.141088 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.140905 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" event={"ID":"d9a19933-7423-4f1a-981c-ace4e3eef7af","Type":"ContainerStarted","Data":"4a7292a1ff28cf93f69ae66c37c5ad3d34d7c689ae0ce2ffa21577ad9013a5ae"} Jun 02 04:43:10.141088 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.140919 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" event={"ID":"d9a19933-7423-4f1a-981c-ace4e3eef7af","Type":"ContainerStarted","Data":"8a8180c2e4be6ac240c51daba9bdf2cf226ba97ffd633bb5d0208b8f028c46ff"} Jun 02 04:43:10.143495 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.143442 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-588cz" event={"ID":"89597f8d-7930-4022-b859-dffd05994f4b","Type":"ContainerStarted","Data":"ca011b37bd48bb507a5619cf316de0862d145479370b16bd81331918cb88896c"} Jun 02 04:43:10.143495 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.143475 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-588cz" event={"ID":"89597f8d-7930-4022-b859-dffd05994f4b","Type":"ContainerStarted","Data":"3a11602d20e9b4ee639a43d1df594a79345e2d45866cfce01b28d25c2d864340"} Jun 02 04:43:10.145044 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.145019 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" event={"ID":"dbd675cb-7425-415d-b59c-b88589c29988","Type":"ContainerStarted","Data":"26523eea8d46f7094168c298dce20475316e27a62036ff69bbc29b75ed0c8e85"} Jun 02 04:43:10.161433 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.161381 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tdm72" podStartSLOduration=2.44155348 podStartE2EDuration="4.161365523s" podCreationTimestamp="2026-06-02 04:43:06 +0000 UTC" firstStartedPulling="2026-06-02 04:43:07.575373303 +0000 UTC m=+80.295454367" lastFinishedPulling="2026-06-02 04:43:09.295185142 +0000 UTC m=+82.015266410" observedRunningTime="2026-06-02 04:43:10.160775612 +0000 UTC m=+82.880856681" watchObservedRunningTime="2026-06-02 04:43:10.161365523 +0000 UTC m=+82.881446598" Jun 02 04:43:10.184480 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.184436 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-588cz" podStartSLOduration=2.78569075 podStartE2EDuration="4.184423437s" podCreationTimestamp="2026-06-02 04:43:06 +0000 UTC" firstStartedPulling="2026-06-02 04:43:06.855698901 +0000 UTC m=+79.575779954" lastFinishedPulling="2026-06-02 04:43:08.254431577 +0000 UTC m=+80.974512641" observedRunningTime="2026-06-02 04:43:10.182395205 +0000 UTC m=+82.902476290" watchObservedRunningTime="2026-06-02 04:43:10.184423437 +0000 UTC m=+82.904504511" Jun 02 04:43:10.898190 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.898154 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b57449cb-z9s56"] Jun 02 04:43:10.901430 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.901408 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:10.903934 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.903912 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 04:43:10.904823 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.904801 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 04:43:10.904932 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.904845 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 04:43:10.904999 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.904845 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3siottqcbsof7\"" Jun 02 04:43:10.905093 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.905077 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 04:43:10.905256 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.905239 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-v9snq\"" Jun 02 04:43:10.911685 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:10.911626 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b57449cb-z9s56"] Jun 02 04:43:11.003353 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.003312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-audit-log\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.003547 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.003368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4kdp\" (UniqueName: \"kubernetes.io/projected/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-kube-api-access-w4kdp\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.003547 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.003452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-secret-metrics-server-client-certs\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.003547 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.003504 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.003547 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.003545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-metrics-server-audit-profiles\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.003777 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.003585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-client-ca-bundle\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.003777 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.003605 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-secret-metrics-server-tls\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.104832 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.104791 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-client-ca-bundle\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.105022 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.104842 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-secret-metrics-server-tls\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.105022 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.104905 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-audit-log\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.105022 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.104942 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4kdp\" (UniqueName: \"kubernetes.io/projected/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-kube-api-access-w4kdp\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.105341 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.105279 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-secret-metrics-server-client-certs\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.105341 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.105328 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.105639 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.105372 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-metrics-server-audit-profiles\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.105639 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.105375 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-audit-log\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.106119 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.106072 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.106449 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.106401 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-metrics-server-audit-profiles\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.107852 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.107830 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-secret-metrics-server-tls\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.107933 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.107921 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-client-ca-bundle\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.108209 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.108189 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-secret-metrics-server-client-certs\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.118528 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.118507 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4kdp\" (UniqueName: \"kubernetes.io/projected/7090b5c9-bb09-42cd-9ef7-d4610deb57a2-kube-api-access-w4kdp\") pod \"metrics-server-7b57449cb-z9s56\" (UID: \"7090b5c9-bb09-42cd-9ef7-d4610deb57a2\") " pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:11.213986 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:11.213906 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:12.725860 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.725815 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:43:12.730295 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.730267 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.733382 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.733356 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 04:43:12.733498 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.733434 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 04:43:12.733498 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.733436 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 04:43:12.733729 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.733709 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 04:43:12.734119 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.734097 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dkk2jhnak3qfh\"" Jun 02 04:43:12.734319 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.734302 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s5964\"" Jun 02 04:43:12.734542 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.734523 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 04:43:12.735413 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.734787 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 04:43:12.735413 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.734974 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 04:43:12.735413 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.735044 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 04:43:12.735413 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.735265 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 04:43:12.737447 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.736127 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 04:43:12.737447 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.736801 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 04:43:12.737447 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.737370 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 04:43:12.753962 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.753919 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:43:12.819448 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819419 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819643 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819475 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819643 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819643 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819643 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819577 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819643 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819939 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819646 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819939 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819694 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-config\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819939 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qclsv\" (UniqueName: \"kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-kube-api-access-qclsv\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819939 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819747 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819939 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819939 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819812 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819939 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819836 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819939 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.819939 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.820379 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.820379 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.819972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.820379 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.820000 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.920933 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.920504 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-config\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.920933 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.920566 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qclsv\" (UniqueName: \"kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-kube-api-access-qclsv\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.920933 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.920599 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.920933 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.920634 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.920933 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.920681 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.920933 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.920712 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921590 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.920735 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921769 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921631 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921769 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921693 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921769 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921720 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921769 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921752 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921986 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921785 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921986 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921805 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921986 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921829 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921986 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921862 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921986 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921888 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921986 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921928 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.921986 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921951 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.922310 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.921987 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.922310 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.922194 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.922412 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.922345 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.923827 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.923459 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.924837 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.924812 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-config\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.925037 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.925016 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.925593 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.925570 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.926118 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.925983 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.926274 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.926045 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.926810 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.926787 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.927308 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.927285 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.927391 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.927350 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.927738 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.927715 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.928008 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.927986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.929521 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.929478 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.930785 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.930698 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.931002 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.930979 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:12.934461 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:12.934443 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qclsv\" (UniqueName: \"kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-kube-api-access-qclsv\") pod \"prometheus-k8s-0\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:13.045610 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:13.045491 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:16.080101 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:16.080072 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:43:17.607336 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:17.607286 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b57449cb-z9s56"] Jun 02 04:43:17.609467 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:43:17.609435 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7090b5c9_bb09_42cd_9ef7_d4610deb57a2.slice/crio-69dcab3a08bd664b5df2c276ffc0f9ebed7d416a75359dd8d5b73294defe90c3 WatchSource:0}: Error finding container 69dcab3a08bd664b5df2c276ffc0f9ebed7d416a75359dd8d5b73294defe90c3: Status 404 returned error can't find the container with id 69dcab3a08bd664b5df2c276ffc0f9ebed7d416a75359dd8d5b73294defe90c3 Jun 02 04:43:17.643103 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:17.643065 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:43:17.648483 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:43:17.648454 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37580a5b_c316_429d_81bd_8218dd54b9f4.slice/crio-6cad11091f3e5d72fe2cec6ed1a323ae597df5b11ccb29f17b9046e5242d8bec WatchSource:0}: Error finding container 6cad11091f3e5d72fe2cec6ed1a323ae597df5b11ccb29f17b9046e5242d8bec: Status 404 returned error can't find the container with id 6cad11091f3e5d72fe2cec6ed1a323ae597df5b11ccb29f17b9046e5242d8bec Jun 02 04:43:18.179248 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:18.179179 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" event={"ID":"7090b5c9-bb09-42cd-9ef7-d4610deb57a2","Type":"ContainerStarted","Data":"69dcab3a08bd664b5df2c276ffc0f9ebed7d416a75359dd8d5b73294defe90c3"} Jun 02 04:43:18.186309 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:18.186271 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" event={"ID":"dbd675cb-7425-415d-b59c-b88589c29988","Type":"ContainerStarted","Data":"2e75a796f38462b7562f6ce4d0d0d4c4274442e391b83b50bc3983094704f5f8"} Jun 02 04:43:18.186488 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:18.186323 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" event={"ID":"dbd675cb-7425-415d-b59c-b88589c29988","Type":"ContainerStarted","Data":"a0039ab598c26081ef19a3936a89d9c0b6ff6666028eb1766e3bb18098db170e"} Jun 02 04:43:18.186488 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:18.186341 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" event={"ID":"dbd675cb-7425-415d-b59c-b88589c29988","Type":"ContainerStarted","Data":"3419a255b2ba638c94246683d5a199bc3e28d20f66dab9385cd90c0306268f23"} Jun 02 04:43:18.188789 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:18.188759 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-wcfss" event={"ID":"be93c146-0e91-4c06-91b1-6855da536ab3","Type":"ContainerStarted","Data":"3fc0531a3eb236140dc2f638edbb0cf4618290652d6cfe522b029eefc7e234f7"} Jun 02 04:43:18.189180 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:18.189133 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-wcfss" Jun 02 04:43:18.191700 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:18.191671 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerStarted","Data":"6cad11091f3e5d72fe2cec6ed1a323ae597df5b11ccb29f17b9046e5242d8bec"} Jun 02 04:43:18.198429 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:18.198391 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-wcfss" Jun 02 04:43:18.208527 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:18.208474 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-wcfss" podStartSLOduration=2.224958595 podStartE2EDuration="22.208457594s" podCreationTimestamp="2026-06-02 04:42:56 +0000 UTC" firstStartedPulling="2026-06-02 04:42:57.535175037 +0000 UTC m=+70.255256086" lastFinishedPulling="2026-06-02 04:43:17.518674021 +0000 UTC m=+90.238755085" observedRunningTime="2026-06-02 04:43:18.206786968 +0000 UTC m=+90.926868035" watchObservedRunningTime="2026-06-02 04:43:18.208457594 +0000 UTC m=+90.928538668" Jun 02 04:43:21.096784 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.096739 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" podUID="76a6b3b4-8439-4363-b7dd-8824b67eab69" containerName="registry" containerID="cri-o://c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0" gracePeriod=30 Jun 02 04:43:21.205818 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.205719 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" event={"ID":"dbd675cb-7425-415d-b59c-b88589c29988","Type":"ContainerStarted","Data":"9c42d722618c188dd8448b65023b4afb7886eb5e9eac0388a7c345d1ff767adb"} Jun 02 04:43:21.205818 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.205781 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" event={"ID":"dbd675cb-7425-415d-b59c-b88589c29988","Type":"ContainerStarted","Data":"ca6dbe4138d89750596d2151e96737e1e720d5217f3c119917dc78588ad2a34b"} Jun 02 04:43:21.205818 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.205795 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" event={"ID":"dbd675cb-7425-415d-b59c-b88589c29988","Type":"ContainerStarted","Data":"efc7835323cc71284e059ddc6f0d9473ac6693965ded53cedcc29c79a295bd50"} Jun 02 04:43:21.206115 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.206016 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:21.207731 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.207702 2581 generic.go:358] "Generic (PLEG): container finished" podID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerID="45767dc3f4ea8391a839be53180c48b843a53370afa670fba7f2f070ba0ec0e5" exitCode=0 Jun 02 04:43:21.207875 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.207767 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerDied","Data":"45767dc3f4ea8391a839be53180c48b843a53370afa670fba7f2f070ba0ec0e5"} Jun 02 04:43:21.209904 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.209789 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" event={"ID":"7090b5c9-bb09-42cd-9ef7-d4610deb57a2","Type":"ContainerStarted","Data":"6365cac09a7d12f37039d9a07facf41941befa61c1cdd471a19fb4cf1dabd440"} Jun 02 04:43:21.238370 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.238314 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" podStartSLOduration=2.216005563 podStartE2EDuration="13.23829576s" podCreationTimestamp="2026-06-02 04:43:08 +0000 UTC" firstStartedPulling="2026-06-02 04:43:09.246067785 +0000 UTC m=+81.966148838" lastFinishedPulling="2026-06-02 04:43:20.268357985 +0000 UTC m=+92.988439035" observedRunningTime="2026-06-02 04:43:21.235996245 +0000 UTC m=+93.956077341" watchObservedRunningTime="2026-06-02 04:43:21.23829576 +0000 UTC m=+93.958376832" Jun 02 04:43:21.259392 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.259331 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" podStartSLOduration=8.599778531 podStartE2EDuration="11.259311311s" podCreationTimestamp="2026-06-02 04:43:10 +0000 UTC" firstStartedPulling="2026-06-02 04:43:17.611822867 +0000 UTC m=+90.331903917" lastFinishedPulling="2026-06-02 04:43:20.271355633 +0000 UTC m=+92.991436697" observedRunningTime="2026-06-02 04:43:21.257291506 +0000 UTC m=+93.977372579" watchObservedRunningTime="2026-06-02 04:43:21.259311311 +0000 UTC m=+93.979392383" Jun 02 04:43:21.386819 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.386795 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:43:21.511364 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.511326 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-installation-pull-secrets\") pod \"76a6b3b4-8439-4363-b7dd-8824b67eab69\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " Jun 02 04:43:21.511572 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.511371 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls\") pod \"76a6b3b4-8439-4363-b7dd-8824b67eab69\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " Jun 02 04:43:21.511572 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.511404 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76a6b3b4-8439-4363-b7dd-8824b67eab69-ca-trust-extracted\") pod \"76a6b3b4-8439-4363-b7dd-8824b67eab69\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " Jun 02 04:43:21.511572 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.511475 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvktz\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-kube-api-access-bvktz\") pod \"76a6b3b4-8439-4363-b7dd-8824b67eab69\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " Jun 02 04:43:21.511572 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.511527 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-bound-sa-token\") pod \"76a6b3b4-8439-4363-b7dd-8824b67eab69\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " Jun 02 04:43:21.511572 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.511551 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-trusted-ca\") pod \"76a6b3b4-8439-4363-b7dd-8824b67eab69\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " Jun 02 04:43:21.511858 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.511584 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-certificates\") pod \"76a6b3b4-8439-4363-b7dd-8824b67eab69\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " Jun 02 04:43:21.511858 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.511625 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-image-registry-private-configuration\") pod \"76a6b3b4-8439-4363-b7dd-8824b67eab69\" (UID: \"76a6b3b4-8439-4363-b7dd-8824b67eab69\") " Jun 02 04:43:21.512322 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.512026 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "76a6b3b4-8439-4363-b7dd-8824b67eab69" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:43:21.512589 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.512540 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "76a6b3b4-8439-4363-b7dd-8824b67eab69" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:43:21.515853 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.515179 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "76a6b3b4-8439-4363-b7dd-8824b67eab69" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:43:21.515853 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.515200 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "76a6b3b4-8439-4363-b7dd-8824b67eab69" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:43:21.516600 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.516561 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-kube-api-access-bvktz" (OuterVolumeSpecName: "kube-api-access-bvktz") pod "76a6b3b4-8439-4363-b7dd-8824b67eab69" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69"). InnerVolumeSpecName "kube-api-access-bvktz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:43:21.516763 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.516636 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "76a6b3b4-8439-4363-b7dd-8824b67eab69" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:43:21.516875 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.516850 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "76a6b3b4-8439-4363-b7dd-8824b67eab69" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:43:21.523677 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.523640 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a6b3b4-8439-4363-b7dd-8824b67eab69-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "76a6b3b4-8439-4363-b7dd-8824b67eab69" (UID: "76a6b3b4-8439-4363-b7dd-8824b67eab69"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:43:21.612799 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.612761 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvktz\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-kube-api-access-bvktz\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:43:21.612799 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.612797 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-bound-sa-token\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:43:21.613007 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.612811 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-trusted-ca\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:43:21.613007 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.612824 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-certificates\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:43:21.613007 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.612838 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-image-registry-private-configuration\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:43:21.613007 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.612853 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76a6b3b4-8439-4363-b7dd-8824b67eab69-installation-pull-secrets\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:43:21.613007 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.612865 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76a6b3b4-8439-4363-b7dd-8824b67eab69-registry-tls\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:43:21.613007 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:21.612877 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76a6b3b4-8439-4363-b7dd-8824b67eab69-ca-trust-extracted\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:43:22.216085 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:22.216039 2581 generic.go:358] "Generic (PLEG): container finished" podID="76a6b3b4-8439-4363-b7dd-8824b67eab69" containerID="c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0" exitCode=0 Jun 02 04:43:22.216713 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:22.216132 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" Jun 02 04:43:22.216713 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:22.216207 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" event={"ID":"76a6b3b4-8439-4363-b7dd-8824b67eab69","Type":"ContainerDied","Data":"c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0"} Jun 02 04:43:22.216713 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:22.216239 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8468664c8c-j92jc" event={"ID":"76a6b3b4-8439-4363-b7dd-8824b67eab69","Type":"ContainerDied","Data":"3dbbd84dba0618199223bdf7bed0c3c91f15cb7fe2a09770b3d56853281f44d5"} Jun 02 04:43:22.216713 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:22.216255 2581 scope.go:117] "RemoveContainer" containerID="c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0" Jun 02 04:43:22.225483 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:22.225458 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-575c555849-dmm8q" Jun 02 04:43:22.231632 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:22.231609 2581 scope.go:117] "RemoveContainer" containerID="c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0" Jun 02 04:43:22.232113 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:43:22.232073 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0\": container with ID starting with c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0 not found: ID does not exist" containerID="c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0" Jun 02 04:43:22.232241 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:22.232121 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0"} err="failed to get container status \"c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0\": rpc error: code = NotFound desc = could not find container \"c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0\": container with ID starting with c0dbb41bd8cf6ef6b12a438719bd9307ef2dd73b0ede1c2a90e93e0dbfe41ed0 not found: ID does not exist" Jun 02 04:43:22.238754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:22.238726 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8468664c8c-j92jc"] Jun 02 04:43:22.244761 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:22.244728 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8468664c8c-j92jc"] Jun 02 04:43:23.735171 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:23.735128 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76a6b3b4-8439-4363-b7dd-8824b67eab69" path="/var/lib/kubelet/pods/76a6b3b4-8439-4363-b7dd-8824b67eab69/volumes" Jun 02 04:43:25.231801 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:25.231762 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerStarted","Data":"0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb"} Jun 02 04:43:25.232166 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:25.231808 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerStarted","Data":"1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee"} Jun 02 04:43:26.238740 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:26.238702 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerStarted","Data":"6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db"} Jun 02 04:43:26.239156 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:26.238748 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerStarted","Data":"0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7"} Jun 02 04:43:26.239156 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:26.238763 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerStarted","Data":"fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233"} Jun 02 04:43:26.239156 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:26.238774 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerStarted","Data":"7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f"} Jun 02 04:43:26.273089 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:26.273025 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.99615685 podStartE2EDuration="14.273005547s" podCreationTimestamp="2026-06-02 04:43:12 +0000 UTC" firstStartedPulling="2026-06-02 04:43:17.655176382 +0000 UTC m=+90.375257431" lastFinishedPulling="2026-06-02 04:43:24.932025074 +0000 UTC m=+97.652106128" observedRunningTime="2026-06-02 04:43:26.270960128 +0000 UTC m=+98.991041224" watchObservedRunningTime="2026-06-02 04:43:26.273005547 +0000 UTC m=+98.993086618" Jun 02 04:43:28.046267 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:28.046234 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:43:29.092556 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:29.092525 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-df4cx" Jun 02 04:43:31.214862 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:31.214825 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:31.214862 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:31.214873 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:51.220146 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:51.220117 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:43:51.224092 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:43:51.224069 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b57449cb-z9s56" Jun 02 04:44:13.046414 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:13.046369 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:13.065101 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:13.065069 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:13.384244 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:13.384173 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:31.153220 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.153186 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:44:31.153752 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.153598 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="prometheus" containerID="cri-o://1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee" gracePeriod=600 Jun 02 04:44:31.153752 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.153623 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy" containerID="cri-o://0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7" gracePeriod=600 Jun 02 04:44:31.153752 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.153697 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="thanos-sidecar" containerID="cri-o://7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f" gracePeriod=600 Jun 02 04:44:31.153752 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.153669 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db" gracePeriod=600 Jun 02 04:44:31.153991 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.153740 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="config-reloader" containerID="cri-o://0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb" gracePeriod=600 Jun 02 04:44:31.153991 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.153788 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy-web" containerID="cri-o://fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233" gracePeriod=600 Jun 02 04:44:31.423638 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.423558 2581 generic.go:358] "Generic (PLEG): container finished" podID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerID="6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db" exitCode=0 Jun 02 04:44:31.423638 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.423582 2581 generic.go:358] "Generic (PLEG): container finished" podID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerID="0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7" exitCode=0 Jun 02 04:44:31.423638 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.423588 2581 generic.go:358] "Generic (PLEG): container finished" podID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerID="7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f" exitCode=0 Jun 02 04:44:31.423638 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.423593 2581 generic.go:358] "Generic (PLEG): container finished" podID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerID="0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb" exitCode=0 Jun 02 04:44:31.423638 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.423599 2581 generic.go:358] "Generic (PLEG): container finished" podID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerID="1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee" exitCode=0 Jun 02 04:44:31.423909 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.423637 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerDied","Data":"6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db"} Jun 02 04:44:31.423909 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.423685 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerDied","Data":"0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7"} Jun 02 04:44:31.423909 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.423697 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerDied","Data":"7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f"} Jun 02 04:44:31.423909 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.423706 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerDied","Data":"0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb"} Jun 02 04:44:31.423909 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:31.423715 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerDied","Data":"1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee"} Jun 02 04:44:32.403848 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.403829 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.432496 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.432465 2581 generic.go:358] "Generic (PLEG): container finished" podID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerID="fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233" exitCode=0 Jun 02 04:44:32.432754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.432574 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerDied","Data":"fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233"} Jun 02 04:44:32.432754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.432606 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37580a5b-c316-429d-81bd-8218dd54b9f4","Type":"ContainerDied","Data":"6cad11091f3e5d72fe2cec6ed1a323ae597df5b11ccb29f17b9046e5242d8bec"} Jun 02 04:44:32.432754 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.432626 2581 scope.go:117] "RemoveContainer" containerID="6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db" Jun 02 04:44:32.432942 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.432802 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.445305 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.445279 2581 scope.go:117] "RemoveContainer" containerID="0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7" Jun 02 04:44:32.454118 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.454077 2581 scope.go:117] "RemoveContainer" containerID="fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233" Jun 02 04:44:32.460677 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.460644 2581 scope.go:117] "RemoveContainer" containerID="7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f" Jun 02 04:44:32.467466 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.467443 2581 scope.go:117] "RemoveContainer" containerID="0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb" Jun 02 04:44:32.475285 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.475266 2581 scope.go:117] "RemoveContainer" containerID="1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee" Jun 02 04:44:32.482276 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.482258 2581 scope.go:117] "RemoveContainer" containerID="45767dc3f4ea8391a839be53180c48b843a53370afa670fba7f2f070ba0ec0e5" Jun 02 04:44:32.485354 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485330 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-trusted-ca-bundle\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485467 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485384 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-config\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485528 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485498 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-metrics-client-certs\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485577 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485530 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-grpc-tls\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485627 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485572 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-tls\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485627 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485606 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485752 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485634 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-thanos-prometheus-http-client-file\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485752 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485680 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-metrics-client-ca\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485752 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485726 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-kubelet-serving-ca-bundle\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485752 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485737 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:44:32.485946 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485756 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485946 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485786 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-tls-assets\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485946 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485821 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-kube-rbac-proxy\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485946 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485852 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-web-config\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485946 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485885 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-config-out\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485946 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485918 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-db\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.485946 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485944 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qclsv\" (UniqueName: \"kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-kube-api-access-qclsv\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.486307 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.485977 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-serving-certs-ca-bundle\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.486307 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.486020 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-rulefiles-0\") pod \"37580a5b-c316-429d-81bd-8218dd54b9f4\" (UID: \"37580a5b-c316-429d-81bd-8218dd54b9f4\") " Jun 02 04:44:32.487929 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.486727 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:44:32.487929 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.486858 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:44:32.488400 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.488167 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:44:32.488567 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.488541 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:44:32.488732 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.488709 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:44:32.488828 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.488798 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:44:32.490711 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.489671 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:44:32.490711 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.490024 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:44:32.490850 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.490735 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-config" (OuterVolumeSpecName: "config") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:44:32.491719 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.491219 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:44:32.491719 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.491246 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:44:32.491851 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.491803 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-kube-api-access-qclsv" (OuterVolumeSpecName: "kube-api-access-qclsv") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "kube-api-access-qclsv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:44:32.491851 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.491827 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-config-out" (OuterVolumeSpecName: "config-out") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:44:32.491933 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.491842 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:44:32.492339 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.492311 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:44:32.492522 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.492505 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:44:32.493641 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.493626 2581 scope.go:117] "RemoveContainer" containerID="6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db" Jun 02 04:44:32.494029 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:44:32.494012 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db\": container with ID starting with 6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db not found: ID does not exist" containerID="6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db" Jun 02 04:44:32.494073 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.494037 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db"} err="failed to get container status \"6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db\": rpc error: code = NotFound desc = could not find container \"6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db\": container with ID starting with 6ec1900cbf722e9ab039c87b76b4cd291cdcf2772a54429bd1d300cee40451db not found: ID does not exist" Jun 02 04:44:32.494073 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.494056 2581 scope.go:117] "RemoveContainer" containerID="0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7" Jun 02 04:44:32.494344 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:44:32.494319 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7\": container with ID starting with 0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7 not found: ID does not exist" containerID="0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7" Jun 02 04:44:32.494457 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.494352 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7"} err="failed to get container status \"0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7\": rpc error: code = NotFound desc = could not find container \"0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7\": container with ID starting with 0a2c7d2523b6082f8560b955591a82778f93bb4546052ccbbeec35bdc2678fb7 not found: ID does not exist" Jun 02 04:44:32.494457 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.494376 2581 scope.go:117] "RemoveContainer" containerID="fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233" Jun 02 04:44:32.494737 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:44:32.494700 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233\": container with ID starting with fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233 not found: ID does not exist" containerID="fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233" Jun 02 04:44:32.494822 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.494743 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233"} err="failed to get container status \"fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233\": rpc error: code = NotFound desc = could not find container \"fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233\": container with ID starting with fcede912b39bf2a510f65b205e2ea1d985ef24783fb619b92134ec79fbbbd233 not found: ID does not exist" Jun 02 04:44:32.494822 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.494768 2581 scope.go:117] "RemoveContainer" containerID="7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f" Jun 02 04:44:32.495229 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:44:32.495204 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f\": container with ID starting with 7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f not found: ID does not exist" containerID="7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f" Jun 02 04:44:32.495333 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.495236 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f"} err="failed to get container status \"7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f\": rpc error: code = NotFound desc = could not find container \"7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f\": container with ID starting with 7372303f4d19dbecd741ba961a54b86462fc2427cadd825e1882bf11d8b8340f not found: ID does not exist" Jun 02 04:44:32.495333 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.495279 2581 scope.go:117] "RemoveContainer" containerID="0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb" Jun 02 04:44:32.495595 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:44:32.495569 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb\": container with ID starting with 0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb not found: ID does not exist" containerID="0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb" Jun 02 04:44:32.495595 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.495602 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb"} err="failed to get container status \"0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb\": rpc error: code = NotFound desc = could not find container \"0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb\": container with ID starting with 0073641b004dedd8c7f3fd90c6ff8ff9d50c20b30d0e84940386a2cd2f5c71cb not found: ID does not exist" Jun 02 04:44:32.495780 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.495623 2581 scope.go:117] "RemoveContainer" containerID="1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee" Jun 02 04:44:32.495889 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:44:32.495868 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee\": container with ID starting with 1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee not found: ID does not exist" containerID="1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee" Jun 02 04:44:32.495947 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.495894 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee"} err="failed to get container status \"1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee\": rpc error: code = NotFound desc = could not find container \"1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee\": container with ID starting with 1daae569f0848e8eaf9e44da9eedd7d12f1e27b6abc2bf24d137eec295aa60ee not found: ID does not exist" Jun 02 04:44:32.495947 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.495912 2581 scope.go:117] "RemoveContainer" containerID="45767dc3f4ea8391a839be53180c48b843a53370afa670fba7f2f070ba0ec0e5" Jun 02 04:44:32.496167 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:44:32.496148 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45767dc3f4ea8391a839be53180c48b843a53370afa670fba7f2f070ba0ec0e5\": container with ID starting with 45767dc3f4ea8391a839be53180c48b843a53370afa670fba7f2f070ba0ec0e5 not found: ID does not exist" containerID="45767dc3f4ea8391a839be53180c48b843a53370afa670fba7f2f070ba0ec0e5" Jun 02 04:44:32.496228 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.496171 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45767dc3f4ea8391a839be53180c48b843a53370afa670fba7f2f070ba0ec0e5"} err="failed to get container status \"45767dc3f4ea8391a839be53180c48b843a53370afa670fba7f2f070ba0ec0e5\": rpc error: code = NotFound desc = could not find container \"45767dc3f4ea8391a839be53180c48b843a53370afa670fba7f2f070ba0ec0e5\": container with ID starting with 45767dc3f4ea8391a839be53180c48b843a53370afa670fba7f2f070ba0ec0e5 not found: ID does not exist" Jun 02 04:44:32.502851 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.502829 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-web-config" (OuterVolumeSpecName: "web-config") pod "37580a5b-c316-429d-81bd-8218dd54b9f4" (UID: "37580a5b-c316-429d-81bd-8218dd54b9f4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:44:32.587531 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587497 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-kube-rbac-proxy\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587531 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587525 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-web-config\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587531 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587539 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-config-out\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587547 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-db\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587557 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qclsv\" (UniqueName: \"kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-kube-api-access-qclsv\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587568 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587577 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587586 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587595 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-config\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587603 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-metrics-client-certs\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587611 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-grpc-tls\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587620 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587629 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587638 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587646 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-metrics-client-ca\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587675 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37580a5b-c316-429d-81bd-8218dd54b9f4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587693 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37580a5b-c316-429d-81bd-8218dd54b9f4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.587782 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.587703 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37580a5b-c316-429d-81bd-8218dd54b9f4-tls-assets\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:44:32.755772 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.755744 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:44:32.761060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.761038 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:44:32.785643 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785613 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:44:32.785927 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785912 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="prometheus" Jun 02 04:44:32.785927 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785928 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="prometheus" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785938 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="init-config-reloader" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785944 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="init-config-reloader" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785952 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="config-reloader" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785958 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="config-reloader" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785965 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="thanos-sidecar" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785969 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="thanos-sidecar" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785976 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a6b3b4-8439-4363-b7dd-8824b67eab69" containerName="registry" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785982 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a6b3b4-8439-4363-b7dd-8824b67eab69" containerName="registry" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785994 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy-web" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.785999 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy-web" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.786004 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.786009 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.786015 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy-thanos" Jun 02 04:44:32.786029 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.786020 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy-thanos" Jun 02 04:44:32.786580 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.786064 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="76a6b3b4-8439-4363-b7dd-8824b67eab69" containerName="registry" Jun 02 04:44:32.786580 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.786073 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="thanos-sidecar" Jun 02 04:44:32.786580 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.786079 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy" Jun 02 04:44:32.786580 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.786085 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy-thanos" Jun 02 04:44:32.786580 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.786091 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="prometheus" Jun 02 04:44:32.786580 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.786097 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="config-reloader" Jun 02 04:44:32.786580 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.786102 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" containerName="kube-rbac-proxy-web" Jun 02 04:44:32.789598 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.789578 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.792525 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.792504 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 04:44:32.792641 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.792579 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 04:44:32.792857 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.792838 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 04:44:32.792981 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.792872 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 04:44:32.792981 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.792967 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s5964\"" Jun 02 04:44:32.793140 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.792998 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 04:44:32.793140 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.793032 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 04:44:32.793140 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.793046 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 04:44:32.793140 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.792967 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 04:44:32.793482 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.793468 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dkk2jhnak3qfh\"" Jun 02 04:44:32.793768 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.793754 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 04:44:32.793891 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.793869 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 04:44:32.796863 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.795729 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 04:44:32.799264 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.799247 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 04:44:32.802156 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.802138 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:44:32.891189 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891155 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891189 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891190 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891385 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891385 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f79a982-9e69-4205-8a67-a633e381f3be-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891385 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891385 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891385 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891385 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f79a982-9e69-4205-8a67-a633e381f3be-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891403 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f79a982-9e69-4205-8a67-a633e381f3be-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcgdm\" (UniqueName: \"kubernetes.io/projected/8f79a982-9e69-4205-8a67-a633e381f3be-kube-api-access-gcgdm\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-config\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891764 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891764 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891593 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891764 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.891764 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.891703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992612 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992522 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992612 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992571 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992612 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992598 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f79a982-9e69-4205-8a67-a633e381f3be-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992896 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992624 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992896 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992641 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f79a982-9e69-4205-8a67-a633e381f3be-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992896 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992683 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992896 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992735 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992896 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992758 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgdm\" (UniqueName: \"kubernetes.io/projected/8f79a982-9e69-4205-8a67-a633e381f3be-kube-api-access-gcgdm\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992896 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992782 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-config\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992896 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992807 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992896 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992834 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992896 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992861 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.992896 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992896 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.993396 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992924 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.993396 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992955 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.993396 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.992981 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.993396 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.993010 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f79a982-9e69-4205-8a67-a633e381f3be-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.993396 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.993057 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.993396 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.993163 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8f79a982-9e69-4205-8a67-a633e381f3be-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.993795 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.993771 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.993870 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.993777 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.995978 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.995829 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.995978 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.995856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.995978 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.995907 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-config\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.995978 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.995975 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-web-config\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.996925 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.996037 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.996925 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.996438 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f79a982-9e69-4205-8a67-a633e381f3be-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.996925 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.996487 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.996925 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.996497 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.996925 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.996561 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.996925 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.996598 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.997968 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.997945 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f79a982-9e69-4205-8a67-a633e381f3be-config-out\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.998150 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.998133 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.998578 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.998558 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f79a982-9e69-4205-8a67-a633e381f3be-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:32.998959 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:32.998944 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8f79a982-9e69-4205-8a67-a633e381f3be-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:33.001989 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:33.001966 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgdm\" (UniqueName: \"kubernetes.io/projected/8f79a982-9e69-4205-8a67-a633e381f3be-kube-api-access-gcgdm\") pod \"prometheus-k8s-0\" (UID: \"8f79a982-9e69-4205-8a67-a633e381f3be\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:33.102463 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:33.102427 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:44:33.238334 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:33.238309 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:44:33.240357 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:44:33.240330 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f79a982_9e69_4205_8a67_a633e381f3be.slice/crio-3dc581575cbd80de8043cbbb6a96cb6099375fbf8a76f8ea5dcb935f1c107fbc WatchSource:0}: Error finding container 3dc581575cbd80de8043cbbb6a96cb6099375fbf8a76f8ea5dcb935f1c107fbc: Status 404 returned error can't find the container with id 3dc581575cbd80de8043cbbb6a96cb6099375fbf8a76f8ea5dcb935f1c107fbc Jun 02 04:44:33.436709 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:33.436675 2581 generic.go:358] "Generic (PLEG): container finished" podID="8f79a982-9e69-4205-8a67-a633e381f3be" containerID="747c273ad4f683e68350cd1d01b075dd8cf0d70c4ded062fadb84e39871746ca" exitCode=0 Jun 02 04:44:33.437129 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:33.436764 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f79a982-9e69-4205-8a67-a633e381f3be","Type":"ContainerDied","Data":"747c273ad4f683e68350cd1d01b075dd8cf0d70c4ded062fadb84e39871746ca"} Jun 02 04:44:33.437129 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:33.436799 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f79a982-9e69-4205-8a67-a633e381f3be","Type":"ContainerStarted","Data":"3dc581575cbd80de8043cbbb6a96cb6099375fbf8a76f8ea5dcb935f1c107fbc"} Jun 02 04:44:33.732878 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:33.732854 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37580a5b-c316-429d-81bd-8218dd54b9f4" path="/var/lib/kubelet/pods/37580a5b-c316-429d-81bd-8218dd54b9f4/volumes" Jun 02 04:44:34.442816 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:34.442783 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f79a982-9e69-4205-8a67-a633e381f3be","Type":"ContainerStarted","Data":"e7856b8e59bab5548cd91a61abf40168409847d779b06c7b6dd1ef2911bdad7f"} Jun 02 04:44:34.442816 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:34.442818 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f79a982-9e69-4205-8a67-a633e381f3be","Type":"ContainerStarted","Data":"8f146f64ffd0874309cb0b17b37edc004a2021091edd08343bd5a3b5a3d80ca8"} Jun 02 04:44:34.443234 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:34.442828 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f79a982-9e69-4205-8a67-a633e381f3be","Type":"ContainerStarted","Data":"90a84a6e79d46aa1fcd07608406ffe3b7815a84c7485e42a27a2f9d10acce72d"} Jun 02 04:44:34.443234 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:34.442836 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f79a982-9e69-4205-8a67-a633e381f3be","Type":"ContainerStarted","Data":"60535b5e3985d250d3dd010d465bbe40cad784ac8e053ac07d0ceff01e6b4301"} Jun 02 04:44:34.443234 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:34.442844 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f79a982-9e69-4205-8a67-a633e381f3be","Type":"ContainerStarted","Data":"8ebfa0b253e36b891e55b2f67b2c236418e2d65c9ab709a4bd6bdc26f95efb19"} Jun 02 04:44:34.443234 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:34.442853 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8f79a982-9e69-4205-8a67-a633e381f3be","Type":"ContainerStarted","Data":"bda3c5970295b496eee35566bfd20638fe998dc23624ed07de7d3dd5e4596490"} Jun 02 04:44:34.474678 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:34.474620 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.474607229 podStartE2EDuration="2.474607229s" podCreationTimestamp="2026-06-02 04:44:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:44:34.47334169 +0000 UTC m=+167.193422774" watchObservedRunningTime="2026-06-02 04:44:34.474607229 +0000 UTC m=+167.194688302" Jun 02 04:44:38.103550 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:44:38.103511 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:33.103531 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:45:33.103496 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:33.118683 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:45:33.118643 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:33.627644 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:45:33.627619 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:46:08.312024 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.311980 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-h58ld"] Jun 02 04:46:08.315192 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.315172 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" Jun 02 04:46:08.317839 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.317819 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 04:46:08.317938 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.317849 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 04:46:08.318545 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.318527 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xwpct\"" Jun 02 04:46:08.325309 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.325288 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-h58ld"] Jun 02 04:46:08.415854 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.415830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/282c8a1c-f6f7-40a9-8244-d6ecf3f84487-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-h58ld\" (UID: \"282c8a1c-f6f7-40a9-8244-d6ecf3f84487\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" Jun 02 04:46:08.415963 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.415873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4l49\" (UniqueName: \"kubernetes.io/projected/282c8a1c-f6f7-40a9-8244-d6ecf3f84487-kube-api-access-x4l49\") pod \"cert-manager-webhook-587ccfb98-h58ld\" (UID: \"282c8a1c-f6f7-40a9-8244-d6ecf3f84487\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" Jun 02 04:46:08.517060 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.517021 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4l49\" (UniqueName: \"kubernetes.io/projected/282c8a1c-f6f7-40a9-8244-d6ecf3f84487-kube-api-access-x4l49\") pod \"cert-manager-webhook-587ccfb98-h58ld\" (UID: \"282c8a1c-f6f7-40a9-8244-d6ecf3f84487\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" Jun 02 04:46:08.517190 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.517122 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/282c8a1c-f6f7-40a9-8244-d6ecf3f84487-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-h58ld\" (UID: \"282c8a1c-f6f7-40a9-8244-d6ecf3f84487\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" Jun 02 04:46:08.526376 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.526340 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/282c8a1c-f6f7-40a9-8244-d6ecf3f84487-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-h58ld\" (UID: \"282c8a1c-f6f7-40a9-8244-d6ecf3f84487\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" Jun 02 04:46:08.526546 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.526529 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4l49\" (UniqueName: \"kubernetes.io/projected/282c8a1c-f6f7-40a9-8244-d6ecf3f84487-kube-api-access-x4l49\") pod \"cert-manager-webhook-587ccfb98-h58ld\" (UID: \"282c8a1c-f6f7-40a9-8244-d6ecf3f84487\") " pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" Jun 02 04:46:08.633375 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.633302 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" Jun 02 04:46:08.757714 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:08.757691 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-h58ld"] Jun 02 04:46:08.760378 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:46:08.760355 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod282c8a1c_f6f7_40a9_8244_d6ecf3f84487.slice/crio-346e5400e8182f14b4629d2f3f0c83c0abf14bd010be9896b843169bb309a523 WatchSource:0}: Error finding container 346e5400e8182f14b4629d2f3f0c83c0abf14bd010be9896b843169bb309a523: Status 404 returned error can't find the container with id 346e5400e8182f14b4629d2f3f0c83c0abf14bd010be9896b843169bb309a523 Jun 02 04:46:09.708448 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:09.708411 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" event={"ID":"282c8a1c-f6f7-40a9-8244-d6ecf3f84487","Type":"ContainerStarted","Data":"346e5400e8182f14b4629d2f3f0c83c0abf14bd010be9896b843169bb309a523"} Jun 02 04:46:11.715382 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:11.715348 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" event={"ID":"282c8a1c-f6f7-40a9-8244-d6ecf3f84487","Type":"ContainerStarted","Data":"93b1165736412b94c99b79adc58f37a94d6da10167e3c4531cbd2d0542af7559"} Jun 02 04:46:11.715735 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:11.715415 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" Jun 02 04:46:11.733052 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:11.733007 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" podStartSLOduration=0.888011493 podStartE2EDuration="3.732971776s" podCreationTimestamp="2026-06-02 04:46:08 +0000 UTC" firstStartedPulling="2026-06-02 04:46:08.762103898 +0000 UTC m=+261.482184951" lastFinishedPulling="2026-06-02 04:46:11.607064184 +0000 UTC m=+264.327145234" observedRunningTime="2026-06-02 04:46:11.732012886 +0000 UTC m=+264.452093958" watchObservedRunningTime="2026-06-02 04:46:11.732971776 +0000 UTC m=+264.453052850" Jun 02 04:46:17.720677 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:17.720625 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-h58ld" Jun 02 04:46:21.640484 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:21.640085 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-g5qxn"] Jun 02 04:46:21.644992 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:21.644965 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-g5qxn" Jun 02 04:46:21.647969 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:21.647952 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qgfqn\"" Jun 02 04:46:21.651853 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:21.651828 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-g5qxn"] Jun 02 04:46:21.819269 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:21.819238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/950c3633-c9fb-4b17-8ebf-2e0804585bf1-bound-sa-token\") pod \"cert-manager-79c8d999ff-g5qxn\" (UID: \"950c3633-c9fb-4b17-8ebf-2e0804585bf1\") " pod="cert-manager/cert-manager-79c8d999ff-g5qxn" Jun 02 04:46:21.819414 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:21.819298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2tfw\" (UniqueName: \"kubernetes.io/projected/950c3633-c9fb-4b17-8ebf-2e0804585bf1-kube-api-access-q2tfw\") pod \"cert-manager-79c8d999ff-g5qxn\" (UID: \"950c3633-c9fb-4b17-8ebf-2e0804585bf1\") " pod="cert-manager/cert-manager-79c8d999ff-g5qxn" Jun 02 04:46:21.919842 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:21.919777 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/950c3633-c9fb-4b17-8ebf-2e0804585bf1-bound-sa-token\") pod \"cert-manager-79c8d999ff-g5qxn\" (UID: \"950c3633-c9fb-4b17-8ebf-2e0804585bf1\") " pod="cert-manager/cert-manager-79c8d999ff-g5qxn" Jun 02 04:46:21.919842 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:21.919830 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2tfw\" (UniqueName: \"kubernetes.io/projected/950c3633-c9fb-4b17-8ebf-2e0804585bf1-kube-api-access-q2tfw\") pod \"cert-manager-79c8d999ff-g5qxn\" (UID: \"950c3633-c9fb-4b17-8ebf-2e0804585bf1\") " pod="cert-manager/cert-manager-79c8d999ff-g5qxn" Jun 02 04:46:21.927931 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:21.927907 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/950c3633-c9fb-4b17-8ebf-2e0804585bf1-bound-sa-token\") pod \"cert-manager-79c8d999ff-g5qxn\" (UID: \"950c3633-c9fb-4b17-8ebf-2e0804585bf1\") " pod="cert-manager/cert-manager-79c8d999ff-g5qxn" Jun 02 04:46:21.928163 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:21.928148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2tfw\" (UniqueName: \"kubernetes.io/projected/950c3633-c9fb-4b17-8ebf-2e0804585bf1-kube-api-access-q2tfw\") pod \"cert-manager-79c8d999ff-g5qxn\" (UID: \"950c3633-c9fb-4b17-8ebf-2e0804585bf1\") " pod="cert-manager/cert-manager-79c8d999ff-g5qxn" Jun 02 04:46:21.954155 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:21.954135 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-g5qxn" Jun 02 04:46:22.074208 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:22.074177 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-g5qxn"] Jun 02 04:46:22.076704 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:46:22.076676 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod950c3633_c9fb_4b17_8ebf_2e0804585bf1.slice/crio-7bbad517e05a2c8bc084b9aed96c0fe7f3cac34c238b51e6f172bfbc210b989a WatchSource:0}: Error finding container 7bbad517e05a2c8bc084b9aed96c0fe7f3cac34c238b51e6f172bfbc210b989a: Status 404 returned error can't find the container with id 7bbad517e05a2c8bc084b9aed96c0fe7f3cac34c238b51e6f172bfbc210b989a Jun 02 04:46:22.745413 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:22.745372 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-g5qxn" event={"ID":"950c3633-c9fb-4b17-8ebf-2e0804585bf1","Type":"ContainerStarted","Data":"fb697782214d3c79968e0ceee0459797ab70c693d6dd96a2a03cc1e19cdd40e0"} Jun 02 04:46:22.745413 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:22.745411 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-g5qxn" event={"ID":"950c3633-c9fb-4b17-8ebf-2e0804585bf1","Type":"ContainerStarted","Data":"7bbad517e05a2c8bc084b9aed96c0fe7f3cac34c238b51e6f172bfbc210b989a"} Jun 02 04:46:22.781400 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:22.781347 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-g5qxn" podStartSLOduration=1.7813309080000002 podStartE2EDuration="1.781330908s" podCreationTimestamp="2026-06-02 04:46:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:46:22.780975419 +0000 UTC m=+275.501056493" watchObservedRunningTime="2026-06-02 04:46:22.781330908 +0000 UTC m=+275.501411980" Jun 02 04:46:42.308082 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.308039 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt"] Jun 02 04:46:42.315004 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.314980 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.318298 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.318278 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 04:46:42.318555 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.318537 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 04:46:42.318636 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.318538 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 04:46:42.319375 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.319359 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 04:46:42.323912 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.323878 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6bclf\"" Jun 02 04:46:42.335908 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.335885 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt"] Jun 02 04:46:42.375935 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.375904 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.376071 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.375945 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-manifests\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.376071 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.376025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.376071 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.376063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwpz2\" (UniqueName: \"kubernetes.io/projected/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-kube-api-access-cwpz2\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.376182 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.376109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-tmp\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.476667 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.476557 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-tmp\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.476667 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.476634 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.476953 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.476695 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-manifests\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.476953 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.476752 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.476953 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.476788 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwpz2\" (UniqueName: \"kubernetes.io/projected/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-kube-api-access-cwpz2\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.477359 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.477332 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-manifests\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.479636 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.479612 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.479749 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.479612 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.479749 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.479704 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-tmp\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.496340 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.496315 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwpz2\" (UniqueName: \"kubernetes.io/projected/fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8-kube-api-access-cwpz2\") pod \"opendatahub-operator-controller-manager-6b5b979d7-4bjbt\" (UID: \"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8\") " pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.626615 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.626530 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:42.758354 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.758327 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt"] Jun 02 04:46:42.760682 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:46:42.760629 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7ad72e_0c9a_4a14_8f9b_470c70ce5df8.slice/crio-4b8c9a73ae22dff40fcd223fe80f07286db75faaafd515b024f51548729b5e4b WatchSource:0}: Error finding container 4b8c9a73ae22dff40fcd223fe80f07286db75faaafd515b024f51548729b5e4b: Status 404 returned error can't find the container with id 4b8c9a73ae22dff40fcd223fe80f07286db75faaafd515b024f51548729b5e4b Jun 02 04:46:42.801361 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:42.801324 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" event={"ID":"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8","Type":"ContainerStarted","Data":"4b8c9a73ae22dff40fcd223fe80f07286db75faaafd515b024f51548729b5e4b"} Jun 02 04:46:45.812460 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:45.812427 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" event={"ID":"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8","Type":"ContainerStarted","Data":"36e6f130c885c8be3a037b0f0e2824951ef30ce174dc50af8fb0f06ceabe34af"} Jun 02 04:46:46.818091 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:46.818057 2581 generic.go:358] "Generic (PLEG): container finished" podID="fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8" containerID="36e6f130c885c8be3a037b0f0e2824951ef30ce174dc50af8fb0f06ceabe34af" exitCode=0 Jun 02 04:46:46.818531 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:46.818140 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" event={"ID":"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8","Type":"ContainerDied","Data":"36e6f130c885c8be3a037b0f0e2824951ef30ce174dc50af8fb0f06ceabe34af"} Jun 02 04:46:47.690353 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:47.690326 2581 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 04:46:47.822229 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:47.822188 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" event={"ID":"fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8","Type":"ContainerStarted","Data":"fc9822600912d73cd4c665a617b861cc60de7a215a7a2bfb36bf90672ecd0cec"} Jun 02 04:46:47.823669 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:47.822372 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:46:47.846244 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:47.846196 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" podStartSLOduration=1.446305562 podStartE2EDuration="5.846183449s" podCreationTimestamp="2026-06-02 04:46:42 +0000 UTC" firstStartedPulling="2026-06-02 04:46:42.762338591 +0000 UTC m=+295.482419645" lastFinishedPulling="2026-06-02 04:46:47.162216478 +0000 UTC m=+299.882297532" observedRunningTime="2026-06-02 04:46:47.845011971 +0000 UTC m=+300.565093043" watchObservedRunningTime="2026-06-02 04:46:47.846183449 +0000 UTC m=+300.566264520" Jun 02 04:46:58.829213 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:46:58.829174 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b5b979d7-4bjbt" Jun 02 04:47:09.414766 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.414725 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq"] Jun 02 04:47:09.419641 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.419616 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.422017 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.421996 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:47:09.422844 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.422821 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 04:47:09.422955 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.422889 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 04:47:09.422955 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.422898 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 04:47:09.422955 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.422920 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 04:47:09.422955 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.422888 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pgjpf\"" Jun 02 04:47:09.429187 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.429167 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq"] Jun 02 04:47:09.484189 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.484149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/10e29769-09c7-4620-bc05-b2e8d1854151-metrics-cert\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.484392 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.484220 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgtn6\" (UniqueName: \"kubernetes.io/projected/10e29769-09c7-4620-bc05-b2e8d1854151-kube-api-access-zgtn6\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.484392 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.484258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/10e29769-09c7-4620-bc05-b2e8d1854151-manager-config\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.484392 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.484309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10e29769-09c7-4620-bc05-b2e8d1854151-cert\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.585462 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.585424 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10e29769-09c7-4620-bc05-b2e8d1854151-cert\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.585462 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.585467 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/10e29769-09c7-4620-bc05-b2e8d1854151-metrics-cert\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.585742 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.585519 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgtn6\" (UniqueName: \"kubernetes.io/projected/10e29769-09c7-4620-bc05-b2e8d1854151-kube-api-access-zgtn6\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.585742 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.585548 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/10e29769-09c7-4620-bc05-b2e8d1854151-manager-config\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.586243 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.586219 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/10e29769-09c7-4620-bc05-b2e8d1854151-manager-config\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.587892 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.587871 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10e29769-09c7-4620-bc05-b2e8d1854151-cert\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.588026 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.588006 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/10e29769-09c7-4620-bc05-b2e8d1854151-metrics-cert\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.595016 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.594991 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgtn6\" (UniqueName: \"kubernetes.io/projected/10e29769-09c7-4620-bc05-b2e8d1854151-kube-api-access-zgtn6\") pod \"lws-controller-manager-f8df7c74b-7ltxq\" (UID: \"10e29769-09c7-4620-bc05-b2e8d1854151\") " pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.729527 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.729429 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:09.882085 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.882058 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq"] Jun 02 04:47:09.883387 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:47:09.883360 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e29769_09c7_4620_bc05_b2e8d1854151.slice/crio-e013b4fee2d4bb66714b251bf90f8d9c8566e27c1e056924d3f8c838a4da2df3 WatchSource:0}: Error finding container e013b4fee2d4bb66714b251bf90f8d9c8566e27c1e056924d3f8c838a4da2df3: Status 404 returned error can't find the container with id e013b4fee2d4bb66714b251bf90f8d9c8566e27c1e056924d3f8c838a4da2df3 Jun 02 04:47:09.885612 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.885592 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 04:47:09.893635 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:09.893611 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" event={"ID":"10e29769-09c7-4620-bc05-b2e8d1854151","Type":"ContainerStarted","Data":"e013b4fee2d4bb66714b251bf90f8d9c8566e27c1e056924d3f8c838a4da2df3"} Jun 02 04:47:12.905918 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:12.905886 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" event={"ID":"10e29769-09c7-4620-bc05-b2e8d1854151","Type":"ContainerStarted","Data":"876bc8e8c9794247c57ae7d6159eba4927c81b6eb121b745c37c748b200ddafd"} Jun 02 04:47:12.906347 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:12.906002 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:12.954095 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:12.954050 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" podStartSLOduration=1.576208864 podStartE2EDuration="3.954034818s" podCreationTimestamp="2026-06-02 04:47:09 +0000 UTC" firstStartedPulling="2026-06-02 04:47:09.885736468 +0000 UTC m=+322.605817518" lastFinishedPulling="2026-06-02 04:47:12.26356242 +0000 UTC m=+324.983643472" observedRunningTime="2026-06-02 04:47:12.95068228 +0000 UTC m=+325.670763344" watchObservedRunningTime="2026-06-02 04:47:12.954034818 +0000 UTC m=+325.674115890" Jun 02 04:47:21.185067 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.185030 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz"] Jun 02 04:47:21.194564 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.194532 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" Jun 02 04:47:21.197087 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.197061 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 04:47:21.197221 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.197083 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 04:47:21.197221 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.197137 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-jsps9\"" Jun 02 04:47:21.203686 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.203634 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz"] Jun 02 04:47:21.292488 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.292457 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s25v\" (UniqueName: \"kubernetes.io/projected/0764f50e-d9b3-4379-ae10-a5d6adb561d6-kube-api-access-2s25v\") pod \"servicemesh-operator3-55f49c5f94-pl7xz\" (UID: \"0764f50e-d9b3-4379-ae10-a5d6adb561d6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" Jun 02 04:47:21.292634 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.292509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0764f50e-d9b3-4379-ae10-a5d6adb561d6-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pl7xz\" (UID: \"0764f50e-d9b3-4379-ae10-a5d6adb561d6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" Jun 02 04:47:21.393761 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.393735 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2s25v\" (UniqueName: \"kubernetes.io/projected/0764f50e-d9b3-4379-ae10-a5d6adb561d6-kube-api-access-2s25v\") pod \"servicemesh-operator3-55f49c5f94-pl7xz\" (UID: \"0764f50e-d9b3-4379-ae10-a5d6adb561d6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" Jun 02 04:47:21.393888 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.393783 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0764f50e-d9b3-4379-ae10-a5d6adb561d6-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pl7xz\" (UID: \"0764f50e-d9b3-4379-ae10-a5d6adb561d6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" Jun 02 04:47:21.396207 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.396178 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0764f50e-d9b3-4379-ae10-a5d6adb561d6-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pl7xz\" (UID: \"0764f50e-d9b3-4379-ae10-a5d6adb561d6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" Jun 02 04:47:21.404121 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.404095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s25v\" (UniqueName: \"kubernetes.io/projected/0764f50e-d9b3-4379-ae10-a5d6adb561d6-kube-api-access-2s25v\") pod \"servicemesh-operator3-55f49c5f94-pl7xz\" (UID: \"0764f50e-d9b3-4379-ae10-a5d6adb561d6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" Jun 02 04:47:21.505800 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.505758 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" Jun 02 04:47:21.665450 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.665414 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz"] Jun 02 04:47:21.669435 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:47:21.669402 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0764f50e_d9b3_4379_ae10_a5d6adb561d6.slice/crio-91db82f6ac0afbeec24949068dce7733d1cf6100c4b5af5970de51aa4b6c159c WatchSource:0}: Error finding container 91db82f6ac0afbeec24949068dce7733d1cf6100c4b5af5970de51aa4b6c159c: Status 404 returned error can't find the container with id 91db82f6ac0afbeec24949068dce7733d1cf6100c4b5af5970de51aa4b6c159c Jun 02 04:47:21.934886 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:21.934812 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" event={"ID":"0764f50e-d9b3-4379-ae10-a5d6adb561d6","Type":"ContainerStarted","Data":"91db82f6ac0afbeec24949068dce7733d1cf6100c4b5af5970de51aa4b6c159c"} Jun 02 04:47:23.911816 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:23.911779 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f8df7c74b-7ltxq" Jun 02 04:47:24.948000 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:24.947968 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" event={"ID":"0764f50e-d9b3-4379-ae10-a5d6adb561d6","Type":"ContainerStarted","Data":"a3af6a79f450d887a2f10d792b5a20b5e5e2309e184fcebec5afb0d77d6147c1"} Jun 02 04:47:24.948382 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:24.948066 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" Jun 02 04:47:24.969989 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:24.969936 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" podStartSLOduration=1.186968185 podStartE2EDuration="3.96992251s" podCreationTimestamp="2026-06-02 04:47:21 +0000 UTC" firstStartedPulling="2026-06-02 04:47:21.672251674 +0000 UTC m=+334.392332723" lastFinishedPulling="2026-06-02 04:47:24.455205978 +0000 UTC m=+337.175287048" observedRunningTime="2026-06-02 04:47:24.967461901 +0000 UTC m=+337.687542974" watchObservedRunningTime="2026-06-02 04:47:24.96992251 +0000 UTC m=+337.690003581" Jun 02 04:47:32.265267 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.265233 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn"] Jun 02 04:47:32.269022 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.268998 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn" Jun 02 04:47:32.273028 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.272996 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 04:47:32.273139 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.273052 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ttfd8\"" Jun 02 04:47:32.278537 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.278514 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn"] Jun 02 04:47:32.387876 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.387839 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvlb6\" (UniqueName: \"kubernetes.io/projected/f9888d12-5348-4435-9e90-50e0974d27b0-kube-api-access-tvlb6\") pod \"dashboard-redirect-5b88b8b9b4-5wxrn\" (UID: \"f9888d12-5348-4435-9e90-50e0974d27b0\") " pod="opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn" Jun 02 04:47:32.387876 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.387876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f9888d12-5348-4435-9e90-50e0974d27b0-redirect-config\") pod \"dashboard-redirect-5b88b8b9b4-5wxrn\" (UID: \"f9888d12-5348-4435-9e90-50e0974d27b0\") " pod="opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn" Jun 02 04:47:32.489265 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.489225 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvlb6\" (UniqueName: \"kubernetes.io/projected/f9888d12-5348-4435-9e90-50e0974d27b0-kube-api-access-tvlb6\") pod \"dashboard-redirect-5b88b8b9b4-5wxrn\" (UID: \"f9888d12-5348-4435-9e90-50e0974d27b0\") " pod="opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn" Jun 02 04:47:32.489439 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.489274 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f9888d12-5348-4435-9e90-50e0974d27b0-redirect-config\") pod \"dashboard-redirect-5b88b8b9b4-5wxrn\" (UID: \"f9888d12-5348-4435-9e90-50e0974d27b0\") " pod="opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn" Jun 02 04:47:32.489994 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.489974 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f9888d12-5348-4435-9e90-50e0974d27b0-redirect-config\") pod \"dashboard-redirect-5b88b8b9b4-5wxrn\" (UID: \"f9888d12-5348-4435-9e90-50e0974d27b0\") " pod="opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn" Jun 02 04:47:32.498618 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.498598 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvlb6\" (UniqueName: \"kubernetes.io/projected/f9888d12-5348-4435-9e90-50e0974d27b0-kube-api-access-tvlb6\") pod \"dashboard-redirect-5b88b8b9b4-5wxrn\" (UID: \"f9888d12-5348-4435-9e90-50e0974d27b0\") " pod="opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn" Jun 02 04:47:32.580336 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.580274 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn" Jun 02 04:47:32.708084 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.707935 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn"] Jun 02 04:47:32.710630 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:47:32.710589 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9888d12_5348_4435_9e90_50e0974d27b0.slice/crio-ef0adaaa886870acb67cba90c7990631ae341c29ac006a9f9b62a36d12d0fd34 WatchSource:0}: Error finding container ef0adaaa886870acb67cba90c7990631ae341c29ac006a9f9b62a36d12d0fd34: Status 404 returned error can't find the container with id ef0adaaa886870acb67cba90c7990631ae341c29ac006a9f9b62a36d12d0fd34 Jun 02 04:47:32.979168 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:32.979086 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn" event={"ID":"f9888d12-5348-4435-9e90-50e0974d27b0","Type":"ContainerStarted","Data":"ef0adaaa886870acb67cba90c7990631ae341c29ac006a9f9b62a36d12d0fd34"} Jun 02 04:47:34.986524 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:34.986457 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn" event={"ID":"f9888d12-5348-4435-9e90-50e0974d27b0","Type":"ContainerStarted","Data":"36e89413776e842c0f7458ec687bac89fa44652e5f15b3734990ed1891339da4"} Jun 02 04:47:35.003638 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:35.003597 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5b88b8b9b4-5wxrn" podStartSLOduration=0.999935606 podStartE2EDuration="3.003584456s" podCreationTimestamp="2026-06-02 04:47:32 +0000 UTC" firstStartedPulling="2026-06-02 04:47:32.71182931 +0000 UTC m=+345.431910366" lastFinishedPulling="2026-06-02 04:47:34.715478152 +0000 UTC m=+347.435559216" observedRunningTime="2026-06-02 04:47:35.001650424 +0000 UTC m=+347.721731516" watchObservedRunningTime="2026-06-02 04:47:35.003584456 +0000 UTC m=+347.723665527" Jun 02 04:47:35.953497 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:35.953461 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pl7xz" Jun 02 04:47:41.659171 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.659139 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9"] Jun 02 04:47:41.663477 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.663454 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.666069 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.666050 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-82xzz\"" Jun 02 04:47:41.666187 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.666170 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 04:47:41.666463 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.666447 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 04:47:41.666907 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.666885 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 04:47:41.675294 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.675270 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9"] Jun 02 04:47:41.767326 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.767298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.767500 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.767343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.767500 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.767372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dth8\" (UniqueName: \"kubernetes.io/projected/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-kube-api-access-9dth8\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.767500 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.767439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.767609 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.767535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.767609 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.767577 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.767695 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.767623 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.767695 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.767674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.767756 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.767693 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.868694 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.868636 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.868851 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.868800 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.868851 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.868831 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.868965 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.868877 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.868965 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.868916 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.868965 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.868946 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.869121 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.868980 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.869121 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.869014 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.869121 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.869024 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.869121 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.869040 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dth8\" (UniqueName: \"kubernetes.io/projected/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-kube-api-access-9dth8\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.869322 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.869158 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.869486 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.869460 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.869613 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.869499 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.869613 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.869509 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.871646 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.871624 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.871786 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.871705 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.877274 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.877249 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.877444 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.877428 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dth8\" (UniqueName: \"kubernetes.io/projected/8a3d4558-72e3-49aa-92eb-fab7243b0a6d-kube-api-access-9dth8\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9\" (UID: \"8a3d4558-72e3-49aa-92eb-fab7243b0a6d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:41.974031 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:41.973948 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:42.133555 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:42.133451 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9"] Jun 02 04:47:42.135798 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:47:42.135766 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3d4558_72e3_49aa_92eb_fab7243b0a6d.slice/crio-a9ffc4416906b5627666c76cfe1c312e070223011ea30103d3ddeb39c1072855 WatchSource:0}: Error finding container a9ffc4416906b5627666c76cfe1c312e070223011ea30103d3ddeb39c1072855: Status 404 returned error can't find the container with id a9ffc4416906b5627666c76cfe1c312e070223011ea30103d3ddeb39c1072855 Jun 02 04:47:43.015594 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:43.015551 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" event={"ID":"8a3d4558-72e3-49aa-92eb-fab7243b0a6d","Type":"ContainerStarted","Data":"a9ffc4416906b5627666c76cfe1c312e070223011ea30103d3ddeb39c1072855"} Jun 02 04:47:45.193065 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:45.193004 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 04:47:45.193353 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:45.193086 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 04:47:45.193353 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:45.193114 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 04:47:46.026141 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:46.026107 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" event={"ID":"8a3d4558-72e3-49aa-92eb-fab7243b0a6d","Type":"ContainerStarted","Data":"b99e4b7a3d0cd97a5d32d33a371aaf582b3dd8a283edc3db636c3b8b36857215"} Jun 02 04:47:46.050744 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:46.050696 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" podStartSLOduration=1.995627993 podStartE2EDuration="5.050680806s" podCreationTimestamp="2026-06-02 04:47:41 +0000 UTC" firstStartedPulling="2026-06-02 04:47:42.137669151 +0000 UTC m=+354.857750235" lastFinishedPulling="2026-06-02 04:47:45.192721995 +0000 UTC m=+357.912803048" observedRunningTime="2026-06-02 04:47:46.049005784 +0000 UTC m=+358.769086880" watchObservedRunningTime="2026-06-02 04:47:46.050680806 +0000 UTC m=+358.770761875" Jun 02 04:47:46.975108 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:46.975076 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:46.979536 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:46.979506 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:47.029541 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:47.029518 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:47:47.030391 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:47:47.030374 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9" Jun 02 04:48:02.713526 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:02.713487 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-42zml"] Jun 02 04:48:02.717014 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:02.716995 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-42zml" Jun 02 04:48:02.719772 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:02.719743 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 04:48:02.719910 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:02.719797 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 04:48:02.720456 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:02.720439 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-pqxnm\"" Jun 02 04:48:02.726309 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:02.726267 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-42zml"] Jun 02 04:48:02.748022 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:02.747990 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlxwg\" (UniqueName: \"kubernetes.io/projected/b24a114c-44f5-41d7-9500-f4fd6c91db9f-kube-api-access-hlxwg\") pod \"kuadrant-operator-catalog-42zml\" (UID: \"b24a114c-44f5-41d7-9500-f4fd6c91db9f\") " pod="kuadrant-system/kuadrant-operator-catalog-42zml" Jun 02 04:48:02.848902 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:02.848867 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlxwg\" (UniqueName: \"kubernetes.io/projected/b24a114c-44f5-41d7-9500-f4fd6c91db9f-kube-api-access-hlxwg\") pod \"kuadrant-operator-catalog-42zml\" (UID: \"b24a114c-44f5-41d7-9500-f4fd6c91db9f\") " pod="kuadrant-system/kuadrant-operator-catalog-42zml" Jun 02 04:48:02.858593 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:02.858562 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlxwg\" (UniqueName: \"kubernetes.io/projected/b24a114c-44f5-41d7-9500-f4fd6c91db9f-kube-api-access-hlxwg\") pod \"kuadrant-operator-catalog-42zml\" (UID: \"b24a114c-44f5-41d7-9500-f4fd6c91db9f\") " pod="kuadrant-system/kuadrant-operator-catalog-42zml" Jun 02 04:48:03.028320 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:03.028288 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-42zml" Jun 02 04:48:03.070959 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:03.070924 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-42zml"] Jun 02 04:48:03.151857 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:03.151827 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-42zml"] Jun 02 04:48:03.153899 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:48:03.153872 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24a114c_44f5_41d7_9500_f4fd6c91db9f.slice/crio-4a0a60b3754e7248b4785ac6c8afcffe2bde7537eccb0e42e32c334550123338 WatchSource:0}: Error finding container 4a0a60b3754e7248b4785ac6c8afcffe2bde7537eccb0e42e32c334550123338: Status 404 returned error can't find the container with id 4a0a60b3754e7248b4785ac6c8afcffe2bde7537eccb0e42e32c334550123338 Jun 02 04:48:03.280524 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:03.280444 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxb7x"] Jun 02 04:48:03.285129 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:03.285113 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" Jun 02 04:48:03.291856 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:03.291831 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxb7x"] Jun 02 04:48:03.353045 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:03.353013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jxg2\" (UniqueName: \"kubernetes.io/projected/879cb067-6de1-4fe5-a78a-98424852f7c4-kube-api-access-6jxg2\") pod \"kuadrant-operator-catalog-fxb7x\" (UID: \"879cb067-6de1-4fe5-a78a-98424852f7c4\") " pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" Jun 02 04:48:03.454423 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:03.454392 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jxg2\" (UniqueName: \"kubernetes.io/projected/879cb067-6de1-4fe5-a78a-98424852f7c4-kube-api-access-6jxg2\") pod \"kuadrant-operator-catalog-fxb7x\" (UID: \"879cb067-6de1-4fe5-a78a-98424852f7c4\") " pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" Jun 02 04:48:03.462712 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:03.462683 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jxg2\" (UniqueName: \"kubernetes.io/projected/879cb067-6de1-4fe5-a78a-98424852f7c4-kube-api-access-6jxg2\") pod \"kuadrant-operator-catalog-fxb7x\" (UID: \"879cb067-6de1-4fe5-a78a-98424852f7c4\") " pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" Jun 02 04:48:03.595574 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:03.595498 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" Jun 02 04:48:03.736442 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:03.736417 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxb7x"] Jun 02 04:48:03.738160 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:48:03.738128 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879cb067_6de1_4fe5_a78a_98424852f7c4.slice/crio-cf14a1996ef3951cf77a483ea9104c22b53cb163ccb1618a0c4527dc58819abd WatchSource:0}: Error finding container cf14a1996ef3951cf77a483ea9104c22b53cb163ccb1618a0c4527dc58819abd: Status 404 returned error can't find the container with id cf14a1996ef3951cf77a483ea9104c22b53cb163ccb1618a0c4527dc58819abd Jun 02 04:48:04.085495 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:04.085450 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" event={"ID":"879cb067-6de1-4fe5-a78a-98424852f7c4","Type":"ContainerStarted","Data":"cf14a1996ef3951cf77a483ea9104c22b53cb163ccb1618a0c4527dc58819abd"} Jun 02 04:48:04.086556 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:04.086519 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-42zml" event={"ID":"b24a114c-44f5-41d7-9500-f4fd6c91db9f","Type":"ContainerStarted","Data":"4a0a60b3754e7248b4785ac6c8afcffe2bde7537eccb0e42e32c334550123338"} Jun 02 04:48:06.100545 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:06.100504 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" event={"ID":"879cb067-6de1-4fe5-a78a-98424852f7c4","Type":"ContainerStarted","Data":"df72750b9a2be584516f214e429912449811ffdb2c131613bac4ba9d5c0a3541"} Jun 02 04:48:06.101839 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:06.101813 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-42zml" event={"ID":"b24a114c-44f5-41d7-9500-f4fd6c91db9f","Type":"ContainerStarted","Data":"30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d"} Jun 02 04:48:06.101953 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:06.101917 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-42zml" podUID="b24a114c-44f5-41d7-9500-f4fd6c91db9f" containerName="registry-server" containerID="cri-o://30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d" gracePeriod=2 Jun 02 04:48:06.119313 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:06.119273 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" podStartSLOduration=1.59278936 podStartE2EDuration="3.119259141s" podCreationTimestamp="2026-06-02 04:48:03 +0000 UTC" firstStartedPulling="2026-06-02 04:48:03.739532388 +0000 UTC m=+376.459613438" lastFinishedPulling="2026-06-02 04:48:05.266002165 +0000 UTC m=+377.986083219" observedRunningTime="2026-06-02 04:48:06.116756863 +0000 UTC m=+378.836837929" watchObservedRunningTime="2026-06-02 04:48:06.119259141 +0000 UTC m=+378.839340212" Jun 02 04:48:06.133501 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:06.133461 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-42zml" podStartSLOduration=2.025540494 podStartE2EDuration="4.133448496s" podCreationTimestamp="2026-06-02 04:48:02 +0000 UTC" firstStartedPulling="2026-06-02 04:48:03.155151019 +0000 UTC m=+375.875232068" lastFinishedPulling="2026-06-02 04:48:05.263059005 +0000 UTC m=+377.983140070" observedRunningTime="2026-06-02 04:48:06.132035593 +0000 UTC m=+378.852116668" watchObservedRunningTime="2026-06-02 04:48:06.133448496 +0000 UTC m=+378.853529568" Jun 02 04:48:06.342007 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:06.341986 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-42zml" Jun 02 04:48:06.479382 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:06.479302 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlxwg\" (UniqueName: \"kubernetes.io/projected/b24a114c-44f5-41d7-9500-f4fd6c91db9f-kube-api-access-hlxwg\") pod \"b24a114c-44f5-41d7-9500-f4fd6c91db9f\" (UID: \"b24a114c-44f5-41d7-9500-f4fd6c91db9f\") " Jun 02 04:48:06.481676 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:06.481635 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b24a114c-44f5-41d7-9500-f4fd6c91db9f-kube-api-access-hlxwg" (OuterVolumeSpecName: "kube-api-access-hlxwg") pod "b24a114c-44f5-41d7-9500-f4fd6c91db9f" (UID: "b24a114c-44f5-41d7-9500-f4fd6c91db9f"). InnerVolumeSpecName "kube-api-access-hlxwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:48:06.580736 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:06.580709 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlxwg\" (UniqueName: \"kubernetes.io/projected/b24a114c-44f5-41d7-9500-f4fd6c91db9f-kube-api-access-hlxwg\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:48:07.106185 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:07.106149 2581 generic.go:358] "Generic (PLEG): container finished" podID="b24a114c-44f5-41d7-9500-f4fd6c91db9f" containerID="30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d" exitCode=0 Jun 02 04:48:07.106641 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:07.106210 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-42zml" Jun 02 04:48:07.106641 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:07.106232 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-42zml" event={"ID":"b24a114c-44f5-41d7-9500-f4fd6c91db9f","Type":"ContainerDied","Data":"30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d"} Jun 02 04:48:07.106641 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:07.106275 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-42zml" event={"ID":"b24a114c-44f5-41d7-9500-f4fd6c91db9f","Type":"ContainerDied","Data":"4a0a60b3754e7248b4785ac6c8afcffe2bde7537eccb0e42e32c334550123338"} Jun 02 04:48:07.106641 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:07.106298 2581 scope.go:117] "RemoveContainer" containerID="30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d" Jun 02 04:48:07.115575 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:07.115559 2581 scope.go:117] "RemoveContainer" containerID="30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d" Jun 02 04:48:07.115878 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:48:07.115859 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d\": container with ID starting with 30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d not found: ID does not exist" containerID="30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d" Jun 02 04:48:07.115939 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:07.115886 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d"} err="failed to get container status \"30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d\": rpc error: code = NotFound desc = could not find container \"30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d\": container with ID starting with 30ebac5f79bebe6b764ba3026c9f6d629403c2377411e91b812e35e16d7bc40d not found: ID does not exist" Jun 02 04:48:07.129221 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:07.129201 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-42zml"] Jun 02 04:48:07.134335 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:07.134315 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-42zml"] Jun 02 04:48:07.733286 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:07.733255 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b24a114c-44f5-41d7-9500-f4fd6c91db9f" path="/var/lib/kubelet/pods/b24a114c-44f5-41d7-9500-f4fd6c91db9f/volumes" Jun 02 04:48:13.595791 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:13.595748 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" Jun 02 04:48:13.595791 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:13.595791 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" Jun 02 04:48:13.618272 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:13.618247 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" Jun 02 04:48:14.153519 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:14.153492 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fxb7x" Jun 02 04:48:35.948039 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:35.948002 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4v4wd"] Jun 02 04:48:35.948554 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:35.948382 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b24a114c-44f5-41d7-9500-f4fd6c91db9f" containerName="registry-server" Jun 02 04:48:35.948554 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:35.948399 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b24a114c-44f5-41d7-9500-f4fd6c91db9f" containerName="registry-server" Jun 02 04:48:35.948554 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:35.948504 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="b24a114c-44f5-41d7-9500-f4fd6c91db9f" containerName="registry-server" Jun 02 04:48:35.951626 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:35.951604 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-4v4wd" Jun 02 04:48:35.955876 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:35.955850 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lbmw6\"" Jun 02 04:48:35.969542 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:35.969486 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4v4wd"] Jun 02 04:48:36.129583 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:36.129542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz5fv\" (UniqueName: \"kubernetes.io/projected/4ce33235-3b03-49ba-a068-9e7207113b8a-kube-api-access-qz5fv\") pod \"authorino-operator-657f44b778-4v4wd\" (UID: \"4ce33235-3b03-49ba-a068-9e7207113b8a\") " pod="kuadrant-system/authorino-operator-657f44b778-4v4wd" Jun 02 04:48:36.230172 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:36.230084 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qz5fv\" (UniqueName: \"kubernetes.io/projected/4ce33235-3b03-49ba-a068-9e7207113b8a-kube-api-access-qz5fv\") pod \"authorino-operator-657f44b778-4v4wd\" (UID: \"4ce33235-3b03-49ba-a068-9e7207113b8a\") " pod="kuadrant-system/authorino-operator-657f44b778-4v4wd" Jun 02 04:48:36.242681 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:36.242643 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz5fv\" (UniqueName: \"kubernetes.io/projected/4ce33235-3b03-49ba-a068-9e7207113b8a-kube-api-access-qz5fv\") pod \"authorino-operator-657f44b778-4v4wd\" (UID: \"4ce33235-3b03-49ba-a068-9e7207113b8a\") " pod="kuadrant-system/authorino-operator-657f44b778-4v4wd" Jun 02 04:48:36.261556 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:36.261526 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-4v4wd" Jun 02 04:48:36.412945 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:36.412912 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-4v4wd"] Jun 02 04:48:36.416851 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:48:36.416824 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce33235_3b03_49ba_a068_9e7207113b8a.slice/crio-ae88044b29033ceb4802be6f4dc35ea2585a7bbc6c88b0881a49e96f244ccc2c WatchSource:0}: Error finding container ae88044b29033ceb4802be6f4dc35ea2585a7bbc6c88b0881a49e96f244ccc2c: Status 404 returned error can't find the container with id ae88044b29033ceb4802be6f4dc35ea2585a7bbc6c88b0881a49e96f244ccc2c Jun 02 04:48:37.207259 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:37.207221 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-4v4wd" event={"ID":"4ce33235-3b03-49ba-a068-9e7207113b8a","Type":"ContainerStarted","Data":"ae88044b29033ceb4802be6f4dc35ea2585a7bbc6c88b0881a49e96f244ccc2c"} Jun 02 04:48:39.178943 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.178891 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9"] Jun 02 04:48:39.182568 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.182544 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" Jun 02 04:48:39.186426 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.186403 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-p6kj6\"" Jun 02 04:48:39.194841 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.194818 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9"] Jun 02 04:48:39.214649 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.214620 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-4v4wd" event={"ID":"4ce33235-3b03-49ba-a068-9e7207113b8a","Type":"ContainerStarted","Data":"615809112ecd0e8e8a7c7899516b03bd83954351b3f3a2203dd8b5fb4ce6f741"} Jun 02 04:48:39.214804 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.214712 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-4v4wd" Jun 02 04:48:39.239281 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.239231 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-4v4wd" podStartSLOduration=2.017135046 podStartE2EDuration="4.239217338s" podCreationTimestamp="2026-06-02 04:48:35 +0000 UTC" firstStartedPulling="2026-06-02 04:48:36.418832624 +0000 UTC m=+409.138913674" lastFinishedPulling="2026-06-02 04:48:38.640914912 +0000 UTC m=+411.360995966" observedRunningTime="2026-06-02 04:48:39.23550741 +0000 UTC m=+411.955588482" watchObservedRunningTime="2026-06-02 04:48:39.239217338 +0000 UTC m=+411.959298410" Jun 02 04:48:39.358945 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.358914 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k96f\" (UniqueName: \"kubernetes.io/projected/deb0c6f9-0288-4bd0-b470-a033420bd23a-kube-api-access-7k96f\") pod \"limitador-operator-controller-manager-85c4996f8c-rvhb9\" (UID: \"deb0c6f9-0288-4bd0-b470-a033420bd23a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" Jun 02 04:48:39.460443 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.460350 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7k96f\" (UniqueName: \"kubernetes.io/projected/deb0c6f9-0288-4bd0-b470-a033420bd23a-kube-api-access-7k96f\") pod \"limitador-operator-controller-manager-85c4996f8c-rvhb9\" (UID: \"deb0c6f9-0288-4bd0-b470-a033420bd23a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" Jun 02 04:48:39.477031 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.476963 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k96f\" (UniqueName: \"kubernetes.io/projected/deb0c6f9-0288-4bd0-b470-a033420bd23a-kube-api-access-7k96f\") pod \"limitador-operator-controller-manager-85c4996f8c-rvhb9\" (UID: \"deb0c6f9-0288-4bd0-b470-a033420bd23a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" Jun 02 04:48:39.493594 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.493550 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" Jun 02 04:48:39.662138 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:39.662090 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9"] Jun 02 04:48:39.664693 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:48:39.664636 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb0c6f9_0288_4bd0_b470_a033420bd23a.slice/crio-d8fc7901baee1680712f50c1f749c9f03ce85d0dcf75d4f71200a15d2fe82225 WatchSource:0}: Error finding container d8fc7901baee1680712f50c1f749c9f03ce85d0dcf75d4f71200a15d2fe82225: Status 404 returned error can't find the container with id d8fc7901baee1680712f50c1f749c9f03ce85d0dcf75d4f71200a15d2fe82225 Jun 02 04:48:40.218690 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:40.218641 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" event={"ID":"deb0c6f9-0288-4bd0-b470-a033420bd23a","Type":"ContainerStarted","Data":"d8fc7901baee1680712f50c1f749c9f03ce85d0dcf75d4f71200a15d2fe82225"} Jun 02 04:48:42.227470 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:42.227394 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" event={"ID":"deb0c6f9-0288-4bd0-b470-a033420bd23a","Type":"ContainerStarted","Data":"a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9"} Jun 02 04:48:42.227470 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:42.227452 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" Jun 02 04:48:42.255640 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:42.255596 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" podStartSLOduration=1.178603263 podStartE2EDuration="3.255583417s" podCreationTimestamp="2026-06-02 04:48:39 +0000 UTC" firstStartedPulling="2026-06-02 04:48:39.677480635 +0000 UTC m=+412.397561685" lastFinishedPulling="2026-06-02 04:48:41.754460786 +0000 UTC m=+414.474541839" observedRunningTime="2026-06-02 04:48:42.251885025 +0000 UTC m=+414.971966108" watchObservedRunningTime="2026-06-02 04:48:42.255583417 +0000 UTC m=+414.975664489" Jun 02 04:48:50.220866 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:50.220838 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-4v4wd" Jun 02 04:48:53.233345 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:48:53.233307 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" Jun 02 04:49:04.550453 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:04.550419 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc"] Jun 02 04:49:04.554010 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:04.553988 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" Jun 02 04:49:04.557827 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:04.557808 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kmqgm\"" Jun 02 04:49:04.572435 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:04.572416 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc"] Jun 02 04:49:04.580370 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:04.580348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d742459d-b972-4cc4-b9c8-9cc2a198b487-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc\" (UID: \"d742459d-b972-4cc4-b9c8-9cc2a198b487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" Jun 02 04:49:04.580519 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:04.580424 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv2b6\" (UniqueName: \"kubernetes.io/projected/d742459d-b972-4cc4-b9c8-9cc2a198b487-kube-api-access-kv2b6\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc\" (UID: \"d742459d-b972-4cc4-b9c8-9cc2a198b487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" Jun 02 04:49:04.681084 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:04.681050 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kv2b6\" (UniqueName: \"kubernetes.io/projected/d742459d-b972-4cc4-b9c8-9cc2a198b487-kube-api-access-kv2b6\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc\" (UID: \"d742459d-b972-4cc4-b9c8-9cc2a198b487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" Jun 02 04:49:04.681084 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:04.681086 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d742459d-b972-4cc4-b9c8-9cc2a198b487-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc\" (UID: \"d742459d-b972-4cc4-b9c8-9cc2a198b487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" Jun 02 04:49:04.681413 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:04.681398 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d742459d-b972-4cc4-b9c8-9cc2a198b487-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc\" (UID: \"d742459d-b972-4cc4-b9c8-9cc2a198b487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" Jun 02 04:49:04.690713 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:04.690684 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv2b6\" (UniqueName: \"kubernetes.io/projected/d742459d-b972-4cc4-b9c8-9cc2a198b487-kube-api-access-kv2b6\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc\" (UID: \"d742459d-b972-4cc4-b9c8-9cc2a198b487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" Jun 02 04:49:04.864472 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:04.864407 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" Jun 02 04:49:05.002839 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.002813 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc"] Jun 02 04:49:05.005720 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:49:05.005692 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd742459d_b972_4cc4_b9c8_9cc2a198b487.slice/crio-be96a7f7a45155dbc40737f710630e68e1dba2ea2a1944c9b886e0bf9b274172 WatchSource:0}: Error finding container be96a7f7a45155dbc40737f710630e68e1dba2ea2a1944c9b886e0bf9b274172: Status 404 returned error can't find the container with id be96a7f7a45155dbc40737f710630e68e1dba2ea2a1944c9b886e0bf9b274172 Jun 02 04:49:05.220985 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.220920 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc"] Jun 02 04:49:05.230362 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.230333 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc"] Jun 02 04:49:05.242877 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.242852 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9"] Jun 02 04:49:05.243121 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.243097 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" podUID="deb0c6f9-0288-4bd0-b470-a033420bd23a" containerName="manager" containerID="cri-o://a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9" gracePeriod=2 Jun 02 04:49:05.249178 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.249154 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm"] Jun 02 04:49:05.253560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.253412 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9"] Jun 02 04:49:05.253560 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.253538 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:05.272024 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.272001 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm"] Jun 02 04:49:05.287151 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.287127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm\" (UID: \"10836cc2-81f9-4b1e-9c45-c0edecb84ac4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:05.287270 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.287175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lppdv\" (UniqueName: \"kubernetes.io/projected/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-kube-api-access-lppdv\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm\" (UID: \"10836cc2-81f9-4b1e-9c45-c0edecb84ac4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:05.288234 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.288209 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g"] Jun 02 04:49:05.288575 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.288562 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb0c6f9-0288-4bd0-b470-a033420bd23a" containerName="manager" Jun 02 04:49:05.288621 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.288578 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb0c6f9-0288-4bd0-b470-a033420bd23a" containerName="manager" Jun 02 04:49:05.288682 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.288644 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="deb0c6f9-0288-4bd0-b470-a033420bd23a" containerName="manager" Jun 02 04:49:05.291514 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.291496 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g" Jun 02 04:49:05.292471 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.292448 2581 status_manager.go:895] "Failed to get status for pod" podUID="deb0c6f9-0288-4bd0-b470-a033420bd23a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" err="pods \"limitador-operator-controller-manager-85c4996f8c-rvhb9\" is forbidden: User \"system:node:ip-10-0-137-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-68.ec2.internal' and this object" Jun 02 04:49:05.296434 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.296403 2581 status_manager.go:895] "Failed to get status for pod" podUID="deb0c6f9-0288-4bd0-b470-a033420bd23a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" err="pods \"limitador-operator-controller-manager-85c4996f8c-rvhb9\" is forbidden: User \"system:node:ip-10-0-137-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-68.ec2.internal' and this object" Jun 02 04:49:05.304862 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.304840 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g"] Jun 02 04:49:05.387842 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.387785 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm\" (UID: \"10836cc2-81f9-4b1e-9c45-c0edecb84ac4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:05.387990 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.387849 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lppdv\" (UniqueName: \"kubernetes.io/projected/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-kube-api-access-lppdv\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm\" (UID: \"10836cc2-81f9-4b1e-9c45-c0edecb84ac4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:05.387990 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.387914 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tknx8\" (UniqueName: \"kubernetes.io/projected/61e7d492-c718-4f55-9aca-393515f8bc13-kube-api-access-tknx8\") pod \"limitador-operator-controller-manager-85c4996f8c-tkn5g\" (UID: \"61e7d492-c718-4f55-9aca-393515f8bc13\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g" Jun 02 04:49:05.388243 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.388221 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm\" (UID: \"10836cc2-81f9-4b1e-9c45-c0edecb84ac4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:05.401381 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.401360 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lppdv\" (UniqueName: \"kubernetes.io/projected/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-kube-api-access-lppdv\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm\" (UID: \"10836cc2-81f9-4b1e-9c45-c0edecb84ac4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:05.469722 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.469699 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" Jun 02 04:49:05.472504 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.472443 2581 status_manager.go:895] "Failed to get status for pod" podUID="deb0c6f9-0288-4bd0-b470-a033420bd23a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" err="pods \"limitador-operator-controller-manager-85c4996f8c-rvhb9\" is forbidden: User \"system:node:ip-10-0-137-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-68.ec2.internal' and this object" Jun 02 04:49:05.488977 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.488950 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tknx8\" (UniqueName: \"kubernetes.io/projected/61e7d492-c718-4f55-9aca-393515f8bc13-kube-api-access-tknx8\") pod \"limitador-operator-controller-manager-85c4996f8c-tkn5g\" (UID: \"61e7d492-c718-4f55-9aca-393515f8bc13\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g" Jun 02 04:49:05.500495 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.500462 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tknx8\" (UniqueName: \"kubernetes.io/projected/61e7d492-c718-4f55-9aca-393515f8bc13-kube-api-access-tknx8\") pod \"limitador-operator-controller-manager-85c4996f8c-tkn5g\" (UID: \"61e7d492-c718-4f55-9aca-393515f8bc13\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g" Jun 02 04:49:05.589476 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.589455 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k96f\" (UniqueName: \"kubernetes.io/projected/deb0c6f9-0288-4bd0-b470-a033420bd23a-kube-api-access-7k96f\") pod \"deb0c6f9-0288-4bd0-b470-a033420bd23a\" (UID: \"deb0c6f9-0288-4bd0-b470-a033420bd23a\") " Jun 02 04:49:05.591596 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.591566 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb0c6f9-0288-4bd0-b470-a033420bd23a-kube-api-access-7k96f" (OuterVolumeSpecName: "kube-api-access-7k96f") pod "deb0c6f9-0288-4bd0-b470-a033420bd23a" (UID: "deb0c6f9-0288-4bd0-b470-a033420bd23a"). InnerVolumeSpecName "kube-api-access-7k96f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:49:05.631899 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.631875 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:05.637602 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.637583 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g" Jun 02 04:49:05.691075 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.691048 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k96f\" (UniqueName: \"kubernetes.io/projected/deb0c6f9-0288-4bd0-b470-a033420bd23a-kube-api-access-7k96f\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:49:05.736385 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.736167 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deb0c6f9-0288-4bd0-b470-a033420bd23a" path="/var/lib/kubelet/pods/deb0c6f9-0288-4bd0-b470-a033420bd23a/volumes" Jun 02 04:49:05.816010 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.815976 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm"] Jun 02 04:49:05.818824 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:05.818805 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g"] Jun 02 04:49:05.819342 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:49:05.819310 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10836cc2_81f9_4b1e_9c45_c0edecb84ac4.slice/crio-ef1b728e8acac611e84f8d60e521915871eb2f3f7445f22274c9d9ccc831bc92 WatchSource:0}: Error finding container ef1b728e8acac611e84f8d60e521915871eb2f3f7445f22274c9d9ccc831bc92: Status 404 returned error can't find the container with id ef1b728e8acac611e84f8d60e521915871eb2f3f7445f22274c9d9ccc831bc92 Jun 02 04:49:05.820444 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:49:05.820420 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e7d492_c718_4f55_9aca_393515f8bc13.slice/crio-c25a261f740df9b17e3d93bab6981129a4292bb8a77abc69989691dec7bb24be WatchSource:0}: Error finding container c25a261f740df9b17e3d93bab6981129a4292bb8a77abc69989691dec7bb24be: Status 404 returned error can't find the container with id c25a261f740df9b17e3d93bab6981129a4292bb8a77abc69989691dec7bb24be Jun 02 04:49:06.311799 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:06.311762 2581 generic.go:358] "Generic (PLEG): container finished" podID="deb0c6f9-0288-4bd0-b470-a033420bd23a" containerID="a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9" exitCode=0 Jun 02 04:49:06.311987 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:06.311822 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rvhb9" Jun 02 04:49:06.311987 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:06.311872 2581 scope.go:117] "RemoveContainer" containerID="a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9" Jun 02 04:49:06.313345 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:06.313314 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" event={"ID":"10836cc2-81f9-4b1e-9c45-c0edecb84ac4","Type":"ContainerStarted","Data":"ef1b728e8acac611e84f8d60e521915871eb2f3f7445f22274c9d9ccc831bc92"} Jun 02 04:49:06.315133 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:06.315081 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g" event={"ID":"61e7d492-c718-4f55-9aca-393515f8bc13","Type":"ContainerStarted","Data":"ad8e000be6bdf36542708ba1dfe8ea0390edb8cf4917a8e174a71d249cf52337"} Jun 02 04:49:06.315133 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:06.315113 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g" event={"ID":"61e7d492-c718-4f55-9aca-393515f8bc13","Type":"ContainerStarted","Data":"c25a261f740df9b17e3d93bab6981129a4292bb8a77abc69989691dec7bb24be"} Jun 02 04:49:06.315297 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:06.315239 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g" Jun 02 04:49:06.321379 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:06.321357 2581 scope.go:117] "RemoveContainer" containerID="a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9" Jun 02 04:49:06.321646 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:49:06.321622 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9\": container with ID starting with a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9 not found: ID does not exist" containerID="a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9" Jun 02 04:49:06.321752 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:06.321673 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9"} err="failed to get container status \"a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9\": rpc error: code = NotFound desc = could not find container \"a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9\": container with ID starting with a4547543d2649bd352088242bcda2e43deb82ae902659a70fc25efa5d2f90ba9 not found: ID does not exist" Jun 02 04:49:07.760217 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:07.760156 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g" podStartSLOduration=2.760137736 podStartE2EDuration="2.760137736s" podCreationTimestamp="2026-06-02 04:49:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:49:06.34126532 +0000 UTC m=+439.061346393" watchObservedRunningTime="2026-06-02 04:49:07.760137736 +0000 UTC m=+440.480218788" Jun 02 04:49:09.329796 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.329736 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" podUID="d742459d-b972-4cc4-b9c8-9cc2a198b487" containerName="manager" containerID="cri-o://e08d2729b7beb4cb6df7db39ee7fab296fd8092b1cf702d21dc86a4238660d72" gracePeriod=2 Jun 02 04:49:09.331154 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.331125 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" event={"ID":"10836cc2-81f9-4b1e-9c45-c0edecb84ac4","Type":"ContainerStarted","Data":"d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0"} Jun 02 04:49:09.331267 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.331236 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:09.333231 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.333203 2581 status_manager.go:895] "Failed to get status for pod" podUID="d742459d-b972-4cc4-b9c8-9cc2a198b487" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc\" is forbidden: User \"system:node:ip-10-0-137-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-68.ec2.internal' and this object" Jun 02 04:49:09.357646 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.357602 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" podStartSLOduration=1.194144804 podStartE2EDuration="4.357587246s" podCreationTimestamp="2026-06-02 04:49:05 +0000 UTC" firstStartedPulling="2026-06-02 04:49:05.822347797 +0000 UTC m=+438.542428858" lastFinishedPulling="2026-06-02 04:49:08.985790246 +0000 UTC m=+441.705871300" observedRunningTime="2026-06-02 04:49:09.354968904 +0000 UTC m=+442.075049976" watchObservedRunningTime="2026-06-02 04:49:09.357587246 +0000 UTC m=+442.077668318" Jun 02 04:49:09.359065 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.359042 2581 status_manager.go:895] "Failed to get status for pod" podUID="d742459d-b972-4cc4-b9c8-9cc2a198b487" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc\" is forbidden: User \"system:node:ip-10-0-137-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-68.ec2.internal' and this object" Jun 02 04:49:09.561101 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.561081 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" Jun 02 04:49:09.563485 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.563460 2581 status_manager.go:895] "Failed to get status for pod" podUID="d742459d-b972-4cc4-b9c8-9cc2a198b487" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc\" is forbidden: User \"system:node:ip-10-0-137-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-68.ec2.internal' and this object" Jun 02 04:49:09.626055 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.626007 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv2b6\" (UniqueName: \"kubernetes.io/projected/d742459d-b972-4cc4-b9c8-9cc2a198b487-kube-api-access-kv2b6\") pod \"d742459d-b972-4cc4-b9c8-9cc2a198b487\" (UID: \"d742459d-b972-4cc4-b9c8-9cc2a198b487\") " Jun 02 04:49:09.626142 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.626070 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d742459d-b972-4cc4-b9c8-9cc2a198b487-extensions-socket-volume\") pod \"d742459d-b972-4cc4-b9c8-9cc2a198b487\" (UID: \"d742459d-b972-4cc4-b9c8-9cc2a198b487\") " Jun 02 04:49:09.626328 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.626308 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d742459d-b972-4cc4-b9c8-9cc2a198b487-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d742459d-b972-4cc4-b9c8-9cc2a198b487" (UID: "d742459d-b972-4cc4-b9c8-9cc2a198b487"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:49:09.627917 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.627901 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d742459d-b972-4cc4-b9c8-9cc2a198b487-kube-api-access-kv2b6" (OuterVolumeSpecName: "kube-api-access-kv2b6") pod "d742459d-b972-4cc4-b9c8-9cc2a198b487" (UID: "d742459d-b972-4cc4-b9c8-9cc2a198b487"). InnerVolumeSpecName "kube-api-access-kv2b6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:49:09.726652 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.726602 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv2b6\" (UniqueName: \"kubernetes.io/projected/d742459d-b972-4cc4-b9c8-9cc2a198b487-kube-api-access-kv2b6\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:49:09.726652 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.726646 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d742459d-b972-4cc4-b9c8-9cc2a198b487-extensions-socket-volume\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:49:09.733252 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:09.733225 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d742459d-b972-4cc4-b9c8-9cc2a198b487" path="/var/lib/kubelet/pods/d742459d-b972-4cc4-b9c8-9cc2a198b487/volumes" Jun 02 04:49:10.335715 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:10.335611 2581 generic.go:358] "Generic (PLEG): container finished" podID="d742459d-b972-4cc4-b9c8-9cc2a198b487" containerID="e08d2729b7beb4cb6df7db39ee7fab296fd8092b1cf702d21dc86a4238660d72" exitCode=2 Jun 02 04:49:10.335715 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:10.335667 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" Jun 02 04:49:10.335715 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:10.335707 2581 scope.go:117] "RemoveContainer" containerID="e08d2729b7beb4cb6df7db39ee7fab296fd8092b1cf702d21dc86a4238660d72" Jun 02 04:49:10.340666 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:10.340629 2581 status_manager.go:895] "Failed to get status for pod" podUID="d742459d-b972-4cc4-b9c8-9cc2a198b487" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc\" is forbidden: User \"system:node:ip-10-0-137-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-68.ec2.internal' and this object" Jun 02 04:49:10.342971 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:10.342949 2581 status_manager.go:895] "Failed to get status for pod" podUID="d742459d-b972-4cc4-b9c8-9cc2a198b487" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-mbgzc\" is forbidden: User \"system:node:ip-10-0-137-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-68.ec2.internal' and this object" Jun 02 04:49:10.343946 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:10.343934 2581 scope.go:117] "RemoveContainer" containerID="e08d2729b7beb4cb6df7db39ee7fab296fd8092b1cf702d21dc86a4238660d72" Jun 02 04:49:10.344230 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:49:10.344205 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e08d2729b7beb4cb6df7db39ee7fab296fd8092b1cf702d21dc86a4238660d72\": container with ID starting with e08d2729b7beb4cb6df7db39ee7fab296fd8092b1cf702d21dc86a4238660d72 not found: ID does not exist" containerID="e08d2729b7beb4cb6df7db39ee7fab296fd8092b1cf702d21dc86a4238660d72" Jun 02 04:49:10.344290 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:10.344238 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e08d2729b7beb4cb6df7db39ee7fab296fd8092b1cf702d21dc86a4238660d72"} err="failed to get container status \"e08d2729b7beb4cb6df7db39ee7fab296fd8092b1cf702d21dc86a4238660d72\": rpc error: code = NotFound desc = could not find container \"e08d2729b7beb4cb6df7db39ee7fab296fd8092b1cf702d21dc86a4238660d72\": container with ID starting with e08d2729b7beb4cb6df7db39ee7fab296fd8092b1cf702d21dc86a4238660d72 not found: ID does not exist" Jun 02 04:49:17.323485 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:17.323457 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tkn5g" Jun 02 04:49:20.337992 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:20.337956 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:32.608743 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:32.608704 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm"] Jun 02 04:49:32.609504 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:32.609457 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" podUID="10836cc2-81f9-4b1e-9c45-c0edecb84ac4" containerName="manager" containerID="cri-o://d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0" gracePeriod=10 Jun 02 04:49:32.851630 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:32.851605 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:32.909922 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:32.909841 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lppdv\" (UniqueName: \"kubernetes.io/projected/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-kube-api-access-lppdv\") pod \"10836cc2-81f9-4b1e-9c45-c0edecb84ac4\" (UID: \"10836cc2-81f9-4b1e-9c45-c0edecb84ac4\") " Jun 02 04:49:32.909922 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:32.909876 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-extensions-socket-volume\") pod \"10836cc2-81f9-4b1e-9c45-c0edecb84ac4\" (UID: \"10836cc2-81f9-4b1e-9c45-c0edecb84ac4\") " Jun 02 04:49:32.910428 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:32.910394 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "10836cc2-81f9-4b1e-9c45-c0edecb84ac4" (UID: "10836cc2-81f9-4b1e-9c45-c0edecb84ac4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:49:32.912044 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:32.912021 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-kube-api-access-lppdv" (OuterVolumeSpecName: "kube-api-access-lppdv") pod "10836cc2-81f9-4b1e-9c45-c0edecb84ac4" (UID: "10836cc2-81f9-4b1e-9c45-c0edecb84ac4"). InnerVolumeSpecName "kube-api-access-lppdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:49:33.010984 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.010948 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lppdv\" (UniqueName: \"kubernetes.io/projected/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-kube-api-access-lppdv\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:49:33.010984 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.010978 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10836cc2-81f9-4b1e-9c45-c0edecb84ac4-extensions-socket-volume\") on node \"ip-10-0-137-68.ec2.internal\" DevicePath \"\"" Jun 02 04:49:33.420177 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.420140 2581 generic.go:358] "Generic (PLEG): container finished" podID="10836cc2-81f9-4b1e-9c45-c0edecb84ac4" containerID="d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0" exitCode=0 Jun 02 04:49:33.420337 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.420209 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" Jun 02 04:49:33.420337 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.420224 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" event={"ID":"10836cc2-81f9-4b1e-9c45-c0edecb84ac4","Type":"ContainerDied","Data":"d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0"} Jun 02 04:49:33.420337 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.420263 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm" event={"ID":"10836cc2-81f9-4b1e-9c45-c0edecb84ac4","Type":"ContainerDied","Data":"ef1b728e8acac611e84f8d60e521915871eb2f3f7445f22274c9d9ccc831bc92"} Jun 02 04:49:33.420337 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.420278 2581 scope.go:117] "RemoveContainer" containerID="d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0" Jun 02 04:49:33.429139 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.429120 2581 scope.go:117] "RemoveContainer" containerID="d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0" Jun 02 04:49:33.429359 ip-10-0-137-68 kubenswrapper[2581]: E0602 04:49:33.429342 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0\": container with ID starting with d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0 not found: ID does not exist" containerID="d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0" Jun 02 04:49:33.429400 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.429367 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0"} err="failed to get container status \"d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0\": rpc error: code = NotFound desc = could not find container \"d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0\": container with ID starting with d9e11a6fb6d91987e15e6fb3b5e94176f8720a3ab1feb570d4547877b68e42c0 not found: ID does not exist" Jun 02 04:49:33.443437 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.443413 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm"] Jun 02 04:49:33.450905 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.450882 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-t4zfm"] Jun 02 04:49:33.732820 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:33.732744 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10836cc2-81f9-4b1e-9c45-c0edecb84ac4" path="/var/lib/kubelet/pods/10836cc2-81f9-4b1e-9c45-c0edecb84ac4/volumes" Jun 02 04:49:36.741351 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.741306 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb"] Jun 02 04:49:36.741717 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.741681 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10836cc2-81f9-4b1e-9c45-c0edecb84ac4" containerName="manager" Jun 02 04:49:36.741717 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.741693 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="10836cc2-81f9-4b1e-9c45-c0edecb84ac4" containerName="manager" Jun 02 04:49:36.741717 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.741710 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d742459d-b972-4cc4-b9c8-9cc2a198b487" containerName="manager" Jun 02 04:49:36.741717 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.741716 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d742459d-b972-4cc4-b9c8-9cc2a198b487" containerName="manager" Jun 02 04:49:36.741884 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.741779 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="d742459d-b972-4cc4-b9c8-9cc2a198b487" containerName="manager" Jun 02 04:49:36.741884 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.741787 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="10836cc2-81f9-4b1e-9c45-c0edecb84ac4" containerName="manager" Jun 02 04:49:36.746005 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.745983 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.749362 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.749341 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-nlwpb\"" Jun 02 04:49:36.761145 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.761119 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb"] Jun 02 04:49:36.843860 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.843834 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.843985 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.843871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.843985 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.843894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.843985 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.843952 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.844112 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.843989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.844112 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.844066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.844112 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.844095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.844258 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.844150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6svk\" (UniqueName: \"kubernetes.io/projected/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-kube-api-access-c6svk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.844258 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.844211 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.945190 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.945151 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.945368 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.945221 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.945368 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.945257 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.945368 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.945299 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.945368 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.945326 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.945567 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.945373 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.945567 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.945398 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.945567 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.945424 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6svk\" (UniqueName: \"kubernetes.io/projected/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-kube-api-access-c6svk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.945567 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.945466 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.945778 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.945570 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.945858 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.945835 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.947242 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.946336 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.947367 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.946496 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.947442 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.947187 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.948855 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.948831 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.949878 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.949855 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.955069 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.955041 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6svk\" (UniqueName: \"kubernetes.io/projected/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-kube-api-access-c6svk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:36.955252 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:36.955231 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fac68ad7-b2f7-4658-b42d-5a30ac30ab30-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s2bfb\" (UID: \"fac68ad7-b2f7-4658-b42d-5a30ac30ab30\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:37.061959 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:37.061924 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:37.196767 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:37.196713 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb"] Jun 02 04:49:37.199910 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:49:37.199881 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac68ad7_b2f7_4658_b42d_5a30ac30ab30.slice/crio-f0ac705015a5c1b390080d6077761d3b7e815193db1541edd259045872252517 WatchSource:0}: Error finding container f0ac705015a5c1b390080d6077761d3b7e815193db1541edd259045872252517: Status 404 returned error can't find the container with id f0ac705015a5c1b390080d6077761d3b7e815193db1541edd259045872252517 Jun 02 04:49:37.202016 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:37.201987 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 04:49:37.202099 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:37.202054 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 04:49:37.202099 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:37.202081 2581 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 04:49:37.437609 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:37.437502 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" event={"ID":"fac68ad7-b2f7-4658-b42d-5a30ac30ab30","Type":"ContainerStarted","Data":"743d5a4c11adfbe3d7e80a6e21e808c2fee717b885b850b79d8fbc729b6983ad"} Jun 02 04:49:37.437609 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:37.437553 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" event={"ID":"fac68ad7-b2f7-4658-b42d-5a30ac30ab30","Type":"ContainerStarted","Data":"f0ac705015a5c1b390080d6077761d3b7e815193db1541edd259045872252517"} Jun 02 04:49:37.462618 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:37.462574 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" podStartSLOduration=1.462561699 podStartE2EDuration="1.462561699s" podCreationTimestamp="2026-06-02 04:49:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:49:37.459956136 +0000 UTC m=+470.180037207" watchObservedRunningTime="2026-06-02 04:49:37.462561699 +0000 UTC m=+470.182642772" Jun 02 04:49:38.063038 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:38.062995 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:38.068639 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:38.068608 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:38.441599 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:38.441514 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:38.442458 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:38.442442 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s2bfb" Jun 02 04:49:52.364718 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.364686 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:49:52.369943 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.369922 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" Jun 02 04:49:52.372482 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.372462 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-264pp\"" Jun 02 04:49:52.372596 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.372540 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 04:49:52.376690 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.376647 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:49:52.382103 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.382078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdsml\" (UniqueName: \"kubernetes.io/projected/44519025-9249-4008-bcc5-65ad41a760f7-kube-api-access-qdsml\") pod \"limitador-limitador-78c99df468-twpt7\" (UID: \"44519025-9249-4008-bcc5-65ad41a760f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" Jun 02 04:49:52.382215 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.382121 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/44519025-9249-4008-bcc5-65ad41a760f7-config-file\") pod \"limitador-limitador-78c99df468-twpt7\" (UID: \"44519025-9249-4008-bcc5-65ad41a760f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" Jun 02 04:49:52.411267 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.411243 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:49:52.482914 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.482890 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdsml\" (UniqueName: \"kubernetes.io/projected/44519025-9249-4008-bcc5-65ad41a760f7-kube-api-access-qdsml\") pod \"limitador-limitador-78c99df468-twpt7\" (UID: \"44519025-9249-4008-bcc5-65ad41a760f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" Jun 02 04:49:52.483022 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.482940 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/44519025-9249-4008-bcc5-65ad41a760f7-config-file\") pod \"limitador-limitador-78c99df468-twpt7\" (UID: \"44519025-9249-4008-bcc5-65ad41a760f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" Jun 02 04:49:52.483488 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.483469 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/44519025-9249-4008-bcc5-65ad41a760f7-config-file\") pod \"limitador-limitador-78c99df468-twpt7\" (UID: \"44519025-9249-4008-bcc5-65ad41a760f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" Jun 02 04:49:52.493022 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.492997 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdsml\" (UniqueName: \"kubernetes.io/projected/44519025-9249-4008-bcc5-65ad41a760f7-kube-api-access-qdsml\") pod \"limitador-limitador-78c99df468-twpt7\" (UID: \"44519025-9249-4008-bcc5-65ad41a760f7\") " pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" Jun 02 04:49:52.682004 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.681919 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" Jun 02 04:49:52.814319 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:52.814298 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:49:52.816065 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:49:52.816037 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44519025_9249_4008_bcc5_65ad41a760f7.slice/crio-1d444400e4f01dea447b4afdf94282e78669aac27ee94b1f4f23d83c2f1e4a81 WatchSource:0}: Error finding container 1d444400e4f01dea447b4afdf94282e78669aac27ee94b1f4f23d83c2f1e4a81: Status 404 returned error can't find the container with id 1d444400e4f01dea447b4afdf94282e78669aac27ee94b1f4f23d83c2f1e4a81 Jun 02 04:49:53.499673 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:53.499537 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" event={"ID":"44519025-9249-4008-bcc5-65ad41a760f7","Type":"ContainerStarted","Data":"1d444400e4f01dea447b4afdf94282e78669aac27ee94b1f4f23d83c2f1e4a81"} Jun 02 04:49:55.509319 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:55.509287 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" event={"ID":"44519025-9249-4008-bcc5-65ad41a760f7","Type":"ContainerStarted","Data":"d822b9a23d9dc7a04137894bda8c9939c06ed7d5198d7a3cd60d4a6d216423c5"} Jun 02 04:49:55.509750 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:55.509392 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" Jun 02 04:49:55.530116 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:49:55.530070 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" podStartSLOduration=1.160388979 podStartE2EDuration="3.530058698s" podCreationTimestamp="2026-06-02 04:49:52 +0000 UTC" firstStartedPulling="2026-06-02 04:49:52.817821198 +0000 UTC m=+485.537902260" lastFinishedPulling="2026-06-02 04:49:55.18749092 +0000 UTC m=+487.907571979" observedRunningTime="2026-06-02 04:49:55.529001991 +0000 UTC m=+488.249083063" watchObservedRunningTime="2026-06-02 04:49:55.530058698 +0000 UTC m=+488.250139770" Jun 02 04:50:06.515936 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:50:06.515908 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-twpt7" Jun 02 04:52:01.370595 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.370559 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7c65995bd6-47trx"] Jun 02 04:52:01.373926 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.373910 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7c65995bd6-47trx" Jun 02 04:52:01.376682 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.376649 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 02 04:52:01.385712 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.385692 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7c65995bd6-47trx"] Jun 02 04:52:01.496601 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.496566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ef6e64d-6924-479e-907e-da9a22c9e7fc-maas-api-tls\") pod \"maas-api-7c65995bd6-47trx\" (UID: \"3ef6e64d-6924-479e-907e-da9a22c9e7fc\") " pod="opendatahub/maas-api-7c65995bd6-47trx" Jun 02 04:52:01.496815 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.496607 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgttr\" (UniqueName: \"kubernetes.io/projected/3ef6e64d-6924-479e-907e-da9a22c9e7fc-kube-api-access-vgttr\") pod \"maas-api-7c65995bd6-47trx\" (UID: \"3ef6e64d-6924-479e-907e-da9a22c9e7fc\") " pod="opendatahub/maas-api-7c65995bd6-47trx" Jun 02 04:52:01.598221 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.598170 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgttr\" (UniqueName: \"kubernetes.io/projected/3ef6e64d-6924-479e-907e-da9a22c9e7fc-kube-api-access-vgttr\") pod \"maas-api-7c65995bd6-47trx\" (UID: \"3ef6e64d-6924-479e-907e-da9a22c9e7fc\") " pod="opendatahub/maas-api-7c65995bd6-47trx" Jun 02 04:52:01.598406 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.598334 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ef6e64d-6924-479e-907e-da9a22c9e7fc-maas-api-tls\") pod \"maas-api-7c65995bd6-47trx\" (UID: \"3ef6e64d-6924-479e-907e-da9a22c9e7fc\") " pod="opendatahub/maas-api-7c65995bd6-47trx" Jun 02 04:52:01.601001 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.600973 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ef6e64d-6924-479e-907e-da9a22c9e7fc-maas-api-tls\") pod \"maas-api-7c65995bd6-47trx\" (UID: \"3ef6e64d-6924-479e-907e-da9a22c9e7fc\") " pod="opendatahub/maas-api-7c65995bd6-47trx" Jun 02 04:52:01.605998 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.605971 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgttr\" (UniqueName: \"kubernetes.io/projected/3ef6e64d-6924-479e-907e-da9a22c9e7fc-kube-api-access-vgttr\") pod \"maas-api-7c65995bd6-47trx\" (UID: \"3ef6e64d-6924-479e-907e-da9a22c9e7fc\") " pod="opendatahub/maas-api-7c65995bd6-47trx" Jun 02 04:52:01.684884 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.684813 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7c65995bd6-47trx" Jun 02 04:52:01.821332 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.821309 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7c65995bd6-47trx"] Jun 02 04:52:01.823947 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:52:01.823914 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef6e64d_6924_479e_907e_da9a22c9e7fc.slice/crio-243b5397eff271576a6ec142841ec6b8d128492a4abfa8b2078179fbcf29bc8d WatchSource:0}: Error finding container 243b5397eff271576a6ec142841ec6b8d128492a4abfa8b2078179fbcf29bc8d: Status 404 returned error can't find the container with id 243b5397eff271576a6ec142841ec6b8d128492a4abfa8b2078179fbcf29bc8d Jun 02 04:52:01.932054 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.932020 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7czmd"] Jun 02 04:52:01.936852 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.936776 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7czmd" Jun 02 04:52:01.939603 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.939579 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 04:52:01.939749 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.939606 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wqhbn\"" Jun 02 04:52:01.947739 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.947717 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7czmd"] Jun 02 04:52:01.954164 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.954135 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7c65995bd6-47trx" event={"ID":"3ef6e64d-6924-479e-907e-da9a22c9e7fc","Type":"ContainerStarted","Data":"243b5397eff271576a6ec142841ec6b8d128492a4abfa8b2078179fbcf29bc8d"} Jun 02 04:52:01.967582 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:01.967555 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:52:02.104020 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:02.103985 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5b6x\" (UniqueName: \"kubernetes.io/projected/d2bb7f10-4124-4a23-931e-741cff153f81-kube-api-access-f5b6x\") pod \"payload-processing-58b6c8fdc7-7czmd\" (UID: \"d2bb7f10-4124-4a23-931e-741cff153f81\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7czmd" Jun 02 04:52:02.205006 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:02.204885 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5b6x\" (UniqueName: \"kubernetes.io/projected/d2bb7f10-4124-4a23-931e-741cff153f81-kube-api-access-f5b6x\") pod \"payload-processing-58b6c8fdc7-7czmd\" (UID: \"d2bb7f10-4124-4a23-931e-741cff153f81\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7czmd" Jun 02 04:52:02.213332 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:02.213308 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5b6x\" (UniqueName: \"kubernetes.io/projected/d2bb7f10-4124-4a23-931e-741cff153f81-kube-api-access-f5b6x\") pod \"payload-processing-58b6c8fdc7-7czmd\" (UID: \"d2bb7f10-4124-4a23-931e-741cff153f81\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7czmd" Jun 02 04:52:02.248955 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:02.248929 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7czmd" Jun 02 04:52:02.400623 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:02.400595 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7czmd"] Jun 02 04:52:02.403212 ip-10-0-137-68 kubenswrapper[2581]: W0602 04:52:02.403179 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2bb7f10_4124_4a23_931e_741cff153f81.slice/crio-590e652f434847b76b5d8fbce1925f10fa4582f61f8e62b3740e07122d4a22ab WatchSource:0}: Error finding container 590e652f434847b76b5d8fbce1925f10fa4582f61f8e62b3740e07122d4a22ab: Status 404 returned error can't find the container with id 590e652f434847b76b5d8fbce1925f10fa4582f61f8e62b3740e07122d4a22ab Jun 02 04:52:02.966104 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:02.966068 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7czmd" event={"ID":"d2bb7f10-4124-4a23-931e-741cff153f81","Type":"ContainerStarted","Data":"590e652f434847b76b5d8fbce1925f10fa4582f61f8e62b3740e07122d4a22ab"} Jun 02 04:52:05.981019 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:05.980979 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7c65995bd6-47trx" event={"ID":"3ef6e64d-6924-479e-907e-da9a22c9e7fc","Type":"ContainerStarted","Data":"4285c87ebccc22aa533c0376cca3cb93b13bf0d095983c608dd5f76cfe45410e"} Jun 02 04:52:05.981474 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:05.981123 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7c65995bd6-47trx" Jun 02 04:52:05.982457 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:05.982431 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7czmd" event={"ID":"d2bb7f10-4124-4a23-931e-741cff153f81","Type":"ContainerStarted","Data":"84d1c6a25165295204bc711f181521dec85c534e930baafd82eb32ef47f6b6f7"} Jun 02 04:52:05.982603 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:05.982506 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7czmd" Jun 02 04:52:06.002449 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:06.002390 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-7c65995bd6-47trx" podStartSLOduration=1.792588835 podStartE2EDuration="5.002374018s" podCreationTimestamp="2026-06-02 04:52:01 +0000 UTC" firstStartedPulling="2026-06-02 04:52:01.82506975 +0000 UTC m=+614.545150804" lastFinishedPulling="2026-06-02 04:52:05.034854928 +0000 UTC m=+617.754935987" observedRunningTime="2026-06-02 04:52:06.000500112 +0000 UTC m=+618.720581185" watchObservedRunningTime="2026-06-02 04:52:06.002374018 +0000 UTC m=+618.722455092" Jun 02 04:52:06.017621 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:06.017573 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-7czmd" podStartSLOduration=2.385791645 podStartE2EDuration="5.017559391s" podCreationTimestamp="2026-06-02 04:52:01 +0000 UTC" firstStartedPulling="2026-06-02 04:52:02.405601885 +0000 UTC m=+615.125682950" lastFinishedPulling="2026-06-02 04:52:05.037369644 +0000 UTC m=+617.757450696" observedRunningTime="2026-06-02 04:52:06.016321897 +0000 UTC m=+618.736402972" watchObservedRunningTime="2026-06-02 04:52:06.017559391 +0000 UTC m=+618.737640462" Jun 02 04:52:11.991138 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:11.991105 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7c65995bd6-47trx" Jun 02 04:52:16.988633 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:52:16.988604 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7czmd" Jun 02 04:53:20.854258 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:53:20.854222 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:53:26.993269 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:53:26.993226 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:53:30.382745 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:53:30.382704 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:53:42.642314 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:53:42.642272 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:53:53.344384 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:53:53.344346 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:53:59.552724 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:53:59.552683 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:56:04.343116 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:56:04.343079 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:56:15.537789 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:56:15.537751 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:56:23.834845 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:56:23.834811 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:56:34.360446 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:56:34.360412 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:56:43.936174 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:56:43.936131 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:56:52.839940 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:56:52.839901 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:58:06.937967 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:58:06.937929 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:58:22.636802 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:58:22.636767 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:59:01.444127 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:59:01.444089 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:59:17.929000 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:59:17.928970 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:59:31.738110 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:59:31.738025 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 04:59:48.132411 ip-10-0-137-68 kubenswrapper[2581]: I0602 04:59:48.132372 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:00:48.557256 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:00:48.557221 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:00:58.449327 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:00:58.449243 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:01:14.240301 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:01:14.240265 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:01:22.843492 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:01:22.843460 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:01:39.338472 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:01:39.338435 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:01:47.749294 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:01:47.749265 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:02:20.559779 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:02:20.559747 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:02:28.738494 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:02:28.738419 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:02:37.340104 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:02:37.340068 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:02:45.641765 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:02:45.641728 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:02:53.344470 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:02:53.344434 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:03:10.344619 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:03:10.344582 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:03:24.441922 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:03:24.441889 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:04:11.644868 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:04:11.644831 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:04:19.838507 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:04:19.838475 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:04:25.640976 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:04:25.640940 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:04:33.934296 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:04:33.934261 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:04:42.744319 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:04:42.744284 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:04:52.442526 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:04:52.442491 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:05:01.038975 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:05:01.038937 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:05:09.750085 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:05:09.750042 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:05:16.544782 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:05:16.544753 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:05:27.137915 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:05:27.137828 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:05:35.848052 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:05:35.848021 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:05:42.842676 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:05:42.842624 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:05:53.030589 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:05:53.030560 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:06:01.843590 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:06:01.843550 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:06:10.659296 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:06:10.659259 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:06:19.349079 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:06:19.349045 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:06:27.846389 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:06:27.846348 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:06:37.272313 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:06:37.272277 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:06:43.583425 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:06:43.583386 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:06:51.488419 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:06:51.488388 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:08:32.781323 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:32.781245 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m"] Jun 02 05:08:32.785117 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:32.785101 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" Jun 02 05:08:32.789735 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:32.789715 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kmqgm\"" Jun 02 05:08:32.808572 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:32.808550 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m"] Jun 02 05:08:32.916363 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:32.916312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwtw2\" (UniqueName: \"kubernetes.io/projected/f2fd5a16-422b-48c9-8bca-a4b7185fda08-kube-api-access-pwtw2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hjk8m\" (UID: \"f2fd5a16-422b-48c9-8bca-a4b7185fda08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" Jun 02 05:08:32.916527 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:32.916414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2fd5a16-422b-48c9-8bca-a4b7185fda08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hjk8m\" (UID: \"f2fd5a16-422b-48c9-8bca-a4b7185fda08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" Jun 02 05:08:33.016962 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:33.016926 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2fd5a16-422b-48c9-8bca-a4b7185fda08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hjk8m\" (UID: \"f2fd5a16-422b-48c9-8bca-a4b7185fda08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" Jun 02 05:08:33.017136 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:33.016996 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwtw2\" (UniqueName: \"kubernetes.io/projected/f2fd5a16-422b-48c9-8bca-a4b7185fda08-kube-api-access-pwtw2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hjk8m\" (UID: \"f2fd5a16-422b-48c9-8bca-a4b7185fda08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" Jun 02 05:08:33.017313 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:33.017288 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2fd5a16-422b-48c9-8bca-a4b7185fda08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hjk8m\" (UID: \"f2fd5a16-422b-48c9-8bca-a4b7185fda08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" Jun 02 05:08:33.026374 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:33.026345 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwtw2\" (UniqueName: \"kubernetes.io/projected/f2fd5a16-422b-48c9-8bca-a4b7185fda08-kube-api-access-pwtw2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-hjk8m\" (UID: \"f2fd5a16-422b-48c9-8bca-a4b7185fda08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" Jun 02 05:08:33.095074 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:33.095014 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" Jun 02 05:08:33.234444 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:33.234329 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m"] Jun 02 05:08:33.237462 ip-10-0-137-68 kubenswrapper[2581]: W0602 05:08:33.237437 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2fd5a16_422b_48c9_8bca_a4b7185fda08.slice/crio-8bce5463255b87e5da6bef0fd6450eca02d28d00b1768fd0f5cd75715e78c792 WatchSource:0}: Error finding container 8bce5463255b87e5da6bef0fd6450eca02d28d00b1768fd0f5cd75715e78c792: Status 404 returned error can't find the container with id 8bce5463255b87e5da6bef0fd6450eca02d28d00b1768fd0f5cd75715e78c792 Jun 02 05:08:33.239765 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:33.239748 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 05:08:33.458298 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:33.458214 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" event={"ID":"f2fd5a16-422b-48c9-8bca-a4b7185fda08","Type":"ContainerStarted","Data":"ea082bfd66bd0c3cdfc7613f05c7cbbe12ada7731f104dd3e93e9ae192a6ddba"} Jun 02 05:08:33.458298 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:33.458260 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" event={"ID":"f2fd5a16-422b-48c9-8bca-a4b7185fda08","Type":"ContainerStarted","Data":"8bce5463255b87e5da6bef0fd6450eca02d28d00b1768fd0f5cd75715e78c792"} Jun 02 05:08:33.458462 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:33.458337 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" Jun 02 05:08:33.480919 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:33.480876 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" podStartSLOduration=1.4808643670000001 podStartE2EDuration="1.480864367s" podCreationTimestamp="2026-06-02 05:08:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:08:33.47931319 +0000 UTC m=+1606.199394261" watchObservedRunningTime="2026-06-02 05:08:33.480864367 +0000 UTC m=+1606.200945439" Jun 02 05:08:44.467527 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:44.467496 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-hjk8m" Jun 02 05:08:51.712709 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:51.712673 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:08:58.395849 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:08:58.395815 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:09:23.604772 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:09:23.604737 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:09:29.895598 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:09:29.895563 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:09:40.401575 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:09:40.401533 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:09:49.901374 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:09:49.901342 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:09:59.814218 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:09:59.814178 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:10:08.907949 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:10:08.907908 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:10:19.600214 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:10:19.600179 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:10:28.194898 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:10:28.194865 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:10:38.012822 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:10:38.012784 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:10:49.100041 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:10:49.100011 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:10:57.810915 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:10:57.810881 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:11:32.335583 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:11:32.335544 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:12:15.807789 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:12:15.807754 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:12:24.996939 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:12:24.996899 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:12:33.206169 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:12:33.206132 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:12:40.904458 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:12:40.904423 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:12:48.902348 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:12:48.902313 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:13:01.805932 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:13:01.805892 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:13:11.908133 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:13:11.908089 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:13:20.016165 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:13:20.016132 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:13:30.411386 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:13:30.411348 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:13:40.004979 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:13:40.004935 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:13:46.197065 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:13:46.197030 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:13:58.998622 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:13:58.998587 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:14:16.902231 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:14:16.902199 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:14:25.795928 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:14:25.795847 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:14:34.898902 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:14:34.898869 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:14:44.103636 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:14:44.103603 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:14:59.105350 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:14:59.105313 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:15:08.496548 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:15:08.496516 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:15:17.301441 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:15:17.301406 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:15:26.096501 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:15:26.096467 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:15:34.920879 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:15:34.920840 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:15:44.199913 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:15:44.199880 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:15:52.800342 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:15:52.800306 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:16:05.901425 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:16:05.901386 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:16:14.899277 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:16:14.899241 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:16:28.208823 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:16:28.205204 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:16:37.204081 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:16:37.204049 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:16:48.002996 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:16:48.002964 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:16:54.115063 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:16:54.115027 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:17:04.002335 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:17:04.002298 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:17:18.910548 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:17:18.910512 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:17:28.010378 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:17:28.010294 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:17:36.797481 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:17:36.797444 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:17:47.204187 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:17:47.204153 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:18:10.395797 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:10.395760 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:18:22.999434 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:22.999396 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-twpt7"] Jun 02 05:18:33.385072 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:33.385043 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5b88b8b9b4-5wxrn_f9888d12-5348-4435-9e90-50e0974d27b0/nginx/0.log" Jun 02 05:18:33.855776 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:33.855749 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7c65995bd6-47trx_3ef6e64d-6924-479e-907e-da9a22c9e7fc/maas-api/0.log" Jun 02 05:18:34.520375 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:34.520348 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b5b979d7-4bjbt_fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8/copy-manifests/0.log" Jun 02 05:18:34.533956 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:34.533932 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b5b979d7-4bjbt_fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8/manager/0.log" Jun 02 05:18:36.215791 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:36.215761 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-4v4wd_4ce33235-3b03-49ba-a068-9e7207113b8a/manager/0.log" Jun 02 05:18:36.548425 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:36.548398 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fxb7x_879cb067-6de1-4fe5-a78a-98424852f7c4/registry-server/0.log" Jun 02 05:18:36.666580 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:36.666551 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-hjk8m_f2fd5a16-422b-48c9-8bca-a4b7185fda08/manager/0.log" Jun 02 05:18:36.786957 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:36.786930 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-twpt7_44519025-9249-4008-bcc5-65ad41a760f7/limitador/0.log" Jun 02 05:18:36.904007 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:36.903922 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-tkn5g_61e7d492-c718-4f55-9aca-393515f8bc13/manager/0.log" Jun 02 05:18:37.242393 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:37.242315 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9_8a3d4558-72e3-49aa-92eb-fab7243b0a6d/istio-proxy/0.log" Jun 02 05:18:37.701594 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:37.701568 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-s2bfb_fac68ad7-b2f7-4658-b42d-5a30ac30ab30/istio-proxy/0.log" Jun 02 05:18:37.817333 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:37.817302 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7czmd_d2bb7f10-4124-4a23-931e-741cff153f81/payload-processing/0.log" Jun 02 05:18:42.581628 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.581598 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-htn26/must-gather-8pm9m"] Jun 02 05:18:42.585126 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.585103 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htn26/must-gather-8pm9m" Jun 02 05:18:42.587581 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.587556 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-htn26\"/\"default-dockercfg-c9nmg\"" Jun 02 05:18:42.587733 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.587593 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-htn26\"/\"kube-root-ca.crt\"" Jun 02 05:18:42.587733 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.587600 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-htn26\"/\"openshift-service-ca.crt\"" Jun 02 05:18:42.603222 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.603200 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-htn26/must-gather-8pm9m"] Jun 02 05:18:42.661730 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.661707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bts5w\" (UniqueName: \"kubernetes.io/projected/6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3-kube-api-access-bts5w\") pod \"must-gather-8pm9m\" (UID: \"6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3\") " pod="openshift-must-gather-htn26/must-gather-8pm9m" Jun 02 05:18:42.661854 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.661764 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3-must-gather-output\") pod \"must-gather-8pm9m\" (UID: \"6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3\") " pod="openshift-must-gather-htn26/must-gather-8pm9m" Jun 02 05:18:42.762782 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.762750 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bts5w\" (UniqueName: \"kubernetes.io/projected/6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3-kube-api-access-bts5w\") pod \"must-gather-8pm9m\" (UID: \"6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3\") " pod="openshift-must-gather-htn26/must-gather-8pm9m" Jun 02 05:18:42.762977 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.762818 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3-must-gather-output\") pod \"must-gather-8pm9m\" (UID: \"6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3\") " pod="openshift-must-gather-htn26/must-gather-8pm9m" Jun 02 05:18:42.763106 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.763090 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3-must-gather-output\") pod \"must-gather-8pm9m\" (UID: \"6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3\") " pod="openshift-must-gather-htn26/must-gather-8pm9m" Jun 02 05:18:42.772364 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.772343 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bts5w\" (UniqueName: \"kubernetes.io/projected/6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3-kube-api-access-bts5w\") pod \"must-gather-8pm9m\" (UID: \"6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3\") " pod="openshift-must-gather-htn26/must-gather-8pm9m" Jun 02 05:18:42.895145 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:42.895069 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htn26/must-gather-8pm9m" Jun 02 05:18:43.028737 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:43.028711 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-htn26/must-gather-8pm9m"] Jun 02 05:18:43.030635 ip-10-0-137-68 kubenswrapper[2581]: W0602 05:18:43.030608 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ec40608_85ae_41cd_9d9a_98d7fa1b2fd3.slice/crio-121d3798299ea508bb87ab1ef1a072849416e298a5c9dae4aac585234b7630be WatchSource:0}: Error finding container 121d3798299ea508bb87ab1ef1a072849416e298a5c9dae4aac585234b7630be: Status 404 returned error can't find the container with id 121d3798299ea508bb87ab1ef1a072849416e298a5c9dae4aac585234b7630be Jun 02 05:18:43.032363 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:43.032346 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 05:18:43.646123 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:43.646045 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htn26/must-gather-8pm9m" event={"ID":"6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3","Type":"ContainerStarted","Data":"121d3798299ea508bb87ab1ef1a072849416e298a5c9dae4aac585234b7630be"} Jun 02 05:18:44.652678 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:44.652157 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htn26/must-gather-8pm9m" event={"ID":"6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3","Type":"ContainerStarted","Data":"389718d975ac50be7ed79314705146d1dc260e0ed95d986cea63885c26a1d1ec"} Jun 02 05:18:44.652678 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:44.652208 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htn26/must-gather-8pm9m" event={"ID":"6ec40608-85ae-41cd-9d9a-98d7fa1b2fd3","Type":"ContainerStarted","Data":"2db3c75cd0350f3e53e8d048df26d893fb3320927ebfe88a309ab2cc0bb6843a"} Jun 02 05:18:44.669790 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:44.669741 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-htn26/must-gather-8pm9m" podStartSLOduration=1.795267926 podStartE2EDuration="2.669726043s" podCreationTimestamp="2026-06-02 05:18:42 +0000 UTC" firstStartedPulling="2026-06-02 05:18:43.032500673 +0000 UTC m=+2215.752581723" lastFinishedPulling="2026-06-02 05:18:43.906958791 +0000 UTC m=+2216.627039840" observedRunningTime="2026-06-02 05:18:44.668290457 +0000 UTC m=+2217.388371530" watchObservedRunningTime="2026-06-02 05:18:44.669726043 +0000 UTC m=+2217.389807116" Jun 02 05:18:45.834546 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:45.834514 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nmvp2_71c98ea9-8e1e-4212-96dc-145382663a08/global-pull-secret-syncer/0.log" Jun 02 05:18:45.923541 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:45.923515 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g5669_c81af97d-0b33-4eb4-8232-77194832e87d/konnectivity-agent/0.log" Jun 02 05:18:46.028999 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:46.028961 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-68.ec2.internal_21f9de860893d0dc1f71b43e21b59dae/haproxy/0.log" Jun 02 05:18:50.840351 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:50.840312 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-4v4wd_4ce33235-3b03-49ba-a068-9e7207113b8a/manager/0.log" Jun 02 05:18:50.961095 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:50.961061 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fxb7x_879cb067-6de1-4fe5-a78a-98424852f7c4/registry-server/0.log" Jun 02 05:18:51.034996 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:51.034957 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-hjk8m_f2fd5a16-422b-48c9-8bca-a4b7185fda08/manager/0.log" Jun 02 05:18:51.059569 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:51.059541 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-twpt7_44519025-9249-4008-bcc5-65ad41a760f7/limitador/0.log" Jun 02 05:18:51.134731 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:51.134640 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-tkn5g_61e7d492-c718-4f55-9aca-393515f8bc13/manager/0.log" Jun 02 05:18:52.922171 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:52.922141 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-tdm72_d9a19933-7423-4f1a-981c-ace4e3eef7af/kube-state-metrics/0.log" Jun 02 05:18:52.949483 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:52.949446 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-tdm72_d9a19933-7423-4f1a-981c-ace4e3eef7af/kube-rbac-proxy-main/0.log" Jun 02 05:18:52.975772 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:52.975741 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-tdm72_d9a19933-7423-4f1a-981c-ace4e3eef7af/kube-rbac-proxy-self/0.log" Jun 02 05:18:53.023385 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.023358 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b57449cb-z9s56_7090b5c9-bb09-42cd-9ef7-d4610deb57a2/metrics-server/0.log" Jun 02 05:18:53.097648 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.097609 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-588cz_89597f8d-7930-4022-b859-dffd05994f4b/node-exporter/0.log" Jun 02 05:18:53.130962 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.130878 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-588cz_89597f8d-7930-4022-b859-dffd05994f4b/kube-rbac-proxy/0.log" Jun 02 05:18:53.154924 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.154893 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-588cz_89597f8d-7930-4022-b859-dffd05994f4b/init-textfile/0.log" Jun 02 05:18:53.357731 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.357703 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-s8plq_e920252e-386d-49aa-8c66-27b8b6d97455/kube-rbac-proxy-main/0.log" Jun 02 05:18:53.381861 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.381778 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-s8plq_e920252e-386d-49aa-8c66-27b8b6d97455/kube-rbac-proxy-self/0.log" Jun 02 05:18:53.410129 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.410090 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-s8plq_e920252e-386d-49aa-8c66-27b8b6d97455/openshift-state-metrics/0.log" Jun 02 05:18:53.457959 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.457929 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f79a982-9e69-4205-8a67-a633e381f3be/prometheus/0.log" Jun 02 05:18:53.490218 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.490190 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f79a982-9e69-4205-8a67-a633e381f3be/config-reloader/0.log" Jun 02 05:18:53.516426 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.516400 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f79a982-9e69-4205-8a67-a633e381f3be/thanos-sidecar/0.log" Jun 02 05:18:53.542779 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.542756 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f79a982-9e69-4205-8a67-a633e381f3be/kube-rbac-proxy-web/0.log" Jun 02 05:18:53.569955 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.569920 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f79a982-9e69-4205-8a67-a633e381f3be/kube-rbac-proxy/0.log" Jun 02 05:18:53.593943 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.593914 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f79a982-9e69-4205-8a67-a633e381f3be/kube-rbac-proxy-thanos/0.log" Jun 02 05:18:53.618539 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.618475 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8f79a982-9e69-4205-8a67-a633e381f3be/init-config-reloader/0.log" Jun 02 05:18:53.655076 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.654973 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-x4p6t_d211fd61-1fd1-461d-984d-59f066f785d4/prometheus-operator/0.log" Jun 02 05:18:53.678235 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.678210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-x4p6t_d211fd61-1fd1-461d-984d-59f066f785d4/kube-rbac-proxy/0.log" Jun 02 05:18:53.706190 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.706143 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-klrb6_4c5be880-75fb-4806-9d0c-dd7f6cf3fefa/prometheus-operator-admission-webhook/0.log" Jun 02 05:18:53.814824 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.814797 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575c555849-dmm8q_dbd675cb-7425-415d-b59c-b88589c29988/thanos-query/0.log" Jun 02 05:18:53.840782 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.840753 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575c555849-dmm8q_dbd675cb-7425-415d-b59c-b88589c29988/kube-rbac-proxy-web/0.log" Jun 02 05:18:53.863268 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.863214 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575c555849-dmm8q_dbd675cb-7425-415d-b59c-b88589c29988/kube-rbac-proxy/0.log" Jun 02 05:18:53.898276 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.898247 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575c555849-dmm8q_dbd675cb-7425-415d-b59c-b88589c29988/prom-label-proxy/0.log" Jun 02 05:18:53.921366 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.921271 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575c555849-dmm8q_dbd675cb-7425-415d-b59c-b88589c29988/kube-rbac-proxy-rules/0.log" Jun 02 05:18:53.943800 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:53.943771 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575c555849-dmm8q_dbd675cb-7425-415d-b59c-b88589c29988/kube-rbac-proxy-metrics/0.log" Jun 02 05:18:56.189841 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.189732 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-wcfss_be93c146-0e91-4c06-91b1-6855da536ab3/download-server/0.log" Jun 02 05:18:56.677869 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.677834 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw"] Jun 02 05:18:56.683819 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.683791 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.688013 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.687985 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw"] Jun 02 05:18:56.806882 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.806850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-lib-modules\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.807051 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.806888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8ntm\" (UniqueName: \"kubernetes.io/projected/29773885-b483-4909-92e3-def4f311fe70-kube-api-access-s8ntm\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.807051 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.806929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-sys\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.807051 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.806950 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-podres\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.807051 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.806983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-proc\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.908163 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.908110 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-lib-modules\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.908357 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.908211 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8ntm\" (UniqueName: \"kubernetes.io/projected/29773885-b483-4909-92e3-def4f311fe70-kube-api-access-s8ntm\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.908357 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.908234 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-lib-modules\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.908357 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.908270 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-sys\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.908357 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.908315 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-podres\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.908546 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.908368 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-sys\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.908546 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.908384 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-proc\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.908546 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.908462 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-podres\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.908546 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.908499 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/29773885-b483-4909-92e3-def4f311fe70-proc\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:56.916703 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:56.916673 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8ntm\" (UniqueName: \"kubernetes.io/projected/29773885-b483-4909-92e3-def4f311fe70-kube-api-access-s8ntm\") pod \"perf-node-gather-daemonset-9kxtw\" (UID: \"29773885-b483-4909-92e3-def4f311fe70\") " pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:57.001801 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:57.001770 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:57.156209 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:57.155955 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw"] Jun 02 05:18:57.159753 ip-10-0-137-68 kubenswrapper[2581]: W0602 05:18:57.159723 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod29773885_b483_4909_92e3_def4f311fe70.slice/crio-2913359cafe9af7f35a38c83444bcfe6ee7f6d0399f80ba66196f39476045b2e WatchSource:0}: Error finding container 2913359cafe9af7f35a38c83444bcfe6ee7f6d0399f80ba66196f39476045b2e: Status 404 returned error can't find the container with id 2913359cafe9af7f35a38c83444bcfe6ee7f6d0399f80ba66196f39476045b2e Jun 02 05:18:57.572090 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:57.572057 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-48x8n_0a385c07-c5f3-4ce4-b3ea-17ce928bc66e/dns/0.log" Jun 02 05:18:57.594024 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:57.593999 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-48x8n_0a385c07-c5f3-4ce4-b3ea-17ce928bc66e/kube-rbac-proxy/0.log" Jun 02 05:18:57.717340 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:57.717302 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" event={"ID":"29773885-b483-4909-92e3-def4f311fe70","Type":"ContainerStarted","Data":"de6050bd90643d6788c19270a0815fb9c2f1cc33cdd9f60f551b5f94c664a8c8"} Jun 02 05:18:57.717340 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:57.717341 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" event={"ID":"29773885-b483-4909-92e3-def4f311fe70","Type":"ContainerStarted","Data":"2913359cafe9af7f35a38c83444bcfe6ee7f6d0399f80ba66196f39476045b2e"} Jun 02 05:18:57.717542 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:57.717418 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:18:57.737726 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:57.737678 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" podStartSLOduration=1.737649808 podStartE2EDuration="1.737649808s" podCreationTimestamp="2026-06-02 05:18:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:18:57.735391151 +0000 UTC m=+2230.455472225" watchObservedRunningTime="2026-06-02 05:18:57.737649808 +0000 UTC m=+2230.457730879" Jun 02 05:18:57.779737 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:57.779714 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zr99x_c6cf0d89-0b9e-4497-97a9-adf610a691eb/dns-node-resolver/0.log" Jun 02 05:18:58.300582 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:58.300554 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gk7dh_03b4fee0-4026-402e-a447-bf848b78a6e3/node-ca/0.log" Jun 02 05:18:59.236026 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:59.236000 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bjdmm9_8a3d4558-72e3-49aa-92eb-fab7243b0a6d/istio-proxy/0.log" Jun 02 05:18:59.428402 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:59.428361 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-s2bfb_fac68ad7-b2f7-4658-b42d-5a30ac30ab30/istio-proxy/0.log" Jun 02 05:18:59.492284 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:18:59.492213 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7czmd_d2bb7f10-4124-4a23-931e-741cff153f81/payload-processing/0.log" Jun 02 05:19:00.137756 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:00.137714 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mjqxt_4c4eacaa-9fc6-403e-a14f-bb9c35340334/serve-healthcheck-canary/0.log" Jun 02 05:19:00.732273 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:00.732246 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nk87q_f2651074-4525-4878-a539-7449d7e8d27e/kube-rbac-proxy/0.log" Jun 02 05:19:00.754912 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:00.754891 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nk87q_f2651074-4525-4878-a539-7449d7e8d27e/exporter/0.log" Jun 02 05:19:00.777332 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:00.777310 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nk87q_f2651074-4525-4878-a539-7449d7e8d27e/extractor/0.log" Jun 02 05:19:02.918841 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:02.918815 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5b88b8b9b4-5wxrn_f9888d12-5348-4435-9e90-50e0974d27b0/nginx/0.log" Jun 02 05:19:03.088816 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:03.088786 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7c65995bd6-47trx_3ef6e64d-6924-479e-907e-da9a22c9e7fc/maas-api/0.log" Jun 02 05:19:03.397126 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:03.397094 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b5b979d7-4bjbt_fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8/manager/0.log" Jun 02 05:19:03.415171 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:03.415144 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b5b979d7-4bjbt_fa7ad72e-0c9a-4a14-8f9b-470c70ce5df8/copy-manifests/0.log" Jun 02 05:19:03.734773 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:03.734701 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-htn26/perf-node-gather-daemonset-9kxtw" Jun 02 05:19:04.919989 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:04.919955 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f8df7c74b-7ltxq_10e29769-09c7-4620-bc05-b2e8d1854151/manager/0.log" Jun 02 05:19:12.206222 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:12.206193 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx2t5_d2328f71-aef7-4be0-b956-7543e950f3a3/kube-multus-additional-cni-plugins/0.log" Jun 02 05:19:12.227914 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:12.227892 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx2t5_d2328f71-aef7-4be0-b956-7543e950f3a3/egress-router-binary-copy/0.log" Jun 02 05:19:12.252723 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:12.252703 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx2t5_d2328f71-aef7-4be0-b956-7543e950f3a3/cni-plugins/0.log" Jun 02 05:19:12.275029 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:12.275009 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx2t5_d2328f71-aef7-4be0-b956-7543e950f3a3/bond-cni-plugin/0.log" Jun 02 05:19:12.297775 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:12.297757 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx2t5_d2328f71-aef7-4be0-b956-7543e950f3a3/routeoverride-cni/0.log" Jun 02 05:19:12.321968 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:12.321941 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx2t5_d2328f71-aef7-4be0-b956-7543e950f3a3/whereabouts-cni-bincopy/0.log" Jun 02 05:19:12.344276 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:12.344250 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sx2t5_d2328f71-aef7-4be0-b956-7543e950f3a3/whereabouts-cni/0.log" Jun 02 05:19:12.412420 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:12.412394 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-knmg7_08b299c5-733d-4d30-8a80-9868860022d9/kube-multus/0.log" Jun 02 05:19:12.496203 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:12.496175 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7cswx_dd76ba94-c5d3-4336-b699-b07e5b707ba5/network-metrics-daemon/0.log" Jun 02 05:19:12.518701 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:12.518651 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7cswx_dd76ba94-c5d3-4336-b699-b07e5b707ba5/kube-rbac-proxy/0.log" Jun 02 05:19:13.546827 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:13.546800 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4wgp9_313dd821-7bd9-454c-b6d5-b19c70e7dbc6/ovn-controller/0.log" Jun 02 05:19:13.576216 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:13.576188 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4wgp9_313dd821-7bd9-454c-b6d5-b19c70e7dbc6/ovn-acl-logging/0.log" Jun 02 05:19:13.600350 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:13.600330 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4wgp9_313dd821-7bd9-454c-b6d5-b19c70e7dbc6/kube-rbac-proxy-node/0.log" Jun 02 05:19:13.646636 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:13.646613 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4wgp9_313dd821-7bd9-454c-b6d5-b19c70e7dbc6/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 05:19:13.666438 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:13.666381 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4wgp9_313dd821-7bd9-454c-b6d5-b19c70e7dbc6/northd/0.log" Jun 02 05:19:13.688323 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:13.688299 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4wgp9_313dd821-7bd9-454c-b6d5-b19c70e7dbc6/nbdb/0.log" Jun 02 05:19:13.711701 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:13.711680 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4wgp9_313dd821-7bd9-454c-b6d5-b19c70e7dbc6/sbdb/0.log" Jun 02 05:19:13.834741 ip-10-0-137-68 kubenswrapper[2581]: I0602 05:19:13.834715 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4wgp9_313dd821-7bd9-454c-b6d5-b19c70e7dbc6/ovnkube-controller/0.log"