I0703 21:58:51.933852 1 cmd.go:250] Using service-serving-cert provided certificates I0703 21:58:51.934828 1 observer_polling.go:159] Starting file observer W0703 21:58:51.957112 1 builder.go:266] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-6fd96f47fd" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0703 21:58:52.268140 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0703 21:58:52.268355 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0703 21:58:52.268891 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0703 21:58:52.268970 1 secure_serving.go:57] Forcing use of http/1.1 only W0703 21:58:52.268996 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0703 21:58:52.269001 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0703 21:58:52.269005 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0703 21:58:52.269008 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0703 21:58:52.269011 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0703 21:58:52.269014 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0703 21:58:52.273379 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes ChunkSizeMiB CloudDualStackNodeIPs DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy PersistentIPsForVirtualization PrivateHostedZoneAWS SetEIPForNLBIngressController VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy AWSClusterHostedDNS AdditionalRoutingCapabilities AutomatedEtcdBackup BootcNodeManagement CSIDriverSharedResource ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ConsolePluginContentSecurityPolicy DNSNameResolver DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example GCPClusterHostedDNS GatewayAPI ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MetricsCollectionProfiles MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NodeSwap NutanixMultiSubnets OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0703 21:58:52.273390 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ConsolePluginContentSecurityPolicy", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0703 21:58:52.275345 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0703 21:58:52.275426 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0703 21:58:52.275363 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0703 21:58:52.275457 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0703 21:58:52.275379 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0703 21:58:52.275720 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0703 21:58:52.276100 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" E0703 21:58:52.276599 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18bee67e387db53a openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"SetEIPForNLBIngressController\", \"VSphereControlPlaneMachineSet\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"VSphereStaticIPs\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AdditionalRoutingCapabilities\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"CSIDriverSharedResource\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ConsolePluginContentSecurityPolicy\", \"DNSNameResolver\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"GCPClusterHostedDNS\", \"GatewayAPI\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MetricsCollectionProfiles\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OnClusterBuild\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SignatureStores\", \"SigstoreImageVerification\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-03 21:58:52.27332537 +0000 UTC m=+0.386249701,LastTimestamp:2026-07-03 21:58:52.27332537 +0000 UTC m=+0.386249701,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" I0703 21:58:52.276750 1 secure_serving.go:213] Serving securely on [::]:8443 I0703 21:58:52.276784 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" W0703 21:58:52.277981 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0703 21:58:52.278004 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0703 21:58:52.278110 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0703 21:58:52.282288 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 21:58:52.282304 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0703 21:58:52.288833 1 secretconfigobserver.go:119] support secret does not exist I0703 21:58:52.292983 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 21:58:52.294304 1 recorder.go:156] Pruning old reports every 4h5m22s, max age is 288h0m0s I0703 21:58:52.296959 1 secretconfigobserver.go:119] support secret does not exist I0703 21:58:52.299364 1 periodic.go:214] Running clusterconfig gatherer I0703 21:58:52.299369 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0703 21:58:52.299390 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0703 21:58:52.299407 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0703 21:58:52.299411 1 insightsreport.go:296] Starting report retriever I0703 21:58:52.299414 1 tasks_processing.go:45] number of workers: 32 I0703 21:58:52.299415 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0703 21:58:52.299429 1 tasks_processing.go:69] worker 0 listening for tasks. I0703 21:58:52.299436 1 tasks_processing.go:69] worker 11 listening for tasks. I0703 21:58:52.299438 1 tasks_processing.go:71] worker 0 working on machine_autoscalers task. I0703 21:58:52.299445 1 tasks_processing.go:69] worker 1 listening for tasks. I0703 21:58:52.299450 1 tasks_processing.go:71] worker 1 working on dvo_metrics task. I0703 21:58:52.299462 1 tasks_processing.go:69] worker 21 listening for tasks. I0703 21:58:52.299477 1 tasks_processing.go:69] worker 12 listening for tasks. I0703 21:58:52.299488 1 tasks_processing.go:69] worker 13 listening for tasks. I0703 21:58:52.299500 1 tasks_processing.go:69] worker 14 listening for tasks. I0703 21:58:52.299510 1 tasks_processing.go:69] worker 15 listening for tasks. I0703 21:58:52.299520 1 tasks_processing.go:69] worker 16 listening for tasks. I0703 21:58:52.299530 1 tasks_processing.go:69] worker 17 listening for tasks. I0703 21:58:52.299540 1 tasks_processing.go:69] worker 18 listening for tasks. I0703 21:58:52.299575 1 tasks_processing.go:69] worker 19 listening for tasks. I0703 21:58:52.299586 1 tasks_processing.go:69] worker 20 listening for tasks. I0703 21:58:52.299596 1 tasks_processing.go:69] worker 26 listening for tasks. I0703 21:58:52.299609 1 tasks_processing.go:69] worker 22 listening for tasks. I0703 21:58:52.299619 1 tasks_processing.go:69] worker 23 listening for tasks. I0703 21:58:52.299628 1 tasks_processing.go:69] worker 24 listening for tasks. I0703 21:58:52.299639 1 tasks_processing.go:69] worker 25 listening for tasks. I0703 21:58:52.299649 1 tasks_processing.go:69] worker 6 listening for tasks. I0703 21:58:52.299659 1 tasks_processing.go:69] worker 2 listening for tasks. I0703 21:58:52.299665 1 tasks_processing.go:69] worker 27 listening for tasks. I0703 21:58:52.299668 1 tasks_processing.go:69] worker 3 listening for tasks. I0703 21:58:52.299676 1 tasks_processing.go:69] worker 28 listening for tasks. I0703 21:58:52.299679 1 tasks_processing.go:69] worker 4 listening for tasks. I0703 21:58:52.299689 1 tasks_processing.go:69] worker 29 listening for tasks. I0703 21:58:52.299693 1 tasks_processing.go:69] worker 5 listening for tasks. I0703 21:58:52.299698 1 tasks_processing.go:69] worker 30 listening for tasks. I0703 21:58:52.299439 1 tasks_processing.go:71] worker 11 working on ceph_cluster task. I0703 21:58:52.299704 1 tasks_processing.go:69] worker 31 listening for tasks. I0703 21:58:52.299713 1 tasks_processing.go:69] worker 8 listening for tasks. I0703 21:58:52.299723 1 tasks_processing.go:69] worker 7 listening for tasks. I0703 21:58:52.299733 1 tasks_processing.go:69] worker 9 listening for tasks. I0703 21:58:52.299743 1 tasks_processing.go:69] worker 10 listening for tasks. I0703 21:58:52.299766 1 tasks_processing.go:71] worker 10 working on install_plans task. I0703 21:58:52.299804 1 tasks_processing.go:71] worker 15 working on openstack_dataplanedeployments task. I0703 21:58:52.299823 1 tasks_processing.go:71] worker 28 working on lokistack task. I0703 21:58:52.299845 1 tasks_processing.go:71] worker 30 working on active_alerts task. I0703 21:58:52.299904 1 tasks_processing.go:71] worker 20 working on openstack_dataplanenodesets task. I0703 21:58:52.299776 1 tasks_processing.go:71] worker 24 working on monitoring_persistent_volumes task. I0703 21:58:52.299806 1 tasks_processing.go:71] worker 6 working on nodenetworkstates task. I0703 21:58:52.299783 1 tasks_processing.go:71] worker 21 working on sap_pods task. I0703 21:58:52.299790 1 tasks_processing.go:71] worker 12 working on clusterroles task. I0703 21:58:52.299993 1 tasks_processing.go:71] worker 19 working on tsdb_status task. I0703 21:58:52.299794 1 tasks_processing.go:71] worker 4 working on sap_config task. I0703 21:58:52.299794 1 tasks_processing.go:71] worker 13 working on machine_healthchecks task. I0703 21:58:52.299799 1 tasks_processing.go:71] worker 14 working on machine_configs task. I0703 21:58:52.299800 1 tasks_processing.go:71] worker 25 working on ingress task. I0703 21:58:52.299810 1 tasks_processing.go:71] worker 2 working on openstack_version task. I0703 21:58:52.299815 1 tasks_processing.go:71] worker 27 working on nodes task. I0703 21:58:52.299819 1 tasks_processing.go:71] worker 3 working on sap_datahubs task. I0703 21:58:52.299814 1 tasks_processing.go:71] worker 31 working on olm_operators task. I0703 21:58:52.299826 1 tasks_processing.go:71] worker 29 working on infrastructures task. I0703 21:58:52.299831 1 tasks_processing.go:71] worker 5 working on pdbs task. I0703 21:58:52.299916 1 tasks_processing.go:71] worker 8 working on service_accounts task. I0703 21:58:52.299907 1 tasks_processing.go:71] worker 26 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0703 21:58:52.299916 1 tasks_processing.go:71] worker 22 working on machines task. I0703 21:58:52.299921 1 tasks_processing.go:71] worker 7 working on ingress_certificates task. I0703 21:58:52.299923 1 tasks_processing.go:71] worker 17 working on storage_cluster task. I0703 21:58:52.299926 1 tasks_processing.go:71] worker 16 working on cluster_apiserver task. I0703 21:58:52.299928 1 tasks_processing.go:71] worker 9 working on oauths task. I0703 21:58:52.299934 1 tasks_processing.go:71] worker 18 working on cost_management_metrics_configs task. I0703 21:58:52.299937 1 tasks_processing.go:71] worker 23 working on silenced_alerts task. I0703 21:58:52.302308 1 tasks_processing.go:71] worker 0 working on crds task. I0703 21:58:52.302320 1 gather.go:181] gatherer "clusterconfig" function "machine_autoscalers" took 2.860407ms to process 0 records I0703 21:58:52.303138 1 gather.go:181] gatherer "clusterconfig" function "ceph_cluster" took 3.253544ms to process 0 records I0703 21:58:52.303152 1 tasks_processing.go:71] worker 11 working on machine_config_pools task. E0703 21:58:52.304597 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.108.108:9091: connect: connection refused I0703 21:58:52.304625 1 tasks_processing.go:71] worker 19 working on storage_classes task. E0703 21:58:52.304757 1 gather.go:144] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.108.108:9091: connect: connection refused I0703 21:58:52.304830 1 gather.go:181] gatherer "clusterconfig" function "tsdb_status" took 4.313452ms to process 0 records I0703 21:58:52.304844 1 gather.go:181] gatherer "clusterconfig" function "lokistack" took 4.803651ms to process 0 records I0703 21:58:52.304850 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkstates" took 4.62965ms to process 0 records I0703 21:58:52.304858 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 4.792187ms to process 0 records I0703 21:58:52.304864 1 gather.go:181] gatherer "clusterconfig" function "sap_pods" took 4.651448ms to process 0 records I0703 21:58:52.304872 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 5.000752ms to process 0 records I0703 21:58:52.304908 1 tasks_processing.go:71] worker 21 working on container_runtime_configs task. I0703 21:58:52.304919 1 tasks_processing.go:71] worker 28 working on feature_gates task. I0703 21:58:52.304926 1 tasks_processing.go:71] worker 15 working on image task. I0703 21:58:52.304937 1 tasks_processing.go:71] worker 20 working on image_registries task. I0703 21:58:52.304932 1 tasks_processing.go:71] worker 6 working on version task. I0703 21:58:52.307238 1 tasks_processing.go:71] worker 13 working on jaegers task. E0703 21:58:52.307312 1 gather.go:144] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0703 21:58:52.307366 1 gather.go:181] gatherer "clusterconfig" function "machine_healthchecks" took 6.699588ms to process 0 records I0703 21:58:52.307401 1 gather.go:181] gatherer "clusterconfig" function "openstack_version" took 6.174712ms to process 0 records I0703 21:58:52.307429 1 tasks_processing.go:71] worker 2 working on metrics task. I0703 21:58:52.307934 1 tasks_processing.go:71] worker 4 working on openstack_controlplanes task. I0703 21:58:52.308096 1 gather.go:181] gatherer "clusterconfig" function "sap_config" took 7.543071ms to process 0 records I0703 21:58:52.308215 1 controller.go:119] Initializing last reported time to 2026-07-03T21:58:46Z I0703 21:58:52.310146 1 controller.go:317] The initial operator extension status is healthy I0703 21:58:52.310268 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 21:58:52.310322 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0703 21:58:52.310380 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0703 21:58:52.310633 1 controller.go:457] The operator is still being initialized I0703 21:58:52.310696 1 controller.go:482] The operator is healthy I0703 21:58:52.310199 1 tasks_processing.go:71] worker 3 working on container_images task. I0703 21:58:52.310213 1 gather.go:181] gatherer "clusterconfig" function "sap_datahubs" took 8.838548ms to process 0 records E0703 21:58:52.313297 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.108.108:9091: connect: connection refused I0703 21:58:52.313331 1 tasks_processing.go:71] worker 2 working on support_secret task. E0703 21:58:52.313337 1 gather.go:144] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.108.108:9091: connect: connection refused I0703 21:58:52.313359 1 gather.go:181] gatherer "clusterconfig" function "metrics" took 5.837847ms to process 0 records I0703 21:58:52.313472 1 tasks_processing.go:71] worker 29 working on validating_webhook_configurations task. I0703 21:58:52.314123 1 recorder.go:70] Recording config/infrastructure with fingerprint=4c96a83c36f6e4f28420cae1827e9fd1db0942c0b25c95b65cff6cec009e2724 I0703 21:58:52.314145 1 gather.go:181] gatherer "clusterconfig" function "infrastructures" took 11.742912ms to process 1 records I0703 21:58:52.314338 1 tasks_processing.go:71] worker 21 working on machine_sets task. I0703 21:58:52.314351 1 gather.go:181] gatherer "clusterconfig" function "container_runtime_configs" took 9.373729ms to process 0 records I0703 21:58:52.314366 1 tasks_processing.go:71] worker 22 working on operators task. E0703 21:58:52.314367 1 gather.go:144] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0703 21:58:52.314378 1 gather.go:181] gatherer "clusterconfig" function "machines" took 12.23989ms to process 0 records I0703 21:58:52.319853 1 tasks_processing.go:71] worker 1 working on pod_network_connectivity_checks task. I0703 21:58:52.319863 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=108780cb24f15bf572a4031966507398a0d0c6a28b3a008952f53b481dc191a9 I0703 21:58:52.319876 1 gather.go:181] gatherer "clusterconfig" function "dvo_metrics" took 20.391543ms to process 1 records I0703 21:58:52.330623 1 tasks_processing.go:71] worker 1 working on config_maps task. E0703 21:58:52.330683 1 gather.go:144] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0703 21:58:52.330727 1 gather.go:181] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 10.755172ms to process 0 records I0703 21:58:52.330743 1 gather.go:181] gatherer "clusterconfig" function "machine_sets" took 16.291638ms to process 0 records I0703 21:58:52.330768 1 gather.go:181] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 30.659295ms to process 0 records I0703 21:58:52.330783 1 tasks_processing.go:71] worker 24 working on schedulers task. I0703 21:58:52.330811 1 tasks_processing.go:71] worker 21 working on openshift_logging task. I0703 21:58:52.330970 1 tasks_processing.go:71] worker 25 working on operators_pods_and_events task. I0703 21:58:52.331282 1 recorder.go:70] Recording config/ingress with fingerprint=694ccba44e566f97962b8b579f8d23df0f83ff1d7e07518d8d0cd71b061a3494 I0703 21:58:52.331337 1 gather.go:181] gatherer "clusterconfig" function "ingress" took 30.113898ms to process 1 records I0703 21:58:52.334562 1 tasks_processing.go:71] worker 17 working on mutating_webhook_configurations task. I0703 21:58:52.334651 1 gather.go:181] gatherer "clusterconfig" function "storage_cluster" took 32.112671ms to process 0 records I0703 21:58:52.334717 1 gather.go:181] gatherer "clusterconfig" function "machine_config_pools" took 31.375198ms to process 0 records I0703 21:58:52.334745 1 gather.go:181] gatherer "clusterconfig" function "openstack_controlplanes" took 26.619648ms to process 0 records I0703 21:58:52.334787 1 tasks_processing.go:71] worker 4 working on node_logs task. E0703 21:58:52.334791 1 gather.go:144] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0703 21:58:52.334937 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0703 21:58:52.334804 1 tasks_processing.go:71] worker 14 working on certificate_signing_requests task. I0703 21:58:52.335009 1 gather.go:181] gatherer "clusterconfig" function "machine_configs" took 33.848247ms to process 1 records I0703 21:58:52.335405 1 gather.go:181] gatherer "clusterconfig" function "cost_management_metrics_configs" took 31.817778ms to process 0 records I0703 21:58:52.335439 1 tasks_processing.go:71] worker 18 working on authentication task. I0703 21:58:52.335487 1 tasks_processing.go:71] worker 13 working on overlapping_namespace_uids task. I0703 21:58:52.335356 1 tasks_processing.go:71] worker 11 working on proxies task. I0703 21:58:52.335443 1 gather.go:181] gatherer "clusterconfig" function "jaegers" took 27.575889ms to process 0 records I0703 21:58:52.335780 1 tasks_processing.go:71] worker 15 working on networks task. I0703 21:58:52.335881 1 recorder.go:70] Recording config/image with fingerprint=5badfa5ac1c7002f33747e69646b2b5a1e7550bf11dd505ca6aec5dae492482f I0703 21:58:52.335935 1 gather.go:181] gatherer "clusterconfig" function "image" took 30.162166ms to process 1 records I0703 21:58:52.336428 1 tasks_processing.go:71] worker 2 working on aggregated_monitoring_cr_names task. E0703 21:58:52.336656 1 gather.go:144] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0703 21:58:52.336674 1 gather.go:181] gatherer "clusterconfig" function "support_secret" took 23.086683ms to process 0 records I0703 21:58:52.336781 1 tasks_processing.go:71] worker 28 working on image_pruners task. I0703 21:58:52.337110 1 recorder.go:70] Recording config/featuregate with fingerprint=49538b036b4d6261d5b936c035c2ed31608dc637ae539b2cd6aa2c529346d6e7 I0703 21:58:52.337129 1 gather.go:181] gatherer "clusterconfig" function "feature_gates" took 31.743917ms to process 1 records I0703 21:58:52.337543 1 recorder.go:70] Recording config/node/ip-10-0-0-144.ec2.internal with fingerprint=89658087028a489744a1191b0964641ac8a761c98da1cf611dbe01004e877366 I0703 21:58:52.337674 1 recorder.go:70] Recording config/node/ip-10-0-1-181.ec2.internal with fingerprint=890c5dc6852f913cc02b0d65116590ae910eec2c7e07a60e8dd3e7527ee1df20 I0703 21:58:52.337765 1 recorder.go:70] Recording config/node/ip-10-0-2-118.ec2.internal with fingerprint=b031051a6beff1fb2768a2981c1c0fd6329a42791f7a1b0c7d8a80a856b65958 I0703 21:58:52.337780 1 gather.go:181] gatherer "clusterconfig" function "nodes" took 35.800763ms to process 3 records I0703 21:58:52.337792 1 tasks_processing.go:71] worker 27 working on nodenetworkconfigurationpolicies task. I0703 21:58:52.337898 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=94c24dd9b3cfc4a11a5925fbcc3bcd7d30d040bb41436c2766deed453154faf3 I0703 21:58:52.337924 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=f1000c8247c3e19c492adfe0d4ff83ae65ba68841280049d9f73430830f371ac I0703 21:58:52.337996 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=e5fb6337911cb1801ac925476a8b83c38c9db28f1e248f8e72f1f5de08497752 I0703 21:58:52.338022 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=7b73ff2ba6238e8533d2fda30961e6dce38449029b87d7aabb7ef44f720edaad I0703 21:58:52.338048 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=9f217afdf056bb0c40ab34d796db59add2930140225c77c0786bbf21f6d679c8 I0703 21:58:52.337949 1 tasks_processing.go:71] worker 5 working on openshift_machine_api_events task. I0703 21:58:52.338078 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=79562f2db4dae4b033b25219dbe74189bb8a768e482b17c248f833cbaa333758 I0703 21:58:52.338101 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=310578d849241cff19bc2bf0b98e9fa601a333ed67a23b4b352853e9c287073f I0703 21:58:52.338129 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=1da472fc21f132a8fa050bed76b84bfa900578cfc6023a64b2b05324f18b83e7 I0703 21:58:52.338155 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=5e159528b7d2696d9662b6c75a202a812a86524706f0c9683b0f107d8238f93a I0703 21:58:52.338182 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=98972bbc005237de6b674906a14d0833af72e25ddc6061fdbf38ba95a82a37d1 I0703 21:58:52.338209 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=af13a4c58343685e262bc00a26e0615ca8ca37882367abe2f8a72308cf20a57a I0703 21:58:52.338220 1 gather.go:181] gatherer "clusterconfig" function "pdbs" took 35.757894ms to process 11 records I0703 21:58:52.338308 1 tasks_processing.go:74] worker 9 stopped. I0703 21:58:52.338561 1 recorder.go:70] Recording config/oauth with fingerprint=c704a0616d30cc0318ffe188f608a6525b51c50518a9f1991e2d5711c61cf66a I0703 21:58:52.338611 1 gather.go:181] gatherer "clusterconfig" function "oauths" took 35.085262ms to process 1 records I0703 21:58:52.339123 1 tasks_processing.go:74] worker 12 stopped. I0703 21:58:52.339632 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s I0703 21:58:52.339852 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=5cd4e243d688c440a661b731758f4ce795ffd8a599aba4ee4c1b19659011fc7d I0703 21:58:52.340108 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=c59773a4a2a75a0913a764ffdc0c18284ff4d78e5a9b3dc2136d6e323d52825a I0703 21:58:52.340164 1 gather.go:181] gatherer "clusterconfig" function "clusterroles" took 38.897378ms to process 2 records I0703 21:58:52.340111 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0703 21:58:52.340965 1 operator.go:288] started I0703 21:58:52.341012 1 tasks_processing.go:74] worker 20 stopped. I0703 21:58:52.341261 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0703 21:58:52.342165 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=246c334d869936a2a92d7e4e03665200f385ef6147af200f31e015a83fd5a0c1 I0703 21:58:52.342199 1 gather.go:181] gatherer "clusterconfig" function "image_registries" took 35.737266ms to process 1 records I0703 21:58:52.346761 1 tasks_processing.go:74] worker 21 stopped. I0703 21:58:52.346821 1 gather.go:181] gatherer "clusterconfig" function "openshift_logging" took 15.91559ms to process 0 records I0703 21:58:52.352410 1 tasks_processing.go:74] worker 19 stopped. I0703 21:58:52.352678 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=c6b336d45d2a2a849542474e7adfec8bd08d8217c9d08be57de1eae4c365af6a I0703 21:58:52.352709 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=f6c3d02f23182a5b08a3d92af35ab11ec6cde17a4cdd989cd7ec4db1ceb6d1c1 I0703 21:58:52.352720 1 gather.go:181] gatherer "clusterconfig" function "storage_classes" took 47.775501ms to process 2 records I0703 21:58:52.352805 1 tasks_processing.go:74] worker 24 stopped. I0703 21:58:52.352822 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=51002b3fa3069c85f017f3c0d7265215e178b3430708e59f0e8637bd883a9556 I0703 21:58:52.352837 1 gather.go:181] gatherer "clusterconfig" function "schedulers" took 21.925367ms to process 1 records I0703 21:58:52.356140 1 tasks_processing.go:74] worker 11 stopped. I0703 21:58:52.356240 1 recorder.go:70] Recording config/proxy with fingerprint=25231e2ec97254103d91e65f2ee5a2ea630d00834df3f806a43c864baf1802e0 I0703 21:58:52.356259 1 gather.go:181] gatherer "clusterconfig" function "proxies" took 20.459216ms to process 1 records I0703 21:58:52.356274 1 tasks_processing.go:74] worker 16 stopped. I0703 21:58:52.356485 1 recorder.go:70] Recording config/apiserver with fingerprint=95dce3426bd3d0ab1c03550409fdbf21cc67fe96e47f2120a93536a41fe74b54 I0703 21:58:52.356508 1 gather.go:181] gatherer "clusterconfig" function "cluster_apiserver" took 53.771277ms to process 1 records I0703 21:58:52.357355 1 tasks_processing.go:74] worker 27 stopped. I0703 21:58:52.357419 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 19.549718ms to process 0 records I0703 21:58:52.357573 1 tasks_processing.go:74] worker 17 stopped. I0703 21:58:52.357665 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=f9c329199b150f5533cc6382c8b76231c19b23357594e041bdf005fa7a6173ee I0703 21:58:52.357716 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=1ef59d30d70d24057b9d9c3934d2d051e49f2d98bda4ede794ad77a733b4bbde I0703 21:58:52.357721 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0703 21:58:52.357732 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 21:58:52.357737 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0703 21:58:52.357742 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0703 21:58:52.357747 1 controller.go:203] Source scaController *sca.Controller is not ready I0703 21:58:52.357759 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=647604f9c3439cd159542c3f2e06659d09520bcfafd842ea39d92cb27e57f46d I0703 21:58:52.357768 1 controller.go:457] The operator is still being initialized I0703 21:58:52.357772 1 gather.go:181] gatherer "clusterconfig" function "mutating_webhook_configurations" took 22.813357ms to process 3 records I0703 21:58:52.357776 1 controller.go:482] The operator is healthy I0703 21:58:52.357858 1 tasks_processing.go:74] worker 28 stopped. I0703 21:58:52.357911 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=6082dc86cdb4e8729a62829d3ea97baa815f20f2ec60d59f1adbdeab06383b21 I0703 21:58:52.357973 1 gather.go:181] gatherer "clusterconfig" function "image_pruners" took 20.941237ms to process 1 records I0703 21:58:52.358254 1 recorder.go:70] Recording config/network with fingerprint=f2a082d44b87bb814f6220e679ef169b12c48c8f1c526565dd3d4813a7d9d08b I0703 21:58:52.358288 1 gather.go:181] gatherer "clusterconfig" function "networks" took 22.041044ms to process 1 records I0703 21:58:52.358312 1 tasks_processing.go:74] worker 15 stopped. I0703 21:58:52.358321 1 gather.go:181] gatherer "clusterconfig" function "openshift_machine_api_events" took 19.842099ms to process 0 records I0703 21:58:52.358328 1 tasks_processing.go:74] worker 5 stopped. I0703 21:58:52.358467 1 tasks_processing.go:74] worker 29 stopped. I0703 21:58:52.358516 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=0513de5fb286606d6a65ce8141d8e451c460d92d92b672b1a39aa34dd97f6d67 I0703 21:58:52.358614 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=022a426ba3a9f0db4c819495c96dd0651fcb10c942add9f1dfcb1e51a549de1b I0703 21:58:52.358717 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=8fe8a429c0a0e4ad2cad16d37af105a79e4e51b5ea7f9120745186be72ee6839 I0703 21:58:52.358753 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=e1cdeba85cab858bc358a8e1b6cb8431fc05ad1dac1c28be8bfaef815ae652e8 I0703 21:58:52.358785 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=1212d7dd37d40b93686e929704e2f0d0c0f988860f601587a2ecaee372fd3547 I0703 21:58:52.358819 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=713ce7d58563dc4a352668f40addbc63212697cb0516fc56d82e63333ee28886 I0703 21:58:52.358871 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=cbcc6120ba1d92deae8849de39f15529ccd548c03c01a2754e8d17a044184cb9 I0703 21:58:52.358929 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=41e247ad5223a3788f46c7a7e58c0e13dd972e02fd9d5b3dd382625d2ec2e69f I0703 21:58:52.358962 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=6297b8b1f22379490b4dc45b660891158404bad6db9eda1dd6d484d5ebed9d00 I0703 21:58:52.359019 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=53b7815cf7bc9bb24a19043e526bbc82ee7c66e9a456c7a849be970bac792f3c I0703 21:58:52.359053 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=7c4478040ebee9edf79b7c615f85c603866cb180215799a66597d8bcc0fdcd0b I0703 21:58:52.359086 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=8e35c5e9e6f58f19f07c2d924f53a79d56c2dd4b502c567d516b43e169ee0acb I0703 21:58:52.359128 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=629bcda6607efe48f658ab25af0cbfc5a6b7f73d42aa5df8d30196232e2e1798 I0703 21:58:52.359141 1 gather.go:181] gatherer "clusterconfig" function "validating_webhook_configurations" took 44.831696ms to process 13 records I0703 21:58:52.359233 1 tasks_processing.go:74] worker 18 stopped. I0703 21:58:52.359318 1 recorder.go:70] Recording config/authentication with fingerprint=ae1345602f775d7636956f0936f2a01f5c590e965781e679754df0912c1394e6 I0703 21:58:52.359332 1 gather.go:181] gatherer "clusterconfig" function "authentication" took 22.937374ms to process 1 records I0703 21:58:52.360142 1 tasks_processing.go:74] worker 14 stopped. I0703 21:58:52.360174 1 gather.go:181] gatherer "clusterconfig" function "certificate_signing_requests" took 25.109961ms to process 0 records I0703 21:58:52.361454 1 tasks_processing.go:74] worker 31 stopped. I0703 21:58:52.361573 1 recorder.go:70] Recording config/olm_operators with fingerprint=b1dada2df54c02559f72dbe20c0790565749febe8e1983fbc5bf0e9aa82350e4 I0703 21:58:52.361592 1 gather.go:181] gatherer "clusterconfig" function "olm_operators" took 59.943514ms to process 1 records I0703 21:58:52.371838 1 tasks_processing.go:74] worker 0 stopped. I0703 21:58:52.372732 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=b8c507d04cd2f2608a6898dbd8b0887586a38471d18c81725eaee7f9cd372e92 I0703 21:58:52.373141 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=d8027fa3ec3c0fe74e8db4b5529a4090e280b18668bc32329cf8c71f5931d59d I0703 21:58:52.373185 1 gather.go:181] gatherer "clusterconfig" function "crds" took 68.726326ms to process 2 records I0703 21:58:52.376505 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0703 21:58:52.376608 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0703 21:58:52.377750 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0703 21:58:52.378291 1 base_controller.go:73] Caches are synced for ConfigController I0703 21:58:52.378314 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0703 21:58:52.381417 1 gather.go:181] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 44.710015ms to process 0 records I0703 21:58:52.381448 1 tasks_processing.go:74] worker 2 stopped. I0703 21:58:52.381493 1 requests.go:204] Asking for SCA certificate for x86_64 architecture I0703 21:58:52.384255 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 21:58:52.384269 1 tasks_processing.go:74] worker 7 stopped. E0703 21:58:52.384281 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0703 21:58:52.384289 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ratr6oqnrpa3mo89qks9a2paljaje4m-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ratr6oqnrpa3mo89qks9a2paljaje4m-primary-cert-bundle-secret" not found I0703 21:58:52.384375 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=fce0b03f39d6d52ebf50a7223a896e1cd63453f0b1d0c1528f324b5f6f9047ed I0703 21:58:52.384392 1 gather.go:181] gatherer "clusterconfig" function "ingress_certificates" took 81.888491ms to process 1 records I0703 21:58:52.384925 1 tasks_processing.go:74] worker 26 stopped. I0703 21:58:52.384937 1 gather.go:181] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 82.945757ms to process 0 records I0703 21:58:52.386136 1 tasks_processing.go:74] worker 3 stopped. I0703 21:58:52.387528 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-7d4ddc79d6-m4qqr with fingerprint=3b43009a9adc8f0660d60124b9c57e2d1e98a08b60cc725bad4851976dcb0ece I0703 21:58:52.387680 1 recorder.go:70] Recording config/pod/openshift-multus/multus-hvpjx with fingerprint=641041b76a2a27805dca6f7039491ad08922a10e9841f1a52509235157e55b95 I0703 21:58:52.387763 1 recorder.go:70] Recording config/running_containers with fingerprint=f0a26698c2cc0f9302f383a524bac0d3c17331a2e0723dc4676bd74a4df918b7 I0703 21:58:52.387774 1 gather.go:181] gatherer "clusterconfig" function "container_images" took 74.830914ms to process 3 records I0703 21:58:52.394314 1 tasks_processing.go:74] worker 1 stopped. E0703 21:58:52.394329 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0703 21:58:52.394337 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0703 21:58:52.394342 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0703 21:58:52.394390 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0703 21:58:52.394406 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0703 21:58:52.394417 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=e1a0ad594db3a5d5d50e9e25d7b235af20f84f5def41537f127febe525b834f2 I0703 21:58:52.394433 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0703 21:58:52.394488 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0703 21:58:52.394500 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0703 21:58:52.394509 1 gather.go:181] gatherer "clusterconfig" function "config_maps" took 63.669585ms to process 6 records I0703 21:58:52.408807 1 tasks_processing.go:74] worker 13 stopped. I0703 21:58:52.408837 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0703 21:58:52.408859 1 gather.go:181] gatherer "clusterconfig" function "overlapping_namespace_uids" took 73.302143ms to process 1 records I0703 21:58:52.418682 1 tasks_processing.go:74] worker 4 stopped. I0703 21:58:52.418697 1 gather.go:181] gatherer "clusterconfig" function "node_logs" took 83.83788ms to process 0 records I0703 21:58:52.424202 1 tasks_processing.go:74] worker 6 stopped. I0703 21:58:52.424789 1 recorder.go:70] Recording config/version with fingerprint=84630d2c297d7fdf8f97ba1842657a12be39e7e81963dce8cf45cb7a4133b5cb I0703 21:58:52.424805 1 recorder.go:70] Recording config/id with fingerprint=099a8628fbac3f5df5297b1ae1263bd16d3932ae0366f4c272d6f978f74ab626 I0703 21:58:52.424815 1 gather.go:181] gatherer "clusterconfig" function "version" took 118.868964ms to process 2 records I0703 21:58:52.441880 1 base_controller.go:73] Caches are synced for LoggingSyncer I0703 21:58:52.441894 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0703 21:58:52.443758 1 cluster_transfer.go:102] no available accepted cluster transfer I0703 21:58:52.443774 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0703 21:58:52.447129 1 gather_cluster_operator_pods_and_events.go:121] Found 6 pods with 6 containers I0703 21:58:52.447140 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 4194304 bytes I0703 21:58:52.447181 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5f6c95477d-7fz92 pod in namespace openshift-ingress (previous: false). I0703 21:58:52.478969 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5f6c95477d-pl94m pod in namespace openshift-ingress (previous: false). I0703 21:58:52.505376 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-67c8cd65d9-5l974 pod in namespace openshift-ingress (previous: false). I0703 21:58:52.515706 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-4zkr7 pod in namespace openshift-ingress-canary (previous: false). I0703 21:58:52.524982 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-m77ds pod in namespace openshift-ingress-canary (previous: false). I0703 21:58:52.566855 1 sca.go:141] etc-pki-entitlement secret successfully updated I0703 21:58:52.566869 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated in the etc-pki-entitlement secret I0703 21:58:52.587319 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-s8clg pod in namespace openshift-ingress-canary (previous: false). I0703 21:58:52.777189 1 tasks_processing.go:74] worker 25 stopped. I0703 21:58:52.777293 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=e2e96d22841e9f7281e0f57dc192778a58e17a77e2eddc3694eb0dc95b040e8e I0703 21:58:52.777377 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=db6c519b0cf7e57f386311cb8385cfe869f4413286e3d316234d75ec364d7821 I0703 21:58:52.777419 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=e020bdafd23f7f36320f10392c24e2acc5f4784e0781d0144632693d919bb896 I0703 21:58:52.777446 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-5f6c95477d-7fz92/router_current.log with fingerprint=2d675db8a1f916b01aa7ec594de02c6300ae3eb04b1d5aa0b66b7f2473a7a458 I0703 21:58:52.777466 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-5f6c95477d-pl94m/router_current.log with fingerprint=3525977e8c49e7fa9c708a9dedf8c1c8f7f96c773cebe44941a300ac720ec559 I0703 21:58:52.777487 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-67c8cd65d9-5l974/router_current.log with fingerprint=ff288908eb294f4f2210450838f83c6fedf3ce25f1356361561123e01f6066e5 I0703 21:58:52.777493 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-4zkr7/serve-healthcheck-canary_current.log with fingerprint=0248fd08ecaaf7d9265ce44ed6740bc7fed2acfdc1e553ec7fcce82da6cbf043 I0703 21:58:52.777498 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-m77ds/serve-healthcheck-canary_current.log with fingerprint=93f55dcea2f85c3153b6afaadd4dd11db63ae8ab98ea62b39d5988ee33043270 I0703 21:58:52.777504 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-s8clg/serve-healthcheck-canary_current.log with fingerprint=6ca7870dc2f5c3a3b39ef9b502d47a5729bcea59b81d9d1bcc6c6ce16fa35a24 I0703 21:58:52.777513 1 gather.go:181] gatherer "clusterconfig" function "operators_pods_and_events" took 446.192388ms to process 9 records I0703 21:58:52.987789 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0703 21:58:53.188339 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0703 21:58:53.338403 1 tasks_processing.go:74] worker 30 stopped. I0703 21:58:53.338459 1 recorder.go:70] Recording config/alerts with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 W0703 21:58:53.338476 1 gather.go:159] issue recording gatherer "clusterconfig" function "active_alerts" result "config/alerts.json" because of the warning: warning: the record with the same fingerprint "4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945" was already recorded at path "config/namespaces_with_overlapping_uids.json", recording another one with a different path "config/alerts.json" I0703 21:58:53.338486 1 gather.go:181] gatherer "clusterconfig" function "active_alerts" took 1.038540678s to process 1 records I0703 21:58:53.338499 1 recorder.go:70] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0703 21:58:53.338505 1 gather.go:181] gatherer "clusterconfig" function "silenced_alerts" took 1.03554129s to process 1 records I0703 21:58:53.338510 1 tasks_processing.go:74] worker 23 stopped. I0703 21:58:54.591037 1 tasks_processing.go:74] worker 22 stopped. I0703 21:58:54.591102 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=62c6628d24abfbeb4ebde902c2f559c9ee1e93a9df9dfea94cce9f9d19a01e5f I0703 21:58:54.591166 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=183539bbe89c989a326011f124cb26e91d4dc0406689baecde44742b1c4a8e80 I0703 21:58:54.591191 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=071d43066eb17f24f5a3943864852eb1d829e61b67253bc029e1f83778ae0b03 I0703 21:58:54.591204 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0703 21:58:54.591226 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=7fa6b24f7aaaf316dc806b52e544fc503128d3f3129e0eaf12d9844cb4cde1c6 I0703 21:58:54.591243 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0703 21:58:54.591270 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=b5a03cf3d408bb71e3d076196c96703aa907d63faa6477551ecdd08910d53a9f I0703 21:58:54.591298 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=39974161e6d7acf776f05e05f74359461d183758285d1c3d522027e0fc840d53 I0703 21:58:54.591326 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=95ecc011788162338b00fe87ca098ac7dc87c90bd5b0d68659fc1ec5c7e18617 I0703 21:58:54.591369 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=665ed134195116f75c1e1519ef44d5d7c0464ef8883e7d172e88731800e6a757 I0703 21:58:54.591695 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=27bc41ec677bc326109bb793fc97152ac9e663af5144fdc289caee52df173d8f I0703 21:58:54.591724 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=b71d51be8741144519a13ec38cf4fff0c5087d0174d9238d8a24cfad30704512 I0703 21:58:54.591736 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0703 21:58:54.591752 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=236673a28a58afee41189648990b03a623ab33c03fe98a1d0d504bbd79ec3d2c I0703 21:58:54.591763 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0703 21:58:54.591779 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=3841d21bd5c13b782dfa7e89a09f5b877d30833a8f3ba829a8e153723d823174 I0703 21:58:54.591789 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0703 21:58:54.591812 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=0d9f78ba21340bcc710a84794349cda8b9878734dedc4d35017d7ae05050a207 I0703 21:58:54.591823 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0703 21:58:54.591843 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=ec234bddc45dd23ba8e3c364498aa5103f99727839df75d3eaa0b483ca32fe6d I0703 21:58:54.591938 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=2e0d8efed35a894032863b9e2f44ab879bdc5cff22ca4808cc3d664795818e4c I0703 21:58:54.591962 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0703 21:58:54.591982 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=ee332075cf95677f7fbe06ebce0022d7d615efa9d098a029a5337d95d1541ea2 I0703 21:58:54.592005 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=204008669a64b153d978c5b1377b93e74d36cf77d10023c74cc78e46c24d7892 I0703 21:58:54.592014 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0703 21:58:54.592031 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=f4da18de73fa60a7fbb06e222241f2d031e5179f027494274509269e9f342004 I0703 21:58:54.592041 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0703 21:58:54.592057 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=01fb01d4c8a3cbcfd49de46bfc955d681d50b29d9da163d3ead39838bdf8922a I0703 21:58:54.592066 1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0703 21:58:54.592079 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=2c8716a94f701ade14013965f2ef7e22e9505dd1aff99b2e0a36f539851d5d1e I0703 21:58:54.592099 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=b1959f7b6198237beb046c9482c71acf1972acdf96906264d1dc526cacb0afe0 I0703 21:58:54.592121 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=86328c3990a00e988f69ee9ee80ce6fdeab412c92654f365fe07424f64211984 I0703 21:58:54.592147 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=20b6d24a51374e08097bc9362165b04e68bf38e431cbdc5e24b8f4de844af29a I0703 21:58:54.592159 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0703 21:58:54.592183 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=24cff10a5a7920cf1f7b60af10374e612cc1871d3d717b8d62f2a6bedee8f856 I0703 21:58:54.592203 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0703 21:58:54.592213 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0703 21:58:54.592222 1 gather.go:181] gatherer "clusterconfig" function "operators" took 2.276649212s to process 37 records I0703 21:59:05.343604 1 tasks_processing.go:74] worker 10 stopped. I0703 21:59:05.343644 1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0703 21:59:05.343658 1 gather.go:181] gatherer "clusterconfig" function "install_plans" took 13.043785913s to process 1 records I0703 21:59:06.108584 1 tasks_processing.go:74] worker 8 stopped. I0703 21:59:06.108896 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=ba16ea6b4503917d33437d4d1999039313b5aa3c669ab94c714d5681918865aa I0703 21:59:06.108914 1 gather.go:181] gatherer "clusterconfig" function "service_accounts" took 13.806655908s to process 1 records E0703 21:59:06.108973 1 periodic.go:252] clusterconfig failed after 13.809s with: function "tsdb_status" failed with an error, function "machine_healthchecks" failed with an error, function "metrics" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error I0703 21:59:06.108986 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "tsdb_status" failed with an error, function "machine_healthchecks" failed with an error, function "metrics" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error I0703 21:59:06.108993 1 periodic.go:214] Running workloads gatherer I0703 21:59:06.109008 1 tasks_processing.go:45] number of workers: 2 I0703 21:59:06.109019 1 tasks_processing.go:69] worker 1 listening for tasks. I0703 21:59:06.109025 1 tasks_processing.go:71] worker 1 working on workload_info task. I0703 21:59:06.109028 1 tasks_processing.go:69] worker 0 listening for tasks. I0703 21:59:06.109101 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0703 21:59:06.131015 1 gather_workloads_info.go:281] Loaded pods in 0s, will wait 24s for image data I0703 21:59:06.133336 1 tasks_processing.go:74] worker 0 stopped. I0703 21:59:06.133351 1 gather.go:181] gatherer "workloads" function "helmchart_info" took 24.207474ms to process 0 records I0703 21:59:06.139839 1 gather_workloads_info.go:390] No image sha256:0c1abef76d6d2832ddcff31e950ffafeb4e0f6fad80a5f5dca94591de0fc9581 (10ms) I0703 21:59:06.149119 1 gather_workloads_info.go:390] No image sha256:5bcfb1b739fa4e6ff9e21e4843f8520f29608135341f7d8dcc31084b9ba25f1d (9ms) I0703 21:59:06.157848 1 gather_workloads_info.go:390] No image sha256:4b9b7949d209e257a76053de4ac74193f747c0d42e25dcd270d655849a4e51aa (9ms) I0703 21:59:06.167217 1 gather_workloads_info.go:390] No image sha256:41029e57ece558b2e0b12174ce924647fd9d5c5d83aadf4bba03d6916d3f9f54 (9ms) I0703 21:59:06.176198 1 gather_workloads_info.go:390] No image sha256:38787de16ee8c686305f93b501d891b50cde24136009863869d230c0d4eeee5c (9ms) I0703 21:59:06.189810 1 gather_workloads_info.go:390] No image sha256:221622a101db9797df0622b4534e3e42c4498df458f355a8a02fad8d65f8e3f2 (14ms) I0703 21:59:06.197818 1 gather_workloads_info.go:390] No image sha256:0c6b7f828184b16a5e6630111e0715e11d34dae9b0bf64619466543e6168e05c (8ms) I0703 21:59:06.205888 1 gather_workloads_info.go:390] No image sha256:3a2c82b772ea6072e1eca0efc5303f002189e80b0e985fb3e3b8ea9a12fe8060 (8ms) I0703 21:59:06.219828 1 gather_workloads_info.go:390] No image sha256:06821dfe231330e0eb5be915b9468cd13826a7ee59d1a732b89cb140548eade2 (14ms) I0703 21:59:06.227361 1 gather_workloads_info.go:390] No image sha256:50076d29400ecf9b704d8175509fc8cb7c28bea91d46a28dc37cbda1668c69f9 (8ms) I0703 21:59:06.238676 1 gather_workloads_info.go:390] No image sha256:194ee1155b87e110bc6c4a6e55667e41f3bdc8292e26a9561f9082fdfe467eec (11ms) I0703 21:59:06.339418 1 gather_workloads_info.go:390] No image sha256:2897724cec17bc13acc133181f64ccb8d54ce5dc9582f9cecf704c2540e15600 (101ms) I0703 21:59:06.439003 1 gather_workloads_info.go:390] No image sha256:68abf16a3b6c33fdd22a823c7d00f96aaaa8015d370116962a5835984908645a (100ms) I0703 21:59:06.539027 1 gather_workloads_info.go:390] No image sha256:13aabbaf260d634ff0e9ac1af88af075b5ba671fd51313e33e74d7d2f7e54128 (100ms) I0703 21:59:06.640124 1 gather_workloads_info.go:390] No image sha256:c96b4bddf3dd7daaa797cbda4dd92e981de2f5fc3404c01381f31dc0414d5c8d (101ms) I0703 21:59:06.738999 1 gather_workloads_info.go:390] No image sha256:8562a483f4568254250f19fc68d79f88c94a48508aefe59a70c1021a3aad000a (99ms) I0703 21:59:06.838854 1 gather_workloads_info.go:390] No image sha256:3969660e807e8ce5656a74e5816573656241946ef1d766a9d2e21d434356313c (100ms) I0703 21:59:06.938472 1 gather_workloads_info.go:390] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (100ms) I0703 21:59:07.039173 1 gather_workloads_info.go:390] No image sha256:1c7c24111f1709d7648156873ced09462638aa4b3cf7e7aee13297e51bcdfb3e (101ms) I0703 21:59:07.139305 1 gather_workloads_info.go:390] No image sha256:48dff3fcb0da58eb9b2b500f89af8b7d0790ffa60da0b0e301feca971dbafcbb (100ms) I0703 21:59:07.241110 1 gather_workloads_info.go:390] No image sha256:c7aa910ca06f8fd89cdf2519136e0f3533bdacfc6bd58a3f6683f9f08756c7b1 (102ms) I0703 21:59:07.339646 1 gather_workloads_info.go:390] No image sha256:02283a64c1936a5dd09d5c6bc0ecbcf9196fe4df6a4055c8be22cebd850aa7a3 (99ms) I0703 21:59:07.440780 1 gather_workloads_info.go:390] No image sha256:6a9b4fd887fa7f1729302fb0330c3c9a483197bf78becdcfda4235ec823a2c39 (101ms) I0703 21:59:07.539198 1 gather_workloads_info.go:390] No image sha256:788d16bfff4bd6bb3ce97acc643b56fae6e619674ab279535480e519b4d5b769 (98ms) I0703 21:59:07.639622 1 gather_workloads_info.go:401] Found image sha256:b8781637560d49de9b8e8cdd59ec75f03d98921ea66950381849398128cc9cb9 (100ms) I0703 21:59:07.738575 1 gather_workloads_info.go:390] No image sha256:351ca92471647f383f3cd7f0b70f33f5fa11c39ab569c4948dff7d471a6c8be3 (99ms) I0703 21:59:07.838007 1 gather_workloads_info.go:401] Found image sha256:751bd7eb62f632c0eef0ca91b6c57c64d4f1279d4dbe1a9b875ac4020a7b693f (99ms) I0703 21:59:07.938592 1 gather_workloads_info.go:390] No image sha256:3fea7db586d3236c1876a8b523af0d8d65c84d6f6cf5d0f4e41cafcffe6db5b5 (101ms) I0703 21:59:08.038647 1 gather_workloads_info.go:390] No image sha256:4dcdadc14b7bdb2c00954d92e957d63aafbbe5f4047fe028e575d65725923cb0 (100ms) I0703 21:59:08.139414 1 gather_workloads_info.go:390] No image sha256:586127c49e25052113263d8aeaf6a1623aef22987364f119a17b2848982ff716 (101ms) I0703 21:59:08.238861 1 gather_workloads_info.go:390] No image sha256:24519dcc0e63cdc60a639dd474d06e7612e9b76966bc60322cd9026a0f1b878c (99ms) I0703 21:59:08.339099 1 gather_workloads_info.go:390] No image sha256:09b3e9e6a4f382fb4bbdb67bc945bcf19d66f604b7c8ffd66d4d4a2c94224248 (100ms) I0703 21:59:08.439160 1 gather_workloads_info.go:390] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (100ms) I0703 21:59:08.538816 1 gather_workloads_info.go:390] No image sha256:1eee856bde9bad71c4444c494225a0cf02d1f4a5293acf0bd6e7e1814efa0064 (100ms) I0703 21:59:08.638489 1 gather_workloads_info.go:390] No image sha256:31a22f6ee061d0f6558664e580ec0f80f1927d4ec29626cf3e9420837f5d80e5 (100ms) I0703 21:59:08.740105 1 gather_workloads_info.go:390] No image sha256:0242cefbf0bb876101c4d67ab4e07401cb0ba6c02be2b73a4f17ba33b2960005 (102ms) I0703 21:59:08.839231 1 gather_workloads_info.go:390] No image sha256:ed0c9631d6e424912cd8ce78ca7a2c4f76b3fc15e9e34fe00999170ccf19a611 (99ms) I0703 21:59:08.938958 1 gather_workloads_info.go:390] No image sha256:a7fc4d05c4a3c82c9f355ca985d6fd26033c0d6a98716f25fcd2f54bae1d2fa0 (100ms) I0703 21:59:09.038804 1 gather_workloads_info.go:390] No image sha256:894452e6587de55d04e37163d3da53e11fced8fb08bd0acf61e6d49f7964284e (100ms) I0703 21:59:09.138584 1 gather_workloads_info.go:390] No image sha256:30ff5e5b72f274598704ca69f1832eba1040cc25da47386004fd59500b6e4c55 (100ms) I0703 21:59:09.240299 1 gather_workloads_info.go:390] No image sha256:bc829520eeec090b60d17abbad1a22b34ea99b426193395808a778d73a5fb57a (102ms) I0703 21:59:09.340136 1 gather_workloads_info.go:390] No image sha256:42b4c6bdf3081ec264bc5edbc4eb779151de9e4742d6fe59a316645891df649c (100ms) I0703 21:59:09.439313 1 gather_workloads_info.go:390] No image sha256:0158b297aec0a66376c04d3c7cf4828db5e5d9f424e331ff7c7b796828036875 (99ms) I0703 21:59:09.539449 1 gather_workloads_info.go:390] No image sha256:8e158c83ec12b3e0237fab9a221630bd691e79c079a111f346354ff43b8199df (100ms) I0703 21:59:09.539481 1 tasks_processing.go:74] worker 1 stopped. I0703 21:59:09.539795 1 recorder.go:70] Recording config/workload_info with fingerprint=2f0c0d095f2fab7358a1e2809b02c27108f3105b83bbd89866ca7925bf5eaeb0 I0703 21:59:09.539810 1 gather.go:181] gatherer "workloads" function "workload_info" took 3.430448896s to process 1 records I0703 21:59:09.539824 1 periodic.go:261] Periodic gather workloads completed in 3.43s I0703 21:59:09.539831 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0703 21:59:09.539836 1 periodic.go:214] Running conditional gatherer I0703 21:59:09.548881 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules I0703 21:59:09.606794 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer I0703 21:59:10.687345 1 conditional_gatherer.go:372] alert "Watchdog" has state "firing" I0703 21:59:10.687429 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0703 21:59:10.696319 1 conditional_gatherer.go:390] cluster version is '4.18.9' I0703 21:59:10.696348 1 tasks_processing.go:45] number of workers: 3 I0703 21:59:10.696360 1 tasks_processing.go:69] worker 2 listening for tasks. I0703 21:59:10.696365 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0703 21:59:10.696372 1 tasks_processing.go:69] worker 0 listening for tasks. I0703 21:59:10.696383 1 tasks_processing.go:69] worker 1 listening for tasks. I0703 21:59:10.696399 1 tasks_processing.go:74] worker 1 stopped. I0703 21:59:10.696417 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I0703 21:59:10.696419 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0703 21:59:10.696415 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0703 21:59:10.696430 1 gather.go:181] gatherer "conditional" function "remote_configuration" took 784ns to process 1 records I0703 21:59:10.696498 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0703 21:59:10.696507 1 gather.go:181] gatherer "conditional" function "conditional_gatherer_rules" took 1.83µs to process 1 records I0703 21:59:10.696519 1 tasks_processing.go:74] worker 2 stopped. I0703 21:59:10.696648 1 tasks_processing.go:74] worker 0 stopped. I0703 21:59:10.696662 1 gather.go:181] gatherer "conditional" function "rapid_container_logs" took 223.005µs to process 0 records I0703 21:59:10.696680 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I0703 21:59:10.696698 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f W0703 21:59:10.720842 1 gather.go:213] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0703 21:59:10.720998 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=a1e26c0d6af5381cb11297e6332d116db4248148d8f80d4b6e531e7653ccb848 I0703 21:59:10.721133 1 diskrecorder.go:70] Writing 118 records to /var/lib/insights-operator/insights-2026-07-03-215910.tar.gz I0703 21:59:10.728803 1 diskrecorder.go:51] Wrote 118 records to disk in 7ms I0703 21:59:10.728835 1 periodic.go:283] Gathering cluster info every 2h0m0s I0703 21:59:10.728850 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0703 22:00:22.299658 1 diskrecorder.go:170] Found files to send: insights-2026-07-03-215910.tar.gz I0703 22:00:22.299687 1 insightsuploader.go:150] Checking archives to upload periodically every 15m55.218588742s I0703 22:00:22.299696 1 insightsuploader.go:165] Uploading latest report since 2026-07-03T21:58:46Z I0703 22:00:22.313314 1 requests.go:47] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0703 22:00:22.473912 1 requests.go:88] Successfully reported id=2026-07-03T22:00:22Z x-rh-insights-request-id=20ef801f981b4d548327fd936ca2fdd4, wrote=56612 I0703 22:00:22.473977 1 insightsuploader.go:187] Uploaded report successfully in 174.272104ms I0703 22:00:22.474015 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0703 22:00:22.474024 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0703 22:00:22.474031 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0703 22:00:22.479601 1 controller.go:482] The operator is healthy I0703 22:00:52.345857 1 controller.go:482] The operator is healthy I0703 22:01:26.828093 1 insightsreport.go:137] Pulling report from smart-proxy I0703 22:01:26.828126 1 insightsreport.go:149] Retrieving report I0703 22:01:26.837115 1 requests.go:111] Retrieving report for cluster: 08acd9b7-bdb3-4898-952c-e86d9c2ad057 I0703 22:01:26.837129 1 requests.go:112] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/08acd9b7-bdb3-4898-952c-e86d9c2ad057/reports I0703 22:01:26.839963 1 requests.go:122] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/08acd9b7-bdb3-4898-952c-e86d9c2ad057/reports I0703 22:01:27.054573 1 insightsreport.go:184] Report retrieved I0703 22:01:27.096412 1 insightsreport.go:239] Report retrieved correctly I0703 22:02:52.345799 1 controller.go:482] The operator is healthy I0703 22:03:52.297964 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:03:52.307278 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:03:52.307298 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:03:52.311539 1 secretconfigobserver.go:119] support secret does not exist I0703 22:04:52.349523 1 controller.go:482] The operator is healthy I0703 22:06:52.348368 1 controller.go:482] The operator is healthy I0703 22:08:52.293750 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:08:52.311846 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:08:52.317468 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:08:52.317490 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:08:52.321762 1 secretconfigobserver.go:119] support secret does not exist I0703 22:08:52.345413 1 controller.go:482] The operator is healthy I0703 22:10:52.346907 1 controller.go:482] The operator is healthy I0703 22:12:52.346516 1 controller.go:482] The operator is healthy I0703 22:13:52.322121 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:13:52.327950 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:13:52.327976 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:13:52.332377 1 secretconfigobserver.go:119] support secret does not exist I0703 22:14:52.347139 1 controller.go:482] The operator is healthy I0703 22:16:22.693643 1 insightsuploader.go:146] Nothing to report since 2026-07-03T22:00:22Z I0703 22:16:52.345720 1 controller.go:482] The operator is healthy I0703 22:18:52.297802 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:18:52.332835 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:18:52.338179 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:18:52.338202 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:18:52.342507 1 secretconfigobserver.go:119] support secret does not exist I0703 22:18:52.345585 1 controller.go:482] The operator is healthy I0703 22:20:52.347883 1 controller.go:482] The operator is healthy I0703 22:22:52.345166 1 controller.go:482] The operator is healthy I0703 22:23:52.343262 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:23:52.347971 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:23:52.347990 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:23:52.352167 1 secretconfigobserver.go:119] support secret does not exist I0703 22:24:52.346010 1 controller.go:482] The operator is healthy I0703 22:26:52.345658 1 controller.go:482] The operator is healthy I0703 22:28:52.294943 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:28:52.298755 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:28:52.345060 1 controller.go:482] The operator is healthy I0703 22:28:52.352946 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:28:52.357139 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:28:52.357153 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:28:52.360853 1 secretconfigobserver.go:119] support secret does not exist I0703 22:30:52.346587 1 controller.go:482] The operator is healthy I0703 22:32:51.454936 1 insightsuploader.go:146] Nothing to report since 2026-07-03T22:00:22Z I0703 22:32:52.345644 1 controller.go:482] The operator is healthy I0703 22:33:52.361141 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:33:52.370213 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:33:52.370234 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:33:52.374683 1 secretconfigobserver.go:119] support secret does not exist I0703 22:34:52.345450 1 controller.go:482] The operator is healthy I0703 22:36:52.345662 1 controller.go:482] The operator is healthy I0703 22:38:52.295448 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 22:38:52.345011 1 controller.go:482] The operator is healthy I0703 22:38:52.375043 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 22:38:52.379111 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 22:38:52.379128 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 22:38:52.382945 1 secretconfigobserver.go:119] support secret does not exist