I0702 22:38:37.456142 1 cmd.go:250] Using service-serving-cert provided certificates I0702 22:38:37.456653 1 observer_polling.go:159] Starting file observer W0702 22:38:37.480636 1 builder.go:266] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-6fd96f47fd" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0702 22:38:37.840044 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0702 22:38:37.840308 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0702 22:38:37.840863 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0702 22:38:37.840920 1 secure_serving.go:57] Forcing use of http/1.1 only W0702 22:38:37.840942 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0702 22:38:37.840948 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0702 22:38:37.840956 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0702 22:38:37.840962 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0702 22:38:37.840965 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0702 22:38:37.840968 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0702 22:38:37.844734 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes ChunkSizeMiB CloudDualStackNodeIPs DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy PersistentIPsForVirtualization PrivateHostedZoneAWS SetEIPForNLBIngressController VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy AWSClusterHostedDNS AdditionalRoutingCapabilities AutomatedEtcdBackup BootcNodeManagement CSIDriverSharedResource ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ConsolePluginContentSecurityPolicy DNSNameResolver DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example GCPClusterHostedDNS GatewayAPI ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MetricsCollectionProfiles MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NodeSwap NutanixMultiSubnets OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0702 22:38:37.844747 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ConsolePluginContentSecurityPolicy", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0702 22:38:37.847218 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0702 22:38:37.847230 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0702 22:38:37.847233 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0702 22:38:37.847254 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 22:38:37.847426 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0702 22:38:37.847450 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0702 22:38:37.847860 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0702 22:38:37.848283 1 secure_serving.go:213] Serving securely on [::]:8443 E0702 22:38:37.848346 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18be9a1516514418 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"SetEIPForNLBIngressController\", \"VSphereControlPlaneMachineSet\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"VSphereStaticIPs\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AdditionalRoutingCapabilities\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"CSIDriverSharedResource\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ConsolePluginContentSecurityPolicy\", \"DNSNameResolver\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"GCPClusterHostedDNS\", \"GatewayAPI\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MetricsCollectionProfiles\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OnClusterBuild\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SignatureStores\", \"SigstoreImageVerification\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-02 22:38:37.844710424 +0000 UTC m=+0.430718201,LastTimestamp:2026-07-02 22:38:37.844710424 +0000 UTC m=+0.430718201,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" I0702 22:38:37.848407 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" W0702 22:38:37.852487 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0702 22:38:37.852508 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 22:38:37.852603 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0702 22:38:37.857459 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:38:37.857475 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 22:38:37.862371 1 secretconfigobserver.go:119] support secret does not exist I0702 22:38:37.866430 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:38:37.867744 1 recorder.go:156] Pruning old reports every 6h40m34s, max age is 288h0m0s I0702 22:38:37.870552 1 secretconfigobserver.go:119] support secret does not exist I0702 22:38:37.873399 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0702 22:38:37.873421 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0702 22:38:37.873424 1 periodic.go:214] Running clusterconfig gatherer I0702 22:38:37.873468 1 tasks_processing.go:45] number of workers: 32 I0702 22:38:37.873504 1 tasks_processing.go:69] worker 31 listening for tasks. I0702 22:38:37.873509 1 tasks_processing.go:69] worker 14 listening for tasks. I0702 22:38:37.873516 1 tasks_processing.go:71] worker 14 working on aggregated_monitoring_cr_names task. I0702 22:38:37.873516 1 tasks_processing.go:69] worker 23 listening for tasks. I0702 22:38:37.873518 1 tasks_processing.go:69] worker 22 listening for tasks. I0702 22:38:37.873524 1 tasks_processing.go:69] worker 24 listening for tasks. I0702 22:38:37.873530 1 tasks_processing.go:69] worker 15 listening for tasks. I0702 22:38:37.873533 1 tasks_processing.go:69] worker 25 listening for tasks. I0702 22:38:37.873537 1 tasks_processing.go:69] worker 16 listening for tasks. I0702 22:38:37.873542 1 tasks_processing.go:69] worker 17 listening for tasks. I0702 22:38:37.873539 1 tasks_processing.go:69] worker 6 listening for tasks. I0702 22:38:37.873547 1 tasks_processing.go:69] worker 18 listening for tasks. I0702 22:38:37.873543 1 tasks_processing.go:69] worker 26 listening for tasks. I0702 22:38:37.873550 1 tasks_processing.go:69] worker 27 listening for tasks. I0702 22:38:37.873553 1 tasks_processing.go:69] worker 19 listening for tasks. I0702 22:38:37.873544 1 tasks_processing.go:69] worker 10 listening for tasks. I0702 22:38:37.873422 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0702 22:38:37.873561 1 tasks_processing.go:69] worker 8 listening for tasks. I0702 22:38:37.873564 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 22:38:37.873566 1 tasks_processing.go:69] worker 12 listening for tasks. I0702 22:38:37.873573 1 tasks_processing.go:69] worker 3 listening for tasks. I0702 22:38:37.873561 1 tasks_processing.go:69] worker 28 listening for tasks. I0702 22:38:37.873578 1 tasks_processing.go:69] worker 30 listening for tasks. I0702 22:38:37.873581 1 tasks_processing.go:69] worker 21 listening for tasks. I0702 22:38:37.873552 1 tasks_processing.go:69] worker 7 listening for tasks. I0702 22:38:37.873510 1 tasks_processing.go:71] worker 31 working on container_images task. I0702 22:38:37.873586 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 22:38:37.873589 1 tasks_processing.go:69] worker 5 listening for tasks. I0702 22:38:37.873592 1 tasks_processing.go:69] worker 13 listening for tasks. I0702 22:38:37.873568 1 tasks_processing.go:69] worker 29 listening for tasks. I0702 22:38:37.873573 1 tasks_processing.go:69] worker 20 listening for tasks. I0702 22:38:37.873577 1 tasks_processing.go:69] worker 4 listening for tasks. I0702 22:38:37.873594 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 22:38:37.873582 1 tasks_processing.go:69] worker 11 listening for tasks. I0702 22:38:37.873565 1 insightsreport.go:296] Starting report retriever I0702 22:38:37.873620 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0702 22:38:37.873635 1 tasks_processing.go:69] worker 9 listening for tasks. I0702 22:38:37.873659 1 tasks_processing.go:71] worker 15 working on active_alerts task. I0702 22:38:37.873668 1 tasks_processing.go:71] worker 0 working on authentication task. I0702 22:38:37.873673 1 tasks_processing.go:71] worker 22 working on sap_pods task. I0702 22:38:37.873677 1 tasks_processing.go:71] worker 17 working on nodenetworkstates task. I0702 22:38:37.873683 1 tasks_processing.go:71] worker 2 working on cluster_apiserver task. I0702 22:38:37.873672 1 tasks_processing.go:71] worker 16 working on networks task. I0702 22:38:37.873733 1 tasks_processing.go:71] worker 5 working on ingress_certificates task. I0702 22:38:37.873740 1 tasks_processing.go:71] worker 6 working on jaegers task. I0702 22:38:37.873771 1 tasks_processing.go:71] worker 12 working on pdbs task. I0702 22:38:37.873791 1 tasks_processing.go:71] worker 20 working on image_registries task. I0702 22:38:37.873798 1 tasks_processing.go:71] worker 4 working on machine_sets task. I0702 22:38:37.873667 1 tasks_processing.go:71] worker 25 working on openstack_version task. I0702 22:38:37.873802 1 tasks_processing.go:71] worker 18 working on openstack_controlplanes task. I0702 22:38:37.873834 1 tasks_processing.go:71] worker 1 working on mutating_webhook_configurations task. I0702 22:38:37.873663 1 tasks_processing.go:71] worker 9 working on version task. I0702 22:38:37.873950 1 tasks_processing.go:71] worker 28 working on crds task. I0702 22:38:37.873663 1 tasks_processing.go:71] worker 8 working on pod_network_connectivity_checks task. I0702 22:38:37.874006 1 tasks_processing.go:71] worker 30 working on tsdb_status task. I0702 22:38:37.874063 1 tasks_processing.go:71] worker 26 working on operators task. I0702 22:38:37.874134 1 tasks_processing.go:71] worker 13 working on overlapping_namespace_uids task. I0702 22:38:37.874165 1 tasks_processing.go:71] worker 11 working on dvo_metrics task. I0702 22:38:37.874202 1 tasks_processing.go:71] worker 24 working on ceph_cluster task. I0702 22:38:37.874317 1 tasks_processing.go:71] worker 23 working on machine_autoscalers task. I0702 22:38:37.873945 1 tasks_processing.go:71] worker 3 working on olm_operators task. I0702 22:38:37.874329 1 tasks_processing.go:71] worker 7 working on oauths task. I0702 22:38:37.874323 1 tasks_processing.go:71] worker 21 working on lokistack task. I0702 22:38:37.874349 1 tasks_processing.go:71] worker 27 working on validating_webhook_configurations task. I0702 22:38:37.874359 1 tasks_processing.go:71] worker 10 working on machine_configs task. I0702 22:38:37.874443 1 tasks_processing.go:71] worker 29 working on node_logs task. I0702 22:38:37.874355 1 tasks_processing.go:71] worker 19 working on install_plans task. I0702 22:38:37.878362 1 tasks_processing.go:71] worker 18 working on sap_config task. I0702 22:38:37.878376 1 gather.go:181] gatherer "clusterconfig" function "openstack_controlplanes" took 4.548504ms to process 0 records I0702 22:38:37.878488 1 gather.go:181] gatherer "clusterconfig" function "openstack_version" took 4.573636ms to process 0 records E0702 22:38:37.878496 1 gather.go:144] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0702 22:38:37.878503 1 gather.go:181] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 4.438542ms to process 0 records I0702 22:38:37.878509 1 tasks_processing.go:71] worker 8 working on storage_cluster task. I0702 22:38:37.878621 1 tasks_processing.go:71] worker 25 working on openstack_dataplanedeployments task. E0702 22:38:37.878837 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.94.133:9094: connect: connection refused I0702 22:38:37.878860 1 tasks_processing.go:71] worker 15 working on infrastructures task. E0702 22:38:37.878870 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.6.107:9091: connect: connection refused E0702 22:38:37.878869 1 gather.go:144] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.94.133:9094: connect: connection refused I0702 22:38:37.878896 1 gather.go:181] gatherer "clusterconfig" function "active_alerts" took 5.185416ms to process 0 records E0702 22:38:37.878928 1 gather.go:144] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.6.107:9091: connect: connection refused I0702 22:38:37.878943 1 gather.go:181] gatherer "clusterconfig" function "tsdb_status" took 4.870737ms to process 0 records I0702 22:38:37.878958 1 tasks_processing.go:71] worker 30 working on monitoring_persistent_volumes task. I0702 22:38:37.879926 1 tasks_processing.go:71] worker 24 working on machine_config_pools task. I0702 22:38:37.879945 1 gather.go:181] gatherer "clusterconfig" function "ceph_cluster" took 5.671309ms to process 0 records I0702 22:38:37.879961 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkstates" took 6.251427ms to process 0 records I0702 22:38:37.879969 1 tasks_processing.go:71] worker 17 working on storage_classes task. I0702 22:38:37.880115 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0702 22:38:37.880131 1 controller.go:317] The initial operator extension status is healthy I0702 22:38:37.880142 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 22:38:37.880150 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0702 22:38:37.880154 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0702 22:38:37.880169 1 controller.go:457] The operator is still being initialized I0702 22:38:37.880177 1 controller.go:482] The operator is healthy I0702 22:38:37.880250 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s I0702 22:38:37.880262 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0702 22:38:37.880390 1 operator.go:288] started I0702 22:38:37.880410 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0702 22:38:37.890800 1 tasks_processing.go:71] worker 6 working on machines task. I0702 22:38:37.890824 1 gather.go:181] gatherer "clusterconfig" function "jaegers" took 17.050429ms to process 0 records I0702 22:38:37.891542 1 tasks_processing.go:71] worker 20 working on metrics task. I0702 22:38:37.892619 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=2f27f41c32bff750f03d4dfe903b8435bad2359ac94fb1b13ce505a9a8359c51 I0702 22:38:37.892681 1 gather.go:181] gatherer "clusterconfig" function "image_registries" took 17.732048ms to process 1 records I0702 22:38:37.892714 1 gather.go:181] gatherer "clusterconfig" function "machine_autoscalers" took 17.854746ms to process 0 records I0702 22:38:37.892727 1 gather.go:181] gatherer "clusterconfig" function "lokistack" took 16.434758ms to process 0 records I0702 22:38:37.892734 1 gather.go:181] gatherer "clusterconfig" function "machine_sets" took 18.469427ms to process 0 records I0702 22:38:37.892933 1 tasks_processing.go:71] worker 21 working on clusterroles task. I0702 22:38:37.893000 1 tasks_processing.go:71] worker 23 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0702 22:38:37.893027 1 tasks_processing.go:71] worker 4 working on proxies task. E0702 22:38:37.894170 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.6.107:9091: connect: connection refused I0702 22:38:37.893055 1 recorder.go:70] Recording config/authentication with fingerprint=760f9329f6b6a7a894d06e4d9a26b4bc1d2d85bf3f6789acf3b38b7a0daf4564 I0702 22:38:37.894302 1 gather.go:181] gatherer "clusterconfig" function "authentication" took 19.016001ms to process 1 records I0702 22:38:37.894334 1 gather.go:181] gatherer "clusterconfig" function "sap_pods" took 19.292591ms to process 0 records I0702 22:38:37.893062 1 tasks_processing.go:71] worker 0 working on openshift_machine_api_events task. I0702 22:38:37.894389 1 tasks_processing.go:71] worker 22 working on certificate_signing_requests task. I0702 22:38:37.894562 1 tasks_processing.go:71] worker 16 working on schedulers task. I0702 22:38:37.895210 1 recorder.go:70] Recording config/network with fingerprint=ebae170ad57350c9e3c9640d33171c462ec1024f195b1134e27e375c7f180ee8 I0702 22:38:37.895277 1 gather.go:181] gatherer "clusterconfig" function "networks" took 19.589206ms to process 1 records I0702 22:38:37.895326 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0702 22:38:37.895369 1 gather.go:181] gatherer "clusterconfig" function "overlapping_namespace_uids" took 19.936029ms to process 1 records I0702 22:38:37.895641 1 tasks_processing.go:71] worker 13 working on image task. I0702 22:38:37.896074 1 tasks_processing.go:71] worker 7 working on ingress task. I0702 22:38:37.896098 1 recorder.go:70] Recording config/oauth with fingerprint=0ee89d34b0a1e0c10debbdee2188570d5c028809b407b6a9cbc4938fbb4c16c1 I0702 22:38:37.896111 1 gather.go:181] gatherer "clusterconfig" function "oauths" took 19.583626ms to process 1 records I0702 22:38:37.896401 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=115a0b471c4f32f7cac240c43fbe238ac332e264fe8a86bf4b43a1ba887c25a1 I0702 22:38:37.896516 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=3df9edc27e9d3f5f9b93fd996a6a592367662042c44db4f292fccd3115dac75c I0702 22:38:37.896595 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=72747514c109980a880ce2d6fe8383ff5e3893906acd603ab92ebff3d38c550e I0702 22:38:37.896641 1 gather.go:181] gatherer "clusterconfig" function "mutating_webhook_configurations" took 20.343176ms to process 3 records E0702 22:38:37.896676 1 gather.go:144] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.6.107:9091: connect: connection refused I0702 22:38:37.896707 1 gather.go:181] gatherer "clusterconfig" function "metrics" took 2.661072ms to process 0 records I0702 22:38:37.896644 1 tasks_processing.go:71] worker 1 working on image_pruners task. I0702 22:38:37.896900 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=3fc640d4bac93ef297f399c00bb98e3b50226aa0e78170860948f4c752af6d13 I0702 22:38:37.896994 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=d21082bbbc29b01933c0f63f1138cf71113235befc18aa3d27c849fbb6e8d183 I0702 22:38:37.897063 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=04dd5472169b32e230249d9cb0ae9c6e5e4a07003191fc19a01aec1406b34387 I0702 22:38:37.897124 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=6936be7030170a2f5f79319fbeff6e4dca8d8ec09629019313e3d8b33d245e11 I0702 22:38:37.897198 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=ace3c8dc4e3d61eb66ce17552604358677196a94cb64ab38dbb7e6fc9a70be6d I0702 22:38:37.897230 1 tasks_processing.go:71] worker 12 working on nodes task. I0702 22:38:37.897260 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=4eabcb626eee82db3b019b52937aec4b8c22326bd2aa9adc3c876aaed3a4f3ad I0702 22:38:37.897509 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=2dcb2d10a71b0cf6a8b8c92c62279fc574f416768a05cc93edec5a046be6fb80 I0702 22:38:37.897579 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=5fde5086ab30f7356121b23beafabec5fa9239b644b7227a742555c6e652f258 I0702 22:38:37.897139 1 tasks_processing.go:71] worker 20 working on sap_datahubs task. I0702 22:38:37.897613 1 gather.go:181] gatherer "clusterconfig" function "pdbs" took 20.558006ms to process 8 records I0702 22:38:37.897814 1 tasks_processing.go:71] worker 2 working on nodenetworkconfigurationpolicies task. I0702 22:38:37.897967 1 recorder.go:70] Recording config/apiserver with fingerprint=9846d4fae98e4581a48be320c68bc0c7dd3e1d0df1b3fd7ba3de8f1f87230b2d I0702 22:38:37.897993 1 gather.go:181] gatherer "clusterconfig" function "cluster_apiserver" took 20.889853ms to process 1 records I0702 22:38:37.898007 1 gather.go:181] gatherer "clusterconfig" function "olm_operators" took 20.167723ms to process 0 records I0702 22:38:37.898015 1 gather.go:181] gatherer "clusterconfig" function "node_logs" took 20.170161ms to process 0 records I0702 22:38:37.898024 1 gather.go:181] gatherer "clusterconfig" function "storage_cluster" took 18.710463ms to process 0 records I0702 22:38:37.898065 1 tasks_processing.go:71] worker 29 working on machine_healthchecks task. I0702 22:38:37.898091 1 tasks_processing.go:71] worker 8 working on operators_pods_and_events task. I0702 22:38:37.898083 1 tasks_processing.go:71] worker 3 working on support_secret task. I0702 22:38:37.898174 1 tasks_processing.go:71] worker 27 working on cost_management_metrics_configs task. I0702 22:38:37.898231 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=d9d066bea2081222fbbe879285bdc02d42f503d84a03f088af61ea7578d31161 I0702 22:38:37.898410 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=322631739973af2dae93f9d018202b6b37e46115ed608acdd7ead74a3dde42e7 I0702 22:38:37.898903 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=e5e2d2bdc6b301785c0dff1d3608a1626b00cd39ab87bf2eb1f8b6d5cbc32708 W0702 22:38:37.898911 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 22:38:37.898982 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=39c48145ad17e8b70582bc6a59dba72d0c54f81a9b5d26c3daf2ce78fdd0fbd0 I0702 22:38:37.899018 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=88aeaba19ea580d216a5a618d295d753ddfdc7dd93376ccd34000b0a41d18f87 I0702 22:38:37.899053 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=6ee63fa593e6fcc1c8b430b0047fe1361d3dd1a8f79c4cb515bdd5a053b4a921 I0702 22:38:37.899085 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=26cd658159d3c14df4a21a7c098a36709575ac9123d800909d7e4eab54a5c4ab I0702 22:38:37.899126 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=8c7c98025f9083f824b47d73636fb1305738ad398fcde07325e64d7a1737f671 I0702 22:38:37.899181 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=129c8a1916528c337bba92f471fcd9af465e3edd068f3c7b2fa47d64446000cb I0702 22:38:37.899233 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=4ecf1ca4da94f565c3574aca9fc38e58af86b26ef3f6e9213bb19080ec126373 I0702 22:38:37.899276 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=e99cbbadecccc546e20e5907cf0096396b100ffd25119fd92032381de90eb3e7 I0702 22:38:37.899308 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=f988aa4aa53b42f855afd7a8f2cb6331448b82b2e1dffb1b1dd41bac913e8713 I0702 22:38:37.899350 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=a4af85b8cd18cbce46a09bdbad04bd8571d4e1707b1c84be6554252cf084ff8c I0702 22:38:37.899360 1 gather.go:181] gatherer "clusterconfig" function "validating_webhook_configurations" took 21.576386ms to process 13 records I0702 22:38:37.899408 1 tasks_processing.go:71] worker 18 working on container_runtime_configs task. I0702 22:38:37.899456 1 gather.go:181] gatherer "clusterconfig" function "sap_config" took 20.999305ms to process 0 records I0702 22:38:37.899518 1 gather.go:181] gatherer "clusterconfig" function "machine_config_pools" took 19.572254ms to process 0 records I0702 22:38:37.899540 1 tasks_processing.go:71] worker 24 working on feature_gates task. I0702 22:38:37.899791 1 tasks_processing.go:71] worker 25 working on silenced_alerts task. I0702 22:38:37.899877 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 21.154787ms to process 0 records E0702 22:38:37.899955 1 gather.go:144] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0702 22:38:37.899981 1 gather.go:181] gatherer "clusterconfig" function "machines" took 9.136746ms to process 0 records I0702 22:38:37.900048 1 tasks_processing.go:71] worker 6 working on service_accounts task. I0702 22:38:37.900115 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0702 22:38:37.900197 1 controller.go:203] Source scaController *sca.Controller is not ready I0702 22:38:37.900247 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=c40425bf6cade4579d79d952b4b074e4a73e74d095dbc362a6eb8a699dc046c3 I0702 22:38:37.900346 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=e84f229e44cc7261ea02eb0b5989b499d9d4093910d04530fedf01b61fa60ed6 I0702 22:38:37.900362 1 gather.go:181] gatherer "clusterconfig" function "storage_classes" took 20.16933ms to process 2 records I0702 22:38:37.900283 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0702 22:38:37.900375 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 22:38:37.900380 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0702 22:38:37.900396 1 controller.go:457] The operator is still being initialized I0702 22:38:37.900401 1 controller.go:482] The operator is healthy I0702 22:38:37.900147 1 tasks_processing.go:71] worker 17 working on openstack_dataplanenodesets task. E0702 22:38:37.901812 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.94.133:9094: connect: connection refused I0702 22:38:37.901836 1 tasks_processing.go:71] worker 25 working on openshift_logging task. E0702 22:38:37.901851 1 gather.go:144] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.94.133:9094: connect: connection refused I0702 22:38:37.901868 1 gather.go:181] gatherer "clusterconfig" function "silenced_alerts" took 2.027603ms to process 0 records I0702 22:38:37.905005 1 tasks_processing.go:71] worker 15 working on config_maps task. I0702 22:38:37.905593 1 recorder.go:70] Recording config/infrastructure with fingerprint=ee11eb154e8122253b5367e08a6a98ff7b783652d95c92de0d9b27876351e9f0 I0702 22:38:37.905608 1 gather.go:181] gatherer "clusterconfig" function "infrastructures" took 26.132181ms to process 1 records I0702 22:38:37.907438 1 tasks_processing.go:74] worker 10 stopped. E0702 22:38:37.907448 1 gather.go:144] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0702 22:38:37.907471 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0702 22:38:37.907479 1 gather.go:181] gatherer "clusterconfig" function "machine_configs" took 31.278818ms to process 1 records I0702 22:38:37.907490 1 gather.go:181] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 28.480512ms to process 0 records I0702 22:38:37.907495 1 tasks_processing.go:74] worker 30 stopped. I0702 22:38:37.909120 1 requests.go:204] Asking for SCA certificate for x86_64 architecture I0702 22:38:37.909351 1 tasks_processing.go:74] worker 20 stopped. I0702 22:38:37.909363 1 gather.go:181] gatherer "clusterconfig" function "sap_datahubs" took 11.729465ms to process 0 records I0702 22:38:37.909639 1 tasks_processing.go:74] worker 27 stopped. I0702 22:38:37.909653 1 gather.go:181] gatherer "clusterconfig" function "cost_management_metrics_configs" took 11.380327ms to process 0 records I0702 22:38:37.909663 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 11.778046ms to process 0 records I0702 22:38:37.909668 1 tasks_processing.go:74] worker 2 stopped. I0702 22:38:37.916428 1 tasks_processing.go:74] worker 29 stopped. E0702 22:38:37.916450 1 gather.go:144] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0702 22:38:37.916497 1 gather.go:181] gatherer "clusterconfig" function "machine_healthchecks" took 18.327157ms to process 0 records I0702 22:38:37.916505 1 gather.go:181] gatherer "clusterconfig" function "container_runtime_configs" took 17.026996ms to process 0 records I0702 22:38:37.916510 1 tasks_processing.go:74] worker 18 stopped. I0702 22:38:37.916732 1 tasks_processing.go:74] worker 13 stopped. I0702 22:38:37.916907 1 recorder.go:70] Recording config/image with fingerprint=a017b8e428500f533dda5876efe8c488ec4a731e87ef132412093803efd86c4f I0702 22:38:37.916924 1 gather.go:181] gatherer "clusterconfig" function "image" took 21.040978ms to process 1 records I0702 22:38:37.917036 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=ab8da4ecb04a7619b85b56962ebba8328ae6d6ffd008d6c6cc7e3b0063306c18 I0702 22:38:37.917047 1 gather.go:181] gatherer "clusterconfig" function "image_pruners" took 19.993288ms to process 1 records I0702 22:38:37.917054 1 gather.go:181] gatherer "clusterconfig" function "openshift_machine_api_events" took 22.482677ms to process 0 records I0702 22:38:37.917058 1 tasks_processing.go:74] worker 1 stopped. I0702 22:38:37.917062 1 gather.go:181] gatherer "clusterconfig" function "openshift_logging" took 15.054711ms to process 0 records I0702 22:38:37.917068 1 tasks_processing.go:74] worker 25 stopped. I0702 22:38:37.917075 1 tasks_processing.go:74] worker 0 stopped. I0702 22:38:37.917142 1 tasks_processing.go:74] worker 7 stopped. I0702 22:38:37.917241 1 recorder.go:70] Recording config/ingress with fingerprint=1f23e5a649d83857a20f959def695f0d05ac390473becad50e7a784624936bff I0702 22:38:37.917259 1 gather.go:181] gatherer "clusterconfig" function "ingress" took 20.876989ms to process 1 records I0702 22:38:37.917270 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 16.633795ms to process 0 records I0702 22:38:37.917291 1 tasks_processing.go:74] worker 17 stopped. I0702 22:38:37.917343 1 recorder.go:70] Recording config/proxy with fingerprint=2201a585df1e0f14e701702e2d1538d39228a77be20b46028adeead675add797 I0702 22:38:37.917357 1 gather.go:181] gatherer "clusterconfig" function "proxies" took 22.881673ms to process 1 records I0702 22:38:37.917364 1 tasks_processing.go:74] worker 4 stopped. E0702 22:38:37.917365 1 gather.go:144] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0702 22:38:37.917371 1 tasks_processing.go:74] worker 3 stopped. I0702 22:38:37.917377 1 gather.go:181] gatherer "clusterconfig" function "support_secret" took 18.933633ms to process 0 records I0702 22:38:37.917780 1 tasks_processing.go:74] worker 12 stopped. I0702 22:38:37.918876 1 recorder.go:70] Recording config/node/ip-10-0-0-112.ec2.internal with fingerprint=0087c023b75df79c4d29c62510cafa3605171e2691854d7a60535e71cfd2c74f I0702 22:38:37.919114 1 recorder.go:70] Recording config/node/ip-10-0-1-42.ec2.internal with fingerprint=913eb258ab016df5fba0c6d3dddfc2e9bb909324a93a040b13442cf3f2e04616 I0702 22:38:37.919294 1 recorder.go:70] Recording config/node/ip-10-0-2-254.ec2.internal with fingerprint=f88c7a185551bd7a52920efe9f8f51b73bbf6dddd59d43ba97777e06c2904f43 I0702 22:38:37.919342 1 gather.go:181] gatherer "clusterconfig" function "nodes" took 20.483826ms to process 3 records I0702 22:38:37.919597 1 tasks_processing.go:74] worker 28 stopped. I0702 22:38:37.920961 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=b526a184ce0baa1aa9d9fd06131320b8304f8a95cc7190cbc05e430714eb460f I0702 22:38:37.921303 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=e9a5b6567eb71a667323623b1531ca0e9f5f133803beaa9dde13300bd529dd3f I0702 22:38:37.921321 1 gather.go:181] gatherer "clusterconfig" function "crds" took 44.158207ms to process 2 records I0702 22:38:37.921409 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=cf5e33aff7308956e997942462dc80879360c819bd261549af5af7d4f7c66358 I0702 22:38:37.921467 1 gather.go:181] gatherer "clusterconfig" function "schedulers" took 26.235321ms to process 1 records I0702 22:38:37.921473 1 tasks_processing.go:74] worker 16 stopped. I0702 22:38:37.921710 1 tasks_processing.go:74] worker 9 stopped. I0702 22:38:37.922185 1 recorder.go:70] Recording config/version with fingerprint=b0e9acef88b81bd03f1cc4c687dbe8ffdd54e4413c8f51dff6a9849e4e254a24 I0702 22:38:37.922203 1 recorder.go:70] Recording config/id with fingerprint=452eccbff6bcfe9ff8d7decc1254384f8569cdb99854b49e6be33f7237a5b99c I0702 22:38:37.922211 1 gather.go:181] gatherer "clusterconfig" function "version" took 47.434536ms to process 2 records I0702 22:38:37.922333 1 tasks_processing.go:74] worker 14 stopped. I0702 22:38:37.922353 1 gather.go:181] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 48.801953ms to process 0 records I0702 22:38:37.923399 1 tasks_processing.go:74] worker 24 stopped. I0702 22:38:37.923656 1 recorder.go:70] Recording config/featuregate with fingerprint=261b38e2718596b63943967c381e160d3dcd3948d16ac98d4a11cd273955a7a0 I0702 22:38:37.923684 1 gather.go:181] gatherer "clusterconfig" function "feature_gates" took 23.803954ms to process 1 records I0702 22:38:37.924703 1 tasks_processing.go:74] worker 22 stopped. I0702 22:38:37.924721 1 gather.go:181] gatherer "clusterconfig" function "certificate_signing_requests" took 30.284749ms to process 0 records I0702 22:38:37.930909 1 tasks_processing.go:74] worker 21 stopped. I0702 22:38:37.931107 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=6075c833004fbf9b65fdc075ab8428940395ed2b381b2b58be2ca39768753148 I0702 22:38:37.931193 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=be819fdb5f13fbfa567df936dddefb1e2480b026485fb293ee28f738b281e40a I0702 22:38:37.931203 1 gather.go:181] gatherer "clusterconfig" function "clusterroles" took 37.524186ms to process 2 records I0702 22:38:37.933215 1 tasks_processing.go:74] worker 8 stopped. I0702 22:38:37.933236 1 gather.go:181] gatherer "clusterconfig" function "operators_pods_and_events" took 35.055061ms to process 0 records I0702 22:38:37.939531 1 tasks_processing.go:74] worker 31 stopped. I0702 22:38:37.941810 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-7d4ddc79d6-fsrkx with fingerprint=705508b89737eaefeba1c73abbc7b9ebb56245638a4f94f58e3ac49820b2ef53 I0702 22:38:37.941942 1 recorder.go:70] Recording config/pod/openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-1-42.ec2.internal with fingerprint=1e6a94092347bcdc12fbb053244aaeab7a7500b4e32b9c20783943a390d6e725 I0702 22:38:37.942319 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-t24d2 with fingerprint=d4a081f35f59c2f85d24516f897ae038d29ff2bf9ef158b0129cd2cc036b47db I0702 22:38:37.942447 1 recorder.go:70] Recording config/running_containers with fingerprint=e5ca7bdb3855ec430fed625290f8f690912abc30db7b7cfb7ef47506788d13c2 I0702 22:38:37.942467 1 gather.go:181] gatherer "clusterconfig" function "container_images" took 65.928766ms to process 4 records I0702 22:38:37.944967 1 tasks_processing.go:74] worker 5 stopped. E0702 22:38:37.944983 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0702 22:38:37.944995 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ra9c3b1427js499c7ofdj6lmqiurcgb-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ra9c3b1427js499c7ofdj6lmqiurcgb-primary-cert-bundle-secret" not found I0702 22:38:37.945062 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=fc503a5c467093fa7b15dccd61e08e895f8eb9e6524e9d898e0c17360d694a8d I0702 22:38:37.945077 1 gather.go:181] gatherer "clusterconfig" function "ingress_certificates" took 71.221446ms to process 1 records I0702 22:38:37.945908 1 tasks_processing.go:74] worker 23 stopped. I0702 22:38:37.945922 1 gather.go:181] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 52.151127ms to process 0 records I0702 22:38:37.947269 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0702 22:38:37.947593 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0702 22:38:37.947627 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 22:38:37.949350 1 tasks_processing.go:74] worker 15 stopped. E0702 22:38:37.949366 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0702 22:38:37.949375 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0702 22:38:37.949379 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0702 22:38:37.949411 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0702 22:38:37.949425 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0702 22:38:37.949431 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=e1a0ad594db3a5d5d50e9e25d7b235af20f84f5def41537f127febe525b834f2 I0702 22:38:37.949441 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0702 22:38:37.949488 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0702 22:38:37.949497 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0702 22:38:37.949502 1 gather.go:181] gatherer "clusterconfig" function "config_maps" took 44.323924ms to process 6 records I0702 22:38:37.952871 1 base_controller.go:73] Caches are synced for ConfigController I0702 22:38:37.952883 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0702 22:38:37.960188 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:38:37.980597 1 base_controller.go:73] Caches are synced for LoggingSyncer I0702 22:38:37.980611 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0702 22:38:37.987640 1 cluster_transfer.go:102] no available accepted cluster transfer I0702 22:38:37.987652 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0702 22:38:38.107113 1 sca.go:141] etc-pki-entitlement secret successfully updated I0702 22:38:38.107133 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated in the etc-pki-entitlement secret I0702 22:38:38.533680 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0702 22:38:38.733655 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W0702 22:38:38.896412 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0702 22:38:39.896263 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 22:38:40.137658 1 tasks_processing.go:74] worker 26 stopped. I0702 22:38:40.137819 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=0eb9d9c22b64711e2cd3cc6036422e0055150dc38201d53bb8a07777249c4aac I0702 22:38:40.137879 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=183539bbe89c989a326011f124cb26e91d4dc0406689baecde44742b1c4a8e80 I0702 22:38:40.137915 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=6df933c6701197f19f977375e92979c8afcadefc7039840cc2a23d3bb09024ee I0702 22:38:40.137931 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0702 22:38:40.137962 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=7ae4b20d4aa3b12cc95dc5e2a720c73df880daf4af8e6123806962ce07117643 I0702 22:38:40.137988 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0702 22:38:40.138026 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=e8356b2fd6982f5ae68a6121a1f363f709d99122436d39168de4b742b7544544 I0702 22:38:40.138063 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=9bb5777a2921f5c713b1f9727f611c1a687ed49ab77b308efe4ff3dad31962b4 I0702 22:38:40.138097 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ac3690db890071febcc8d12febed79a2983292b3e2541e2e4b1df6c8009e838c I0702 22:38:40.138139 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=ca6913824c9132a59f2c4c04dc1c994e961d0f5b2b188fe99310db35831f3126 I0702 22:38:40.138417 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=892e92447f8a32b51fe42572e31d0b9c758b681e5bf194d146b61bd4c936872b I0702 22:38:40.138446 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=2e5ebbc737d57606a27d90d958a2bd82ce92bd039e4c39113455044bd50762bd I0702 22:38:40.138461 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0702 22:38:40.138486 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=e30f569357192be192b28d1f79ef270851d93e6bd002395ba2043333dd38a429 I0702 22:38:40.138502 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0702 22:38:40.138527 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=bb1b77ccfd3e96c5ae87aee7670ff5f36cc550b96487719374dfbd8e2005f1a3 I0702 22:38:40.138543 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0702 22:38:40.138572 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=d3b31869351ab6a4a93cfbd001df8f8d4d2acb058c1164966a4b4937cdef6b49 I0702 22:38:40.138588 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0702 22:38:40.138616 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=c765b3fa721841b5e4a9267443d8f911c9c921061ac820ed412cc9fdd6981f03 I0702 22:38:40.138726 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=32568b9405d35c87f82f0c1d3e677af5cbb6ff5940c32662ca8264dd245cd51b I0702 22:38:40.138777 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0702 22:38:40.138813 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=7f2235e8380ac9501a3c3c5536b97051276af0847b5914873a27d1818d8a9e8f I0702 22:38:40.138847 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=e3b2246dac89dd4c65ea05abaebcd4245881ae3bee5e1b1678464769a0922ba0 I0702 22:38:40.138868 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0702 22:38:40.138896 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=739ccf7bcdb523f3b66b035c93ceca793225e57bef1f7c761f5bddd821267bd7 I0702 22:38:40.138912 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0702 22:38:40.138953 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=b6ae244f6cf669b74e2a6260502c3e6986ad28bee9f3e07caa6ab753835b3d79 I0702 22:38:40.138971 1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0702 22:38:40.138992 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=cc51a16130e5bc2b5eff4f4234d3663817243ccd19dc0aecbab3a03fe13c9ecb I0702 22:38:40.139017 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=0dfbf54a2227826d0a3cf55ed0faf04d6cf1050f626bd2a0fe8ee8cc6e9907b5 I0702 22:38:40.139043 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=9f126c3d54a23e01d20b6b4a5d0c262b0de84beb7fe558a0ad64ed043097f5b6 I0702 22:38:40.139076 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=a833b902f6312b0b9ff38c815ecee29561f2a6211ddc2fdfd31dde57f2721716 I0702 22:38:40.139090 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0702 22:38:40.139127 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=60ab0474a868cc64b42343aab236de7051e46634a00b21d2fab799c7a8d9f710 I0702 22:38:40.139153 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0702 22:38:40.139167 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0702 22:38:40.139179 1 gather.go:181] gatherer "clusterconfig" function "operators" took 2.263572117s to process 37 records W0702 22:38:40.896948 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0702 22:38:41.897118 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0702 22:38:42.896890 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0702 22:38:42.896931 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0702 22:38:42.896947 1 tasks_processing.go:74] worker 11 stopped. E0702 22:38:42.896959 1 gather.go:144] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0702 22:38:42.896972 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0702 22:38:42.896985 1 gather.go:181] gatherer "clusterconfig" function "dvo_metrics" took 5.022764419s to process 1 records I0702 22:38:50.906311 1 tasks_processing.go:74] worker 19 stopped. I0702 22:38:50.906376 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0702 22:38:50.906436 1 gather.go:181] gatherer "clusterconfig" function "install_plans" took 13.029802192s to process 1 records I0702 22:38:51.709884 1 tasks_processing.go:74] worker 6 stopped. I0702 22:38:51.710173 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=3147920508c35ebe366823a967c9abd74504ad42fa321a8f3930fc3d294e486a I0702 22:38:51.710190 1 gather.go:181] gatherer "clusterconfig" function "service_accounts" took 13.809718348s to process 1 records E0702 22:38:51.710252 1 periodic.go:252] clusterconfig failed after 13.836s with: function "pod_network_connectivity_checks" failed with an error, function "active_alerts" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "machines" failed with an error, function "silenced_alerts" failed with an error, function "machine_configs" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error I0702 22:38:51.710268 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "active_alerts" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "machines" failed with an error, function "silenced_alerts" failed with an error, function "machine_configs" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error I0702 22:38:51.710275 1 periodic.go:214] Running workloads gatherer I0702 22:38:51.710289 1 tasks_processing.go:45] number of workers: 2 I0702 22:38:51.710299 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 22:38:51.710303 1 tasks_processing.go:71] worker 1 working on workload_info task. I0702 22:38:51.710316 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 22:38:51.710393 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0702 22:38:51.742260 1 gather_workloads_info.go:281] Loaded pods in 0s, will wait 24s for image data I0702 22:38:51.746053 1 tasks_processing.go:74] worker 0 stopped. I0702 22:38:51.746071 1 gather.go:181] gatherer "workloads" function "helmchart_info" took 35.645226ms to process 0 records I0702 22:38:51.750545 1 gather_workloads_info.go:390] No image sha256:0c1abef76d6d2832ddcff31e950ffafeb4e0f6fad80a5f5dca94591de0fc9581 (10ms) I0702 22:38:51.759981 1 gather_workloads_info.go:390] No image sha256:5bcfb1b739fa4e6ff9e21e4843f8520f29608135341f7d8dcc31084b9ba25f1d (9ms) I0702 22:38:51.771108 1 gather_workloads_info.go:390] No image sha256:351ca92471647f383f3cd7f0b70f33f5fa11c39ab569c4948dff7d471a6c8be3 (11ms) I0702 22:38:51.780877 1 gather_workloads_info.go:390] No image sha256:0158b297aec0a66376c04d3c7cf4828db5e5d9f424e331ff7c7b796828036875 (10ms) I0702 22:38:51.789257 1 gather_workloads_info.go:390] No image sha256:4b9b7949d209e257a76053de4ac74193f747c0d42e25dcd270d655849a4e51aa (8ms) I0702 22:38:51.797095 1 gather_workloads_info.go:390] No image sha256:38787de16ee8c686305f93b501d891b50cde24136009863869d230c0d4eeee5c (8ms) I0702 22:38:51.804241 1 gather_workloads_info.go:390] No image sha256:09b3e9e6a4f382fb4bbdb67bc945bcf19d66f604b7c8ffd66d4d4a2c94224248 (7ms) I0702 22:38:51.811796 1 gather_workloads_info.go:390] No image sha256:1eee856bde9bad71c4444c494225a0cf02d1f4a5293acf0bd6e7e1814efa0064 (8ms) I0702 22:38:51.819416 1 gather_workloads_info.go:390] No image sha256:788d16bfff4bd6bb3ce97acc643b56fae6e619674ab279535480e519b4d5b769 (8ms) I0702 22:38:51.827038 1 gather_workloads_info.go:390] No image sha256:48dff3fcb0da58eb9b2b500f89af8b7d0790ffa60da0b0e301feca971dbafcbb (8ms) I0702 22:38:51.849658 1 gather_workloads_info.go:390] No image sha256:24519dcc0e63cdc60a639dd474d06e7612e9b76966bc60322cd9026a0f1b878c (23ms) I0702 22:38:51.949416 1 gather_workloads_info.go:390] No image sha256:31a22f6ee061d0f6558664e580ec0f80f1927d4ec29626cf3e9420837f5d80e5 (100ms) I0702 22:38:52.050440 1 gather_workloads_info.go:390] No image sha256:8e158c83ec12b3e0237fab9a221630bd691e79c079a111f346354ff43b8199df (101ms) I0702 22:38:52.150410 1 gather_workloads_info.go:390] No image sha256:a7fc4d05c4a3c82c9f355ca985d6fd26033c0d6a98716f25fcd2f54bae1d2fa0 (100ms) I0702 22:38:52.250439 1 gather_workloads_info.go:390] No image sha256:894452e6587de55d04e37163d3da53e11fced8fb08bd0acf61e6d49f7964284e (100ms) I0702 22:38:52.351900 1 gather_workloads_info.go:390] No image sha256:194ee1155b87e110bc6c4a6e55667e41f3bdc8292e26a9561f9082fdfe467eec (101ms) I0702 22:38:52.449897 1 gather_workloads_info.go:390] No image sha256:06821dfe231330e0eb5be915b9468cd13826a7ee59d1a732b89cb140548eade2 (98ms) I0702 22:38:52.550369 1 gather_workloads_info.go:390] No image sha256:13aabbaf260d634ff0e9ac1af88af075b5ba671fd51313e33e74d7d2f7e54128 (100ms) I0702 22:38:52.650219 1 gather_workloads_info.go:390] No image sha256:8562a483f4568254250f19fc68d79f88c94a48508aefe59a70c1021a3aad000a (100ms) I0702 22:38:52.750445 1 gather_workloads_info.go:390] No image sha256:c96b4bddf3dd7daaa797cbda4dd92e981de2f5fc3404c01381f31dc0414d5c8d (100ms) I0702 22:38:52.850412 1 gather_workloads_info.go:390] No image sha256:6a9b4fd887fa7f1729302fb0330c3c9a483197bf78becdcfda4235ec823a2c39 (100ms) I0702 22:38:52.950776 1 gather_workloads_info.go:401] Found image sha256:751bd7eb62f632c0eef0ca91b6c57c64d4f1279d4dbe1a9b875ac4020a7b693f (100ms) I0702 22:38:53.050809 1 gather_workloads_info.go:390] No image sha256:41029e57ece558b2e0b12174ce924647fd9d5c5d83aadf4bba03d6916d3f9f54 (100ms) I0702 22:38:53.151240 1 gather_workloads_info.go:401] Found image sha256:b8781637560d49de9b8e8cdd59ec75f03d98921ea66950381849398128cc9cb9 (100ms) I0702 22:38:53.250471 1 gather_workloads_info.go:390] No image sha256:02283a64c1936a5dd09d5c6bc0ecbcf9196fe4df6a4055c8be22cebd850aa7a3 (99ms) I0702 22:38:53.350411 1 gather_workloads_info.go:390] No image sha256:42b4c6bdf3081ec264bc5edbc4eb779151de9e4742d6fe59a316645891df649c (100ms) I0702 22:38:53.450352 1 gather_workloads_info.go:390] No image sha256:221622a101db9797df0622b4534e3e42c4498df458f355a8a02fad8d65f8e3f2 (100ms) I0702 22:38:53.550699 1 gather_workloads_info.go:390] No image sha256:1c7c24111f1709d7648156873ced09462638aa4b3cf7e7aee13297e51bcdfb3e (100ms) I0702 22:38:53.650524 1 gather_workloads_info.go:390] No image sha256:3fea7db586d3236c1876a8b523af0d8d65c84d6f6cf5d0f4e41cafcffe6db5b5 (100ms) I0702 22:38:53.750691 1 gather_workloads_info.go:390] No image sha256:586127c49e25052113263d8aeaf6a1623aef22987364f119a17b2848982ff716 (100ms) I0702 22:38:53.852239 1 gather_workloads_info.go:390] No image sha256:0c6b7f828184b16a5e6630111e0715e11d34dae9b0bf64619466543e6168e05c (102ms) I0702 22:38:53.950418 1 gather_workloads_info.go:390] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (98ms) I0702 22:38:54.050967 1 gather_workloads_info.go:390] No image sha256:0242cefbf0bb876101c4d67ab4e07401cb0ba6c02be2b73a4f17ba33b2960005 (101ms) I0702 22:38:54.150331 1 gather_workloads_info.go:390] No image sha256:30ff5e5b72f274598704ca69f1832eba1040cc25da47386004fd59500b6e4c55 (99ms) I0702 22:38:54.253412 1 gather_workloads_info.go:390] No image sha256:3a2c82b772ea6072e1eca0efc5303f002189e80b0e985fb3e3b8ea9a12fe8060 (103ms) I0702 22:38:54.350206 1 gather_workloads_info.go:390] No image sha256:2897724cec17bc13acc133181f64ccb8d54ce5dc9582f9cecf704c2540e15600 (97ms) I0702 22:38:54.450502 1 gather_workloads_info.go:390] No image sha256:3969660e807e8ce5656a74e5816573656241946ef1d766a9d2e21d434356313c (100ms) I0702 22:38:54.551031 1 gather_workloads_info.go:390] No image sha256:50076d29400ecf9b704d8175509fc8cb7c28bea91d46a28dc37cbda1668c69f9 (101ms) I0702 22:38:54.649894 1 gather_workloads_info.go:390] No image sha256:4dcdadc14b7bdb2c00954d92e957d63aafbbe5f4047fe028e575d65725923cb0 (99ms) I0702 22:38:54.749612 1 gather_workloads_info.go:390] No image sha256:ed0c9631d6e424912cd8ce78ca7a2c4f76b3fc15e9e34fe00999170ccf19a611 (100ms) I0702 22:38:54.850921 1 gather_workloads_info.go:390] No image sha256:bc829520eeec090b60d17abbad1a22b34ea99b426193395808a778d73a5fb57a (101ms) I0702 22:38:54.950093 1 gather_workloads_info.go:390] No image sha256:c7aa910ca06f8fd89cdf2519136e0f3533bdacfc6bd58a3f6683f9f08756c7b1 (99ms) I0702 22:38:55.050479 1 gather_workloads_info.go:390] No image sha256:68abf16a3b6c33fdd22a823c7d00f96aaaa8015d370116962a5835984908645a (100ms) I0702 22:38:55.050512 1 tasks_processing.go:74] worker 1 stopped. I0702 22:38:55.050869 1 recorder.go:70] Recording config/workload_info with fingerprint=79c09eb4ff54909aab3428ddf1eac059999b725e0a56d24478ace4aa160a5787 I0702 22:38:55.050890 1 gather.go:181] gatherer "workloads" function "workload_info" took 3.340202442s to process 1 records I0702 22:38:55.050905 1 periodic.go:261] Periodic gather workloads completed in 3.34s I0702 22:38:55.050916 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0702 22:38:55.050923 1 periodic.go:214] Running conditional gatherer I0702 22:38:55.060183 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules I0702 22:38:55.238850 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer E0702 22:38:55.241271 1 conditional_gatherer.go:322] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.6.107:9091: connect: connection refused I0702 22:38:55.241359 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0702 22:38:55.250127 1 conditional_gatherer.go:390] cluster version is '4.18.9' E0702 22:38:55.250143 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 22:38:55.250152 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 22:38:55.250157 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 22:38:55.250162 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 22:38:55.250166 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 22:38:55.250172 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 22:38:55.250176 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 22:38:55.250179 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 22:38:55.250182 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 22:38:55.250185 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0702 22:38:55.250199 1 tasks_processing.go:45] number of workers: 3 I0702 22:38:55.250211 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 22:38:55.250215 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0702 22:38:55.250222 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 22:38:55.250239 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0702 22:38:55.250245 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0702 22:38:55.250237 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 22:38:55.250256 1 tasks_processing.go:74] worker 1 stopped. I0702 22:38:55.250310 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0702 22:38:55.250326 1 gather.go:181] gatherer "conditional" function "conditional_gatherer_rules" took 1.386µs to process 1 records I0702 22:38:55.250363 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0702 22:38:55.250372 1 gather.go:181] gatherer "conditional" function "remote_configuration" took 1.163µs to process 1 records I0702 22:38:55.250378 1 tasks_processing.go:74] worker 0 stopped. I0702 22:38:55.250436 1 tasks_processing.go:74] worker 2 stopped. I0702 22:38:55.250449 1 gather.go:181] gatherer "conditional" function "rapid_container_logs" took 186.404µs to process 0 records I0702 22:38:55.250465 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I0702 22:38:55.250483 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f W0702 22:38:55.276929 1 gather.go:213] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0702 22:38:55.277084 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=76c2b418f819a962856bfd9b60c9275b2a6e576937e8120da3d00848528f028b I0702 22:38:55.277195 1 diskrecorder.go:70] Writing 104 records to /var/lib/insights-operator/insights-2026-07-02-223855.tar.gz I0702 22:38:55.284465 1 diskrecorder.go:51] Wrote 104 records to disk in 7ms I0702 22:38:55.284495 1 periodic.go:283] Gathering cluster info every 2h0m0s I0702 22:38:55.284514 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0702 22:40:07.874332 1 diskrecorder.go:170] Found files to send: insights-2026-07-02-223855.tar.gz I0702 22:40:07.874363 1 insightsuploader.go:150] Checking archives to upload periodically every 16m28.993256307s I0702 22:40:07.874371 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0702 22:40:07.891210 1 requests.go:47] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0702 22:40:07.985792 1 requests.go:88] Successfully reported id=2026-07-02T22:40:07Z x-rh-insights-request-id=0bc598e56f7741afb92cf10aca9c96d3, wrote=53564 I0702 22:40:07.985846 1 insightsuploader.go:187] Uploaded report successfully in 111.463643ms I0702 22:40:07.985869 1 controller.go:119] Initializing last reported time to 2026-07-02T22:40:07Z I0702 22:40:07.985891 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0702 22:40:07.985905 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0702 22:40:07.985914 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0702 22:40:07.991443 1 controller.go:482] The operator is healthy I0702 22:40:37.886665 1 controller.go:482] The operator is healthy I0702 22:41:08.473718 1 insightsreport.go:137] Pulling report from smart-proxy I0702 22:41:08.473747 1 insightsreport.go:149] Retrieving report I0702 22:41:08.484732 1 requests.go:111] Retrieving report for cluster: e03187a0-70d0-490d-8890-eba1d740cef2 I0702 22:41:08.484745 1 requests.go:112] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/e03187a0-70d0-490d-8890-eba1d740cef2/reports I0702 22:41:08.487901 1 requests.go:122] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/e03187a0-70d0-490d-8890-eba1d740cef2/reports I0702 22:41:08.675074 1 insightsreport.go:184] Report retrieved I0702 22:41:08.716319 1 insightsreport.go:239] Report retrieved correctly I0702 22:42:37.901505 1 controller.go:482] The operator is healthy I0702 22:43:37.871377 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:43:37.877844 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:43:37.877866 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:43:37.881822 1 secretconfigobserver.go:119] support secret does not exist I0702 22:44:37.886330 1 controller.go:482] The operator is healthy I0702 22:46:37.893416 1 controller.go:482] The operator is healthy I0702 22:48:37.868649 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:48:37.882840 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:48:37.885728 1 controller.go:482] The operator is healthy I0702 22:48:37.887117 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:48:37.887143 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:48:37.890950 1 secretconfigobserver.go:119] support secret does not exist I0702 22:50:37.886687 1 controller.go:482] The operator is healthy I0702 22:52:37.887589 1 controller.go:482] The operator is healthy I0702 22:53:37.891442 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:53:37.897023 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:53:37.897043 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:53:37.900903 1 secretconfigobserver.go:119] support secret does not exist I0702 22:54:37.887199 1 controller.go:482] The operator is healthy I0702 22:56:37.885810 1 controller.go:482] The operator is healthy I0702 22:56:41.980937 1 insightsuploader.go:146] Nothing to report since 2026-07-02T22:40:07Z I0702 22:58:37.869338 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:58:37.885596 1 controller.go:482] The operator is healthy I0702 22:58:37.901417 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:58:37.905792 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:58:37.905812 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:58:37.909515 1 secretconfigobserver.go:119] support secret does not exist I0702 23:00:37.889510 1 controller.go:482] The operator is healthy I0702 23:02:37.886143 1 controller.go:482] The operator is healthy I0702 23:03:37.909735 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:03:37.915339 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:03:37.915360 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:03:37.919462 1 secretconfigobserver.go:119] support secret does not exist I0702 23:04:37.887082 1 controller.go:482] The operator is healthy I0702 23:06:37.887016 1 controller.go:482] The operator is healthy I0702 23:08:37.873468 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 23:08:37.885649 1 controller.go:482] The operator is healthy I0702 23:08:37.919681 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:08:37.924263 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:08:37.924284 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:08:37.928083 1 secretconfigobserver.go:119] support secret does not exist I0702 23:10:37.888922 1 controller.go:482] The operator is healthy I0702 23:12:30.294981 1 insightsuploader.go:146] Nothing to report since 2026-07-02T22:40:07Z I0702 23:12:37.889958 1 controller.go:482] The operator is healthy I0702 23:13:37.928460 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:13:37.934264 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:13:37.934285 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:13:37.938375 1 secretconfigobserver.go:119] support secret does not exist I0702 23:14:37.887857 1 controller.go:482] The operator is healthy