I0702 21:53:27.869981 1 cmd.go:250] Using service-serving-cert provided certificates I0702 21:53:27.870314 1 observer_polling.go:159] Starting file observer W0702 21:53:27.922991 1 builder.go:266] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-6fd96f47fd" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0702 21:53:28.180463 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0702 21:53:28.180668 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0702 21:53:28.181017 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0702 21:53:28.181197 1 secure_serving.go:57] Forcing use of http/1.1 only W0702 21:53:28.181217 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0702 21:53:28.181223 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0702 21:53:28.181227 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0702 21:53:28.181230 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0702 21:53:28.181232 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0702 21:53:28.181234 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0702 21:53:28.183951 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes ChunkSizeMiB CloudDualStackNodeIPs DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy PersistentIPsForVirtualization PrivateHostedZoneAWS SetEIPForNLBIngressController VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy AWSClusterHostedDNS AdditionalRoutingCapabilities AutomatedEtcdBackup BootcNodeManagement CSIDriverSharedResource ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ConsolePluginContentSecurityPolicy DNSNameResolver DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example GCPClusterHostedDNS GatewayAPI ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MetricsCollectionProfiles MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NodeSwap NutanixMultiSubnets OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0702 21:53:28.183960 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ConsolePluginContentSecurityPolicy", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0702 21:53:28.186615 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0702 21:53:28.186630 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0702 21:53:28.186629 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0702 21:53:28.186645 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 21:53:28.186653 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0702 21:53:28.186668 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0702 21:53:28.186893 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0702 21:53:28.187011 1 secure_serving.go:213] Serving securely on [::]:8443 I0702 21:53:28.187034 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" E0702 21:53:28.188697 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18be979e31f283d7 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"SetEIPForNLBIngressController\", \"VSphereControlPlaneMachineSet\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"VSphereStaticIPs\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AdditionalRoutingCapabilities\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"CSIDriverSharedResource\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ConsolePluginContentSecurityPolicy\", \"DNSNameResolver\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"GCPClusterHostedDNS\", \"GatewayAPI\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MetricsCollectionProfiles\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OnClusterBuild\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SignatureStores\", \"SigstoreImageVerification\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-02 21:53:28.183899095 +0000 UTC m=+0.344967116,LastTimestamp:2026-07-02 21:53:28.183899095 +0000 UTC m=+0.344967116,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0702 21:53:28.190597 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0702 21:53:28.190618 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 21:53:28.190713 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0702 21:53:28.197188 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 21:53:28.197210 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 21:53:28.200599 1 secretconfigobserver.go:119] support secret does not exist I0702 21:53:28.204008 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 21:53:28.205485 1 recorder.go:156] Pruning old reports every 4h18m40s, max age is 288h0m0s I0702 21:53:28.207144 1 secretconfigobserver.go:119] support secret does not exist I0702 21:53:28.210042 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0702 21:53:28.210057 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0702 21:53:28.210065 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0702 21:53:28.210079 1 insightsreport.go:296] Starting report retriever I0702 21:53:28.210078 1 periodic.go:214] Running clusterconfig gatherer I0702 21:53:28.210084 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0702 21:53:28.210116 1 tasks_processing.go:45] number of workers: 64 I0702 21:53:28.210140 1 tasks_processing.go:69] worker 5 listening for tasks. I0702 21:53:28.210149 1 tasks_processing.go:69] worker 3 listening for tasks. I0702 21:53:28.210154 1 tasks_processing.go:69] worker 23 listening for tasks. I0702 21:53:28.210159 1 tasks_processing.go:69] worker 6 listening for tasks. I0702 21:53:28.210159 1 tasks_processing.go:69] worker 4 listening for tasks. I0702 21:53:28.210155 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 21:53:28.210168 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 21:53:28.210168 1 tasks_processing.go:71] worker 4 working on dvo_metrics task. I0702 21:53:28.210170 1 tasks_processing.go:69] worker 24 listening for tasks. I0702 21:53:28.210172 1 tasks_processing.go:69] worker 15 listening for tasks. I0702 21:53:28.210173 1 tasks_processing.go:71] worker 0 working on node_logs task. I0702 21:53:28.210178 1 tasks_processing.go:69] worker 16 listening for tasks. I0702 21:53:28.210175 1 tasks_processing.go:69] worker 14 listening for tasks. I0702 21:53:28.210181 1 tasks_processing.go:71] worker 16 working on authentication task. I0702 21:53:28.210178 1 tasks_processing.go:71] worker 15 working on config_maps task. I0702 21:53:28.210188 1 tasks_processing.go:69] worker 47 listening for tasks. I0702 21:53:28.210192 1 tasks_processing.go:69] worker 48 listening for tasks. I0702 21:53:28.210197 1 tasks_processing.go:69] worker 49 listening for tasks. I0702 21:53:28.210194 1 tasks_processing.go:69] worker 45 listening for tasks. I0702 21:53:28.210164 1 tasks_processing.go:71] worker 6 working on validating_webhook_configurations task. I0702 21:53:28.210207 1 tasks_processing.go:69] worker 51 listening for tasks. I0702 21:53:28.210209 1 tasks_processing.go:69] worker 25 listening for tasks. I0702 21:53:28.210207 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 21:53:28.210213 1 tasks_processing.go:69] worker 52 listening for tasks. I0702 21:53:28.210216 1 tasks_processing.go:69] worker 26 listening for tasks. I0702 21:53:28.210222 1 tasks_processing.go:69] worker 60 listening for tasks. I0702 21:53:28.210223 1 tasks_processing.go:69] worker 27 listening for tasks. I0702 21:53:28.210224 1 tasks_processing.go:69] worker 20 listening for tasks. I0702 21:53:28.210228 1 tasks_processing.go:69] worker 61 listening for tasks. I0702 21:53:28.210228 1 tasks_processing.go:71] worker 60 working on openstack_dataplanedeployments task. I0702 21:53:28.210232 1 tasks_processing.go:69] worker 21 listening for tasks. I0702 21:53:28.210235 1 tasks_processing.go:71] worker 61 working on operators_pods_and_events task. I0702 21:53:28.210236 1 tasks_processing.go:71] worker 21 working on ingress task. I0702 21:53:28.210253 1 tasks_processing.go:69] worker 19 listening for tasks. I0702 21:53:28.210250 1 tasks_processing.go:69] worker 59 listening for tasks. I0702 21:53:28.210174 1 tasks_processing.go:71] worker 24 working on oauths task. I0702 21:53:28.210266 1 tasks_processing.go:69] worker 53 listening for tasks. I0702 21:53:28.210274 1 tasks_processing.go:69] worker 10 listening for tasks. I0702 21:53:28.210269 1 tasks_processing.go:69] worker 18 listening for tasks. I0702 21:53:28.210281 1 tasks_processing.go:69] worker 7 listening for tasks. I0702 21:53:28.210277 1 tasks_processing.go:69] worker 55 listening for tasks. I0702 21:53:28.210288 1 tasks_processing.go:69] worker 9 listening for tasks. I0702 21:53:28.210288 1 tasks_processing.go:69] worker 8 listening for tasks. I0702 21:53:28.210292 1 tasks_processing.go:69] worker 54 listening for tasks. I0702 21:53:28.210296 1 tasks_processing.go:69] worker 41 listening for tasks. I0702 21:53:28.210299 1 tasks_processing.go:69] worker 31 listening for tasks. I0702 21:53:28.210299 1 tasks_processing.go:69] worker 29 listening for tasks. I0702 21:53:28.210297 1 tasks_processing.go:69] worker 57 listening for tasks. I0702 21:53:28.210305 1 tasks_processing.go:69] worker 28 listening for tasks. I0702 21:53:28.210303 1 tasks_processing.go:69] worker 37 listening for tasks. I0702 21:53:28.210310 1 tasks_processing.go:69] worker 56 listening for tasks. I0702 21:53:28.210314 1 tasks_processing.go:69] worker 30 listening for tasks. I0702 21:53:28.210317 1 tasks_processing.go:69] worker 39 listening for tasks. I0702 21:53:28.210310 1 tasks_processing.go:69] worker 38 listening for tasks. I0702 21:53:28.210307 1 tasks_processing.go:69] worker 36 listening for tasks. I0702 21:53:28.210322 1 tasks_processing.go:69] worker 63 listening for tasks. I0702 21:53:28.210325 1 tasks_processing.go:69] worker 40 listening for tasks. I0702 21:53:28.210325 1 tasks_processing.go:69] worker 11 listening for tasks. I0702 21:53:28.210318 1 tasks_processing.go:69] worker 32 listening for tasks. I0702 21:53:28.210330 1 tasks_processing.go:69] worker 34 listening for tasks. I0702 21:53:28.210331 1 tasks_processing.go:69] worker 62 listening for tasks. I0702 21:53:28.210334 1 tasks_processing.go:69] worker 43 listening for tasks. I0702 21:53:28.210334 1 tasks_processing.go:69] worker 35 listening for tasks. I0702 21:53:28.210337 1 tasks_processing.go:69] worker 42 listening for tasks. I0702 21:53:28.210337 1 tasks_processing.go:69] worker 13 listening for tasks. I0702 21:53:28.210340 1 tasks_processing.go:69] worker 44 listening for tasks. I0702 21:53:28.210341 1 tasks_processing.go:71] worker 20 working on nodenetworkconfigurationpolicies task. I0702 21:53:28.210344 1 tasks_processing.go:71] worker 47 working on jaegers task. I0702 21:53:28.210345 1 tasks_processing.go:71] worker 1 working on storage_cluster task. I0702 21:53:28.210346 1 tasks_processing.go:71] worker 5 working on clusterroles task. I0702 21:53:28.210347 1 tasks_processing.go:71] worker 26 working on tsdb_status task. I0702 21:53:28.210351 1 tasks_processing.go:71] worker 48 working on aggregated_monitoring_cr_names task. I0702 21:53:28.210401 1 tasks_processing.go:71] worker 49 working on machine_config_pools task. I0702 21:53:28.210230 1 tasks_processing.go:71] worker 27 working on machine_healthchecks task. I0702 21:53:28.210431 1 tasks_processing.go:71] worker 51 working on machine_configs task. I0702 21:53:28.210163 1 tasks_processing.go:71] worker 23 working on cost_management_metrics_configs task. I0702 21:53:28.210441 1 tasks_processing.go:71] worker 52 working on networks task. I0702 21:53:28.210183 1 tasks_processing.go:69] worker 46 listening for tasks. I0702 21:53:28.210343 1 tasks_processing.go:71] worker 3 working on crds task. I0702 21:53:28.210169 1 tasks_processing.go:71] worker 2 working on nodenetworkstates task. I0702 21:53:28.210462 1 tasks_processing.go:71] worker 25 working on machine_autoscalers task. I0702 21:53:28.210319 1 tasks_processing.go:69] worker 12 listening for tasks. I0702 21:53:28.210339 1 tasks_processing.go:71] worker 45 working on operators task. I0702 21:53:28.210233 1 tasks_processing.go:69] worker 17 listening for tasks. I0702 21:53:28.210203 1 tasks_processing.go:69] worker 50 listening for tasks. I0702 21:53:28.210327 1 tasks_processing.go:69] worker 33 listening for tasks. I0702 21:53:28.210502 1 tasks_processing.go:71] worker 14 working on openstack_version task. I0702 21:53:28.210506 1 tasks_processing.go:71] worker 29 working on openstack_dataplanenodesets task. I0702 21:53:28.210508 1 tasks_processing.go:71] worker 11 working on container_runtime_configs task. I0702 21:53:28.210514 1 tasks_processing.go:71] worker 42 working on mutating_webhook_configurations task. I0702 21:53:28.210507 1 tasks_processing.go:71] worker 50 working on nodes task. I0702 21:53:28.210537 1 tasks_processing.go:71] worker 53 working on sap_pods task. I0702 21:53:28.210541 1 tasks_processing.go:71] worker 37 working on openstack_controlplanes task. I0702 21:53:28.210327 1 tasks_processing.go:69] worker 58 listening for tasks. I0702 21:53:28.210561 1 tasks_processing.go:71] worker 13 working on lokistack task. I0702 21:53:28.210562 1 tasks_processing.go:71] worker 58 working on container_images task. I0702 21:53:28.210565 1 tasks_processing.go:71] worker 56 working on install_plans task. I0702 21:53:28.210346 1 tasks_processing.go:69] worker 22 listening for tasks. I0702 21:53:28.210508 1 tasks_processing.go:71] worker 33 working on openshift_logging task. I0702 21:53:28.210598 1 tasks_processing.go:71] worker 39 working on overlapping_namespace_uids task. I0702 21:53:28.210645 1 tasks_processing.go:71] worker 44 working on ingress_certificates task. I0702 21:53:28.210534 1 tasks_processing.go:71] worker 57 working on schedulers task. I0702 21:53:28.210713 1 tasks_processing.go:71] worker 32 working on machines task. I0702 21:53:28.210766 1 tasks_processing.go:71] worker 17 working on service_accounts task. I0702 21:53:28.210530 1 tasks_processing.go:71] worker 19 working on sap_config task. I0702 21:53:28.210844 1 tasks_processing.go:71] worker 9 working on active_alerts task. I0702 21:53:28.210880 1 tasks_processing.go:71] worker 18 working on infrastructures task. I0702 21:53:28.210929 1 tasks_processing.go:71] worker 38 working on support_secret task. I0702 21:53:28.210936 1 tasks_processing.go:71] worker 22 working on machine_sets task. I0702 21:53:28.210955 1 tasks_processing.go:71] worker 54 working on image_registries task. I0702 21:53:28.210962 1 tasks_processing.go:71] worker 35 working on cluster_apiserver task. I0702 21:53:28.210977 1 tasks_processing.go:71] worker 10 working on silenced_alerts task. I0702 21:53:28.210533 1 tasks_processing.go:71] worker 59 working on monitoring_persistent_volumes task. I0702 21:53:28.211016 1 tasks_processing.go:71] worker 55 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0702 21:53:28.211012 1 tasks_processing.go:71] worker 43 working on feature_gates task. I0702 21:53:28.211028 1 tasks_processing.go:71] worker 34 working on version task. I0702 21:53:28.210530 1 tasks_processing.go:71] worker 30 working on metrics task. I0702 21:53:28.211062 1 tasks_processing.go:71] worker 8 working on ceph_cluster task. I0702 21:53:28.210538 1 tasks_processing.go:71] worker 28 working on openshift_machine_api_events task. I0702 21:53:28.211123 1 tasks_processing.go:71] worker 36 working on image task. I0702 21:53:28.211149 1 tasks_processing.go:71] worker 41 working on proxies task. I0702 21:53:28.211154 1 tasks_processing.go:71] worker 63 working on pod_network_connectivity_checks task. I0702 21:53:28.211181 1 tasks_processing.go:71] worker 31 working on sap_datahubs task. I0702 21:53:28.211211 1 tasks_processing.go:71] worker 62 working on image_pruners task. I0702 21:53:28.211149 1 tasks_processing.go:71] worker 40 working on certificate_signing_requests task. I0702 21:53:28.210556 1 tasks_processing.go:71] worker 46 working on pdbs task. I0702 21:53:28.211011 1 tasks_processing.go:71] worker 7 working on olm_operators task. I0702 21:53:28.211926 1 tasks_processing.go:71] worker 12 working on storage_classes task. I0702 21:53:28.212612 1 tasks_processing.go:74] worker 60 stopped. I0702 21:53:28.212624 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 2.372591ms to process 0 records E0702 21:53:28.214674 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.244.171:9091: connect: connection refused I0702 21:53:28.214694 1 tasks_processing.go:74] worker 30 stopped. E0702 21:53:28.214701 1 gather.go:144] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.244.171:9091: connect: connection refused E0702 21:53:28.214701 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.61.100:9094: connect: connection refused I0702 21:53:28.214711 1 gather.go:181] gatherer "clusterconfig" function "metrics" took 3.641919ms to process 0 records E0702 21:53:28.214729 1 gather.go:144] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.61.100:9094: connect: connection refused E0702 21:53:28.214729 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.61.100:9094: connect: connection refused I0702 21:53:28.214739 1 gather.go:181] gatherer "clusterconfig" function "active_alerts" took 3.86229ms to process 0 records E0702 21:53:28.214747 1 gather.go:144] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.61.100:9094: connect: connection refused I0702 21:53:28.214755 1 gather.go:181] gatherer "clusterconfig" function "silenced_alerts" took 3.754589ms to process 0 records I0702 21:53:28.214761 1 tasks_processing.go:74] worker 10 stopped. I0702 21:53:28.214764 1 tasks_processing.go:74] worker 9 stopped. E0702 21:53:28.214726 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.244.171:9091: connect: connection refused I0702 21:53:28.214769 1 tasks_processing.go:74] worker 26 stopped. E0702 21:53:28.214773 1 gather.go:144] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.244.171:9091: connect: connection refused I0702 21:53:28.214782 1 gather.go:181] gatherer "clusterconfig" function "tsdb_status" took 4.416007ms to process 0 records I0702 21:53:28.234776 1 tasks_processing.go:74] worker 20 stopped. I0702 21:53:28.234791 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 24.425968ms to process 0 records I0702 21:53:28.234797 1 gather.go:181] gatherer "clusterconfig" function "storage_cluster" took 24.426139ms to process 0 records I0702 21:53:28.234801 1 tasks_processing.go:74] worker 1 stopped. I0702 21:53:28.234865 1 tasks_processing.go:74] worker 47 stopped. I0702 21:53:28.234879 1 gather.go:181] gatherer "clusterconfig" function "jaegers" took 24.513586ms to process 0 records I0702 21:53:28.234888 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkstates" took 24.401213ms to process 0 records I0702 21:53:28.234896 1 tasks_processing.go:74] worker 2 stopped. I0702 21:53:28.234920 1 tasks_processing.go:74] worker 25 stopped. I0702 21:53:28.234931 1 gather.go:181] gatherer "clusterconfig" function "machine_autoscalers" took 24.452569ms to process 0 records I0702 21:53:28.239002 1 tasks_processing.go:74] worker 0 stopped. I0702 21:53:28.239013 1 gather.go:181] gatherer "clusterconfig" function "node_logs" took 28.818776ms to process 0 records I0702 21:53:28.240049 1 tasks_processing.go:74] worker 11 stopped. I0702 21:53:28.240060 1 gather.go:181] gatherer "clusterconfig" function "container_runtime_configs" took 29.53418ms to process 0 records I0702 21:53:28.240116 1 tasks_processing.go:74] worker 14 stopped. I0702 21:53:28.240129 1 gather.go:181] gatherer "clusterconfig" function "openstack_version" took 29.605182ms to process 0 records I0702 21:53:28.240283 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0702 21:53:28.240296 1 controller.go:317] The initial operator extension status is healthy I0702 21:53:28.240304 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 21:53:28.240308 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0702 21:53:28.240311 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0702 21:53:28.240322 1 controller.go:457] The operator is still being initialized I0702 21:53:28.240327 1 controller.go:482] The operator is healthy I0702 21:53:28.240394 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s I0702 21:53:28.240466 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0702 21:53:28.240510 1 operator.go:288] started I0702 21:53:28.240532 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0702 21:53:28.240559 1 tasks_processing.go:74] worker 21 stopped. I0702 21:53:28.240832 1 recorder.go:70] Recording config/ingress with fingerprint=2a60293ba5eb8702142581f559b57a27a1978a048fc969fc842cbb4bd04332a0 I0702 21:53:28.240842 1 gather.go:181] gatherer "clusterconfig" function "ingress" took 30.298924ms to process 1 records I0702 21:53:28.242098 1 tasks_processing.go:74] worker 52 stopped. I0702 21:53:28.242254 1 recorder.go:70] Recording config/network with fingerprint=1ade7432836ac7bb72f4ecc290dc5b7fe247f6bea1fb28e799abd6e0fccb374e I0702 21:53:28.242266 1 gather.go:181] gatherer "clusterconfig" function "networks" took 31.647468ms to process 1 records I0702 21:53:28.245067 1 tasks_processing.go:74] worker 49 stopped. I0702 21:53:28.245081 1 gather.go:181] gatherer "clusterconfig" function "machine_config_pools" took 34.65542ms to process 0 records I0702 21:53:28.245087 1 gather.go:181] gatherer "clusterconfig" function "lokistack" took 34.504078ms to process 0 records I0702 21:53:28.245091 1 tasks_processing.go:74] worker 13 stopped. I0702 21:53:28.245374 1 tasks_processing.go:74] worker 16 stopped. I0702 21:53:28.245519 1 recorder.go:70] Recording config/authentication with fingerprint=d17ca7f60735849df4efdc36b66569f86dfa4e12e7ff0428ca61de36cfbb39e9 I0702 21:53:28.245529 1 gather.go:181] gatherer "clusterconfig" function "authentication" took 35.18384ms to process 1 records I0702 21:53:28.250075 1 tasks_processing.go:74] worker 19 stopped. I0702 21:53:28.250086 1 gather.go:181] gatherer "clusterconfig" function "sap_config" took 39.267944ms to process 0 records I0702 21:53:28.250847 1 tasks_processing.go:74] worker 27 stopped. E0702 21:53:28.250867 1 gather.go:144] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0702 21:53:28.250884 1 gather.go:181] gatherer "clusterconfig" function "machine_healthchecks" took 40.422872ms to process 0 records I0702 21:53:28.250978 1 tasks_processing.go:74] worker 22 stopped. I0702 21:53:28.251017 1 gather.go:181] gatherer "clusterconfig" function "machine_sets" took 40.034908ms to process 0 records I0702 21:53:28.251303 1 tasks_processing.go:74] worker 32 stopped. E0702 21:53:28.251338 1 gather.go:144] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0702 21:53:28.251360 1 gather.go:181] gatherer "clusterconfig" function "machines" took 40.564257ms to process 0 records I0702 21:53:28.251430 1 tasks_processing.go:74] worker 37 stopped. I0702 21:53:28.251443 1 gather.go:181] gatherer "clusterconfig" function "openstack_controlplanes" took 40.884012ms to process 0 records I0702 21:53:28.251649 1 tasks_processing.go:74] worker 57 stopped. I0702 21:53:28.251960 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=438abbd8e335961ccf7ea09b439cc04551cfaa8f3494999e03cc0d2a316845ba I0702 21:53:28.251973 1 gather.go:181] gatherer "clusterconfig" function "schedulers" took 40.952779ms to process 1 records I0702 21:53:28.251979 1 gather.go:181] gatherer "clusterconfig" function "openshift_logging" took 41.134348ms to process 0 records I0702 21:53:28.251993 1 tasks_processing.go:74] worker 53 stopped. I0702 21:53:28.252000 1 tasks_processing.go:74] worker 33 stopped. I0702 21:53:28.251983 1 gather.go:181] gatherer "clusterconfig" function "sap_pods" took 41.200675ms to process 0 records I0702 21:53:28.252006 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 41.238857ms to process 0 records I0702 21:53:28.252010 1 gather.go:181] gatherer "clusterconfig" function "sap_datahubs" took 40.569629ms to process 0 records I0702 21:53:28.252018 1 tasks_processing.go:74] worker 29 stopped. I0702 21:53:28.252019 1 tasks_processing.go:74] worker 31 stopped. I0702 21:53:28.252087 1 tasks_processing.go:74] worker 42 stopped. I0702 21:53:28.252456 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=597152fc32d5b39798763d86715be948a0f7f3a847633fb8d762609fc61ae2f2 I0702 21:53:28.252505 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=5893973a2457117c96dc4e27618fa50be2759f69a5f083251adedf7d32efc8d5 I0702 21:53:28.252543 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=afcddc4a3bf6ba088d9b0d81438617e7149b0f03d3b42e1ebb41c10ea5d260ef I0702 21:53:28.252552 1 gather.go:181] gatherer "clusterconfig" function "mutating_webhook_configurations" took 41.243012ms to process 3 records I0702 21:53:28.252562 1 gather.go:181] gatherer "clusterconfig" function "ceph_cluster" took 40.703614ms to process 0 records E0702 21:53:28.252568 1 gather.go:144] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0702 21:53:28.252574 1 gather.go:181] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 40.617653ms to process 0 records E0702 21:53:28.252579 1 gather.go:144] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0702 21:53:28.252584 1 gather.go:181] gatherer "clusterconfig" function "support_secret" took 40.863527ms to process 0 records I0702 21:53:28.252591 1 tasks_processing.go:74] worker 38 stopped. I0702 21:53:28.252595 1 tasks_processing.go:74] worker 8 stopped. I0702 21:53:28.252598 1 tasks_processing.go:74] worker 63 stopped. I0702 21:53:28.253421 1 tasks_processing.go:74] worker 41 stopped. I0702 21:53:28.253494 1 recorder.go:70] Recording config/proxy with fingerprint=afe66761f58e8f41dd385bf6ee3799cea72cc10426a5879a351eee896c2dc520 I0702 21:53:28.253514 1 gather.go:181] gatherer "clusterconfig" function "proxies" took 42.256911ms to process 1 records I0702 21:53:28.253708 1 tasks_processing.go:74] worker 62 stopped. I0702 21:53:28.253906 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=081772e8e97e71b6ab33544fa2519f78ff8a2f6ef17f2956927b7e84423c8591 I0702 21:53:28.253941 1 gather.go:181] gatherer "clusterconfig" function "image_pruners" took 42.481259ms to process 1 records I0702 21:53:28.253953 1 gather.go:181] gatherer "clusterconfig" function "openshift_machine_api_events" took 42.725418ms to process 0 records I0702 21:53:28.253961 1 tasks_processing.go:74] worker 28 stopped. I0702 21:53:28.253906 1 controller.go:203] Source scaController *sca.Controller is not ready I0702 21:53:28.253976 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0702 21:53:28.253983 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 21:53:28.253998 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0702 21:53:28.254004 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0702 21:53:28.254037 1 controller.go:457] The operator is still being initialized I0702 21:53:28.254045 1 controller.go:482] The operator is healthy I0702 21:53:28.254110 1 tasks_processing.go:74] worker 6 stopped. I0702 21:53:28.254186 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=508669a556413c053c2c12065c23ec7569343e60da81ac580a2d71d8aff839c4 I0702 21:53:28.254210 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=74c471322fabc81958c928bdebdec06061490e60066e3b602eabe023ec26172a I0702 21:53:28.254261 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=59b6c6b4d0870d24f7ca0f85493a16ba1ece7db76eadea2dbc10781a53fd76f9 I0702 21:53:28.254279 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=2c436cd4ab99eedee5f64c3f2472ff134ddbe4d70551e4afff1cbf742614c625 I0702 21:53:28.254293 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=528ebf59763389641f1ca5a7677af8b9dda4ba03fd65291907a60a6c3225b521 I0702 21:53:28.254315 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=833b8c778c922fb275a7853017246e55fa28e9980eaddb8b857e9e9329b0d149 I0702 21:53:28.254334 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=76d7ce81af92e8c8d3bf7c2b77f96c43b26c7af2f2d0f3e11f2f55a7dfbb24f1 I0702 21:53:28.254350 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=1043973b9b4219a44d87a146c64b93f3c86e747119130876ac1b7f381ae4d39c I0702 21:53:28.254366 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=98e0e1c4a2c965bf3d42b21460cd4e0a84b0a804d00513d81eddff689782612b I0702 21:53:28.254393 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=1c8c83641cb37edc8e5372517398792456813fae80f277c7fcb3d4f8e5bde0e5 I0702 21:53:28.254423 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=4cd3a7f2752b951c2804fbb0132837099dda9f009b1053969579fa3808c6aad0 I0702 21:53:28.254449 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=e1f7d341efb87ae01323294d9732ed12fe2c40983d312c9575fab9f396dac368 I0702 21:53:28.254476 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=39235fe723c8d1e9b0ce47792feff7e197b151936ad7f91b7b527ee6b725b4e9 I0702 21:53:28.254484 1 gather.go:181] gatherer "clusterconfig" function "validating_webhook_configurations" took 43.896756ms to process 13 records I0702 21:53:28.255154 1 tasks_processing.go:74] worker 50 stopped. I0702 21:53:28.255423 1 recorder.go:70] Recording config/node/ip-10-0-141-67.ec2.internal with fingerprint=e3e6b691832de0ff4822b7fca40f77040c7bb3b7f0794f7441d1042517dcd54d I0702 21:53:28.255466 1 recorder.go:70] Recording config/node/ip-10-0-158-108.ec2.internal with fingerprint=43721e205941dc24ed31f2d0b2ef9867b544c36321ced7da86b2c545d965edbb I0702 21:53:28.255503 1 recorder.go:70] Recording config/node/ip-10-0-163-2.ec2.internal with fingerprint=272e98a8a23abb5090ee2870852d434471f0110cde6a54db22bd09225f0f1a62 I0702 21:53:28.255510 1 gather.go:181] gatherer "clusterconfig" function "nodes" took 44.613567ms to process 3 records I0702 21:53:28.255590 1 tasks_processing.go:74] worker 18 stopped. I0702 21:53:28.255884 1 recorder.go:70] Recording config/infrastructure with fingerprint=c732ecb650b3de931e0601744dba15ae085819cf596fd5d12c420de1a38c5b35 I0702 21:53:28.255892 1 gather.go:181] gatherer "clusterconfig" function "infrastructures" took 44.618238ms to process 1 records I0702 21:53:28.256067 1 tasks_processing.go:74] worker 23 stopped. I0702 21:53:28.256075 1 gather.go:181] gatherer "clusterconfig" function "cost_management_metrics_configs" took 45.624898ms to process 0 records I0702 21:53:28.256166 1 tasks_processing.go:74] worker 59 stopped. I0702 21:53:28.256177 1 gather.go:181] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 45.143771ms to process 0 records I0702 21:53:28.256277 1 tasks_processing.go:74] worker 51 stopped. E0702 21:53:28.256289 1 gather.go:144] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0702 21:53:28.256312 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0702 21:53:28.256356 1 gather.go:181] gatherer "clusterconfig" function "machine_configs" took 45.834819ms to process 1 records I0702 21:53:28.256573 1 tasks_processing.go:74] worker 35 stopped. I0702 21:53:28.256681 1 recorder.go:70] Recording config/apiserver with fingerprint=eaa6502b165ebe4b4b1aec51a679a83861713f082a4b2071ae968b609f0ea3ec I0702 21:53:28.256692 1 gather.go:181] gatherer "clusterconfig" function "cluster_apiserver" took 45.603473ms to process 1 records I0702 21:53:28.256755 1 recorder.go:70] Recording config/image with fingerprint=4f126a47cbd92a08baae6c4768f598f3cd895dce81369ebb3c4e321e9ebad522 I0702 21:53:28.256762 1 gather.go:181] gatherer "clusterconfig" function "image" took 45.525172ms to process 1 records I0702 21:53:28.256768 1 tasks_processing.go:74] worker 36 stopped. I0702 21:53:28.256810 1 tasks_processing.go:74] worker 24 stopped. I0702 21:53:28.257027 1 recorder.go:70] Recording config/oauth with fingerprint=0f234fbf8910719dd9a635d9d9beaa61728fd522ad1b1201ef29aa2da1b17154 I0702 21:53:28.257037 1 gather.go:181] gatherer "clusterconfig" function "oauths" took 46.536257ms to process 1 records I0702 21:53:28.257198 1 tasks_processing.go:74] worker 43 stopped. I0702 21:53:28.257543 1 recorder.go:70] Recording config/featuregate with fingerprint=eb23ede27ce9b5baefe23347e0f5f1b50c2ac784cb76cebefc884baa339feefc I0702 21:53:28.257561 1 gather.go:181] gatherer "clusterconfig" function "feature_gates" took 46.171271ms to process 1 records I0702 21:53:28.257738 1 tasks_processing.go:74] worker 12 stopped. I0702 21:53:28.257792 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=5a06e1476ae1f33e63819adcf27eb36e3ddf16e965d2102193b034afcac9ef69 I0702 21:53:28.257818 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=d22a7d7969eb0d92ba91f4cbd80bda63bb736065eda2d1f22876c97b3878e289 I0702 21:53:28.257824 1 gather.go:181] gatherer "clusterconfig" function "storage_classes" took 45.286722ms to process 2 records I0702 21:53:28.258096 1 tasks_processing.go:74] worker 54 stopped. I0702 21:53:28.258923 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=9729e72ea083f96e4741e86b68d7e5ddf9e32c3cc8f03a9276889a8f2b95827a I0702 21:53:28.258948 1 gather.go:181] gatherer "clusterconfig" function "image_registries" took 47.128217ms to process 1 records I0702 21:53:28.259345 1 tasks_processing.go:74] worker 4 stopped. I0702 21:53:28.259363 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=108780cb24f15bf572a4031966507398a0d0c6a28b3a008952f53b481dc191a9 I0702 21:53:28.259372 1 gather.go:181] gatherer "clusterconfig" function "dvo_metrics" took 49.165651ms to process 1 records I0702 21:53:28.261329 1 tasks_processing.go:74] worker 46 stopped. I0702 21:53:28.261411 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=7f8eb2090da1c82f32b093f100a8f374e3efa5264d4b39bbc24f67d68d035ee4 I0702 21:53:28.261429 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=4a0b611c99e213534029a85f01c40935e497b20c0c4f918d388470a7aca08722 I0702 21:53:28.261439 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=1b23ea5667144f6839e74249e1f46c8d1e7e3a4391c03a24d7a1cfa8f3695ed6 I0702 21:53:28.261447 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=d0d50fe05d1dcf1ed1dbfa0a4608bc94e9e803585503ac1445941cebcedb367e I0702 21:53:28.261460 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=0f4fba24b5cdfcdfcf30ea9e6022c0f5d9739fb5405981fa719b0f932c39d69c I0702 21:53:28.261481 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=0e097d53292d5f202f22adb0898083f4c1b7c9de2be2039d49259903904bc20c I0702 21:53:28.261494 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=e244ddb4ab316fda5514ee4eed33917a9b823e50d1a89c99a4e4c04d8ea5a2d5 I0702 21:53:28.261502 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=e8335cac9bca0162a672d862256712ac45dd902440a1c111ea1b0a1512f5b91a I0702 21:53:28.261515 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=603e24970c995c8c9c6b0ac6d9b8d7348b3fc7cfccbe147ec3c29908cb0f36cf I0702 21:53:28.261527 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=dc4c5f36fae83c5e5f621df5b15b76bc893c1f93f460de5ca3d2fa230635f453 I0702 21:53:28.261537 1 gather.go:181] gatherer "clusterconfig" function "pdbs" took 50.028151ms to process 10 records I0702 21:53:28.262525 1 tasks_processing.go:74] worker 40 stopped. I0702 21:53:28.262536 1 gather.go:181] gatherer "clusterconfig" function "certificate_signing_requests" took 51.290603ms to process 0 records I0702 21:53:28.262879 1 tasks_processing.go:74] worker 39 stopped. I0702 21:53:28.262906 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0702 21:53:28.262920 1 gather.go:181] gatherer "clusterconfig" function "overlapping_namespace_uids" took 52.271723ms to process 1 records I0702 21:53:28.266658 1 requests.go:204] Asking for SCA certificate for x86_64 architecture I0702 21:53:28.268825 1 tasks_processing.go:74] worker 5 stopped. I0702 21:53:28.269037 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=52dea463d3cafb2ea955bd72b069915c367b4821bea1e65828d65f1f85380fce I0702 21:53:28.269809 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=508015232365fc8b9e7f25520ea1556b688f17666e315c182684f7e9825940ae I0702 21:53:28.269861 1 gather.go:181] gatherer "clusterconfig" function "clusterroles" took 58.467616ms to process 2 records I0702 21:53:28.270837 1 tasks_processing.go:74] worker 7 stopped. I0702 21:53:28.270942 1 recorder.go:70] Recording config/olm_operators with fingerprint=8462681117356be1658771599331f25246ca5ee59095c0bf8e6ec180b37a805c I0702 21:53:28.270956 1 gather.go:181] gatherer "clusterconfig" function "olm_operators" took 59.431188ms to process 1 records I0702 21:53:28.271844 1 tasks_processing.go:74] worker 3 stopped. I0702 21:53:28.272358 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=7ecee1fc5ecf963ecefe6855f58bef394753d044d0e4913060762694d6de345d I0702 21:53:28.272500 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=b6bd42f025c581f020404a86b8cd38d518dff8dcc2af427c936fcdcfb84ac8b8 I0702 21:53:28.272512 1 gather.go:181] gatherer "clusterconfig" function "crds" took 61.378207ms to process 2 records I0702 21:53:28.274194 1 tasks_processing.go:74] worker 34 stopped. I0702 21:53:28.274558 1 recorder.go:70] Recording config/version with fingerprint=015598f931cef58c7ff66f1b89ce882cb9b8d4c3d75b68183451fc438331259a I0702 21:53:28.274570 1 recorder.go:70] Recording config/id with fingerprint=6e2ca9887477383faad1ea906eded69cb93bf8ca26519d6244b036d9f4f40935 I0702 21:53:28.274579 1 gather.go:181] gatherer "clusterconfig" function "version" took 63.153939ms to process 2 records I0702 21:53:28.275253 1 tasks_processing.go:74] worker 48 stopped. I0702 21:53:28.275266 1 gather.go:181] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 64.872333ms to process 0 records I0702 21:53:28.279721 1 tasks_processing.go:74] worker 58 stopped. I0702 21:53:28.280984 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-7d4ddc79d6-kflhw with fingerprint=58d12195d11690b161682a0f5c2cce936ce682314fc42c3cf8e5d4906667944c I0702 21:53:28.281155 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-2cpx7 with fingerprint=697b3bfd44d741e67a6e65e209bfea554c732acd91dffcc64892d655a69d6c32 I0702 21:53:28.281221 1 recorder.go:70] Recording config/running_containers with fingerprint=a86c1b8d9282d46bb9d79d2f7e12c4fa562f97db23f8e848429d7cd71fa3d7d4 I0702 21:53:28.281230 1 gather.go:181] gatherer "clusterconfig" function "container_images" took 69.146415ms to process 3 records I0702 21:53:28.282267 1 tasks_processing.go:74] worker 55 stopped. I0702 21:53:28.282274 1 gather.go:181] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 71.239381ms to process 0 records I0702 21:53:28.286024 1 tasks_processing.go:74] worker 44 stopped. E0702 21:53:28.286037 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0702 21:53:28.286046 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ra8m6rs610mrkm6dlrk7h9rbvi934kl-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ra8m6rs610mrkm6dlrk7h9rbvi934kl-primary-cert-bundle-secret" not found I0702 21:53:28.286101 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=710113eefc2eea766b0df72b3c4c6c611e5f5a8646deefb095a82a8bb865534f I0702 21:53:28.286113 1 gather.go:181] gatherer "clusterconfig" function "ingress_certificates" took 75.362921ms to process 1 records I0702 21:53:28.287051 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0702 21:53:28.287120 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0702 21:53:28.287191 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 21:53:28.289994 1 tasks_processing.go:74] worker 15 stopped. E0702 21:53:28.290006 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0702 21:53:28.290011 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0702 21:53:28.290014 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0702 21:53:28.290030 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=2b7e7d968c1ca0e033f2ae1514829fefa6008cf7d89addbe266d351cfb9cca19 I0702 21:53:28.290036 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0702 21:53:28.290039 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=e1a0ad594db3a5d5d50e9e25d7b235af20f84f5def41537f127febe525b834f2 I0702 21:53:28.290045 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0702 21:53:28.290060 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0702 21:53:28.290067 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0702 21:53:28.290071 1 gather.go:181] gatherer "clusterconfig" function "config_maps" took 79.803746ms to process 6 records I0702 21:53:28.290818 1 base_controller.go:73] Caches are synced for ConfigController I0702 21:53:28.290829 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0702 21:53:28.295531 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 21:53:28.341173 1 base_controller.go:73] Caches are synced for LoggingSyncer I0702 21:53:28.341186 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0702 21:53:28.375848 1 cluster_transfer.go:102] no available accepted cluster transfer I0702 21:53:28.375862 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0702 21:53:28.471206 1 sca.go:141] etc-pki-entitlement secret successfully updated I0702 21:53:28.471221 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated in the etc-pki-entitlement secret I0702 21:53:28.473890 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-7d4ddc79d6-kflhw pod in namespace openshift-console-operator (previous: false). I0702 21:53:28.672429 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-6658789746-9lm7n pod in namespace openshift-console (previous: false). I0702 21:53:28.868363 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-6658789746-fxhmz pod in namespace openshift-console (previous: false). I0702 21:53:28.882415 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0702 21:53:29.064312 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 21:53:29.064331 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-7dddd55d4b-c6ww6 pod in namespace openshift-console (previous: false). I0702 21:53:29.082391 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0702 21:53:29.269368 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-7dddd55d4b-g8lkq pod in namespace openshift-console (previous: false). I0702 21:53:29.473732 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-6d4c9b4b6c-jmgv8 pod in namespace openshift-console (previous: false). I0702 21:53:29.668462 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for downloads-6d4c9b4b6c-jmgv8 pod in namespace openshift-console for failing operator download-server (previous: false): "container \"download-server\" in pod \"downloads-6d4c9b4b6c-jmgv8\" is waiting to start: ContainerCreating" I0702 21:53:29.668479 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"download-server\" in pod \"downloads-6d4c9b4b6c-jmgv8\" is waiting to start: ContainerCreating" I0702 21:53:29.668489 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-6d4c9b4b6c-qmt9t pod in namespace openshift-console (previous: false). I0702 21:53:29.867748 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for downloads-6d4c9b4b6c-qmt9t pod in namespace openshift-console for failing operator download-server (previous: false): "container \"download-server\" in pod \"downloads-6d4c9b4b6c-qmt9t\" is waiting to start: ContainerCreating" I0702 21:53:29.867778 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"download-server\" in pod \"downloads-6d4c9b4b6c-qmt9t\" is waiting to start: ContainerCreating" I0702 21:53:29.867795 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-74c74456d9-2ghkp pod in namespace openshift-ingress (previous: false). I0702 21:53:30.074134 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-74c74456d9-2ghkp pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-74c74456d9-2ghkp\" is waiting to start: ContainerCreating" I0702 21:53:30.074154 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-74c74456d9-2ghkp\" is waiting to start: ContainerCreating" I0702 21:53:30.074164 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-74c74456d9-rm7c9 pod in namespace openshift-ingress (previous: false). I0702 21:53:30.268931 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-74c74456d9-rm7c9 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-74c74456d9-rm7c9\" is waiting to start: ContainerCreating" I0702 21:53:30.268954 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-74c74456d9-rm7c9\" is waiting to start: ContainerCreating" I0702 21:53:30.268965 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-bf8bdff75-dbz9k pod in namespace openshift-ingress (previous: false). I0702 21:53:30.468833 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-7snqt pod in namespace openshift-ingress-canary (previous: false). I0702 21:53:30.485861 1 tasks_processing.go:74] worker 45 stopped. I0702 21:53:30.486003 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=1efb04a768641b683196252e4eded8f31c8113f4388d3ae69467237ddb913527 I0702 21:53:30.486040 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=183539bbe89c989a326011f124cb26e91d4dc0406689baecde44742b1c4a8e80 I0702 21:53:30.486057 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=276922dc454960aef411ea8a0caa4d18f88021402a28a173444969928e7554a1 I0702 21:53:30.486066 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0702 21:53:30.486082 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=0b87ea66e4467a510dada9ef562636808d6cb6f99d03d1bdc045dfb17d596259 I0702 21:53:30.486096 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0702 21:53:30.486111 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=93588c9a9ed26c2bfdd36b54e5728143d4d09b83f2c7f0c76bdaa0c81781ac8f I0702 21:53:30.486129 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=0544211def4fde4cbd36ff7a4c30db812723a6425cb407027cb3ebcdfb5a6851 I0702 21:53:30.486149 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ecdc38f4ba7e77fa19d5e5f30bce73f2d44f6110cb1882c973263715aff798e8 I0702 21:53:30.486170 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=f81ae768c1ff4cf110e48c342e38b054fbcf934c8153f2c5b04f60433ab8db3e I0702 21:53:30.486379 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=d86886b6ea3b458b15f6426c3bcfefbd7109934385d6c23aefa359c707341316 I0702 21:53:30.486393 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=26b68b095cd9ee9ea340fb34f6b5591066d08b23856b608315bb1491d709b90d I0702 21:53:30.486398 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0702 21:53:30.486408 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=e83d6f033b52f75021d57d184ffb08d9a4ea0dc93aa1865c85e485c6d92b0937 I0702 21:53:30.486414 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0702 21:53:30.486424 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=cf3058df14df74316fe2a030a3f4985276e69efba01b8a876768194a65a827a4 I0702 21:53:30.486432 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0702 21:53:30.486443 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=025f8fdefc0c393b8b9614821fbde3c307cec36afdec44bf974ce50ca931ee46 I0702 21:53:30.486451 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0702 21:53:30.486463 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=b013a65d16044c2c558e135b04e98fd5095b48ad215b4f84449b78cfb62ff301 I0702 21:53:30.486517 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=cb91d2b5386466a2e89c2ab92eee48b5ef39026b2a51a14094950fb7fbbd3ee2 I0702 21:53:30.486537 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0702 21:53:30.486551 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=ec01f1ae117114cc7904b144eb6f4c7b35636856f64a41ac2eb345ba6cd1df1a I0702 21:53:30.486566 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=ab7afeffaa967acb7a661209488d81eb9ae5db90a39b9677565d97f802f870af I0702 21:53:30.486574 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0702 21:53:30.486585 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=7a39726d911162919df7f851a03f846edaeb96ae29718d430f36e9af16c20a27 I0702 21:53:30.486592 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0702 21:53:30.486602 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=91fb58651a04768b55bb19ea1cc9d8fe61aa2bc908fe265d5748f27a375623f4 I0702 21:53:30.486611 1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0702 21:53:30.486619 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=8e153c76182b7c59b1e27592e03621ec8de16a4ef5e89f4f5719da026308bb07 I0702 21:53:30.486629 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=b17375b86f289c79bb77f990db7ddc4993bad9bf50bc9636ee8cfd4c3b8a36ce I0702 21:53:30.486638 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=9be55034e18bdb6ff5b8fadea848a3df0720310b45d3ccb94e9ee12f1d19d295 I0702 21:53:30.486650 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=c64b58b44086c33bcf5388579a7803a43d28b3bf5cdb79b25c5b8ef6d2f4b977 I0702 21:53:30.486658 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0702 21:53:30.486673 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=767d69a849590a7cab9cef59cff871f7db166aaab1073c76f9e5c0ec78560ba7 I0702 21:53:30.486687 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0702 21:53:30.486694 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0702 21:53:30.486698 1 gather.go:181] gatherer "clusterconfig" function "operators" took 2.275368623s to process 37 records I0702 21:53:30.669342 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-cf6rm pod in namespace openshift-ingress-canary (previous: false). I0702 21:53:30.877017 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-ppt8w pod in namespace openshift-ingress-canary (previous: false). I0702 21:53:31.068919 1 tasks_processing.go:74] worker 61 stopped. I0702 21:53:31.069036 1 recorder.go:70] Recording events/openshift-console-operator with fingerprint=7680505703de034c6cc3000311fe387ab24fa1b848718dcde73fe905ee9a8943 I0702 21:53:31.069100 1 recorder.go:70] Recording events/openshift-console with fingerprint=6036eb42f0d951460508a8d7a468b6d131cb166a0b9c7980480328d4c0449c8b I0702 21:53:31.069118 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=9aec026af5a116cd258388d2ae02a14e4c68e0f0215c96d8a5780d28fe890399 I0702 21:53:31.069151 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=818b88c61a85ed2c7ac9755e49bd9fa414a225ffc3d49568971941501cfae6bf I0702 21:53:31.069176 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=e47e65f56f7d6111a524241d21f4bbf38f6efa686b957bf409ea80950746bef6 I0702 21:53:31.069297 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-7d4ddc79d6-kflhw with fingerprint=58d12195d11690b161682a0f5c2cce936ce682314fc42c3cf8e5d4906667944c E0702 21:53:31.069316 1 gather.go:165] error recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-7d4ddc79d6-kflhw.json" because of the error: the record with the same name "config/pod/openshift-console-operator/console-operator-7d4ddc79d6-kflhw.json" was already recorded and had the fingerprint "58d12195d11690b161682a0f5c2cce936ce682314fc42c3cf8e5d4906667944c", overwriting with the record having fingerprint "58d12195d11690b161682a0f5c2cce936ce682314fc42c3cf8e5d4906667944c" W0702 21:53:31.069329 1 gather.go:159] issue recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-7d4ddc79d6-kflhw.json" because of the warning: warning: the record with the same fingerprint "58d12195d11690b161682a0f5c2cce936ce682314fc42c3cf8e5d4906667944c" was already recorded at path "config/pod/openshift-console-operator/console-operator-7d4ddc79d6-kflhw.json", recording another one with a different path "config/pod/openshift-console-operator/console-operator-7d4ddc79d6-kflhw.json" I0702 21:53:31.069337 1 recorder.go:70] Recording config/pod/openshift-console-operator/logs/console-operator-7d4ddc79d6-kflhw/console-operator_previous.log with fingerprint=2bdcd430132b99fcbaf504396faae78bed8c9389b26f5a189af90ada85bc1d75 I0702 21:53:31.069388 1 recorder.go:70] Recording config/pod/openshift-console-operator/logs/console-operator-7d4ddc79d6-kflhw/console-operator_current.log with fingerprint=f1eb28b6c72606c0e498d07764af62e4f311048639e9145b4b454409f4d447b8 I0702 21:53:31.069398 1 recorder.go:70] Recording config/pod/openshift-console/logs/console-6658789746-9lm7n/console_current.log with fingerprint=25138e77ba921599e500303b88d62ef6f9dc18cff7a79fcfedf10dc5bdea0bd8 I0702 21:53:31.069404 1 recorder.go:70] Recording config/pod/openshift-console/logs/console-7dddd55d4b-c6ww6/console_current.log with fingerprint=dc2b46de3084283061f672cf3952355141cda2a6f3c45dc8c7dfd60bdfa8a505 I0702 21:53:31.069413 1 recorder.go:70] Recording config/pod/openshift-console/logs/console-7dddd55d4b-g8lkq/console_current.log with fingerprint=f5706b37aec1b4bfe36e7a77776cd5899b633d5c33236c12e248db953620fd6e I0702 21:53:31.069424 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-bf8bdff75-dbz9k/router_current.log with fingerprint=52544a451caa90e2dddd30d04555ae65b1512dd5a68cd777207d8decbdab476c I0702 21:53:31.069431 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-7snqt/serve-healthcheck-canary_current.log with fingerprint=99856aca845767a353ec85bbf3eafe14ea45737085ab47d9d10139ce717594b3 I0702 21:53:31.069435 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-cf6rm/serve-healthcheck-canary_current.log with fingerprint=ab0428fe837edbc71851c2eebdd114e4f2e7ff29ded511bc3ad06dee93db8238 I0702 21:53:31.069439 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-ppt8w/serve-healthcheck-canary_current.log with fingerprint=e938f28a2dc5fb41145bda3f8401ec3c0ec46d6c394bf9c37cebbc95af96dd57 I0702 21:53:31.069444 1 gather.go:181] gatherer "clusterconfig" function "operators_pods_and_events" took 2.858653036s to process 15 records I0702 21:53:41.268409 1 tasks_processing.go:74] worker 56 stopped. I0702 21:53:41.268446 1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0702 21:53:41.268459 1 gather.go:181] gatherer "clusterconfig" function "install_plans" took 13.057830026s to process 1 records I0702 21:53:42.014792 1 tasks_processing.go:74] worker 17 stopped. I0702 21:53:42.015058 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=d309c5d800188ed390d5318f4d495169a88f9d6a7a83f87c3c59208ec78fa56d I0702 21:53:42.015072 1 gather.go:181] gatherer "clusterconfig" function "service_accounts" took 13.804004815s to process 1 records E0702 21:53:42.015119 1 periodic.go:252] clusterconfig failed after 13.805s with: function "metrics" failed with an error, function "active_alerts" failed with an error, function "silenced_alerts" failed with an error, function "tsdb_status" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, unable to record function "operators_pods_and_events" record "config/pod/openshift-console-operator/console-operator-7d4ddc79d6-kflhw.json" I0702 21:53:42.015131 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "metrics" failed with an error, function "active_alerts" failed with an error, function "silenced_alerts" failed with an error, function "tsdb_status" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, unable to record function "operators_pods_and_events" record "config/pod/openshift-console-operator/console-operator-7d4ddc79d6-kflhw.json" I0702 21:53:42.015138 1 periodic.go:214] Running workloads gatherer I0702 21:53:42.015148 1 tasks_processing.go:45] number of workers: 2 I0702 21:53:42.015158 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 21:53:42.015161 1 tasks_processing.go:71] worker 1 working on workload_info task. I0702 21:53:42.015171 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 21:53:42.015258 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0702 21:53:42.037137 1 gather_workloads_info.go:281] Loaded pods in 0s, will wait 24s for image data I0702 21:53:42.037498 1 tasks_processing.go:74] worker 0 stopped. I0702 21:53:42.037512 1 gather.go:181] gatherer "workloads" function "helmchart_info" took 22.221687ms to process 0 records I0702 21:53:42.043888 1 gather_workloads_info.go:390] No image sha256:5bcfb1b739fa4e6ff9e21e4843f8520f29608135341f7d8dcc31084b9ba25f1d (8ms) I0702 21:53:42.051005 1 gather_workloads_info.go:390] No image sha256:351ca92471647f383f3cd7f0b70f33f5fa11c39ab569c4948dff7d471a6c8be3 (7ms) I0702 21:53:42.057687 1 gather_workloads_info.go:390] No image sha256:3a2c82b772ea6072e1eca0efc5303f002189e80b0e985fb3e3b8ea9a12fe8060 (7ms) I0702 21:53:42.064190 1 gather_workloads_info.go:390] No image sha256:0c1abef76d6d2832ddcff31e950ffafeb4e0f6fad80a5f5dca94591de0fc9581 (6ms) I0702 21:53:42.070293 1 gather_workloads_info.go:390] No image sha256:3fea7db586d3236c1876a8b523af0d8d65c84d6f6cf5d0f4e41cafcffe6db5b5 (6ms) I0702 21:53:42.076494 1 gather_workloads_info.go:390] No image sha256:1eee856bde9bad71c4444c494225a0cf02d1f4a5293acf0bd6e7e1814efa0064 (6ms) I0702 21:53:42.083406 1 gather_workloads_info.go:390] No image sha256:bc829520eeec090b60d17abbad1a22b34ea99b426193395808a778d73a5fb57a (7ms) I0702 21:53:42.089813 1 gather_workloads_info.go:390] No image sha256:8e158c83ec12b3e0237fab9a221630bd691e79c079a111f346354ff43b8199df (6ms) I0702 21:53:42.096573 1 gather_workloads_info.go:390] No image sha256:30ff5e5b72f274598704ca69f1832eba1040cc25da47386004fd59500b6e4c55 (7ms) I0702 21:53:42.103094 1 gather_workloads_info.go:390] No image sha256:48dff3fcb0da58eb9b2b500f89af8b7d0790ffa60da0b0e301feca971dbafcbb (7ms) I0702 21:53:42.143958 1 gather_workloads_info.go:390] No image sha256:8562a483f4568254250f19fc68d79f88c94a48508aefe59a70c1021a3aad000a (41ms) I0702 21:53:42.244152 1 gather_workloads_info.go:390] No image sha256:41029e57ece558b2e0b12174ce924647fd9d5c5d83aadf4bba03d6916d3f9f54 (100ms) I0702 21:53:42.344571 1 gather_workloads_info.go:390] No image sha256:788d16bfff4bd6bb3ce97acc643b56fae6e619674ab279535480e519b4d5b769 (100ms) I0702 21:53:42.443670 1 gather_workloads_info.go:390] No image sha256:c96b4bddf3dd7daaa797cbda4dd92e981de2f5fc3404c01381f31dc0414d5c8d (99ms) I0702 21:53:42.544147 1 gather_workloads_info.go:390] No image sha256:ed0c9631d6e424912cd8ce78ca7a2c4f76b3fc15e9e34fe00999170ccf19a611 (100ms) I0702 21:53:42.644580 1 gather_workloads_info.go:390] No image sha256:894452e6587de55d04e37163d3da53e11fced8fb08bd0acf61e6d49f7964284e (100ms) I0702 21:53:42.745788 1 gather_workloads_info.go:390] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (101ms) I0702 21:53:42.844764 1 gather_workloads_info.go:390] No image sha256:2897724cec17bc13acc133181f64ccb8d54ce5dc9582f9cecf704c2540e15600 (99ms) I0702 21:53:42.944545 1 gather_workloads_info.go:390] No image sha256:09b3e9e6a4f382fb4bbdb67bc945bcf19d66f604b7c8ffd66d4d4a2c94224248 (100ms) I0702 21:53:43.044097 1 gather_workloads_info.go:390] No image sha256:c7aa910ca06f8fd89cdf2519136e0f3533bdacfc6bd58a3f6683f9f08756c7b1 (100ms) I0702 21:53:43.145170 1 gather_workloads_info.go:390] No image sha256:4dcdadc14b7bdb2c00954d92e957d63aafbbe5f4047fe028e575d65725923cb0 (101ms) I0702 21:53:43.243913 1 gather_workloads_info.go:390] No image sha256:0242cefbf0bb876101c4d67ab4e07401cb0ba6c02be2b73a4f17ba33b2960005 (99ms) I0702 21:53:43.344688 1 gather_workloads_info.go:390] No image sha256:38787de16ee8c686305f93b501d891b50cde24136009863869d230c0d4eeee5c (101ms) I0702 21:53:43.444418 1 gather_workloads_info.go:390] No image sha256:42b4c6bdf3081ec264bc5edbc4eb779151de9e4742d6fe59a316645891df649c (100ms) I0702 21:53:43.545162 1 gather_workloads_info.go:390] No image sha256:194ee1155b87e110bc6c4a6e55667e41f3bdc8292e26a9561f9082fdfe467eec (101ms) I0702 21:53:43.645605 1 gather_workloads_info.go:390] No image sha256:31a22f6ee061d0f6558664e580ec0f80f1927d4ec29626cf3e9420837f5d80e5 (100ms) I0702 21:53:43.744360 1 gather_workloads_info.go:390] No image sha256:13aabbaf260d634ff0e9ac1af88af075b5ba671fd51313e33e74d7d2f7e54128 (99ms) I0702 21:53:43.844005 1 gather_workloads_info.go:390] No image sha256:0158b297aec0a66376c04d3c7cf4828db5e5d9f424e331ff7c7b796828036875 (100ms) I0702 21:53:43.965683 1 gather_workloads_info.go:390] No image sha256:221622a101db9797df0622b4534e3e42c4498df458f355a8a02fad8d65f8e3f2 (122ms) I0702 21:53:44.045318 1 gather_workloads_info.go:401] Found image sha256:b8781637560d49de9b8e8cdd59ec75f03d98921ea66950381849398128cc9cb9 (80ms) I0702 21:53:44.144497 1 gather_workloads_info.go:390] No image sha256:1c7c24111f1709d7648156873ced09462638aa4b3cf7e7aee13297e51bcdfb3e (99ms) I0702 21:53:44.244415 1 gather_workloads_info.go:390] No image sha256:68abf16a3b6c33fdd22a823c7d00f96aaaa8015d370116962a5835984908645a (100ms) I0702 21:53:44.344589 1 gather_workloads_info.go:390] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (100ms) I0702 21:53:44.445212 1 gather_workloads_info.go:390] No image sha256:a7fc4d05c4a3c82c9f355ca985d6fd26033c0d6a98716f25fcd2f54bae1d2fa0 (101ms) I0702 21:53:44.543817 1 gather_workloads_info.go:390] No image sha256:50076d29400ecf9b704d8175509fc8cb7c28bea91d46a28dc37cbda1668c69f9 (99ms) I0702 21:53:44.644530 1 gather_workloads_info.go:390] No image sha256:24519dcc0e63cdc60a639dd474d06e7612e9b76966bc60322cd9026a0f1b878c (101ms) I0702 21:53:44.744948 1 gather_workloads_info.go:390] No image sha256:586127c49e25052113263d8aeaf6a1623aef22987364f119a17b2848982ff716 (100ms) I0702 21:53:44.844621 1 gather_workloads_info.go:390] No image sha256:3969660e807e8ce5656a74e5816573656241946ef1d766a9d2e21d434356313c (100ms) I0702 21:53:44.944419 1 gather_workloads_info.go:390] No image sha256:06821dfe231330e0eb5be915b9468cd13826a7ee59d1a732b89cb140548eade2 (100ms) I0702 21:53:45.044040 1 gather_workloads_info.go:390] No image sha256:4b9b7949d209e257a76053de4ac74193f747c0d42e25dcd270d655849a4e51aa (100ms) I0702 21:53:45.144363 1 gather_workloads_info.go:390] No image sha256:6a9b4fd887fa7f1729302fb0330c3c9a483197bf78becdcfda4235ec823a2c39 (100ms) I0702 21:53:45.244234 1 gather_workloads_info.go:401] Found image sha256:751bd7eb62f632c0eef0ca91b6c57c64d4f1279d4dbe1a9b875ac4020a7b693f (100ms) I0702 21:53:45.343457 1 gather_workloads_info.go:390] No image sha256:02283a64c1936a5dd09d5c6bc0ecbcf9196fe4df6a4055c8be22cebd850aa7a3 (99ms) I0702 21:53:45.444375 1 gather_workloads_info.go:390] No image sha256:0c6b7f828184b16a5e6630111e0715e11d34dae9b0bf64619466543e6168e05c (101ms) I0702 21:53:45.444406 1 tasks_processing.go:74] worker 1 stopped. I0702 21:53:45.444663 1 recorder.go:70] Recording config/workload_info with fingerprint=85a936375b4e89cb41f9cf86b315dac7beee3998a663376a26b0b612b068ef7d I0702 21:53:45.444676 1 gather.go:181] gatherer "workloads" function "workload_info" took 3.429239432s to process 1 records I0702 21:53:45.444685 1 periodic.go:261] Periodic gather workloads completed in 3.429s I0702 21:53:45.444695 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0702 21:53:45.444699 1 periodic.go:214] Running conditional gatherer I0702 21:53:45.453958 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules I0702 21:53:45.563421 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer E0702 21:53:45.565451 1 conditional_gatherer.go:322] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.244.171:9091: connect: connection refused I0702 21:53:45.565507 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0702 21:53:45.572326 1 conditional_gatherer.go:390] cluster version is '4.18.9' E0702 21:53:45.572340 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 21:53:45.572346 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 21:53:45.572349 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 21:53:45.572352 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 21:53:45.572354 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 21:53:45.572356 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 21:53:45.572359 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 21:53:45.572360 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 21:53:45.572363 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 21:53:45.572365 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0702 21:53:45.572378 1 tasks_processing.go:45] number of workers: 3 I0702 21:53:45.572387 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 21:53:45.572391 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0702 21:53:45.572400 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 21:53:45.572413 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0702 21:53:45.572412 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 21:53:45.572419 1 tasks_processing.go:74] worker 1 stopped. I0702 21:53:45.572433 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0702 21:53:45.572481 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0702 21:53:45.572492 1 gather.go:181] gatherer "conditional" function "conditional_gatherer_rules" took 701ns to process 1 records I0702 21:53:45.572522 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0702 21:53:45.572530 1 gather.go:181] gatherer "conditional" function "remote_configuration" took 1.347µs to process 1 records I0702 21:53:45.572534 1 tasks_processing.go:74] worker 0 stopped. I0702 21:53:45.572624 1 tasks_processing.go:74] worker 2 stopped. I0702 21:53:45.572636 1 gather.go:181] gatherer "conditional" function "rapid_container_logs" took 175.463µs to process 0 records I0702 21:53:45.572661 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I0702 21:53:45.572673 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f W0702 21:53:45.595073 1 gather.go:213] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0702 21:53:45.595229 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=be50f4572e16ae30dee8d18c6864a2c26a5f959453261f6b87f746ab1dff4867 I0702 21:53:45.595386 1 diskrecorder.go:70] Writing 120 records to /var/lib/insights-operator/insights-2026-07-02-215345.tar.gz I0702 21:53:45.604159 1 diskrecorder.go:51] Wrote 120 records to disk in 8ms I0702 21:53:45.604218 1 periodic.go:283] Gathering cluster info every 2h0m0s I0702 21:53:45.604236 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0702 21:54:58.210690 1 diskrecorder.go:170] Found files to send: insights-2026-07-02-215345.tar.gz I0702 21:54:58.210717 1 insightsuploader.go:150] Checking archives to upload periodically every 15m4.85116911s I0702 21:54:58.210727 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0702 21:54:58.226650 1 requests.go:47] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0702 21:54:58.400445 1 requests.go:88] Successfully reported id=2026-07-02T21:54:58Z x-rh-insights-request-id=fd8456dd51214687960b225a652f7fed, wrote=65583 I0702 21:54:58.400561 1 insightsuploader.go:187] Uploaded report successfully in 189.825024ms I0702 21:54:58.400587 1 controller.go:119] Initializing last reported time to 2026-07-02T21:54:58Z I0702 21:54:58.400629 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0702 21:54:58.400643 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0702 21:54:58.400651 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0702 21:54:58.405517 1 controller.go:482] The operator is healthy I0702 21:55:28.247315 1 controller.go:482] The operator is healthy I0702 21:56:01.443726 1 insightsreport.go:137] Pulling report from smart-proxy I0702 21:56:01.443750 1 insightsreport.go:149] Retrieving report I0702 21:56:01.452339 1 requests.go:111] Retrieving report for cluster: 3157c2e9-3dff-4e1b-8d50-daca3b57cf08 I0702 21:56:01.452350 1 requests.go:112] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/3157c2e9-3dff-4e1b-8d50-daca3b57cf08/reports I0702 21:56:01.454215 1 requests.go:122] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/3157c2e9-3dff-4e1b-8d50-daca3b57cf08/reports I0702 21:56:01.623501 1 insightsreport.go:184] Report retrieved I0702 21:56:01.662269 1 insightsreport.go:239] Report retrieved correctly I0702 21:57:28.246155 1 controller.go:482] The operator is healthy I0702 21:58:28.207806 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 21:58:28.211548 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 21:58:28.211563 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 21:58:28.214700 1 secretconfigobserver.go:119] support secret does not exist I0702 21:59:28.246126 1 controller.go:482] The operator is healthy I0702 22:01:28.246662 1 controller.go:482] The operator is healthy I0702 22:03:28.204801 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:03:28.214855 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:03:28.218192 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:03:28.218216 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:03:28.221143 1 secretconfigobserver.go:119] support secret does not exist I0702 22:03:28.245743 1 controller.go:482] The operator is healthy I0702 22:05:28.251762 1 controller.go:482] The operator is healthy I0702 22:07:28.245699 1 controller.go:482] The operator is healthy I0702 22:08:28.221421 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:08:28.226371 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:08:28.226389 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:08:28.231841 1 secretconfigobserver.go:119] support secret does not exist I0702 22:09:28.246677 1 controller.go:482] The operator is healthy I0702 22:10:08.253600 1 insightsuploader.go:146] Nothing to report since 2026-07-02T21:54:58Z I0702 22:11:28.245779 1 controller.go:482] The operator is healthy I0702 22:13:28.210540 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:13:28.232583 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:13:28.238837 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:13:28.238859 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:13:28.242169 1 secretconfigobserver.go:119] support secret does not exist I0702 22:13:28.245236 1 controller.go:482] The operator is healthy I0702 22:15:28.251151 1 controller.go:482] The operator is healthy I0702 22:17:28.250713 1 controller.go:482] The operator is healthy I0702 22:18:28.242599 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:18:28.250869 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:18:28.250895 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:18:28.254488 1 secretconfigobserver.go:119] support secret does not exist I0702 22:19:28.249850 1 controller.go:482] The operator is healthy I0702 22:21:28.250135 1 controller.go:482] The operator is healthy I0702 22:23:28.206755 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:23:28.245918 1 controller.go:482] The operator is healthy I0702 22:23:28.254800 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:23:28.258358 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:23:28.258373 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:23:28.261393 1 secretconfigobserver.go:119] support secret does not exist I0702 22:25:17.095216 1 insightsuploader.go:146] Nothing to report since 2026-07-02T21:54:58Z I0702 22:25:28.251723 1 controller.go:482] The operator is healthy I0702 22:27:28.246145 1 controller.go:482] The operator is healthy I0702 22:28:28.262267 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:28:28.266281 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:28:28.266298 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:28:28.269806 1 secretconfigobserver.go:119] support secret does not exist I0702 22:29:28.245779 1 controller.go:482] The operator is healthy I0702 22:31:28.246292 1 controller.go:482] The operator is healthy I0702 22:33:28.208144 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:33:28.245361 1 controller.go:482] The operator is healthy I0702 22:33:28.270609 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:33:28.274338 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:33:28.274352 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:33:28.278139 1 secretconfigobserver.go:119] support secret does not exist I0702 22:35:28.250763 1 controller.go:482] The operator is healthy I0702 22:37:28.251071 1 controller.go:482] The operator is healthy I0702 22:38:28.279107 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:38:28.283316 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:38:28.283334 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:38:28.286533 1 secretconfigobserver.go:119] support secret does not exist I0702 22:39:28.250037 1 controller.go:482] The operator is healthy I0702 22:40:40.782571 1 insightsuploader.go:146] Nothing to report since 2026-07-02T21:54:58Z I0702 22:41:28.247549 1 controller.go:482] The operator is healthy I0702 22:43:28.207699 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:43:28.245665 1 controller.go:482] The operator is healthy I0702 22:43:28.286721 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:43:28.290125 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:43:28.290141 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:43:28.293144 1 secretconfigobserver.go:119] support secret does not exist I0702 22:45:28.245812 1 controller.go:482] The operator is healthy I0702 22:47:28.245523 1 controller.go:482] The operator is healthy I0702 22:48:28.293801 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:48:28.298513 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:48:28.298534 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:48:28.301948 1 secretconfigobserver.go:119] support secret does not exist I0702 22:49:28.246435 1 controller.go:482] The operator is healthy I0702 22:51:28.249758 1 controller.go:482] The operator is healthy I0702 22:53:28.207924 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:53:28.211114 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 22:53:28.245612 1 controller.go:482] The operator is healthy I0702 22:53:28.302786 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:53:28.306566 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:53:28.306588 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:53:28.309970 1 secretconfigobserver.go:119] support secret does not exist I0702 22:55:28.246526 1 controller.go:482] The operator is healthy I0702 22:56:41.293113 1 insightsuploader.go:146] Nothing to report since 2026-07-02T21:54:58Z I0702 22:57:28.245847 1 controller.go:482] The operator is healthy I0702 22:58:28.310800 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 22:58:28.315214 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 22:58:28.315234 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 22:58:28.318431 1 secretconfigobserver.go:119] support secret does not exist I0702 22:59:28.246198 1 controller.go:482] The operator is healthy I0702 23:01:28.246671 1 controller.go:482] The operator is healthy I0702 23:03:28.208295 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 23:03:28.245315 1 controller.go:482] The operator is healthy I0702 23:03:28.318785 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:03:28.323781 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:03:28.323802 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:03:28.326932 1 secretconfigobserver.go:119] support secret does not exist I0702 23:05:28.249829 1 controller.go:482] The operator is healthy I0702 23:07:28.249568 1 controller.go:482] The operator is healthy I0702 23:08:28.327278 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:08:28.331848 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:08:28.331884 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:08:28.335496 1 secretconfigobserver.go:119] support secret does not exist I0702 23:09:28.249995 1 controller.go:482] The operator is healthy I0702 23:11:28.246973 1 controller.go:482] The operator is healthy I0702 23:12:17.346218 1 insightsuploader.go:146] Nothing to report since 2026-07-02T21:54:58Z I0702 23:13:28.209289 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 23:13:28.245555 1 controller.go:482] The operator is healthy I0702 23:13:28.335955 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:13:28.339796 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:13:28.339815 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:13:28.343092 1 secretconfigobserver.go:119] support secret does not exist I0702 23:15:28.249465 1 controller.go:482] The operator is healthy I0702 23:17:28.246289 1 controller.go:482] The operator is healthy I0702 23:18:28.343591 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:18:28.349833 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:18:28.349850 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:18:28.353707 1 secretconfigobserver.go:119] support secret does not exist I0702 23:19:28.248934 1 controller.go:482] The operator is healthy I0702 23:21:28.250065 1 controller.go:482] The operator is healthy I0702 23:23:28.209478 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 23:23:28.244555 1 controller.go:482] The operator is healthy I0702 23:23:28.353806 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:23:28.357908 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:23:28.357927 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:23:28.361373 1 secretconfigobserver.go:119] support secret does not exist I0702 23:25:28.245306 1 controller.go:482] The operator is healthy I0702 23:27:28.249681 1 controller.go:482] The operator is healthy I0702 23:28:12.305900 1 insightsuploader.go:146] Nothing to report since 2026-07-02T21:54:58Z I0702 23:28:28.362005 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:28:28.368261 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:28:28.368279 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:28:28.371196 1 secretconfigobserver.go:119] support secret does not exist I0702 23:29:28.246786 1 controller.go:482] The operator is healthy I0702 23:31:28.250553 1 controller.go:482] The operator is healthy I0702 23:33:28.210103 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 23:33:28.216363 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 23:33:28.247668 1 controller.go:482] The operator is healthy I0702 23:33:28.371936 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:33:28.375716 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:33:28.375730 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:33:28.381424 1 secretconfigobserver.go:119] support secret does not exist I0702 23:35:28.246146 1 controller.go:482] The operator is healthy I0702 23:37:28.247171 1 controller.go:482] The operator is healthy I0702 23:38:28.381816 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:38:28.389275 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:38:28.389292 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:38:28.392416 1 secretconfigobserver.go:119] support secret does not exist I0702 23:39:28.250000 1 controller.go:482] The operator is healthy I0702 23:41:28.250465 1 controller.go:482] The operator is healthy I0702 23:43:28.215210 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 23:43:28.245790 1 controller.go:482] The operator is healthy I0702 23:43:28.393276 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 23:43:28.396661 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 23:43:28.396679 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 23:43:28.399725 1 secretconfigobserver.go:119] support secret does not exist