I0704 18:18:29.436888 1 cmd.go:250] Using service-serving-cert provided certificates I0704 18:18:29.437333 1 observer_polling.go:159] Starting file observer W0704 18:18:29.463417 1 builder.go:266] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-6fd96f47fd" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0704 18:18:29.931553 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0704 18:18:29.931794 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0704 18:18:29.932375 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0704 18:18:29.932449 1 secure_serving.go:57] Forcing use of http/1.1 only W0704 18:18:29.932466 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0704 18:18:29.932470 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0704 18:18:29.932474 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0704 18:18:29.932477 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0704 18:18:29.932491 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0704 18:18:29.932496 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0704 18:18:29.938682 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes ChunkSizeMiB CloudDualStackNodeIPs DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy PersistentIPsForVirtualization PrivateHostedZoneAWS SetEIPForNLBIngressController VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy AWSClusterHostedDNS AdditionalRoutingCapabilities AutomatedEtcdBackup BootcNodeManagement CSIDriverSharedResource ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ConsolePluginContentSecurityPolicy DNSNameResolver DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example GCPClusterHostedDNS GatewayAPI ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MetricsCollectionProfiles MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NodeSwap NutanixMultiSubnets OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0704 18:18:29.939042 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ConsolePluginContentSecurityPolicy", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0704 18:18:29.941046 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0704 18:18:29.941064 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0704 18:18:29.941072 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0704 18:18:29.941081 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0704 18:18:29.941086 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0704 18:18:29.941070 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0704 18:18:29.941245 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0704 18:18:29.941522 1 secure_serving.go:213] Serving securely on [::]:8443 I0704 18:18:29.941596 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" E0704 18:18:29.944326 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18bf290c3933afe1 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"SetEIPForNLBIngressController\", \"VSphereControlPlaneMachineSet\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"VSphereStaticIPs\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AdditionalRoutingCapabilities\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"CSIDriverSharedResource\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ConsolePluginContentSecurityPolicy\", \"DNSNameResolver\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"GCPClusterHostedDNS\", \"GatewayAPI\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MetricsCollectionProfiles\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OnClusterBuild\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SignatureStores\", \"SigstoreImageVerification\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-04 18:18:29.938040801 +0000 UTC m=+0.541994423,LastTimestamp:2026-07-04 18:18:29.938040801 +0000 UTC m=+0.541994423,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0704 18:18:29.954552 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0704 18:18:29.954585 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0704 18:18:29.954665 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0704 18:18:29.963296 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0704 18:18:29.963321 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0704 18:18:29.973151 1 secretconfigobserver.go:119] support secret does not exist I0704 18:18:29.981626 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0704 18:18:29.983133 1 recorder.go:156] Pruning old reports every 7h27m10s, max age is 288h0m0s I0704 18:18:29.987495 1 secretconfigobserver.go:119] support secret does not exist I0704 18:18:29.992802 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0704 18:18:29.992813 1 periodic.go:214] Running clusterconfig gatherer I0704 18:18:29.992821 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0704 18:18:29.992839 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0704 18:18:29.992844 1 insightsreport.go:296] Starting report retriever I0704 18:18:29.992848 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0704 18:18:29.992864 1 tasks_processing.go:45] number of workers: 32 I0704 18:18:29.992895 1 tasks_processing.go:69] worker 1 listening for tasks. I0704 18:18:29.992902 1 tasks_processing.go:69] worker 4 listening for tasks. I0704 18:18:29.992908 1 tasks_processing.go:69] worker 0 listening for tasks. I0704 18:18:29.992909 1 tasks_processing.go:69] worker 2 listening for tasks. I0704 18:18:29.992915 1 tasks_processing.go:69] worker 9 listening for tasks. I0704 18:18:29.992917 1 tasks_processing.go:71] worker 2 working on machines task. I0704 18:18:29.992919 1 tasks_processing.go:69] worker 3 listening for tasks. I0704 18:18:29.992921 1 tasks_processing.go:69] worker 5 listening for tasks. I0704 18:18:29.992925 1 tasks_processing.go:69] worker 14 listening for tasks. I0704 18:18:29.992927 1 tasks_processing.go:69] worker 6 listening for tasks. I0704 18:18:29.992932 1 tasks_processing.go:69] worker 7 listening for tasks. I0704 18:18:29.992935 1 tasks_processing.go:69] worker 16 listening for tasks. I0704 18:18:29.992938 1 tasks_processing.go:71] worker 6 working on nodenetworkstates task. I0704 18:18:29.992936 1 tasks_processing.go:69] worker 10 listening for tasks. I0704 18:18:29.992942 1 tasks_processing.go:69] worker 8 listening for tasks. I0704 18:18:29.992945 1 tasks_processing.go:69] worker 17 listening for tasks. I0704 18:18:29.992940 1 tasks_processing.go:71] worker 14 working on config_maps task. I0704 18:18:29.992945 1 tasks_processing.go:71] worker 5 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0704 18:18:29.992954 1 tasks_processing.go:69] worker 26 listening for tasks. I0704 18:18:29.992983 1 tasks_processing.go:69] worker 18 listening for tasks. I0704 18:18:29.992989 1 tasks_processing.go:69] worker 27 listening for tasks. I0704 18:18:29.992980 1 tasks_processing.go:69] worker 13 listening for tasks. I0704 18:18:29.992993 1 tasks_processing.go:69] worker 12 listening for tasks. I0704 18:18:29.993020 1 tasks_processing.go:69] worker 28 listening for tasks. I0704 18:18:29.993030 1 tasks_processing.go:69] worker 29 listening for tasks. I0704 18:18:29.992952 1 tasks_processing.go:69] worker 25 listening for tasks. I0704 18:18:29.993041 1 tasks_processing.go:69] worker 22 listening for tasks. I0704 18:18:29.992998 1 tasks_processing.go:69] worker 19 listening for tasks. I0704 18:18:29.993020 1 tasks_processing.go:69] worker 20 listening for tasks. I0704 18:18:29.993030 1 tasks_processing.go:69] worker 21 listening for tasks. I0704 18:18:29.993052 1 tasks_processing.go:69] worker 31 listening for tasks. I0704 18:18:29.993038 1 tasks_processing.go:69] worker 30 listening for tasks. I0704 18:18:29.992929 1 tasks_processing.go:69] worker 11 listening for tasks. I0704 18:18:29.993059 1 tasks_processing.go:69] worker 23 listening for tasks. I0704 18:18:29.993062 1 tasks_processing.go:69] worker 24 listening for tasks. I0704 18:18:29.993063 1 tasks_processing.go:71] worker 4 working on storage_cluster task. I0704 18:18:29.993066 1 tasks_processing.go:71] worker 9 working on ceph_cluster task. I0704 18:18:29.993059 1 tasks_processing.go:71] worker 1 working on nodenetworkconfigurationpolicies task. I0704 18:18:29.993143 1 tasks_processing.go:71] worker 24 working on image_registries task. I0704 18:18:29.992917 1 tasks_processing.go:71] worker 0 working on aggregated_monitoring_cr_names task. I0704 18:18:29.993238 1 tasks_processing.go:71] worker 28 working on authentication task. I0704 18:18:29.993261 1 tasks_processing.go:71] worker 17 working on machine_sets task. I0704 18:18:29.992926 1 tasks_processing.go:69] worker 15 listening for tasks. I0704 18:18:29.993323 1 tasks_processing.go:71] worker 15 working on crds task. I0704 18:18:29.993355 1 tasks_processing.go:71] worker 27 working on machine_config_pools task. I0704 18:18:29.993389 1 tasks_processing.go:71] worker 13 working on certificate_signing_requests task. I0704 18:18:29.993404 1 tasks_processing.go:71] worker 7 working on mutating_webhook_configurations task. I0704 18:18:29.993475 1 tasks_processing.go:71] worker 10 working on openstack_version task. I0704 18:18:29.993485 1 tasks_processing.go:71] worker 26 working on openstack_controlplanes task. I0704 18:18:29.993493 1 tasks_processing.go:71] worker 29 working on ingress task. I0704 18:18:29.993602 1 tasks_processing.go:71] worker 16 working on cluster_apiserver task. I0704 18:18:29.993624 1 tasks_processing.go:71] worker 25 working on node_logs task. I0704 18:18:29.993638 1 tasks_processing.go:71] worker 18 working on install_plans task. I0704 18:18:29.993646 1 tasks_processing.go:71] worker 21 working on service_accounts task. I0704 18:18:29.993698 1 tasks_processing.go:71] worker 3 working on jaegers task. I0704 18:18:29.994244 1 tasks_processing.go:71] worker 8 working on image_pruners task. I0704 18:18:29.993915 1 tasks_processing.go:71] worker 20 working on sap_datahubs task. I0704 18:18:29.994453 1 tasks_processing.go:71] worker 19 working on proxies task. I0704 18:18:29.994541 1 tasks_processing.go:71] worker 31 working on clusterroles task. I0704 18:18:29.994653 1 tasks_processing.go:71] worker 12 working on networks task. I0704 18:18:29.994680 1 tasks_processing.go:71] worker 30 working on pod_network_connectivity_checks task. I0704 18:18:29.994812 1 tasks_processing.go:71] worker 22 working on dvo_metrics task. I0704 18:18:29.994557 1 tasks_processing.go:71] worker 23 working on sap_pods task. I0704 18:18:29.994774 1 tasks_processing.go:71] worker 11 working on support_secret task. I0704 18:18:29.997085 1 tasks_processing.go:71] worker 6 working on container_runtime_configs task. I0704 18:18:29.997099 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkstates" took 4.134475ms to process 0 records I0704 18:18:29.997113 1 gather.go:181] gatherer "clusterconfig" function "storage_cluster" took 4.041793ms to process 0 records I0704 18:18:29.997119 1 tasks_processing.go:71] worker 4 working on infrastructures task. I0704 18:18:29.999604 1 tasks_processing.go:71] worker 1 working on nodes task. I0704 18:18:29.999623 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 6.454758ms to process 0 records I0704 18:18:29.999639 1 gather.go:181] gatherer "clusterconfig" function "ceph_cluster" took 6.542528ms to process 0 records I0704 18:18:29.999648 1 tasks_processing.go:71] worker 9 working on machine_autoscalers task. I0704 18:18:30.000670 1 tasks_processing.go:71] worker 26 working on openshift_logging task. I0704 18:18:30.000681 1 gather.go:181] gatherer "clusterconfig" function "openstack_controlplanes" took 7.172115ms to process 0 records I0704 18:18:30.000695 1 gather.go:181] gatherer "clusterconfig" function "machine_config_pools" took 7.301274ms to process 0 records I0704 18:18:30.000706 1 tasks_processing.go:71] worker 27 working on openstack_dataplanedeployments task. I0704 18:18:30.001258 1 tasks_processing.go:71] worker 17 working on machine_configs task. I0704 18:18:30.001268 1 gather.go:181] gatherer "clusterconfig" function "machine_sets" took 7.98316ms to process 0 records I0704 18:18:30.003164 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0704 18:18:30.003180 1 controller.go:317] The initial operator extension status is healthy I0704 18:18:30.003188 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0704 18:18:30.003192 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0704 18:18:30.003196 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0704 18:18:30.003212 1 controller.go:457] The operator is still being initialized I0704 18:18:30.003219 1 controller.go:482] The operator is healthy I0704 18:18:30.003307 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s I0704 18:18:30.003370 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0704 18:18:30.003487 1 operator.go:288] started I0704 18:18:30.003510 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0704 18:18:30.006420 1 tasks_processing.go:71] worker 10 working on operators task. I0704 18:18:30.006424 1 gather.go:181] gatherer "clusterconfig" function "openstack_version" took 12.934814ms to process 0 records I0704 18:18:30.006578 1 tasks_processing.go:71] worker 2 working on silenced_alerts task. E0704 18:18:30.006619 1 gather.go:144] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0704 18:18:30.006636 1 gather.go:181] gatherer "clusterconfig" function "machines" took 13.652335ms to process 0 records I0704 18:18:30.006824 1 tasks_processing.go:71] worker 3 working on image task. I0704 18:18:30.006839 1 gather.go:181] gatherer "clusterconfig" function "jaegers" took 12.728696ms to process 0 records I0704 18:18:30.007074 1 tasks_processing.go:71] worker 29 working on schedulers task. I0704 18:18:30.007358 1 recorder.go:70] Recording config/ingress with fingerprint=9cb802ba2908ac0a3e324a35a6dd9488227ec6551ec7d2f977c772ae207c33a5 I0704 18:18:30.007373 1 gather.go:181] gatherer "clusterconfig" function "ingress" took 13.572906ms to process 1 records I0704 18:18:30.007932 1 tasks_processing.go:71] worker 23 working on pdbs task. I0704 18:18:30.007953 1 gather.go:181] gatherer "clusterconfig" function "sap_pods" took 12.995198ms to process 0 records I0704 18:18:30.010683 1 tasks_processing.go:71] worker 24 working on tsdb_status task. I0704 18:18:30.011543 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=41efddbf5015f195d72655a270fef3743334844a74c94906ad8c5ce7024ee8b3 I0704 18:18:30.011565 1 gather.go:181] gatherer "clusterconfig" function "image_registries" took 17.524456ms to process 1 records I0704 18:18:30.012342 1 tasks_processing.go:71] worker 30 working on cost_management_metrics_configs task. E0704 18:18:30.012346 1 gather.go:144] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0704 18:18:30.012360 1 gather.go:181] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 17.526523ms to process 0 records I0704 18:18:30.012372 1 gather.go:181] gatherer "clusterconfig" function "sap_datahubs" took 17.949099ms to process 0 records I0704 18:18:30.012378 1 tasks_processing.go:71] worker 20 working on validating_webhook_configurations task. I0704 18:18:30.012700 1 tasks_processing.go:71] worker 16 working on feature_gates task. I0704 18:18:30.012888 1 recorder.go:70] Recording config/apiserver with fingerprint=e5081d6700914ff1be8435c4f639dfbad3d86c0d0a56d1cbef112c18fcdbda82 I0704 18:18:30.012903 1 gather.go:181] gatherer "clusterconfig" function "cluster_apiserver" took 19.085306ms to process 1 records I0704 18:18:30.012983 1 tasks_processing.go:71] worker 28 working on metrics task. I0704 18:18:30.013092 1 recorder.go:70] Recording config/authentication with fingerprint=2e88fe0e5055b6340c470c8b1726eab2cb935c095913aa0570fd99cf3b0aa26d I0704 18:18:30.013102 1 gather.go:181] gatherer "clusterconfig" function "authentication" took 19.561437ms to process 1 records I0704 18:18:30.013855 1 tasks_processing.go:71] worker 7 working on operators_pods_and_events task. I0704 18:18:30.014044 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=38235c7180b4434aa189d1c6bdf2c7bfa8c23c99f6482d2db030a3194472123e I0704 18:18:30.014078 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=0effab71587ccdb8f8f6a85c4507746626a2b13e907c83a26c007a59d2948718 I0704 18:18:30.014112 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=e363b79d4641b5ce766747066975e2b200b8b9cc60fd4a9cc20f82e7659914fb I0704 18:18:30.014123 1 gather.go:181] gatherer "clusterconfig" function "mutating_webhook_configurations" took 20.4367ms to process 3 records I0704 18:18:30.014168 1 tasks_processing.go:71] worker 6 working on sap_config task. I0704 18:18:30.014175 1 gather.go:181] gatherer "clusterconfig" function "container_runtime_configs" took 17.06362ms to process 0 records E0704 18:18:30.015460 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.113.208:9091: connect: connection refused I0704 18:18:30.015485 1 tasks_processing.go:71] worker 24 working on active_alerts task. E0704 18:18:30.015489 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.113.208:9091: connect: connection refused E0704 18:18:30.015499 1 gather.go:144] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.113.208:9091: connect: connection refused I0704 18:18:30.015517 1 gather.go:181] gatherer "clusterconfig" function "tsdb_status" took 4.786051ms to process 0 records E0704 18:18:30.015526 1 gather.go:144] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.113.208:9091: connect: connection refused I0704 18:18:30.015538 1 gather.go:181] gatherer "clusterconfig" function "metrics" took 2.51965ms to process 0 records I0704 18:18:30.015552 1 tasks_processing.go:71] worker 28 working on lokistack task. I0704 18:18:30.017465 1 tasks_processing.go:71] worker 9 working on storage_classes task. I0704 18:18:30.017480 1 gather.go:181] gatherer "clusterconfig" function "machine_autoscalers" took 17.80787ms to process 0 records I0704 18:18:30.017618 1 gather.go:181] gatherer "clusterconfig" function "openshift_logging" took 16.780454ms to process 0 records I0704 18:18:30.017629 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 16.770706ms to process 0 records I0704 18:18:30.017636 1 gather.go:181] gatherer "clusterconfig" function "node_logs" took 23.912815ms to process 0 records I0704 18:18:30.017637 1 tasks_processing.go:71] worker 26 working on openshift_machine_api_events task. I0704 18:18:30.017646 1 tasks_processing.go:71] worker 27 working on olm_operators task. I0704 18:18:30.017694 1 tasks_processing.go:71] worker 25 working on oauths task. I0704 18:18:30.017982 1 tasks_processing.go:71] worker 8 working on monitoring_persistent_volumes task. I0704 18:18:30.018134 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=e3a3eedbde72432702ccea1df05195412282e2690c8be9f7e0d5b2e67304a0d7 I0704 18:18:30.018151 1 gather.go:181] gatherer "clusterconfig" function "image_pruners" took 23.664025ms to process 1 records I0704 18:18:30.018225 1 tasks_processing.go:71] worker 19 working on overlapping_namespace_uids task. I0704 18:18:30.018384 1 recorder.go:70] Recording config/proxy with fingerprint=11685b1892e49480e98d9ca55765ceb690723b070b56531ecd3c4f169a09dde0 I0704 18:18:30.018409 1 gather.go:181] gatherer "clusterconfig" function "proxies" took 23.721116ms to process 1 records I0704 18:18:30.026860 1 tasks_processing.go:71] worker 1 working on ingress_certificates task. I0704 18:18:30.027824 1 recorder.go:70] Recording config/node/ip-10-0-0-235.ec2.internal with fingerprint=b51188707d430f6d1a1c25fb7f904dac2ec9107ada8d617f75c6b63577132759 I0704 18:18:30.028069 1 recorder.go:70] Recording config/node/ip-10-0-1-207.ec2.internal with fingerprint=361950d042a13aa88d621091c6c131425c4e90549ace1e6cc8df9b2c8868d1ce I0704 18:18:30.028421 1 recorder.go:70] Recording config/node/ip-10-0-2-34.ec2.internal with fingerprint=84a4aaf41fa990426417e5824a2455704135a3b00d7c7f1d2e871a114791cc97 I0704 18:18:30.028437 1 gather.go:181] gatherer "clusterconfig" function "nodes" took 27.238958ms to process 3 records I0704 18:18:30.030345 1 tasks_processing.go:71] worker 13 working on version task. I0704 18:18:30.030386 1 gather.go:181] gatherer "clusterconfig" function "certificate_signing_requests" took 36.946549ms to process 0 records E0704 18:18:30.030452 1 gather.go:144] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0704 18:18:30.030488 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0704 18:18:30.030499 1 gather.go:181] gatherer "clusterconfig" function "machine_configs" took 29.177661ms to process 1 records I0704 18:18:30.030501 1 tasks_processing.go:71] worker 17 working on container_images task. I0704 18:18:30.030512 1 tasks_processing.go:71] worker 30 working on openstack_dataplanenodesets task. I0704 18:18:30.030528 1 gather.go:181] gatherer "clusterconfig" function "cost_management_metrics_configs" took 18.156055ms to process 0 records E0704 18:18:30.030542 1 gather.go:144] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0704 18:18:30.030551 1 gather.go:181] gatherer "clusterconfig" function "support_secret" took 35.081561ms to process 0 records I0704 18:18:30.030558 1 tasks_processing.go:71] worker 11 working on machine_healthchecks task. I0704 18:18:30.030848 1 tasks_processing.go:74] worker 28 stopped. I0704 18:18:30.030863 1 gather.go:181] gatherer "clusterconfig" function "lokistack" took 15.288313ms to process 0 records I0704 18:18:30.030881 1 gather.go:181] gatherer "clusterconfig" function "sap_config" took 16.669503ms to process 0 records I0704 18:18:30.030890 1 tasks_processing.go:74] worker 6 stopped. I0704 18:18:30.031185 1 tasks_processing.go:74] worker 12 stopped. I0704 18:18:30.031366 1 recorder.go:70] Recording config/network with fingerprint=809e59f7a45a01b5954106e88b8219156525aee1763fc81950262ebc08002f4f I0704 18:18:30.031369 1 controller.go:203] Source scaController *sca.Controller is not ready I0704 18:18:30.031382 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0704 18:18:30.031385 1 gather.go:181] gatherer "clusterconfig" function "networks" took 36.477009ms to process 1 records I0704 18:18:30.031390 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0704 18:18:30.031394 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0704 18:18:30.031399 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0704 18:18:30.031421 1 controller.go:457] The operator is still being initialized I0704 18:18:30.031432 1 controller.go:482] The operator is healthy I0704 18:18:30.031551 1 tasks_processing.go:74] worker 4 stopped. I0704 18:18:30.032152 1 recorder.go:70] Recording config/infrastructure with fingerprint=850efd78af8b19bb29b3f4d54e5b611c6a791126c203753b19b8abe99724fef5 I0704 18:18:30.032166 1 gather.go:181] gatherer "clusterconfig" function "infrastructures" took 34.419846ms to process 1 records I0704 18:18:30.035571 1 tasks_processing.go:74] worker 26 stopped. I0704 18:18:30.035586 1 gather.go:181] gatherer "clusterconfig" function "openshift_machine_api_events" took 17.916827ms to process 0 records I0704 18:18:30.035988 1 tasks_processing.go:74] worker 16 stopped. I0704 18:18:30.036161 1 recorder.go:70] Recording config/featuregate with fingerprint=beecdf2124af563677a958e7196c4163903ea8e6ee02bc55e2764433a911eca8 I0704 18:18:30.036178 1 gather.go:181] gatherer "clusterconfig" function "feature_gates" took 23.266461ms to process 1 records I0704 18:18:30.036262 1 tasks_processing.go:74] worker 25 stopped. I0704 18:18:30.036414 1 recorder.go:70] Recording config/oauth with fingerprint=e80f7caa5a49533dadaa27cfc71ef958819b9b8d03ede796819a30e16e81b124 I0704 18:18:30.036424 1 gather.go:181] gatherer "clusterconfig" function "oauths" took 18.413615ms to process 1 records I0704 18:18:30.039191 1 tasks_processing.go:74] worker 19 stopped. I0704 18:18:30.039228 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0704 18:18:30.039241 1 gather.go:181] gatherer "clusterconfig" function "overlapping_namespace_uids" took 20.943796ms to process 1 records I0704 18:18:30.040097 1 tasks_processing.go:74] worker 3 stopped. I0704 18:18:30.040326 1 recorder.go:70] Recording config/image with fingerprint=06a5ed2d38308530b469b7bcec9f766c0f5f1700cd6b1e15c27369f554966ac1 I0704 18:18:30.040347 1 gather.go:181] gatherer "clusterconfig" function "image" took 33.262028ms to process 1 records I0704 18:18:30.041304 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0704 18:18:30.041821 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0704 18:18:30.041823 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0704 18:18:30.042719 1 tasks_processing.go:74] worker 31 stopped. I0704 18:18:30.043050 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=4959d3f9787703181eeaf541cc0b453466a7991b07642d35e2214802c049c283 I0704 18:18:30.043195 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=9da8f02c7dee06815e43ac1ab16562ca1e113491a03f9980968afb3a246b6bac I0704 18:18:30.043211 1 gather.go:181] gatherer "clusterconfig" function "clusterroles" took 48.117022ms to process 2 records I0704 18:18:30.044609 1 tasks_processing.go:74] worker 15 stopped. I0704 18:18:30.045341 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=d9a358a23c5fee6d525feec182bb9cff467c3396cd72926893999f1ee5ec2a9b I0704 18:18:30.045657 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=8166476390eb760dfb7a5ab8ad0c5a4893ed2e339ef381afb751da898d4bc4a3 I0704 18:18:30.045674 1 gather.go:181] gatherer "clusterconfig" function "crds" took 51.27663ms to process 2 records I0704 18:18:30.045808 1 requests.go:204] Asking for SCA certificate for x86_64 architecture I0704 18:18:30.046563 1 tasks_processing.go:74] worker 9 stopped. I0704 18:18:30.046661 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=2ff06929d40de8213b450caa6ef16eac927ae037f8bb90ce613aac8c5a4ff657 I0704 18:18:30.046684 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=566cbf505e79b5db5be46cf7e4ddf524bbb53bf22666532d15282ff0e851b1f9 I0704 18:18:30.046695 1 gather.go:181] gatherer "clusterconfig" function "storage_classes" took 29.036435ms to process 2 records I0704 18:18:30.047002 1 tasks_processing.go:74] worker 20 stopped. I0704 18:18:30.047146 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=91c59f6af09b38d624aa5cbc3cbed1e343ecf98a54f22bd70a934c2efc7a9afb I0704 18:18:30.047228 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=403e631a6638ed4930ef323be6ab8c3dbb56e8a08dcec9ce3258c30efb975901 I0704 18:18:30.047333 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=cd2d003d17d0b2a72234052ac4bb3c2498412dc257c3112ad077a979240c95b8 I0704 18:18:30.047369 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=39bfbfa8de5c83048b41e04d46b3d5878f418af59827c246b0d2c65c6eda592f I0704 18:18:30.047417 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=008b5deaf9410e7528b5462a055d4957a01f76bff58fbac81ea588f3380cecd6 I0704 18:18:30.047452 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=9af872b6f21c34925453b39265e5c34219454a95a702bb45c8e4e5083e93561a I0704 18:18:30.047487 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=62e2a40f81d5b2d0e03019ff178bebe3cf2cea1b9e59317eed8a899ada9ed47f I0704 18:18:30.047520 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=f168cf815b67499a7474e78f4570ced7ee19c7483bf89a533f33df2d1867cfb1 I0704 18:18:30.047559 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=0835243096e89e34771cba92b49b03e9183153d2caf56771062c899aeb49c17e I0704 18:18:30.047615 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=b2dc1474a9429fe461ded3c4de591d0052b78fc332cb9f957ddca08d29a776b3 I0704 18:18:30.047664 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=8f0f604116ccce3ebb48e0a6565cef112da8d00fa7992928ee304b3df0538e61 I0704 18:18:30.047707 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=7febd40c1eb8c6f4f836cdca7a2d7c938073c8f6770741eb20f69a0f4b1ff95a I0704 18:18:30.047767 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=9369a250ee4ba98426e240612c32d59c8f14ea80a1f3be92f83b10fea5caa1ef I0704 18:18:30.047788 1 gather.go:181] gatherer "clusterconfig" function "validating_webhook_configurations" took 34.61369ms to process 13 records I0704 18:18:30.047815 1 gather.go:181] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 53.948666ms to process 0 records I0704 18:18:30.047832 1 tasks_processing.go:74] worker 0 stopped. I0704 18:18:30.049150 1 tasks_processing.go:74] worker 30 stopped. I0704 18:18:30.049162 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 18.623986ms to process 0 records I0704 18:18:30.049202 1 tasks_processing.go:74] worker 11 stopped. E0704 18:18:30.049227 1 gather.go:144] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0704 18:18:30.049244 1 gather.go:181] gatherer "clusterconfig" function "machine_healthchecks" took 18.63368ms to process 0 records I0704 18:18:30.049868 1 tasks_processing.go:74] worker 8 stopped. I0704 18:18:30.049883 1 gather.go:181] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 31.803189ms to process 0 records I0704 18:18:30.051369 1 tasks_processing.go:74] worker 29 stopped. I0704 18:18:30.051476 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=03e11d10b409e02e5721506a85351b2a7306902e0ec7719d3b6c80108260ae3c I0704 18:18:30.051492 1 gather.go:181] gatherer "clusterconfig" function "schedulers" took 44.261898ms to process 1 records I0704 18:18:30.054729 1 tasks_processing.go:74] worker 22 stopped. I0704 18:18:30.054743 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=108780cb24f15bf572a4031966507398a0d0c6a28b3a008952f53b481dc191a9 I0704 18:18:30.054752 1 gather.go:181] gatherer "clusterconfig" function "dvo_metrics" took 59.865767ms to process 1 records I0704 18:18:30.054768 1 base_controller.go:73] Caches are synced for ConfigController I0704 18:18:30.054774 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0704 18:18:30.058569 1 tasks_processing.go:74] worker 23 stopped. I0704 18:18:30.058738 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=7466263185414fbd04b3a820c27aba36763321d522f17477dd2314c11d31bd5a I0704 18:18:30.058759 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=54fef2809d3153616164f91f3e76b43561e86ed6b62408c3386936d2e3004624 I0704 18:18:30.058774 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=c36e58915fa4597b7f0cda5152f09df2f5426818b704d4c08451125659fc9949 I0704 18:18:30.058788 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=d089b8f6d68d3982285edea0efce0c8e34284e60c7cd524e86544110a065d2a6 I0704 18:18:30.058807 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=340029e7c1fb999a565106636654057ef0e70a1834be92e79c2fad66ea11a209 I0704 18:18:30.058823 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=c6151f6db10fe69e2050839c2867dbbf7fabb72397bbdea165f87f72c9a33308 I0704 18:18:30.058839 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=0c4eac9c8da52b52e54a1231735eba4f76a2ec8dda601fe750d83c3e09b7b3e8 I0704 18:18:30.058855 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=5d187847cf4aa4dbfb9d04dee36dd4fd3f3cd2500c062aec0c5f0d379a55bd7a I0704 18:18:30.058870 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=1e9a559056644b1fc3e7ecc9def882e62a18628353c3b9a5219e50ee4c0a4d73 I0704 18:18:30.058884 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=1767eb2c1f936435e54f837f88421c3e9f5711a6c1f05a8a6193071961d005fe I0704 18:18:30.058905 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=aaa05543e9129b29b52be7ad08d3a6e65d079b0e8537dd5c024cffb47b7c77c9 I0704 18:18:30.058914 1 gather.go:181] gatherer "clusterconfig" function "pdbs" took 50.617621ms to process 11 records I0704 18:18:30.067728 1 configmapobserver.go:84] configmaps "insights-config" not found I0704 18:18:30.067809 1 tasks_processing.go:74] worker 5 stopped. I0704 18:18:30.067825 1 gather.go:181] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 74.847185ms to process 0 records I0704 18:18:30.076714 1 tasks_processing.go:74] worker 27 stopped. I0704 18:18:30.076806 1 recorder.go:70] Recording config/olm_operators with fingerprint=48884be1470f194dfd830da6ff8b36f2a3b03db7629f00d43d91d90feeb75ac7 I0704 18:18:30.076822 1 gather.go:181] gatherer "clusterconfig" function "olm_operators" took 59.053982ms to process 1 records I0704 18:18:30.093967 1 tasks_processing.go:74] worker 13 stopped. I0704 18:18:30.097095 1 recorder.go:70] Recording config/version with fingerprint=1e8e991776c09616f3f6f923d20d2565de56d666bed58d231b06ad8cb84f1a59 I0704 18:18:30.097126 1 recorder.go:70] Recording config/id with fingerprint=6ae7c379357868d5a373e0f03964f822355bca5c5f4606827b14f6b35d172724 I0704 18:18:30.097135 1 gather.go:181] gatherer "clusterconfig" function "version" took 63.602417ms to process 2 records I0704 18:18:30.100977 1 tasks_processing.go:74] worker 17 stopped. I0704 18:18:30.102515 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-7d4ddc79d6-xfnww with fingerprint=8609200c011c95963aa961419c1288767091d1c2bb23ba6383d24fd2a832f3ae I0704 18:18:30.102765 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-b74fm with fingerprint=7d3875bb93abeaa2ac6ac378b3037ea89be191987caa303a01189caa78b91dc4 I0704 18:18:30.102847 1 recorder.go:70] Recording config/running_containers with fingerprint=44a8fc2cd385ea753ebe67d488213c5c97e428ca240e972c9d548af7ca45fa4d I0704 18:18:30.102858 1 gather.go:181] gatherer "clusterconfig" function "container_images" took 70.453088ms to process 3 records I0704 18:18:30.102891 1 tasks_processing.go:74] worker 14 stopped. E0704 18:18:30.102905 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0704 18:18:30.102912 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0704 18:18:30.102916 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0704 18:18:30.102950 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0704 18:18:30.102960 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0704 18:18:30.102966 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=e1a0ad594db3a5d5d50e9e25d7b235af20f84f5def41537f127febe525b834f2 I0704 18:18:30.102975 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0704 18:18:30.103036 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0704 18:18:30.103047 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0704 18:18:30.103053 1 gather.go:181] gatherer "clusterconfig" function "config_maps" took 109.930034ms to process 6 records I0704 18:18:30.104101 1 base_controller.go:73] Caches are synced for LoggingSyncer I0704 18:18:30.104112 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0704 18:18:30.106954 1 gather_cluster_operator_pods_and_events.go:121] Found 6 pods with 9 containers I0704 18:18:30.106965 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 2796202 bytes I0704 18:18:30.107056 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-5pscj pod in namespace openshift-dns (previous: false). I0704 18:18:30.117113 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-5pscj pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-5pscj\" is waiting to start: ContainerCreating" I0704 18:18:30.117129 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-5pscj\" is waiting to start: ContainerCreating" I0704 18:18:30.117137 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-5pscj pod in namespace openshift-dns (previous: false). I0704 18:18:30.127792 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-5pscj pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-5pscj\" is waiting to start: ContainerCreating" I0704 18:18:30.127809 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-5pscj\" is waiting to start: ContainerCreating" I0704 18:18:30.127839 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-85dls pod in namespace openshift-dns (previous: false). I0704 18:18:30.128806 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I0704 18:18:30.134411 1 cluster_transfer.go:102] no available accepted cluster transfer I0704 18:18:30.134426 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0704 18:18:30.137639 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-85dls pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-85dls\" is waiting to start: ContainerCreating" I0704 18:18:30.137654 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-85dls\" is waiting to start: ContainerCreating" I0704 18:18:30.137662 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-85dls pod in namespace openshift-dns (previous: false). I0704 18:18:30.147974 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-85dls pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-85dls\" is waiting to start: ContainerCreating" I0704 18:18:30.147994 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-85dls\" is waiting to start: ContainerCreating" I0704 18:18:30.148026 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-8np8w pod in namespace openshift-dns (previous: false). I0704 18:18:30.158346 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-8np8w pod in namespace openshift-dns (previous: false). I0704 18:18:30.169353 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-df2jw pod in namespace openshift-dns (previous: false). I0704 18:18:30.180099 1 tasks_processing.go:74] worker 1 stopped. E0704 18:18:30.180122 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0704 18:18:30.180129 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2rbfm8gj4c74rnhbisdk8m29d724i5ic-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2rbfm8gj4c74rnhbisdk8m29d724i5ic-primary-cert-bundle-secret" not found I0704 18:18:30.180226 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=2d5ecd8632db61003b0b3c835e85214569c7fde3c5581d05aeec5de63ef7763e I0704 18:18:30.180243 1 gather.go:181] gatherer "clusterconfig" function "ingress_certificates" took 153.202553ms to process 1 records I0704 18:18:30.224259 1 sca.go:141] etc-pki-entitlement secret successfully updated I0704 18:18:30.224283 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated in the etc-pki-entitlement secret I0704 18:18:30.263646 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-m84zp pod in namespace openshift-dns (previous: false). I0704 18:18:30.463727 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-vs9nr pod in namespace openshift-dns (previous: false). I0704 18:18:30.664179 1 tasks_processing.go:74] worker 7 stopped. I0704 18:18:30.664283 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=6980e0ea1445b384fa1977462aee74c124bfd6fbc20e81e42dad8d843a57a3ab I0704 18:18:30.664349 1 recorder.go:70] Recording events/openshift-dns with fingerprint=d494523696fb6ec228edb66baf5a8ddacc98290a3ce53a20b7cab76185889e3b I0704 18:18:30.664483 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-5pscj with fingerprint=9947c6e7c0e027cb6415d984cff1a177de4e0d3a0324131c050fedb1cd1fdb41 I0704 18:18:30.664565 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-85dls with fingerprint=cec8199599643e44c4cdb2adcf016306d93f676659f61d4637f7248e68f398aa I0704 18:18:30.664577 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-8np8w/dns_current.log with fingerprint=cc031f5e14c13ddc7318f606526a53c9d4a47b69a1e40f8c45df2cc4cf21536f I0704 18:18:30.664584 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-8np8w/kube-rbac-proxy_current.log with fingerprint=108703ef56494c7d6a559912ed91a6abb0e752c3136b0b9cb75fba587b47b068 I0704 18:18:30.664589 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-df2jw/dns-node-resolver_current.log with fingerprint=fc989b1db25f80da0ce6656f46dc3cb681dcbae68930a0769e048fa6d4655ab2 I0704 18:18:30.664593 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-m84zp/dns-node-resolver_current.log with fingerprint=444bde382a94ee882ebd62b5a0f1b4df730ec40db42ea1594f61da4b69d205bf I0704 18:18:30.664597 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-vs9nr/dns-node-resolver_current.log with fingerprint=b77ca03de9e53bc30f7dec4fb1dd42fc2c39bacd9d982434db1f906b922dcd45 I0704 18:18:30.664603 1 gather.go:181] gatherer "clusterconfig" function "operators_pods_and_events" took 650.301743ms to process 9 records I0704 18:18:30.674786 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0704 18:18:30.874426 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0704 18:18:31.068629 1 tasks_processing.go:74] worker 24 stopped. I0704 18:18:31.068680 1 recorder.go:70] Recording config/alerts with fingerprint=adb30ec09bc137bd154d29587b8c9a18cb941b042297ec5e38c01d4703569ddd I0704 18:18:31.068701 1 gather.go:181] gatherer "clusterconfig" function "active_alerts" took 1.053131728s to process 1 records I0704 18:18:31.068718 1 recorder.go:70] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0704 18:18:31.068728 1 gather.go:181] gatherer "clusterconfig" function "silenced_alerts" took 1.062045856s to process 1 records I0704 18:18:31.068735 1 tasks_processing.go:74] worker 2 stopped. I0704 18:18:32.278081 1 tasks_processing.go:74] worker 10 stopped. I0704 18:18:32.278255 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=4aafb883ed61b8141636500eefd618af7dea6f83e45bc44935725d49926d126b I0704 18:18:32.278312 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=62bee8f2648594d7d3528b12d8651a300a306c8e575a9321360ad60516b06432 I0704 18:18:32.278350 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=61127306f45be7d03a50738d473f7951dd77dbd9b4fa465f9dfb9742e344e3fa I0704 18:18:32.278366 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0704 18:18:32.278401 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=3f1655555d77a073100bd3a98050a5c4f1782cae810d597c7888fa84a6b85d48 I0704 18:18:32.278428 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0704 18:18:32.278461 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=f8792b25efd8575064cca1e1f95795308d221e6fd890343447ae79b59ebfba58 I0704 18:18:32.278496 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=bfb2c2f866e4b2e8d63f6a86d1d0efdc54da47d612e05c13f6aaeaf1245af892 I0704 18:18:32.278530 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=1c51f36a05d8dc2ece52620b21fdf7eda326d8aca69b1d1e00edf817ae9552d5 I0704 18:18:32.278575 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=b97a7258f49a8f5fe984ba235269c6b2ca5cf6609927cd9d98e082ee741b98b9 I0704 18:18:32.278868 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=7f77689c4573bc016ba14012a3b347622cd3acdc458bcbbb82ba22b3f722bcf6 I0704 18:18:32.278898 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=5fce67be4c59c38cf4d049331f561c3f09500b68baaeddfaf5555addb215e3b4 I0704 18:18:32.278913 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0704 18:18:32.278938 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=99571eab5ab8ec5361cadeeaabbb1042097640a291094f3c18b9fde0964bf8c4 I0704 18:18:32.278955 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0704 18:18:32.278981 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=1558b2eb95c0bf22c8e327bb4a0e0d4788ef03cd824938641e2d6c75c53b397b I0704 18:18:32.278996 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0704 18:18:32.279045 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=85649637341059a7763588dc41799b454c97cbb34142de907c20b6293ab16dee I0704 18:18:32.279061 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0704 18:18:32.279089 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=39e6c0e1d4454e1637cac4d4667b19ceb63d9c65ad5d4b4eb77b09d5c3dae140 I0704 18:18:32.279199 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=7fedc04f90e9fb0d0eacc8b3b95b8227b91ea703601ec8037b49874a12908a8a I0704 18:18:32.279235 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0704 18:18:32.279268 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=0f64613b3543559045096290e4ed00daadc817d0309a4ca059b7aa202cf50b95 I0704 18:18:32.279303 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=c202f0da7cdf62ce7c4e55dbb4e6f81318516f37e6d6ce609dc23e908e7439cf I0704 18:18:32.279319 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0704 18:18:32.279344 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=407c53fb87fc1e41adc126085ce479d6154fc928d335a9a70000121205a88952 I0704 18:18:32.279359 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0704 18:18:32.279391 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=f1e10ec2a2a2f7d266852bec1510cfcb9da2da014c00ff0d90f5f459cd1dfede I0704 18:18:32.279407 1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0704 18:18:32.279429 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=1332525b3c7467063b3f2949567f032ed6a70d820bc727d1d24a44fe5896195e I0704 18:18:32.279461 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=ea69855644975bdf8ae2a6235c92d3910a402eae40abe3650f7980be154f5168 I0704 18:18:32.279488 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=d60e7751a93f7aa320b257d028457fba12254c53e24a168ff978a37f4626d2dd I0704 18:18:32.279522 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=5fdc9cd724f4696d420e8f86799bf9533e1e56371db18fd98356618dfc8449a8 I0704 18:18:32.279541 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0704 18:18:32.279581 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=4190e7846ab65a39e81e18182d07034615ac4f898353997ded0fe09a0213d00b I0704 18:18:32.279609 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0704 18:18:32.279624 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0704 18:18:32.279636 1 gather.go:181] gatherer "clusterconfig" function "operators" took 2.271634327s to process 37 records I0704 18:18:43.032387 1 tasks_processing.go:74] worker 18 stopped. I0704 18:18:43.032431 1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0704 18:18:43.032446 1 gather.go:181] gatherer "clusterconfig" function "install_plans" took 13.038730974s to process 1 records I0704 18:18:43.800141 1 tasks_processing.go:74] worker 21 stopped. I0704 18:18:43.800428 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=ba16ea6b4503917d33437d4d1999039313b5aa3c669ab94c714d5681918865aa I0704 18:18:43.800449 1 gather.go:181] gatherer "clusterconfig" function "service_accounts" took 13.806478783s to process 1 records E0704 18:18:43.800506 1 periodic.go:252] clusterconfig failed after 13.807s with: function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0704 18:18:43.800521 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0704 18:18:43.800527 1 periodic.go:214] Running workloads gatherer I0704 18:18:43.800541 1 tasks_processing.go:45] number of workers: 2 I0704 18:18:43.800551 1 tasks_processing.go:69] worker 1 listening for tasks. I0704 18:18:43.800555 1 tasks_processing.go:71] worker 1 working on workload_info task. I0704 18:18:43.800569 1 tasks_processing.go:69] worker 0 listening for tasks. I0704 18:18:43.800632 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0704 18:18:43.827066 1 gather_workloads_info.go:281] Loaded pods in 0s, will wait 24s for image data I0704 18:18:43.831407 1 tasks_processing.go:74] worker 0 stopped. I0704 18:18:43.831427 1 gather.go:181] gatherer "workloads" function "helmchart_info" took 30.75443ms to process 0 records I0704 18:18:43.836264 1 gather_workloads_info.go:390] No image sha256:5bcfb1b739fa4e6ff9e21e4843f8520f29608135341f7d8dcc31084b9ba25f1d (11ms) I0704 18:18:43.846840 1 gather_workloads_info.go:390] No image sha256:31a22f6ee061d0f6558664e580ec0f80f1927d4ec29626cf3e9420837f5d80e5 (11ms) I0704 18:18:43.856910 1 gather_workloads_info.go:390] No image sha256:894452e6587de55d04e37163d3da53e11fced8fb08bd0acf61e6d49f7964284e (10ms) I0704 18:18:43.866753 1 gather_workloads_info.go:390] No image sha256:09b3e9e6a4f382fb4bbdb67bc945bcf19d66f604b7c8ffd66d4d4a2c94224248 (10ms) I0704 18:18:43.876568 1 gather_workloads_info.go:390] No image sha256:50076d29400ecf9b704d8175509fc8cb7c28bea91d46a28dc37cbda1668c69f9 (10ms) I0704 18:18:43.886144 1 gather_workloads_info.go:390] No image sha256:4dcdadc14b7bdb2c00954d92e957d63aafbbe5f4047fe028e575d65725923cb0 (10ms) I0704 18:18:43.896415 1 gather_workloads_info.go:390] No image sha256:02283a64c1936a5dd09d5c6bc0ecbcf9196fe4df6a4055c8be22cebd850aa7a3 (10ms) I0704 18:18:43.905878 1 gather_workloads_info.go:390] No image sha256:0c6b7f828184b16a5e6630111e0715e11d34dae9b0bf64619466543e6168e05c (9ms) I0704 18:18:43.915538 1 gather_workloads_info.go:390] No image sha256:586127c49e25052113263d8aeaf6a1623aef22987364f119a17b2848982ff716 (10ms) I0704 18:18:43.924870 1 gather_workloads_info.go:390] No image sha256:c7aa910ca06f8fd89cdf2519136e0f3533bdacfc6bd58a3f6683f9f08756c7b1 (9ms) I0704 18:18:43.936104 1 gather_workloads_info.go:390] No image sha256:788d16bfff4bd6bb3ce97acc643b56fae6e619674ab279535480e519b4d5b769 (11ms) I0704 18:18:44.036624 1 gather_workloads_info.go:390] No image sha256:6a9b4fd887fa7f1729302fb0330c3c9a483197bf78becdcfda4235ec823a2c39 (100ms) I0704 18:18:44.136836 1 gather_workloads_info.go:390] No image sha256:3fea7db586d3236c1876a8b523af0d8d65c84d6f6cf5d0f4e41cafcffe6db5b5 (100ms) I0704 18:18:44.237052 1 gather_workloads_info.go:390] No image sha256:ed0c9631d6e424912cd8ce78ca7a2c4f76b3fc15e9e34fe00999170ccf19a611 (100ms) I0704 18:18:44.336887 1 gather_workloads_info.go:390] No image sha256:c96b4bddf3dd7daaa797cbda4dd92e981de2f5fc3404c01381f31dc0414d5c8d (100ms) I0704 18:18:44.437116 1 gather_workloads_info.go:390] No image sha256:06821dfe231330e0eb5be915b9468cd13826a7ee59d1a732b89cb140548eade2 (100ms) I0704 18:18:44.536812 1 gather_workloads_info.go:390] No image sha256:13aabbaf260d634ff0e9ac1af88af075b5ba671fd51313e33e74d7d2f7e54128 (100ms) I0704 18:18:44.637225 1 gather_workloads_info.go:390] No image sha256:41029e57ece558b2e0b12174ce924647fd9d5c5d83aadf4bba03d6916d3f9f54 (100ms) I0704 18:18:44.738279 1 gather_workloads_info.go:390] No image sha256:8e158c83ec12b3e0237fab9a221630bd691e79c079a111f346354ff43b8199df (101ms) I0704 18:18:44.837286 1 gather_workloads_info.go:390] No image sha256:4b9b7949d209e257a76053de4ac74193f747c0d42e25dcd270d655849a4e51aa (99ms) I0704 18:18:44.936577 1 gather_workloads_info.go:390] No image sha256:38787de16ee8c686305f93b501d891b50cde24136009863869d230c0d4eeee5c (99ms) I0704 18:18:45.037237 1 gather_workloads_info.go:390] No image sha256:a7fc4d05c4a3c82c9f355ca985d6fd26033c0d6a98716f25fcd2f54bae1d2fa0 (101ms) I0704 18:18:45.136985 1 gather_workloads_info.go:390] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (100ms) I0704 18:18:45.237539 1 gather_workloads_info.go:390] No image sha256:0c1abef76d6d2832ddcff31e950ffafeb4e0f6fad80a5f5dca94591de0fc9581 (101ms) I0704 18:18:45.343265 1 gather_workloads_info.go:390] No image sha256:42b4c6bdf3081ec264bc5edbc4eb779151de9e4742d6fe59a316645891df649c (106ms) I0704 18:18:45.436997 1 gather_workloads_info.go:390] No image sha256:68abf16a3b6c33fdd22a823c7d00f96aaaa8015d370116962a5835984908645a (94ms) I0704 18:18:45.535843 1 gather_workloads_info.go:390] No image sha256:194ee1155b87e110bc6c4a6e55667e41f3bdc8292e26a9561f9082fdfe467eec (99ms) I0704 18:18:45.636694 1 gather_workloads_info.go:390] No image sha256:1c7c24111f1709d7648156873ced09462638aa4b3cf7e7aee13297e51bcdfb3e (101ms) I0704 18:18:45.743121 1 gather_workloads_info.go:390] No image sha256:1eee856bde9bad71c4444c494225a0cf02d1f4a5293acf0bd6e7e1814efa0064 (106ms) I0704 18:18:45.837199 1 gather_workloads_info.go:401] Found image sha256:b8781637560d49de9b8e8cdd59ec75f03d98921ea66950381849398128cc9cb9 (94ms) I0704 18:18:45.937396 1 gather_workloads_info.go:390] No image sha256:3a2c82b772ea6072e1eca0efc5303f002189e80b0e985fb3e3b8ea9a12fe8060 (100ms) I0704 18:18:46.037191 1 gather_workloads_info.go:401] Found image sha256:751bd7eb62f632c0eef0ca91b6c57c64d4f1279d4dbe1a9b875ac4020a7b693f (100ms) I0704 18:18:46.137544 1 gather_workloads_info.go:390] No image sha256:8562a483f4568254250f19fc68d79f88c94a48508aefe59a70c1021a3aad000a (100ms) I0704 18:18:46.236792 1 gather_workloads_info.go:390] No image sha256:30ff5e5b72f274598704ca69f1832eba1040cc25da47386004fd59500b6e4c55 (99ms) I0704 18:18:46.336443 1 gather_workloads_info.go:390] No image sha256:3969660e807e8ce5656a74e5816573656241946ef1d766a9d2e21d434356313c (100ms) I0704 18:18:46.436901 1 gather_workloads_info.go:390] No image sha256:48dff3fcb0da58eb9b2b500f89af8b7d0790ffa60da0b0e301feca971dbafcbb (100ms) I0704 18:18:46.537051 1 gather_workloads_info.go:390] No image sha256:351ca92471647f383f3cd7f0b70f33f5fa11c39ab569c4948dff7d471a6c8be3 (100ms) I0704 18:18:46.636941 1 gather_workloads_info.go:390] No image sha256:bc829520eeec090b60d17abbad1a22b34ea99b426193395808a778d73a5fb57a (100ms) I0704 18:18:46.736567 1 gather_workloads_info.go:390] No image sha256:24519dcc0e63cdc60a639dd474d06e7612e9b76966bc60322cd9026a0f1b878c (100ms) I0704 18:18:46.836807 1 gather_workloads_info.go:390] No image sha256:2897724cec17bc13acc133181f64ccb8d54ce5dc9582f9cecf704c2540e15600 (100ms) I0704 18:18:46.936740 1 gather_workloads_info.go:390] No image sha256:0242cefbf0bb876101c4d67ab4e07401cb0ba6c02be2b73a4f17ba33b2960005 (100ms) I0704 18:18:47.036828 1 gather_workloads_info.go:390] No image sha256:221622a101db9797df0622b4534e3e42c4498df458f355a8a02fad8d65f8e3f2 (100ms) I0704 18:18:47.136800 1 gather_workloads_info.go:390] No image sha256:0158b297aec0a66376c04d3c7cf4828db5e5d9f424e331ff7c7b796828036875 (100ms) I0704 18:18:47.236669 1 gather_workloads_info.go:390] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (100ms) I0704 18:18:47.236706 1 tasks_processing.go:74] worker 1 stopped. I0704 18:18:47.237069 1 recorder.go:70] Recording config/workload_info with fingerprint=33b734fd6af47210c424e347d8bbfcaadaf36d1e9fcf54e5d53230665ba19283 I0704 18:18:47.237090 1 gather.go:181] gatherer "workloads" function "workload_info" took 3.436142821s to process 1 records I0704 18:18:47.237105 1 periodic.go:261] Periodic gather workloads completed in 3.436s I0704 18:18:47.237112 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0704 18:18:47.237117 1 periodic.go:214] Running conditional gatherer I0704 18:18:47.247113 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules I0704 18:18:47.465761 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer E0704 18:18:47.470772 1 conditional_gatherer.go:322] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.113.208:9091: connect: connection refused I0704 18:18:47.470858 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0704 18:18:47.480087 1 conditional_gatherer.go:390] cluster version is '4.18.9' E0704 18:18:47.480107 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 18:18:47.480113 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 18:18:47.480116 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 18:18:47.480120 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 18:18:47.480123 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 18:18:47.480127 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 18:18:47.480130 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 18:18:47.480133 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 18:18:47.480136 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 18:18:47.480140 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0704 18:18:47.480155 1 tasks_processing.go:45] number of workers: 3 I0704 18:18:47.480167 1 tasks_processing.go:69] worker 2 listening for tasks. I0704 18:18:47.480171 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0704 18:18:47.480179 1 tasks_processing.go:69] worker 0 listening for tasks. I0704 18:18:47.480188 1 tasks_processing.go:69] worker 1 listening for tasks. I0704 18:18:47.480259 1 tasks_processing.go:71] worker 1 working on conditional_gatherer_rules task. I0704 18:18:47.480271 1 tasks_processing.go:74] worker 1 stopped. I0704 18:18:47.480275 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0704 18:18:47.480377 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0704 18:18:47.480394 1 gather.go:181] gatherer "conditional" function "conditional_gatherer_rules" took 1.951µs to process 1 records I0704 18:18:47.480431 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0704 18:18:47.480438 1 gather.go:181] gatherer "conditional" function "remote_configuration" took 2.17µs to process 1 records I0704 18:18:47.480444 1 gather.go:181] gatherer "conditional" function "rapid_container_logs" took 190.263µs to process 0 records I0704 18:18:47.480450 1 tasks_processing.go:74] worker 2 stopped. I0704 18:18:47.480454 1 tasks_processing.go:74] worker 0 stopped. I0704 18:18:47.480467 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I0704 18:18:47.480480 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f W0704 18:18:47.531753 1 gather.go:213] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0704 18:18:47.531957 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=551cfcf1827c43301f750e29a7c3b28d397f8d2821a3c526ba6d50351f73582c I0704 18:18:47.532110 1 diskrecorder.go:70] Writing 118 records to /var/lib/insights-operator/insights-2026-07-04-181847.tar.gz I0704 18:18:47.539991 1 diskrecorder.go:51] Wrote 118 records to disk in 7ms I0704 18:18:47.540045 1 periodic.go:283] Gathering cluster info every 2h0m0s I0704 18:18:47.540060 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0704 18:19:59.993797 1 diskrecorder.go:170] Found files to send: insights-2026-07-04-181847.tar.gz I0704 18:19:59.993830 1 insightsuploader.go:150] Checking archives to upload periodically every 15m9.011680882s I0704 18:19:59.993838 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0704 18:20:00.007447 1 requests.go:47] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0704 18:20:00.175745 1 requests.go:88] Successfully reported id=2026-07-04T18:19:59Z x-rh-insights-request-id=85a34dcb5aba46c382119839ceb8d9be, wrote=58509 I0704 18:20:00.175847 1 insightsuploader.go:187] Uploaded report successfully in 182.000316ms I0704 18:20:00.175874 1 controller.go:119] Initializing last reported time to 2026-07-04T18:19:59Z I0704 18:20:00.175937 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0704 18:20:00.175946 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0704 18:20:00.175953 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0704 18:20:00.183649 1 controller.go:482] The operator is healthy I0704 18:20:30.010322 1 controller.go:482] The operator is healthy I0704 18:21:04.410180 1 insightsreport.go:137] Pulling report from smart-proxy I0704 18:21:04.410213 1 insightsreport.go:149] Retrieving report I0704 18:21:04.421173 1 requests.go:111] Retrieving report for cluster: a9989514-5f4b-475f-91c3-089627bb49ea I0704 18:21:04.421185 1 requests.go:112] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/a9989514-5f4b-475f-91c3-089627bb49ea/reports I0704 18:21:04.424347 1 requests.go:122] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/a9989514-5f4b-475f-91c3-089627bb49ea/reports I0704 18:21:04.706271 1 insightsreport.go:184] Report retrieved I0704 18:21:04.754918 1 insightsreport.go:239] Report retrieved correctly I0704 18:22:30.013229 1 controller.go:482] The operator is healthy I0704 18:23:29.987735 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0704 18:23:29.995175 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0704 18:23:29.995204 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0704 18:23:30.002917 1 secretconfigobserver.go:119] support secret does not exist I0704 18:24:30.009427 1 controller.go:482] The operator is healthy I0704 18:26:30.010894 1 controller.go:482] The operator is healthy I0704 18:28:29.981437 1 configmapobserver.go:84] configmaps "insights-config" not found I0704 18:28:30.003516 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0704 18:28:30.009225 1 controller.go:482] The operator is healthy I0704 18:28:30.009452 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0704 18:28:30.009467 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0704 18:28:30.013993 1 secretconfigobserver.go:119] support secret does not exist I0704 18:30:30.010899 1 controller.go:482] The operator is healthy I0704 18:32:30.010490 1 controller.go:482] The operator is healthy I0704 18:33:30.014772 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0704 18:33:30.020242 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0704 18:33:30.020263 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0704 18:33:30.025156 1 secretconfigobserver.go:119] support secret does not exist I0704 18:34:30.010224 1 controller.go:482] The operator is healthy I0704 18:35:14.189042 1 insightsuploader.go:146] Nothing to report since 2026-07-04T18:19:59Z