I0703 06:43:56.937913 1 cmd.go:253] Using service-serving-cert provided certificates I0703 06:43:56.938399 1 observer_polling.go:159] Starting file observer W0703 06:43:56.963427 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0703 06:43:57.389466 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0703 06:43:57.389675 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0703 06:43:57.390194 1 secure_serving.go:57] Forcing use of http/1.1 only W0703 06:43:57.390219 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0703 06:43:57.390224 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0703 06:43:57.390230 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0703 06:43:57.390234 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0703 06:43:57.390238 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0703 06:43:57.390242 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0703 06:43:57.390305 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0703 06:43:57.395231 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0703 06:43:57.395320 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0703 06:43:57.396922 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0703 06:43:57.396945 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0703 06:43:57.396941 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0703 06:43:57.396946 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0703 06:43:57.396957 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0703 06:43:57.396962 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0703 06:43:57.397239 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0703 06:43:57.397457 1 secure_serving.go:213] Serving securely on [::]:8443 I0703 06:43:57.397488 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" E0703 06:43:57.398862 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18beb49102c7e3a5 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-03 06:43:57.395207077 +0000 UTC m=+0.498414145,LastTimestamp:2026-07-03 06:43:57.395207077 +0000 UTC m=+0.498414145,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0703 06:43:57.402035 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0703 06:43:57.402057 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0703 06:43:57.402167 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0703 06:43:57.416827 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 06:43:57.416849 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0703 06:43:57.423395 1 secretconfigobserver.go:119] support secret does not exist I0703 06:43:57.429766 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 06:43:57.435717 1 secretconfigobserver.go:119] support secret does not exist I0703 06:43:57.439782 1 recorder.go:156] Pruning old reports every 5h27m48s, max age is 288h0m0s I0703 06:43:57.446673 1 periodic.go:212] Running clusterconfig gatherer I0703 06:43:57.446681 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0703 06:43:57.446704 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0703 06:43:57.446733 1 tasks_processing.go:45] number of workers: 32 I0703 06:43:57.446742 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0703 06:43:57.446754 1 insightsreport.go:296] Starting report retriever I0703 06:43:57.446765 1 tasks_processing.go:69] worker 1 listening for tasks. I0703 06:43:57.446764 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0703 06:43:57.446777 1 tasks_processing.go:69] worker 5 listening for tasks. I0703 06:43:57.446781 1 tasks_processing.go:71] worker 1 working on cluster_apiserver task. I0703 06:43:57.446782 1 tasks_processing.go:69] worker 0 listening for tasks. I0703 06:43:57.446787 1 tasks_processing.go:71] worker 5 working on pod_network_connectivity_checks task. I0703 06:43:57.446788 1 tasks_processing.go:69] worker 2 listening for tasks. I0703 06:43:57.446776 1 tasks_processing.go:69] worker 9 listening for tasks. I0703 06:43:57.446793 1 tasks_processing.go:69] worker 8 listening for tasks. I0703 06:43:57.446798 1 tasks_processing.go:69] worker 6 listening for tasks. I0703 06:43:57.446780 1 tasks_processing.go:69] worker 3 listening for tasks. I0703 06:43:57.446800 1 tasks_processing.go:69] worker 7 listening for tasks. I0703 06:43:57.446802 1 tasks_processing.go:69] worker 20 listening for tasks. I0703 06:43:57.446809 1 tasks_processing.go:69] worker 10 listening for tasks. I0703 06:43:57.446810 1 tasks_processing.go:69] worker 26 listening for tasks. I0703 06:43:57.446816 1 tasks_processing.go:69] worker 29 listening for tasks. I0703 06:43:57.446817 1 tasks_processing.go:69] worker 24 listening for tasks. I0703 06:43:57.446821 1 tasks_processing.go:69] worker 11 listening for tasks. I0703 06:43:57.446824 1 tasks_processing.go:69] worker 25 listening for tasks. I0703 06:43:57.446828 1 tasks_processing.go:69] worker 12 listening for tasks. I0703 06:43:57.446833 1 tasks_processing.go:69] worker 27 listening for tasks. I0703 06:43:57.446834 1 tasks_processing.go:69] worker 28 listening for tasks. I0703 06:43:57.446827 1 tasks_processing.go:69] worker 4 listening for tasks. I0703 06:43:57.446842 1 tasks_processing.go:69] worker 22 listening for tasks. I0703 06:43:57.446841 1 tasks_processing.go:69] worker 21 listening for tasks. I0703 06:43:57.446836 1 tasks_processing.go:69] worker 13 listening for tasks. I0703 06:43:57.446852 1 tasks_processing.go:69] worker 31 listening for tasks. I0703 06:43:57.446851 1 tasks_processing.go:69] worker 18 listening for tasks. I0703 06:43:57.446856 1 tasks_processing.go:69] worker 15 listening for tasks. I0703 06:43:57.446859 1 tasks_processing.go:69] worker 19 listening for tasks. I0703 06:43:57.446861 1 tasks_processing.go:69] worker 16 listening for tasks. I0703 06:43:57.446842 1 tasks_processing.go:69] worker 14 listening for tasks. I0703 06:43:57.446848 1 tasks_processing.go:69] worker 17 listening for tasks. I0703 06:43:57.446832 1 tasks_processing.go:69] worker 23 listening for tasks. I0703 06:43:57.446855 1 tasks_processing.go:69] worker 30 listening for tasks. I0703 06:43:57.446879 1 tasks_processing.go:71] worker 8 working on sap_datahubs task. I0703 06:43:57.446884 1 tasks_processing.go:71] worker 30 working on machine_sets task. I0703 06:43:57.446886 1 tasks_processing.go:71] worker 0 working on aggregated_monitoring_cr_names task. I0703 06:43:57.446925 1 tasks_processing.go:71] worker 28 working on active_alerts task. I0703 06:43:57.446932 1 tasks_processing.go:71] worker 18 working on openstack_version task. I0703 06:43:57.446941 1 tasks_processing.go:71] worker 16 working on ingress_certificates task. I0703 06:43:57.446946 1 tasks_processing.go:71] worker 2 working on container_images task. I0703 06:43:57.447001 1 tasks_processing.go:71] worker 9 working on machine_configs task. I0703 06:43:57.447005 1 tasks_processing.go:71] worker 15 working on validating_webhook_configurations task. I0703 06:43:57.447012 1 tasks_processing.go:71] worker 4 working on ceph_cluster task. I0703 06:43:57.447013 1 tasks_processing.go:71] worker 21 working on ingress task. I0703 06:43:57.447011 1 tasks_processing.go:71] worker 19 working on lokistack task. I0703 06:43:57.447016 1 tasks_processing.go:71] worker 13 working on node_logs task. I0703 06:43:57.447017 1 tasks_processing.go:71] worker 22 working on nodenetworkconfigurationpolicies task. I0703 06:43:57.447019 1 tasks_processing.go:71] worker 26 working on image task. I0703 06:43:57.447020 1 tasks_processing.go:71] worker 31 working on oauths task. I0703 06:43:57.447024 1 tasks_processing.go:71] worker 11 working on openshift_machine_api_events task. I0703 06:43:57.447024 1 tasks_processing.go:71] worker 6 working on feature_gates task. I0703 06:43:57.447028 1 tasks_processing.go:71] worker 29 working on monitoring_persistent_volumes task. I0703 06:43:57.447028 1 tasks_processing.go:71] worker 3 working on silenced_alerts task. I0703 06:43:57.447028 1 tasks_processing.go:71] worker 17 working on sap_pods task. I0703 06:43:57.447032 1 tasks_processing.go:71] worker 7 working on machine_autoscalers task. I0703 06:43:57.447032 1 tasks_processing.go:71] worker 24 working on openstack_controlplanes task. I0703 06:43:57.447032 1 tasks_processing.go:71] worker 14 working on crds task. I0703 06:43:57.447037 1 tasks_processing.go:71] worker 20 working on proxies task. I0703 06:43:57.447039 1 tasks_processing.go:71] worker 12 working on mutating_webhook_configurations task. I0703 06:43:57.447039 1 tasks_processing.go:71] worker 10 working on service_accounts task. I0703 06:43:57.447042 1 tasks_processing.go:71] worker 25 working on sap_config task. I0703 06:43:57.447043 1 tasks_processing.go:71] worker 23 working on support_secret task. I0703 06:43:57.447045 1 tasks_processing.go:71] worker 27 working on operators_pods_and_events task. I0703 06:43:57.454238 1 tasks_processing.go:71] worker 25 working on jaegers task. I0703 06:43:57.454250 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 5.13559ms to process 0 records I0703 06:43:57.454839 1 tasks_processing.go:71] worker 5 working on olm_operators task. E0703 06:43:57.454849 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0703 06:43:57.454861 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 8.039918ms to process 0 records I0703 06:43:57.455130 1 tasks_processing.go:71] worker 17 working on certificate_signing_requests task. I0703 06:43:57.455142 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 6.543724ms to process 0 records I0703 06:43:57.455857 1 tasks_processing.go:71] worker 7 working on cost_management_metrics_configs task. I0703 06:43:57.455867 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 7.234873ms to process 0 records I0703 06:43:57.457269 1 tasks_processing.go:71] worker 8 working on operators task. I0703 06:43:57.457277 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 10.379083ms to process 0 records I0703 06:43:57.467049 1 tasks_processing.go:71] worker 19 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0703 06:43:57.467062 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 19.660894ms to process 0 records I0703 06:43:57.467246 1 tasks_processing.go:71] worker 18 working on pdbs task. I0703 06:43:57.467256 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 20.301649ms to process 0 records I0703 06:43:57.467474 1 tasks_processing.go:71] worker 22 working on machines task. I0703 06:43:57.467488 1 controller.go:119] Initializing last reported time to 2026-07-03T06:43:51Z I0703 06:43:57.467465 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 19.589996ms to process 0 records I0703 06:43:57.467958 1 controller.go:317] The initial operator extension status is healthy I0703 06:43:57.467975 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 06:43:57.467985 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0703 06:43:57.467991 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0703 06:43:57.468044 1 controller.go:458] The operator is still being initialized I0703 06:43:57.468084 1 controller.go:481] The operator is healthy I0703 06:43:57.468348 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 19.288975ms to process 0 records E0703 06:43:57.468371 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0703 06:43:57.468381 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 19.080136ms to process 0 records I0703 06:43:57.468392 1 tasks_processing.go:71] worker 23 working on metrics task. I0703 06:43:57.468565 1 tasks_processing.go:71] worker 9 working on nodenetworkstates task. E0703 06:43:57.468729 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0703 06:43:57.468862 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0703 06:43:57.468899 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 21.5081ms to process 1 records I0703 06:43:57.468929 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 21.683791ms to process 0 records I0703 06:43:57.468963 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 21.438092ms to process 0 records I0703 06:43:57.468988 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 12.768071ms to process 0 records I0703 06:43:57.469092 1 tasks_processing.go:71] worker 4 working on version task. I0703 06:43:57.468044 1 tasks_processing.go:71] worker 24 working on infrastructures task. I0703 06:43:57.469194 1 recorder.go:70] Recording config/proxy with fingerprint=0e5a3ed442e4f4a7658842b7caf45a2e0f997e6f4043efd63496ead736ad2fe7 I0703 06:43:57.469469 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 19.842298ms to process 1 records I0703 06:43:57.469507 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 14.471428ms to process 0 records I0703 06:43:57.469572 1 tasks_processing.go:71] worker 25 working on networks task. I0703 06:43:57.469932 1 recorder.go:70] Recording config/apiserver with fingerprint=12f2dabb7e5cd2343c84b5b6d3f116d17e563cc7d86393efc02ed783bbe5ec6a I0703 06:43:57.470000 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 22.488808ms to process 1 records I0703 06:43:57.470066 1 tasks_processing.go:71] worker 21 working on tsdb_status task. I0703 06:43:57.469551 1 tasks_processing.go:71] worker 30 working on nodes task. I0703 06:43:57.469558 1 tasks_processing.go:71] worker 7 working on container_runtime_configs task. I0703 06:43:57.469563 1 tasks_processing.go:71] worker 20 working on clusterroles task. I0703 06:43:57.470130 1 tasks_processing.go:71] worker 1 working on image_registries task. I0703 06:43:57.470881 1 recorder.go:70] Recording config/ingress with fingerprint=59150eb02e6d99179fc31f6cbabb667282b7635e99e6decdad848b8474f32d68 I0703 06:43:57.470901 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 22.787287ms to process 1 records I0703 06:43:57.471104 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=07267de50f91c232b27db2e7015ef6d81796af48af8d997e7a8393305edee860 I0703 06:43:57.471198 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=fec0e8ac560afbae80bedb85bad009ad2ce5fc363507c40b75fa35efb1820ac5 I0703 06:43:57.471161 1 tasks_processing.go:71] worker 12 working on overlapping_namespace_uids task. I0703 06:43:57.471243 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=443fc7657518ebb0d6162931b2f9afbdb84005fd6c5938854cbc6596142c754b I0703 06:43:57.471254 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 21.867396ms to process 3 records I0703 06:43:57.471267 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 22.927412ms to process 0 records I0703 06:43:57.471273 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 23.163851ms to process 0 records I0703 06:43:57.471282 1 tasks_processing.go:71] worker 29 working on openstack_dataplanenodesets task. I0703 06:43:57.471395 1 tasks_processing.go:71] worker 11 working on schedulers task. I0703 06:43:57.472006 1 tasks_processing.go:71] worker 6 working on install_plans task. I0703 06:43:57.472198 1 recorder.go:70] Recording config/featuregate with fingerprint=f61379d1950e4d3ab158548d0d7bb3ecbe4d2c55a9e07f3add01053b623f0293 I0703 06:43:57.472218 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 23.950533ms to process 1 records E0703 06:43:57.472662 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.98.168:9091: connect: connection refused I0703 06:43:57.472706 1 tasks_processing.go:71] worker 23 working on config_maps task. E0703 06:43:57.472679 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.98.168:9091: connect: connection refused E0703 06:43:57.472725 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.98.168:9091: connect: connection refused I0703 06:43:57.472747 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 4.308419ms to process 0 records E0703 06:43:57.472763 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.98.168:9091: connect: connection refused I0703 06:43:57.472772 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 2.629749ms to process 0 records I0703 06:43:57.472779 1 tasks_processing.go:71] worker 21 working on openshift_logging task. I0703 06:43:57.473313 1 tasks_processing.go:71] worker 13 working on image_pruners task. I0703 06:43:57.473314 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 25.845095ms to process 0 records I0703 06:43:57.473493 1 tasks_processing.go:71] worker 26 working on openstack_dataplanedeployments task. I0703 06:43:57.473617 1 recorder.go:70] Recording config/image with fingerprint=ff5bd07c78b57165e42263fdb5b217ff37c23bd37fc93d138d8f2c73d24fc541 I0703 06:43:57.473639 1 gather.go:177] gatherer "clusterconfig" function "image" took 25.622502ms to process 1 records I0703 06:43:57.473656 1 tasks_processing.go:71] worker 31 working on authentication task. I0703 06:43:57.473914 1 recorder.go:70] Recording config/oauth with fingerprint=336fd5321ff39a7afe2b02516f9cba53448a322201e4ec58976af2f4a889b6bd I0703 06:43:57.473926 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 25.746803ms to process 1 records I0703 06:43:57.481125 1 tasks_processing.go:71] worker 17 working on storage_cluster task. I0703 06:43:57.481136 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 25.975445ms to process 0 records I0703 06:43:57.485123 1 tasks_processing.go:71] worker 7 working on machine_healthchecks task. I0703 06:43:57.485183 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 14.811979ms to process 0 records I0703 06:43:57.489780 1 tasks_processing.go:71] worker 26 working on dvo_metrics task. I0703 06:43:57.489811 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 16.2342ms to process 0 records E0703 06:43:57.489824 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0703 06:43:57.489834 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 4.665962ms to process 0 records I0703 06:43:57.489910 1 tasks_processing.go:71] worker 7 working on machine_config_pools task. I0703 06:43:57.491977 1 tasks_processing.go:71] worker 9 working on storage_classes task. I0703 06:43:57.492020 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 23.360866ms to process 0 records I0703 06:43:57.492513 1 tasks_processing.go:74] worker 22 stopped. E0703 06:43:57.492523 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0703 06:43:57.492535 1 gather.go:177] gatherer "clusterconfig" function "machines" took 24.883368ms to process 0 records I0703 06:43:57.492551 1 tasks_processing.go:74] worker 21 stopped. I0703 06:43:57.492565 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 19.760567ms to process 0 records I0703 06:43:57.492741 1 tasks_processing.go:74] worker 15 stopped. I0703 06:43:57.492864 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=9bca7516bfcedce5f6d0fb09b1c55af864cf0b975e69a07d614c4069d9302713 I0703 06:43:57.492934 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=f009a05e000ffa0546ac99c61f5cab69085e1c8b1792f99c74f815e34460e12b I0703 06:43:57.493024 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=92a8438df285edcc89fdbd1bab214d69b15e6893b80308b8bb3d32729e69ca6a I0703 06:43:57.493049 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=9fffae04f5602af80be3d3959cba1fca58f56d7965ceb3a48f56bfe84d5958a4 I0703 06:43:57.493075 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=ee5aac7f0f13000abd1e7774bbd8556a86baa0205b9778238af6a804ca041510 I0703 06:43:57.493101 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=abf214fc98624073f4654f27dac2e14a70d0439ff50ceb785c45e431584a193e I0703 06:43:57.493125 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=7f8c9995f763f3a5688b27855004331149dd1c102a505d64e46d1892e9f261c6 I0703 06:43:57.493150 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=fda41b371db552f7ca9fcab6ca0daf84a16ba9fa638c0c786724283be1c7e3f6 I0703 06:43:57.493173 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=d475f8da4f656fc681bf8c8298124fb1045448cee2460c8c3bb96174a3c18269 I0703 06:43:57.493217 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=724aac2be6414818bde0ee85db45f4aab96084a9fb678af9cd85fdd92d755c09 I0703 06:43:57.493243 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=31a84443b86d87da298cd357eab6e594faa0600b8b443d9af786c9a7786e1015 I0703 06:43:57.493266 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=8db0cc47a65624ef4b453a2f22ac855eb1bc5e53d773850ece7acd5470c1d02b I0703 06:43:57.493317 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=1c0dcd22ae7848924eecd58dd3658e09dabf5de985d550fb431a5e5acd947456 I0703 06:43:57.493327 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 45.638691ms to process 13 records I0703 06:43:57.497646 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0703 06:43:57.497653 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0703 06:43:57.497721 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0703 06:43:57.498713 1 tasks_processing.go:74] worker 17 stopped. I0703 06:43:57.498729 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 17.569104ms to process 0 records I0703 06:43:57.498746 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 8.787607ms to process 0 records I0703 06:43:57.498754 1 tasks_processing.go:74] worker 7 stopped. I0703 06:43:57.498846 1 tasks_processing.go:74] worker 25 stopped. I0703 06:43:57.499102 1 recorder.go:70] Recording config/network with fingerprint=cbddf2ee513cca6cf49396b7f9643229e28422ac12f1e4c5c88529a24c13ffc6 I0703 06:43:57.499116 1 gather.go:177] gatherer "clusterconfig" function "networks" took 29.226989ms to process 1 records I0703 06:43:57.499982 1 tasks_processing.go:74] worker 14 stopped. I0703 06:43:57.500640 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=edbf0e3fff92ed848f3a0b6fe4abe5f3c2b022238a0ae88bb7f2891e63ff810b I0703 06:43:57.500883 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=bcc9940a15470476fed5ff31018edab0aaa99d21d8fbc073b085bf163a78fdb4 I0703 06:43:57.500895 1 gather.go:177] gatherer "clusterconfig" function "crds" took 51.188609ms to process 2 records I0703 06:43:57.500915 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0703 06:43:57.500932 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 28.979449ms to process 1 records I0703 06:43:57.500940 1 tasks_processing.go:74] worker 12 stopped. I0703 06:43:57.502567 1 base_controller.go:82] Caches are synced for ConfigController I0703 06:43:57.502580 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0703 06:43:57.512868 1 tasks_processing.go:74] worker 29 stopped. I0703 06:43:57.512986 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 41.55302ms to process 0 records I0703 06:43:57.513517 1 tasks_processing.go:74] worker 24 stopped. I0703 06:43:57.515070 1 recorder.go:70] Recording config/infrastructure with fingerprint=5616832819bf18b7fdea3eecf4229efeeb238896da1f72334a3091265639136d I0703 06:43:57.515154 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 44.291222ms to process 1 records I0703 06:43:57.515771 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=491e1891bf0076c82f277259a6521eb2711f9faaa14508608a560d0b476ad50d I0703 06:43:57.515803 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 41.070132ms to process 1 records I0703 06:43:57.515936 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=0efc0036f728a5976d9d3b91026f44791637216480882f0dd2f0379bc2836574 I0703 06:43:57.515990 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 43.635986ms to process 1 records I0703 06:43:57.516022 1 tasks_processing.go:74] worker 11 stopped. I0703 06:43:57.516033 1 tasks_processing.go:74] worker 13 stopped. I0703 06:43:57.516626 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 06:43:57.516948 1 tasks_processing.go:74] worker 9 stopped. I0703 06:43:57.517183 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=75011c021a55f0e3bb404f0a6fb67b33224f9a8cd06ab3249ca302fba1417c1a I0703 06:43:57.517214 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=e464476bc9fa37198f61af2f11bdca43e48412b7cdb826e4854467af555e3fb9 I0703 06:43:57.517228 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 24.952696ms to process 2 records I0703 06:43:57.518083 1 tasks_processing.go:74] worker 1 stopped. I0703 06:43:57.518828 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=c1afbb19c865bc8398cd8a357e21350b4592561c69d0b1938484e962ea3a63d4 I0703 06:43:57.518908 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 46.579233ms to process 1 records I0703 06:43:57.519064 1 tasks_processing.go:74] worker 31 stopped. I0703 06:43:57.519903 1 recorder.go:70] Recording config/authentication with fingerprint=474538fde3da5b1f1f06c0086040d81271418d8f8614bbb866978c01f805e3b9 I0703 06:43:57.519981 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 45.058617ms to process 1 records I0703 06:43:57.520524 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0703 06:43:57.520922 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0703 06:43:57.520985 1 recorder.go:70] Recording config/olm_operators with fingerprint=89adb07c725d1cd2b801e91feb9df4458ce1ddeca58b6caa12d45e05cbd32d5e I0703 06:43:57.521007 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 65.812152ms to process 1 records I0703 06:43:57.521202 1 tasks_processing.go:74] worker 30 stopped. I0703 06:43:57.521229 1 tasks_processing.go:74] worker 5 stopped. W0703 06:43:57.521403 1 operator.go:287] started I0703 06:43:57.521501 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0703 06:43:57.521777 1 recorder.go:70] Recording config/node/ip-10-0-0-219.ec2.internal with fingerprint=c5e032cc5fce404477602ee6edaf60fa8cbc5d86600ecfedf20dd4a94c23ff29 I0703 06:43:57.521924 1 recorder.go:70] Recording config/node/ip-10-0-1-166.ec2.internal with fingerprint=50a961aaa443e640198a5dc539461886fbeeb865e7ee22479ba34cd9cc68a16d I0703 06:43:57.522061 1 recorder.go:70] Recording config/node/ip-10-0-2-172.ec2.internal with fingerprint=6b7ce0193838988197ee1268adb18954f629ebdb5ba77ff5e0a89c62b6f2f5ef I0703 06:43:57.522080 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 51.036032ms to process 3 records I0703 06:43:57.522460 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=5a0c0c7a3b86e0f89f7c661858aa49829175a3c9d73fc4b7a18394fddfc53719 I0703 06:43:57.522494 1 tasks_processing.go:74] worker 20 stopped. I0703 06:43:57.522664 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=3a984b2d6c3291c8cf4cbe465812653f8facd51eae490c2fc25fe43620b6016e I0703 06:43:57.522712 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 50.851508ms to process 2 records I0703 06:43:57.522886 1 tasks_processing.go:74] worker 18 stopped. I0703 06:43:57.522901 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=95dc7f22a76545c282fef233a0832f6331b9219c1c16710329cd61e7395d1573 I0703 06:43:57.522974 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=421b475a7248ba959ea8d58d435881d8b86ba35fc47e770c06e951d412333d45 I0703 06:43:57.523008 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=f48faf38f59972f55210ac9a0947d43cebe483b6f04b0b4c15dc65ef6f8ac780 I0703 06:43:57.523035 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=d04075faa53610771cf9a2af375eb611fa9e17df5b8d3afee4b30e550c6b13ce I0703 06:43:57.523064 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=59f89353711541817de647be1c5d8be2ea84e74715d8bbc7eacf1ca522ef7996 I0703 06:43:57.523083 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=b008f074d1d201d22dd5e6ecbeb9286c60b6f4931ee3a01eee8928799b6faabd I0703 06:43:57.523106 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=2dc5a09af50c826d07c9b657d9f67b631710c8b330f2003112730af8612adabc I0703 06:43:57.523149 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=f4664b7404c76698bd01d95efb984228abaf4986eded5e38880aba1e0a7f552d I0703 06:43:57.523169 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=d755b0f50301de78b065f061e758956c1642158d318507e50aa1c5ec3dc554bf I0703 06:43:57.523191 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=3aaf4e8209fdc9c014f69bb43ca936059feddf020218bce37b7700e253363550 I0703 06:43:57.523221 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=9a50aec4937c8526e9597eeae952eeab9f95d551baf5fcffdc2767acf1f941aa I0703 06:43:57.523247 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 55.138727ms to process 11 records I0703 06:43:57.523260 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 75.989281ms to process 0 records I0703 06:43:57.523270 1 tasks_processing.go:74] worker 0 stopped. I0703 06:43:57.526784 1 tasks_processing.go:74] worker 26 stopped. I0703 06:43:57.526801 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=108780cb24f15bf572a4031966507398a0d0c6a28b3a008952f53b481dc191a9 I0703 06:43:57.526808 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 36.985769ms to process 1 records I0703 06:43:57.532635 1 controller.go:203] Source scaController *sca.Controller is not ready I0703 06:43:57.532651 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0703 06:43:57.532659 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0703 06:43:57.532664 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0703 06:43:57.532670 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0703 06:43:57.532693 1 controller.go:458] The operator is still being initialized I0703 06:43:57.532701 1 controller.go:481] The operator is healthy I0703 06:43:57.536514 1 tasks_processing.go:74] worker 2 stopped. I0703 06:43:57.538028 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-pcwtr with fingerprint=11491c11d35c1b802a1a69b6640d161a574a82deb5dcbdb2b0e1bf56bdc44751 I0703 06:43:57.538134 1 recorder.go:70] Recording config/running_containers with fingerprint=80dd2a2411576755bd00a0c516c1d581eec9f3b3941b31f0a83011c8f90a8f3b I0703 06:43:57.538147 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 89.550789ms to process 2 records I0703 06:43:57.540155 1 tasks_processing.go:74] worker 19 stopped. I0703 06:43:57.540168 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 73.08926ms to process 0 records I0703 06:43:57.543517 1 tasks_processing.go:74] worker 16 stopped. E0703 06:43:57.543531 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0703 06:43:57.543537 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ragcqil26o75rikag1kbunt6ncm3ure-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ragcqil26o75rikag1kbunt6ncm3ure-primary-cert-bundle-secret" not found I0703 06:43:57.543607 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=5124ba6a79deb11f96ed54fbcaa6c40f8ed0907f2428dc18322f46e76717d879 I0703 06:43:57.543628 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 96.561893ms to process 1 records I0703 06:43:57.561073 1 tasks_processing.go:74] worker 23 stopped. E0703 06:43:57.561092 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0703 06:43:57.561103 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0703 06:43:57.561108 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0703 06:43:57.561123 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I0703 06:43:57.561161 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0703 06:43:57.561171 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0703 06:43:57.561177 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I0703 06:43:57.561188 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0703 06:43:57.561224 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0703 06:43:57.561233 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0703 06:43:57.561239 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 88.350647ms to process 7 records I0703 06:43:57.569399 1 tasks_processing.go:74] worker 4 stopped. I0703 06:43:57.570013 1 recorder.go:70] Recording config/version with fingerprint=d6abb5c91c201fcb6210efb587d124e60848feaafb650aca56b9f2343a7498e8 I0703 06:43:57.570033 1 recorder.go:70] Recording config/id with fingerprint=22d3a76bdae8399956a9672c68c46f0f3de7207a8134243b83fb954cd4840931 I0703 06:43:57.570041 1 gather.go:177] gatherer "clusterconfig" function "version" took 100.253766ms to process 2 records I0703 06:43:57.592811 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0703 06:43:57.606504 1 cluster_transfer.go:102] no available accepted cluster transfer I0703 06:43:57.606519 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0703 06:43:57.621558 1 base_controller.go:82] Caches are synced for LoggingSyncer I0703 06:43:57.621578 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0703 06:43:57.640470 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7594d5db4f-hwfhp pod in namespace openshift-ingress (previous: false). I0703 06:43:57.679707 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7594d5db4f-nlrkg pod in namespace openshift-ingress (previous: false). I0703 06:43:57.722316 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-b7585c9f-fdgfk pod in namespace openshift-ingress (previous: false). I0703 06:43:57.742015 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-k5497 pod in namespace openshift-ingress-canary (previous: false). I0703 06:43:57.755508 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-nh2rd pod in namespace openshift-ingress-canary (previous: false). I0703 06:43:57.791736 1 sca.go:266] etc-pki-entitlement secret successfully created I0703 06:43:57.791845 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0703 06:43:57.906477 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-prkkl pod in namespace openshift-ingress-canary (previous: false). I0703 06:43:58.102891 1 tasks_processing.go:74] worker 27 stopped. I0703 06:43:58.103010 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=ecc09d8227e6666951f0370adf1679e49f35fdd392c888f8396aa5441bbe8304 I0703 06:43:58.103126 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=dbeac18ef589bd6cc9069755fe018f6b7d348880dda41ccecc9b426c41e2f854 I0703 06:43:58.103168 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=601097e833643ec074d75a3e936c8f766271e31fad0a2c11a173c411f7904c19 I0703 06:43:58.103215 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-7594d5db4f-bb9nk/router_current.log with fingerprint=b7a066f9d31c35f80f650c8d5d2a12ee7692e21291150b27192097f80764a7a8 I0703 06:43:58.103248 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-7594d5db4f-hwfhp/router_current.log with fingerprint=7a5052091ff51a94ceb7805037b850107c9da648d5ce50035835c6b371afb7ab I0703 06:43:58.103284 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-7594d5db4f-nlrkg/router_current.log with fingerprint=6113856f98249b8cc69a7b4016abc522704d78b5b23d09a62fb6ab773f2d99a1 I0703 06:43:58.103340 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-b7585c9f-fdgfk/router_current.log with fingerprint=259ca4a6ce65afc73fc9b422dceb8a3ce051372a79bc620aff82ca973ec3f522 I0703 06:43:58.103348 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-k5497/serve-healthcheck-canary_current.log with fingerprint=ff8e69d4d6dcf1b180e54f9443e7e576d660bab90d896dc707a07614fca0d33f I0703 06:43:58.103353 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-nh2rd/serve-healthcheck-canary_current.log with fingerprint=c35dbd3b17efbfc1cbe5942d4d1f33c77b57449e7cbfcbc335f3735ab4289b93 I0703 06:43:58.103358 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-prkkl/serve-healthcheck-canary_current.log with fingerprint=d2a0c8de0b71874b7ac3fdcf5e700fbc2197ee3f25fbcffe4d17f8c497304565 I0703 06:43:58.103364 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 653.524353ms to process 10 records I0703 06:43:58.330175 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0703 06:43:58.518062 1 tasks_processing.go:74] worker 3 stopped. I0703 06:43:58.518088 1 recorder.go:70] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0703 06:43:58.518101 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.069713324s to process 1 records I0703 06:43:58.518161 1 tasks_processing.go:74] worker 28 stopped. I0703 06:43:58.518201 1 recorder.go:70] Recording config/alerts with fingerprint=f5f0471f2cfa3af514f63750dcf82cd670a5ac4c57c581113e2f8175c7850a71 I0703 06:43:58.518215 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.071215568s to process 1 records I0703 06:43:58.529971 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0703 06:43:59.333124 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0703 06:43:59.935881 1 tasks_processing.go:74] worker 8 stopped. I0703 06:43:59.935965 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=a6d58cefb26797096b34eefa42fba798184894a495d050a59d24ae8c68965f79 I0703 06:43:59.936030 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0703 06:43:59.936071 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=0441a7bbefa4fd0273dc4fda980a02621aa791fc2297550dc6dcb43b2cd33e49 I0703 06:43:59.936088 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0703 06:43:59.936121 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=8c6f8cc7fecf88864c9d3c9c332d67f2fc8239f1fcb40286f7f6578d4db9e88d I0703 06:43:59.936150 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0703 06:43:59.936186 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=933992f5057e88de603ec1ca71272d8221081c3c2191799c5afaccdb0709a210 I0703 06:43:59.936230 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=b66918164a32b29393dd827916b96ac9bbefe92c20e8de29bd444e8a98e5b036 I0703 06:43:59.936318 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=feeee1782a3ed56aadd8c654716f03cf6c3586228d47d6fb8ec06d193c1f6473 I0703 06:43:59.936371 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=7623d8052373376fd32a627a3bc705353e4836e7f4562da69ca2007af6a059f5 I0703 06:43:59.936670 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=0fad56f08540265ad8a4a4f055affb5dc364cadf9bef791b7b6d56dd4641595f I0703 06:43:59.936704 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=f1f9c4ed37fa8c7418f3698063eb2da95b85fdd183a07a9cd0bb78a6dce30972 I0703 06:43:59.936720 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0703 06:43:59.936747 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=8891c7a93da7f4841a226552e28192e0ce0bf48fc301b30d9f14665d470bd2f3 I0703 06:43:59.936765 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0703 06:43:59.936790 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=ceabe4e2a5166c6363e4a558405cf05c4e34bf0805f8cbcac4ce204d4f6d546e I0703 06:43:59.936806 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0703 06:43:59.936836 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=60922009afe10de651425d40c3ce2d0b65fcf9bc50fcdfb2cc01b68e938e0dae I0703 06:43:59.936853 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0703 06:43:59.936882 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=4b194dff4437a93facaf6db4845458d9c07d0e536cd1c3f792cbc3cefe94fcd9 I0703 06:43:59.936992 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=fa090480b6cc33c6ec3b6c8245b85335c6a2596190e1d1e02106430e718a7c8b I0703 06:43:59.937027 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0703 06:43:59.937059 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=ec97f095462156c86e9fbf5783bdfb81d23775c85f4fdad257d01928b75903a7 I0703 06:43:59.937095 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=4ee2cc8dc91445823fbc6d991ddad46d15a5f8b6e3e58f99073e0b01e2628b0a I0703 06:43:59.937112 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0703 06:43:59.937139 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=563362fa7e5ff8b8be8b2d790fbbec4c4da83b5bb93f79211661c7b7751388ea I0703 06:43:59.937155 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0703 06:43:59.937178 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=1658bae0954f48af07827ce76b94b6bee598b6305527690af0f4e0808ccf5952 I0703 06:43:59.937203 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=c52cdfb2435bbd0a377e1996999325bc41b4fb99f08a8fcb4ee6697d249db97e I0703 06:43:59.937237 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=cbd6970b5f3f4ed57ba4e1b7f9ade5ce5c46697192eed761aeb23a7c82606197 I0703 06:43:59.937266 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=b736d9ee2879e44679b961da6bc0e6b5e30026909f62e724f279000c527951b6 I0703 06:43:59.937314 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=4d307988d276b7e869294b1e0e8ebf7991a44f1d09655acfa0e4c183054ca2a5 I0703 06:43:59.937334 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0703 06:43:59.937373 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=81a68d9510c965e0029e3a2e3ce6d5fd972e0ffdb71f521ac52407eb654874cc I0703 06:43:59.937404 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0703 06:43:59.937423 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0703 06:43:59.937439 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.478591001s to process 36 records I0703 06:44:10.510034 1 tasks_processing.go:74] worker 6 stopped. I0703 06:44:10.510336 1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0703 06:44:10.510371 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.03800296s to process 1 records I0703 06:44:11.258858 1 tasks_processing.go:74] worker 10 stopped. I0703 06:44:11.259182 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=dabcdda6991bac1666e8c7d62a42c20e4eacf733a346e4ee546090403d855ed3 I0703 06:44:11.259208 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.809870922s to process 1 records E0703 06:44:11.259283 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.812s with: function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"metrics\" failed with an error, function \"tsdb_status\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error" I0703 06:44:11.260413 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "metrics" failed with an error, function "tsdb_status" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error I0703 06:44:11.260430 1 periodic.go:212] Running workloads gatherer I0703 06:44:11.260445 1 tasks_processing.go:45] number of workers: 2 I0703 06:44:11.260454 1 tasks_processing.go:69] worker 1 listening for tasks. I0703 06:44:11.260458 1 tasks_processing.go:71] worker 1 working on workload_info task. I0703 06:44:11.260471 1 tasks_processing.go:69] worker 0 listening for tasks. I0703 06:44:11.260546 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0703 06:44:11.269929 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-219.ec2.internal... I0703 06:44:11.269939 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-172.ec2.internal... I0703 06:44:11.269931 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-166.ec2.internal... I0703 06:44:11.297942 1 tasks_processing.go:74] worker 0 stopped. I0703 06:44:11.297964 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 37.370193ms to process 0 records I0703 06:44:16.296203 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 5s I0703 06:44:16.323696 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 24s for image data I0703 06:44:16.334128 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (12ms) I0703 06:44:16.346150 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (12ms) I0703 06:44:16.357134 1 gather_workloads_info.go:387] No image sha256:929a4a9c96a08b57fe4c315deca55c30d1990c83e34b8b5692f7646d29f715c8 (11ms) I0703 06:44:16.368058 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (11ms) I0703 06:44:16.379278 1 gather_workloads_info.go:387] No image sha256:1f2aa1e1026570162984f7fbb634635bcf319e408cafa8f9034ee842a2f193ab (11ms) I0703 06:44:16.390535 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (11ms) I0703 06:44:16.402014 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (11ms) I0703 06:44:16.413975 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (12ms) I0703 06:44:16.424976 1 gather_workloads_info.go:387] No image sha256:e40bbab1e52f580ab471bd7ab19ae23a4bcbaf1893243a05238af6bede7ba9cc (11ms) I0703 06:44:16.436267 1 gather_workloads_info.go:387] No image sha256:38dd36da63b1f01316a02daf6c18b821318c6ec313712147292d74abf955e0da (11ms) I0703 06:44:16.447157 1 gather_workloads_info.go:387] No image sha256:5cba745f09f3bd6b8028c6773597cbb30bf3639a84f2b4b6493fe20642339a2c (11ms) I0703 06:44:16.535467 1 gather_workloads_info.go:387] No image sha256:1d471ad866b8564b209214d7dd3a7363c47e9535211d660b63b46abb278af7ab (88ms) I0703 06:44:16.635214 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (100ms) I0703 06:44:16.738520 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (103ms) I0703 06:44:16.836129 1 gather_workloads_info.go:387] No image sha256:bcca5c17371caa2dce7e28da4c9fe30163c340fa172187f94db90ea1bd6ab80d (98ms) I0703 06:44:16.934949 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (99ms) I0703 06:44:17.035898 1 gather_workloads_info.go:387] No image sha256:6c3c7f77d7a3815bbb69cad5f6f1742c17d9597bc135ba3d116c9736d98fae33 (101ms) I0703 06:44:17.137801 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (102ms) I0703 06:44:17.236998 1 gather_workloads_info.go:387] No image sha256:6277dac65decba0ea094146bb99600f479eaf804696842e724de1f1b436f9a38 (99ms) I0703 06:44:17.335138 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (98ms) I0703 06:44:17.435545 1 gather_workloads_info.go:387] No image sha256:799f5628c18e77a49c08645c03179046b5200c8cbcfd65737fb59668132f393e (100ms) I0703 06:44:17.536791 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (101ms) I0703 06:44:17.634830 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (98ms) I0703 06:44:17.735633 1 gather_workloads_info.go:398] Found image sha256:59db91eadf1e1e5343777be43ff25fb712f300f9341be48ba05f45270944536f (101ms) I0703 06:44:17.835628 1 gather_workloads_info.go:387] No image sha256:ce3d8211c0bde5788a4fd04c3eff31ae591437ceab2b3168dbbdfe408673c8b1 (100ms) I0703 06:44:17.938343 1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (103ms) I0703 06:44:18.034647 1 gather_workloads_info.go:398] Found image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (96ms) I0703 06:44:18.136258 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (102ms) I0703 06:44:18.235756 1 gather_workloads_info.go:387] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (99ms) I0703 06:44:18.335437 1 gather_workloads_info.go:387] No image sha256:68d8e92046969bcfcbca2d2b3dcf4dcad5f6edc5fcb44861eb22f8079a43ea4d (100ms) I0703 06:44:18.438778 1 gather_workloads_info.go:387] No image sha256:039479f355d6903e1018abf8427fece3465c4348d4de2144ec38114b51bec27e (103ms) I0703 06:44:18.535450 1 gather_workloads_info.go:387] No image sha256:7854174b4b98e9b10d9c8e9b43113df1217ab21db4b2395d9399af0c3d7911a3 (97ms) I0703 06:44:18.635455 1 gather_workloads_info.go:387] No image sha256:46c2c396ca651699738c3f26b79b10af2922123dd27c2e32382d2a31a87e92c7 (100ms) I0703 06:44:18.735191 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (100ms) I0703 06:44:18.835276 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (100ms) I0703 06:44:18.934630 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (99ms) I0703 06:44:19.035101 1 gather_workloads_info.go:387] No image sha256:527ed405bf66234718321996dacf51f91c64c746de9f1509416ef6ce89c90a50 (100ms) I0703 06:44:19.137202 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (102ms) I0703 06:44:19.235089 1 gather_workloads_info.go:387] No image sha256:00f977c2275f5bf03d423911159a39ca44fabc1862ecb7ae492198ec8c46c6bb (98ms) I0703 06:44:19.334373 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (99ms) I0703 06:44:19.435251 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (101ms) I0703 06:44:19.534438 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (99ms) I0703 06:44:19.635423 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (101ms) I0703 06:44:19.735158 1 gather_workloads_info.go:387] No image sha256:1cc2f3c83068c8c67d9070f67677e1bb6b4feff7ac5744cad08711893e56b55f (100ms) I0703 06:44:19.838183 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (103ms) I0703 06:44:19.935243 1 gather_workloads_info.go:387] No image sha256:a3d34d8f38a540ce79d34a5248b1965346155497db57b72cb4758d659418059c (97ms) I0703 06:44:19.935276 1 tasks_processing.go:74] worker 1 stopped. E0703 06:44:19.935308 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: received unexpected status code 500 Internal Server Error from https://10.130.0.13:8443/gather_runtime_info I0703 06:44:19.935643 1 recorder.go:70] Recording config/workload_info with fingerprint=c62584138f6e2907dada8531c808ce1c22bf2c266c10a2ccbddf5c81b7fd2546 I0703 06:44:19.935661 1 gather.go:177] gatherer "workloads" function "workload_info" took 8.674811135s to process 1 records E0703 06:44:19.935684 1 periodic.go:250] "Unhandled Error" err="workloads failed after 8.675s with: function \"workload_info\" failed with an error" I0703 06:44:19.936784 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0703 06:44:19.936799 1 periodic.go:212] Running conditional gatherer I0703 06:44:19.947165 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I0703 06:44:20.002831 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer I0703 06:44:21.060398 1 conditional_gatherer.go:372] alert "ClusterMonitoringOperatorReconciliationErrors" has state "pending" I0703 06:44:21.060521 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0703 06:44:21.072469 1 conditional_gatherer.go:390] cluster version is '4.19.9' I0703 06:44:21.072501 1 tasks_processing.go:45] number of workers: 3 I0703 06:44:21.072513 1 tasks_processing.go:69] worker 2 listening for tasks. I0703 06:44:21.072518 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0703 06:44:21.072526 1 tasks_processing.go:69] worker 0 listening for tasks. I0703 06:44:21.072543 1 tasks_processing.go:69] worker 1 listening for tasks. I0703 06:44:21.072604 1 tasks_processing.go:71] worker 1 working on conditional_gatherer_rules task. I0703 06:44:21.072614 1 tasks_processing.go:74] worker 1 stopped. I0703 06:44:21.072625 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0703 06:44:21.072708 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0703 06:44:21.072724 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.349µs to process 1 records I0703 06:44:21.072759 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0703 06:44:21.072768 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 2.147µs to process 1 records I0703 06:44:21.072774 1 tasks_processing.go:74] worker 0 stopped. I0703 06:44:21.072848 1 tasks_processing.go:74] worker 2 stopped. I0703 06:44:21.072863 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 323.572µs to process 0 records I0703 06:44:21.072884 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I0703 06:44:21.072910 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0703 06:44:21.101986 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=943ce26d5a32aad1e2b81e29cdd3414c90bf3f5378158755010547dc6e197429 I0703 06:44:21.102141 1 diskrecorder.go:70] Writing 118 records to /var/lib/insights-operator/insights-2026-07-03-064421.tar.gz I0703 06:44:21.109777 1 diskrecorder.go:51] Wrote 118 records to disk in 7ms I0703 06:44:21.109811 1 periodic.go:281] Gathering cluster info every 2h0m0s I0703 06:44:21.109833 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0703 06:45:27.447393 1 diskrecorder.go:223] Found files to send: insights-2026-07-03-064421.tar.gz I0703 06:45:27.447423 1 insightsuploader.go:150] Checking archives to upload periodically every 15m41.502940766s I0703 06:45:27.447431 1 insightsuploader.go:165] Uploading latest report since 2026-07-03T06:43:51Z I0703 06:45:27.463619 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0703 06:45:27.575404 1 requests.go:87] Successfully reported id=2026-07-03T06:45:27Z x-rh-insights-request-id=19ee4362fae14718a294982884c16ee1, wrote=59089 I0703 06:45:27.575528 1 insightsuploader.go:187] Uploaded report successfully in 128.088062ms I0703 06:45:27.575575 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0703 06:45:27.575598 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0703 06:45:27.575608 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0703 06:45:27.583496 1 controller.go:481] The operator is healthy I0703 06:45:57.529376 1 controller.go:481] The operator is healthy I0703 06:46:27.799781 1 insightsreport.go:137] Pulling report from smart-proxy I0703 06:46:27.799804 1 insightsreport.go:149] Retrieving report I0703 06:46:27.811506 1 requests.go:110] Retrieving report for cluster: e2d7d320-8944-4bf9-bb4a-7031596b1886 I0703 06:46:27.811522 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/e2d7d320-8944-4bf9-bb4a-7031596b1886/reports I0703 06:46:27.814568 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/e2d7d320-8944-4bf9-bb4a-7031596b1886/reports I0703 06:46:27.949359 1 insightsreport.go:184] Report retrieved I0703 06:46:27.998011 1 insightsreport.go:239] Report retrieved correctly I0703 06:47:57.531319 1 controller.go:481] The operator is healthy I0703 06:48:57.436452 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 06:48:57.443884 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 06:48:57.443911 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 06:48:57.450925 1 secretconfigobserver.go:119] support secret does not exist I0703 06:49:57.529787 1 controller.go:481] The operator is healthy I0703 06:51:57.532601 1 controller.go:481] The operator is healthy I0703 06:53:57.423723 1 configmapobserver.go:84] configmaps "insights-config" not found I0703 06:53:57.451800 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 06:53:57.459115 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 06:53:57.459136 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 06:53:57.465278 1 secretconfigobserver.go:119] support secret does not exist I0703 06:53:57.528193 1 controller.go:481] The operator is healthy I0703 06:55:57.528761 1 controller.go:481] The operator is healthy I0703 06:57:57.529937 1 controller.go:481] The operator is healthy I0703 06:58:57.465833 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0703 06:58:57.475803 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0703 06:58:57.475825 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0703 06:58:57.483500 1 secretconfigobserver.go:119] support secret does not exist I0703 06:59:57.534170 1 controller.go:481] The operator is healthy