I0702 02:19:02.802287       1 cmd.go:253] Using service-serving-cert provided certificates
I0702 02:19:02.802887       1 observer_polling.go:159] Starting file observer
W0702 02:19:02.823379       1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights"
I0702 02:19:03.052385       1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$
I0702 02:19:03.052605       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0702 02:19:03.053175       1 secure_serving.go:57] Forcing use of http/1.1 only
W0702 02:19:03.053199       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0702 02:19:03.053206       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0702 02:19:03.053212       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
W0702 02:19:03.053217       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
I0702 02:19:03.053212       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
W0702 02:19:03.053221       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
W0702 02:19:03.053262       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0702 02:19:03.056760       1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot]
I0702 02:19:03.056763       1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}}
I0702 02:19:03.057763       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0702 02:19:03.057779       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0702 02:19:03.057779       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0702 02:19:03.057796       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0702 02:19:03.057800       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0702 02:19:03.057813       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0702 02:19:03.058110       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key"
I0702 02:19:03.058374       1 secure_serving.go:213] Serving securely on [::]:8443
I0702 02:19:03.058410       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
E0702 02:19:03.059624       1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18be5787c11233ff  openshift-insights    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-02 02:19:03.056692223 +0000 UTC m=+0.291435413,LastTimestamp:2026-07-02 02:19:03.056692223 +0000 UTC m=+0.291435413,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}"
W0702 02:19:03.062768       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0702 02:19:03.062805       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0702 02:19:03.062892       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0702 02:19:03.067123       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0702 02:19:03.067147       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0702 02:19:03.071014       1 secretconfigobserver.go:119] support secret does not exist
I0702 02:19:03.074698       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0702 02:19:03.078394       1 secretconfigobserver.go:119] support secret does not exist
I0702 02:19:03.081189       1 recorder.go:156] Pruning old reports every 4h47m47s, max age is 288h0m0s
I0702 02:19:03.085233       1 periodic.go:212] Running clusterconfig gatherer
I0702 02:19:03.085238       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0702 02:19:03.085253       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s
I0702 02:19:03.085270       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0702 02:19:03.085275       1 insightsreport.go:296] Starting report retriever
I0702 02:19:03.085275       1 tasks_processing.go:45] number of workers: 32
I0702 02:19:03.085280       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0702 02:19:03.085294       1 tasks_processing.go:69] worker 2 listening for tasks.
I0702 02:19:03.085296       1 tasks_processing.go:69] worker 3 listening for tasks.
I0702 02:19:03.085295       1 tasks_processing.go:69] worker 1 listening for tasks.
I0702 02:19:03.085303       1 tasks_processing.go:69] worker 11 listening for tasks.
I0702 02:19:03.085304       1 tasks_processing.go:69] worker 0 listening for tasks.
I0702 02:19:03.085308       1 tasks_processing.go:69] worker 8 listening for tasks.
I0702 02:19:03.085315       1 tasks_processing.go:69] worker 9 listening for tasks.
I0702 02:19:03.085317       1 tasks_processing.go:69] worker 10 listening for tasks.
I0702 02:19:03.085319       1 tasks_processing.go:71] worker 8 working on storage_cluster task.
I0702 02:19:03.085317       1 tasks_processing.go:69] worker 5 listening for tasks.
I0702 02:19:03.085324       1 tasks_processing.go:69] worker 4 listening for tasks.
I0702 02:19:03.085327       1 tasks_processing.go:71] worker 10 working on storage_classes task.
I0702 02:19:03.085322       1 tasks_processing.go:71] worker 9 working on support_secret task.
I0702 02:19:03.085335       1 tasks_processing.go:69] worker 7 listening for tasks.
I0702 02:19:03.085345       1 tasks_processing.go:69] worker 6 listening for tasks.
I0702 02:19:03.085352       1 tasks_processing.go:69] worker 24 listening for tasks.
I0702 02:19:03.085361       1 tasks_processing.go:69] worker 30 listening for tasks.
I0702 02:19:03.085361       1 tasks_processing.go:69] worker 17 listening for tasks.
I0702 02:19:03.085366       1 tasks_processing.go:69] worker 18 listening for tasks.
I0702 02:19:03.085371       1 tasks_processing.go:69] worker 12 listening for tasks.
I0702 02:19:03.085375       1 tasks_processing.go:69] worker 25 listening for tasks.
I0702 02:19:03.085376       1 tasks_processing.go:69] worker 19 listening for tasks.
I0702 02:19:03.085383       1 tasks_processing.go:69] worker 13 listening for tasks.
I0702 02:19:03.085385       1 tasks_processing.go:69] worker 20 listening for tasks.
I0702 02:19:03.085386       1 tasks_processing.go:69] worker 26 listening for tasks.
I0702 02:19:03.085393       1 tasks_processing.go:69] worker 27 listening for tasks.
I0702 02:19:03.085394       1 tasks_processing.go:69] worker 14 listening for tasks.
I0702 02:19:03.085397       1 tasks_processing.go:69] worker 21 listening for tasks.
I0702 02:19:03.085400       1 tasks_processing.go:69] worker 15 listening for tasks.
I0702 02:19:03.085404       1 tasks_processing.go:69] worker 28 listening for tasks.
I0702 02:19:03.085406       1 tasks_processing.go:69] worker 22 listening for tasks.
I0702 02:19:03.085411       1 tasks_processing.go:69] worker 16 listening for tasks.
I0702 02:19:03.085412       1 tasks_processing.go:69] worker 23 listening for tasks.
I0702 02:19:03.085414       1 tasks_processing.go:71] worker 3 working on networks task.
I0702 02:19:03.085414       1 tasks_processing.go:69] worker 29 listening for tasks.
I0702 02:19:03.085419       1 tasks_processing.go:71] worker 11 working on machine_sets task.
I0702 02:19:03.085422       1 tasks_processing.go:69] worker 31 listening for tasks.
I0702 02:19:03.085422       1 tasks_processing.go:71] worker 1 working on ingress task.
I0702 02:19:03.085428       1 tasks_processing.go:71] worker 0 working on machines task.
I0702 02:19:03.085495       1 tasks_processing.go:71] worker 2 working on ingress_certificates task.
I0702 02:19:03.085705       1 tasks_processing.go:71] worker 31 working on validating_webhook_configurations task.
I0702 02:19:03.085716       1 tasks_processing.go:71] worker 5 working on openshift_logging task.
I0702 02:19:03.085766       1 tasks_processing.go:71] worker 13 working on cluster_apiserver task.
I0702 02:19:03.085927       1 tasks_processing.go:71] worker 4 working on silenced_alerts task.
I0702 02:19:03.085977       1 tasks_processing.go:71] worker 15 working on crds task.
I0702 02:19:03.086017       1 tasks_processing.go:71] worker 17 working on overlapping_namespace_uids task.
I0702 02:19:03.086057       1 tasks_processing.go:71] worker 20 working on install_plans task.
I0702 02:19:03.086080       1 tasks_processing.go:71] worker 12 working on mutating_webhook_configurations task.
I0702 02:19:03.086125       1 tasks_processing.go:71] worker 6 working on clusterroles task.
I0702 02:19:03.086260       1 tasks_processing.go:71] worker 28 working on machine_configs task.
I0702 02:19:03.086493       1 tasks_processing.go:71] worker 24 working on jaegers task.
I0702 02:19:03.086522       1 tasks_processing.go:71] worker 18 working on node_logs task.
I0702 02:19:03.086568       1 tasks_processing.go:71] worker 26 working on lokistack task.
I0702 02:19:03.086594       1 tasks_processing.go:71] worker 25 working on aggregated_monitoring_cr_names task.
I0702 02:19:03.086622       1 tasks_processing.go:71] worker 7 working on config_maps task.
I0702 02:19:03.086638       1 tasks_processing.go:71] worker 30 working on olm_operators task.
I0702 02:19:03.086744       1 tasks_processing.go:71] worker 27 working on machine_config_pools task.
I0702 02:19:03.086757       1 tasks_processing.go:71] worker 19 working on nodenetworkstates task.
I0702 02:19:03.086826       1 tasks_processing.go:71] worker 16 working on container_images task.
I0702 02:19:03.087054       1 tasks_processing.go:71] worker 23 working on pod_network_connectivity_checks task.
I0702 02:19:03.087203       1 tasks_processing.go:71] worker 22 working on nodenetworkconfigurationpolicies task.
I0702 02:19:03.087223       1 tasks_processing.go:71] worker 29 working on container_runtime_configs task.
I0702 02:19:03.087359       1 tasks_processing.go:71] worker 14 working on dvo_metrics task.
I0702 02:19:03.087396       1 tasks_processing.go:71] worker 21 working on image task.
I0702 02:19:03.088013       1 tasks_processing.go:71] worker 8 working on schedulers task.
I0702 02:19:03.088026       1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 2.664638ms to process 0 records
I0702 02:19:03.090927       1 tasks_processing.go:71] worker 11 working on tsdb_status task.
I0702 02:19:03.090954       1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 5.500394ms to process 0 records
E0702 02:19:03.093296       1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.118.128:9091: connect: connection refused
I0702 02:19:03.093315       1 tasks_processing.go:71] worker 11 working on ceph_cluster task.
E0702 02:19:03.093330       1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.118.128:9091: connect: connection refused
I0702 02:19:03.093356       1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 2.373855ms to process 0 records
I0702 02:19:03.096304       1 tasks_processing.go:71] worker 0 working on openstack_controlplanes task.
E0702 02:19:03.096315       1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope
I0702 02:19:03.096324       1 gather.go:177] gatherer "clusterconfig" function "machines" took 10.863557ms to process 0 records
I0702 02:19:03.097979       1 tasks_processing.go:71] worker 5 working on sap_pods task.
I0702 02:19:03.098085       1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 12.248238ms to process 0 records
I0702 02:19:03.099476       1 tasks_processing.go:71] worker 9 working on machine_healthchecks task.
E0702 02:19:03.099565       1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found
I0702 02:19:03.099592       1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 14.137107ms to process 0 records
I0702 02:19:03.099829       1 tasks_processing.go:71] worker 1 working on pdbs task.
I0702 02:19:03.100422       1 recorder.go:70] Recording config/ingress with fingerprint=dbf7838fd76b57b30d5e762a0d8fa0d02e0cec0eff1d6eb122fa7608a804c003
I0702 02:19:03.100503       1 gather.go:177] gatherer "clusterconfig" function "ingress" took 14.356181ms to process 1 records
I0702 02:19:03.100530       1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 13.765062ms to process 0 records
I0702 02:19:03.100539       1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 13.900324ms to process 0 records
I0702 02:19:03.100548       1 tasks_processing.go:71] worker 26 working on active_alerts task.
I0702 02:19:03.100600       1 tasks_processing.go:71] worker 18 working on authentication task.
I0702 02:19:03.100642       1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z
I0702 02:19:03.100719       1 tasks_processing.go:71] worker 10 working on oauths task.
I0702 02:19:03.100775       1 controller.go:317] The initial operator extension status is healthy
I0702 02:19:03.100790       1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0702 02:19:03.101190       1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=853d2eb25260fa88c0598c2533530a559b39562b841b613cc06aff4fa17e69b1
I0702 02:19:03.101262       1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=d18f3339ab8eb23adac177d7a6cc98aac0ebe6043fe42fe8fd4552a0bc3025c1
I0702 02:19:03.101295       1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 15.381704ms to process 2 records
I0702 02:19:03.101381       1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready
I0702 02:19:03.101413       1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready
I0702 02:19:03.101445       1 controller.go:458] The operator is still being initialized
I0702 02:19:03.101453       1 controller.go:481] The operator is healthy
I0702 02:19:03.101472       1 tasks_processing.go:71] worker 3 working on certificate_signing_requests task.
I0702 02:19:03.101540       1 recorder.go:70] Recording config/network with fingerprint=53b1e77742e64cf642d226a4aa6d8c8e9d1471f72cad61d4cb1a4ad76726e185
I0702 02:19:03.101558       1 gather.go:177] gatherer "clusterconfig" function "networks" took 15.882033ms to process 1 records
I0702 02:19:03.101616       1 tasks_processing.go:71] worker 23 working on metrics task.
I0702 02:19:03.101702       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
W0702 02:19:03.101751       1 operator.go:287] started
I0702 02:19:03.101814       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
I0702 02:19:03.101848       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
E0702 02:19:03.101955       1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io)
I0702 02:19:03.101974       1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 14.541307ms to process 0 records
I0702 02:19:03.101985       1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 15.154735ms to process 0 records
I0702 02:19:03.102065       1 tasks_processing.go:71] worker 24 working on openstack_dataplanenodesets task.
I0702 02:19:03.102328       1 tasks_processing.go:71] worker 13 working on infrastructures task.
I0702 02:19:03.102601       1 recorder.go:70] Recording config/apiserver with fingerprint=17faaa08d4181df1aa2cdefe6a27d667caa2ce3b4e8ce9a5038859c2d6471b41
I0702 02:19:03.102626       1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 16.549608ms to process 1 records
I0702 02:19:03.102636       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 15.106323ms to process 0 records
I0702 02:19:03.102645       1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 6.034797ms to process 0 records
I0702 02:19:03.102652       1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 15.203256ms to process 0 records
I0702 02:19:03.102658       1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 15.685487ms to process 0 records
I0702 02:19:03.102665       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 15.683485ms to process 0 records
I0702 02:19:03.102934       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=682f7758c8baeb0277d6ae9b889be281ead0010dbc43d902824c93bc3c5e0a37
I0702 02:19:03.103061       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=af426bff0ece4e1df8f7614979b098711ad77e47dd1546950028fa15f2135e9e
I0702 02:19:03.103152       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=421f5aa5e7e6b791d7d3f9a8866425f904d306e30f74f33fd5414b4cf6ea6ebe
I0702 02:19:03.103201       1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 16.499503ms to process 3 records
I0702 02:19:03.103229       1 tasks_processing.go:71] worker 29 working on machine_autoscalers task.
I0702 02:19:03.103364       1 tasks_processing.go:71] worker 0 working on service_accounts task.
I0702 02:19:03.103237       1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 9.365059ms to process 0 records
I0702 02:19:03.103667       1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=9d91eec37f7da65d07ae83f58cf3853982bfdffb7d9e59b02cf61794f68616ba
I0702 02:19:03.103435       1 tasks_processing.go:71] worker 19 working on operators_pods_and_events task.
I0702 02:19:03.103824       1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=99b91cbf9a63bcad5206c81bce8c96ffdca094d4a5fe9a0ce1127d08524c7fcf
I0702 02:19:03.103965       1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=4fb8bf3d771fd1df089afafab069a632af1979acb7257b6a05ee30f4ea7952fe
I0702 02:19:03.104028       1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=ed6e20fd23101959b140fe49d762a9a8b82d0c20d3b310c896e07b44966d8b34
I0702 02:19:03.104069       1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=5466a4094e4eff126b720870edbbb969118b6a38fbe9fbfc04a1d39e221c6098
I0702 02:19:03.104136       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=a8b35a1dbc58d0623b620b606fbcbdffa5222e894a8f1dd17036e2f959fc6851
I0702 02:19:03.104199       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=67e8d8fcc84219678b1f382e99b81c2317d3ab3563d2fa7417f7207de7dfa2fa
I0702 02:19:03.104254       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=b921853cc1d8c3e5192b1ffd611cb52842f3920e7eccf656da2dba0f12019b8e
I0702 02:19:03.103448       1 tasks_processing.go:71] worker 27 working on openstack_dataplanedeployments task.
I0702 02:19:03.103455       1 tasks_processing.go:71] worker 12 working on feature_gates task.
I0702 02:19:03.103462       1 tasks_processing.go:71] worker 22 working on proxies task.
I0702 02:19:03.104317       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=75bd73cef6c7e73828d87b0422357d9d0b1dfadbf5b3a73f1e46e59476c0242f
E0702 02:19:03.104863       1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.118.128:9091: connect: connection refused
I0702 02:19:03.105240       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=7cf156e3440e49098bec16c75e72aaa571571254e798730e6432c1080edad519
I0702 02:19:03.104324       1 tasks_processing.go:71] worker 31 working on cost_management_metrics_configs task.
I0702 02:19:03.105392       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=db44022ab6b85b7e50c480f8d0a7bcebea9064855403f02a853ddd3a231925f4
I0702 02:19:03.105507       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=60801c13f7a01eba5187bf25a4c4272960db606b248862195375aacad6dc4d0e
I0702 02:19:03.103441       1 tasks_processing.go:71] worker 11 working on sap_config task.
I0702 02:19:03.105803       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=586871bfbefa4c8a9d0e438d65922657ce70083f122852b41c39632ee90ccfba
I0702 02:19:03.105858       1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 17.146114ms to process 13 records
I0702 02:19:03.105920       1 tasks_processing.go:71] worker 21 working on number_of_pods_and_netnamespaces_with_sdn_annotations task.
I0702 02:19:03.106095       1 recorder.go:70] Recording config/image with fingerprint=520ee8a9255128e400c98d96d5e455741212413691dbc24527517bfc63fd5aaf
I0702 02:19:03.106113       1 gather.go:177] gatherer "clusterconfig" function "image" took 15.706292ms to process 1 records
I0702 02:19:03.106128       1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 5.168985ms to process 0 records
E0702 02:19:03.106137       1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io)
I0702 02:19:03.106160       1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499
I0702 02:19:03.106176       1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 16.966673ms to process 1 records
I0702 02:19:03.106204       1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
I0702 02:19:03.106217       1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 18.363606ms to process 1 records
I0702 02:19:03.106343       1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=1c776fbe13c8b65e23f66d6432ac4b4cbe3888308f42ad0335e1d90ccf5fe667
I0702 02:19:03.106359       1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 16.717385ms to process 1 records
E0702 02:19:03.106367       1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.118.128:9091: connect: connection refused
I0702 02:19:03.106404       1 gather.go:177] gatherer "clusterconfig" function "metrics" took 3.509372ms to process 0 records
I0702 02:19:03.106464       1 tasks_processing.go:71] worker 23 working on image_registries task.
I0702 02:19:03.106533       1 tasks_processing.go:71] worker 9 working on operators task.
E0702 02:19:03.106880       1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope
I0702 02:19:03.106901       1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 7.040006ms to process 0 records
W0702 02:19:03.106954       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0702 02:19:03.107079       1 tasks_processing.go:71] worker 5 working on nodes task.
I0702 02:19:03.107173       1 tasks_processing.go:71] worker 28 working on openshift_machine_api_events task.
I0702 02:19:03.107391       1 tasks_processing.go:71] worker 17 working on version task.
I0702 02:19:03.107661       1 tasks_processing.go:71] worker 8 working on image_pruners task.
I0702 02:19:03.121193       1 tasks_processing.go:71] worker 24 working on openstack_version task.
I0702 02:19:03.121226       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 19.11733ms to process 0 records
I0702 02:19:03.121586       1 tasks_processing.go:71] worker 10 working on monitoring_persistent_volumes task.
I0702 02:19:03.122170       1 recorder.go:70] Recording config/oauth with fingerprint=b2b3aadfe03dca04e10507ca67084b9015fcf104358044746cc9fbefa1eb6203
I0702 02:19:03.122189       1 gather.go:177] gatherer "clusterconfig" function "oauths" took 20.82386ms to process 1 records
I0702 02:19:03.122254       1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready
I0702 02:19:03.122308       1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0702 02:19:03.122321       1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready
I0702 02:19:03.122327       1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready
I0702 02:19:03.122335       1 controller.go:203] Source scaController *sca.Controller is not ready
I0702 02:19:03.122360       1 controller.go:458] The operator is still being initialized
I0702 02:19:03.122368       1 controller.go:481] The operator is healthy
I0702 02:19:03.122277       1 tasks_processing.go:71] worker 18 working on sap_datahubs task.
I0702 02:19:03.122559       1 recorder.go:70] Recording config/authentication with fingerprint=4ec06fdf7dc6282e5e136014a91936b620d9934cb98c1df45f1715727ba8b08c
I0702 02:19:03.122611       1 gather.go:177] gatherer "clusterconfig" function "authentication" took 21.04056ms to process 1 records
I0702 02:19:03.122697       1 tasks_processing.go:74] worker 13 stopped.
I0702 02:19:03.123860       1 recorder.go:70] Recording config/infrastructure with fingerprint=a69cf6a1234a3a1c061870f5326d4416abb84fdb636fa89e831ff23bd3bfcb19
I0702 02:19:03.123881       1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 19.599986ms to process 1 records
I0702 02:19:03.123890       1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 19.16561ms to process 0 records
I0702 02:19:03.123960       1 tasks_processing.go:74] worker 29 stopped.
I0702 02:19:03.124011       1 tasks_processing.go:74] worker 1 stopped.
I0702 02:19:03.124095       1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=7d194d6a8ddb5625fea95afbaa5accab724ceefc9401baa6e6cd6a39a34274d0
I0702 02:19:03.124163       1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=6778cb8b096dd78399501ca287511a4efa99f267db7d9735ea80a4b452348de7
I0702 02:19:03.124210       1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=0cbe03cd58a857f0c23060b440c47e5a571f3de947b4a871c2e2407abb24dbf0
I0702 02:19:03.124246       1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=e4cc2b2d07ceec4846ee17fd087fe0a76d1473cb259d54343c13469c80e3fb32
I0702 02:19:03.124278       1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=63ce1c9de984cd521b8873071b158cfe1d1d05afce39581f5d0cf9b3e5fbdcc0
I0702 02:19:03.124301       1 recorder.go:70] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=e1e7a9d280b9c4f463352f8ad46199e7774acb6d19c0a10ed9d4f166471b3088
I0702 02:19:03.124330       1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=0e66a28baf7b57dcd463029c5e27d55bf110ace45d31fbcf436807ce653ae44c
I0702 02:19:03.124357       1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=4657ec07aa53665d0ffd90a29cc9b8e5df59826e32ee79acfb6da5aca78d4d38
I0702 02:19:03.124384       1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=c32265a8e27acc628594e734ccdf803cd9d0052092ba9a03906aa8d143490a34
I0702 02:19:03.124426       1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=d789f8580540ddfab2be71163b358186660a3d872a8d81f6cb9a46c54697319f
I0702 02:19:03.124462       1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=ff8c9ded48e80b6aaf24ae7c05d194ee86c3b03f63318d5b0e6663a9b2e2b879
I0702 02:19:03.124475       1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 22.582072ms to process 11 records
I0702 02:19:03.124489       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 19.034095ms to process 0 records
I0702 02:19:03.124501       1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 18.580339ms to process 0 records
I0702 02:19:03.124501       1 tasks_processing.go:74] worker 27 stopped.
I0702 02:19:03.124512       1 tasks_processing.go:74] worker 31 stopped.
I0702 02:19:03.124578       1 recorder.go:70] Recording config/proxy with fingerprint=8b7a9f5963bd1efaaad880b550bfd98bd5a9151ea4eabccb8e89739cf76e1cd1
I0702 02:19:03.124583       1 tasks_processing.go:74] worker 22 stopped.
I0702 02:19:03.124592       1 gather.go:177] gatherer "clusterconfig" function "proxies" took 19.459938ms to process 1 records
I0702 02:19:03.124599       1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 18.536662ms to process 0 records
I0702 02:19:03.124647       1 recorder.go:70] Recording config/olm_operators with fingerprint=5d57eff97646cd72385a77340c9ec9c9a6df57daeb2fa8ea2d36bc1740d1afff
I0702 02:19:03.124659       1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 37.516225ms to process 1 records
I0702 02:19:03.124672       1 tasks_processing.go:74] worker 11 stopped.
I0702 02:19:03.124674       1 tasks_processing.go:74] worker 30 stopped.
I0702 02:19:03.124738       1 tasks_processing.go:74] worker 6 stopped.
I0702 02:19:03.124838       1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=291d14757bd74bf6c0e2804531c7ded2f3a9c2ad5d95fd3a8f0b7b683e89c2e4
I0702 02:19:03.124932       1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=8a95fcac7504fdf1903fbbb429f99a4bb1f4a85bf005b851d93069c76f1f9e40
I0702 02:19:03.124944       1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 38.116925ms to process 2 records
I0702 02:19:03.125010       1 tasks_processing.go:74] worker 15 stopped.
I0702 02:19:03.125457       1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=e184acf7787d69fa9fbe341b89703cad38689ba20fff44978b99506cd8013504
I0702 02:19:03.125706       1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=2a975f4b79870e418cf289c80ba0db581ad74f6871cf3e0e376e5fe35ffc0aa6
I0702 02:19:03.125727       1 gather.go:177] gatherer "clusterconfig" function "crds" took 38.349917ms to process 2 records
I0702 02:19:03.125809       1 tasks_processing.go:74] worker 12 stopped.
I0702 02:19:03.125837       1 recorder.go:70] Recording config/featuregate with fingerprint=b58451b4116a44c48616e2ab2911b59f9abfcb089e747a2b6983f2fa9c7e5b5e
I0702 02:19:03.125849       1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 20.038749ms to process 1 records
I0702 02:19:03.127313       1 tasks_processing.go:74] worker 5 stopped.
I0702 02:19:03.128113       1 recorder.go:70] Recording config/node/ip-10-0-0-146.ec2.internal with fingerprint=4d46adac368eab1b39ba89c47c6ac612d16b020c5daa1e401b6e463b486acfbf
I0702 02:19:03.128824       1 recorder.go:70] Recording config/node/ip-10-0-1-207.ec2.internal with fingerprint=e8ccb852d0823a410f01896b277d7b5ac0b154ad4f8f4cb38f4943923893e795
I0702 02:19:03.129133       1 recorder.go:70] Recording config/node/ip-10-0-2-12.ec2.internal with fingerprint=422e28f088ff69d276cb4eb949fe5912e38350d6adf8e1b80c46f53a25aa329c
I0702 02:19:03.129185       1 gather.go:177] gatherer "clusterconfig" function "nodes" took 20.219395ms to process 3 records
I0702 02:19:03.129231       1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 21.549588ms to process 0 records
I0702 02:19:03.129267       1 tasks_processing.go:74] worker 28 stopped.
I0702 02:19:03.129348       1 tasks_processing.go:74] worker 8 stopped.
I0702 02:19:03.129943       1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=a1e6ed19826b4ce422d53bc97cab2c347aa3798c947d8158cfdcf5b1bddd6773
I0702 02:19:03.130009       1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 21.669696ms to process 1 records
I0702 02:19:03.131790       1 tasks_processing.go:74] worker 3 stopped.
I0702 02:19:03.131815       1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 30.296978ms to process 0 records
I0702 02:19:03.132129       1 tasks_processing.go:74] worker 4 stopped.
I0702 02:19:03.132197       1 recorder.go:70] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570
I0702 02:19:03.132269       1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 46.155028ms to process 1 records
I0702 02:19:03.132475       1 tasks_processing.go:74] worker 26 stopped.
I0702 02:19:03.132549       1 recorder.go:70] Recording config/alerts with fingerprint=c5d2559a1a53b2c245776f6316cbbed5c9d0e3c0fb646d780ef56df5b55cfb0d
I0702 02:19:03.132582       1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 31.91878ms to process 1 records
I0702 02:19:03.132611       1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 28.782121ms to process 0 records
I0702 02:19:03.132660       1 tasks_processing.go:74] worker 19 stopped.
I0702 02:19:03.136227       1 tasks_processing.go:74] worker 24 stopped.
I0702 02:19:03.136261       1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 14.963681ms to process 0 records
I0702 02:19:03.136430       1 tasks_processing.go:74] worker 10 stopped.
I0702 02:19:03.136442       1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 14.828736ms to process 0 records
I0702 02:19:03.136509       1 tasks_processing.go:74] worker 18 stopped.
I0702 02:19:03.136549       1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 14.096828ms to process 0 records
I0702 02:19:03.137252       1 tasks_processing.go:74] worker 23 stopped.
I0702 02:19:03.137795       1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=ea06091419b1c5540d56682564b99b12ec6b6a3987e5a1f1095aa5c82188a23c
I0702 02:19:03.137818       1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 30.770893ms to process 1 records
I0702 02:19:03.137828       1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 50.742329ms to process 0 records
I0702 02:19:03.137835       1 tasks_processing.go:74] worker 25 stopped.
I0702 02:19:03.148191       1 tasks_processing.go:74] worker 17 stopped.
I0702 02:19:03.149022       1 recorder.go:70] Recording config/version with fingerprint=bff59dd438de51d38836c82ce3da79b1d21cb79747fb945ea8917162ce7a22c7
I0702 02:19:03.149045       1 recorder.go:70] Recording config/id with fingerprint=3ebb040e884ae6150cbd0678a8f1e7f3e40397a789962bd14bf62ea70d024f98
I0702 02:19:03.149059       1 gather.go:177] gatherer "clusterconfig" function "version" took 40.780346ms to process 2 records
E0702 02:19:03.149070       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found
E0702 02:19:03.149077       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2r9ndq6k1ld2tlie8baqcoacuj22feld-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2r9ndq6k1ld2tlie8baqcoacuj22feld-primary-cert-bundle-secret" not found
I0702 02:19:03.149144       1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=e88247b38acba187835c6f7fc196f4a19293682fb24a7ef96f86d51de5886544
I0702 02:19:03.149162       1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 62.807054ms to process 1 records
I0702 02:19:03.149173       1 tasks_processing.go:74] worker 2 stopped.
I0702 02:19:03.149920       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
I0702 02:19:03.156974       1 tasks_processing.go:74] worker 7 stopped.
E0702 02:19:03.157008       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found
E0702 02:19:03.157015       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found
E0702 02:19:03.157019       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found
I0702 02:19:03.157028       1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17
I0702 02:19:03.157060       1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb
I0702 02:19:03.157069       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a
I0702 02:19:03.157074       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4
I0702 02:19:03.157083       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d
I0702 02:19:03.157120       1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0
I0702 02:19:03.157128       1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d
I0702 02:19:03.157134       1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 70.33664ms to process 7 records
I0702 02:19:03.157905       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0702 02:19:03.157922       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0702 02:19:03.157962       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0702 02:19:03.159926       1 tasks_processing.go:74] worker 16 stopped.
I0702 02:19:03.161538       1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-pswc9 with fingerprint=34926824b65f30671da7f7c429e9a649e339b1e1707e694cd21b83213f44f507
I0702 02:19:03.161618       1 recorder.go:70] Recording config/running_containers with fingerprint=a6341970d214108e6518476f18edffa0428279c8e52fea44127ffb9dfeae3bcb
I0702 02:19:03.161627       1 gather.go:177] gatherer "clusterconfig" function "container_images" took 73.081742ms to process 2 records
I0702 02:19:03.161638       1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 54.560242ms to process 0 records
I0702 02:19:03.161644       1 tasks_processing.go:74] worker 21 stopped.
I0702 02:19:03.163142       1 base_controller.go:82] Caches are synced for ConfigController 
I0702 02:19:03.163155       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
I0702 02:19:03.168349       1 configmapobserver.go:84] configmaps "insights-config" not found
I0702 02:19:03.197647       1 cluster_transfer.go:102] no available accepted cluster transfer
I0702 02:19:03.197663       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer
I0702 02:19:03.202404       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0702 02:19:03.202418       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0702 02:19:03.328754       1 sca.go:266] etc-pki-entitlement secret successfully created
I0702 02:19:03.328774       1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated
I0702 02:19:03.954740       1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes"
W0702 02:19:04.106109       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0702 02:19:04.154914       1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes"
W0702 02:19:05.105749       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0702 02:19:05.558296       1 tasks_processing.go:74] worker 9 stopped.
I0702 02:19:05.558430       1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=055cca89be70171498eb9654fb37ff3830c75150f5f1c83a1489160bfc1d54bb
I0702 02:19:05.558490       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1
I0702 02:19:05.558526       1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=8e1a36c44b753411df3fc1c1ac2cf36f4bfe5b270fd739bcd69144a46438b943
I0702 02:19:05.558543       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e
I0702 02:19:05.558574       1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=de4a21849f4cd198af4732265445fe23363aadab31793b754f7c8fd26242dba6
I0702 02:19:05.558602       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f
I0702 02:19:05.558636       1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=5e57cea3452643990b5a6165b3a5a331a01382f590e5d9d7775390c88edfa5fc
I0702 02:19:05.558674       1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=89ff346fab0a8ef991bda7bad49c54b28f6ceaad6db64f6e4d664cfa62b88600
I0702 02:19:05.558708       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=38d9edf5ef6fec7a9c9eaa0cd308e94dab2f33df9decd060b104e69f2835dff7
I0702 02:19:05.558750       1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=6cdb8ae2c04760085401d5e3ed21e5af9bfdea4ef080bb6c389c699995b87504
I0702 02:19:05.559047       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=29c637c0cd3d1377a318ee53e03d016048d3cc6d2a3aa7a9b3f2842048f787be
I0702 02:19:05.559085       1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=b50e3071d1896232d5f0300af5e00dd91ccfdd0f81b96f4dfd2bb55c55d8ac5d
I0702 02:19:05.559101       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762
I0702 02:19:05.559131       1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=9f049a13dceff07c21655a7b8f1bba62fa1c06eccadeb94bde29f1de521fa835
I0702 02:19:05.559148       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11
I0702 02:19:05.559174       1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=ff62c77e3652bb99276ed4ae61e2257441ebfbe1c840c7e1adbad7910eb3ba6e
I0702 02:19:05.559190       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a
I0702 02:19:05.559219       1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=962e90ce6af5809762fc94fba8d637080ef4545c0a74bbd8f92cd3d5e0d36b1f
I0702 02:19:05.559238       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db
I0702 02:19:05.559270       1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=b1a2993581f2a0f14b6c35a1f79c1016a408edef33daf1844ba16285d5f3dd3a
I0702 02:19:05.559381       1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=9638063186bbe33c55cfb70a4c65a537b761ec1ca4c29ec2c8d0029f88d4547a
I0702 02:19:05.559415       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75
I0702 02:19:05.559447       1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=5fce7a0dbb0a32ccd842b9125823fc00732d66e8b4acdc01cd2040d2bfcc25f9
I0702 02:19:05.559493       1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=f33170d7f694dc5988c2fad37b01adc68e935a002c8a3d103769e67418c2bbc3
I0702 02:19:05.559509       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76
I0702 02:19:05.559535       1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=4bbc1aed5e424a32dbebc03f846f76e7da8a1e967853ac5abb6fdf2e3cbc6160
I0702 02:19:05.559551       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7
I0702 02:19:05.559578       1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=6b486bf5a8c2c1326e833f97d49c13a24756ba4a1d574d2a2bd7443ced27a3c3
I0702 02:19:05.559594       1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd
I0702 02:19:05.559617       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=abdfd1a590d8dd2b7d4b99eda17122d1dc80b981b13dacf473e0c88279e5e298
I0702 02:19:05.559645       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=09c11d555338ee3cee8cfbab53235504300d74c9a7a8a7250dc2273675d98388
I0702 02:19:05.559672       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=5d16a1e6bbcea4bf8afdb7ef71b706b644dcfb444bf8a6251591fd522497b87a
I0702 02:19:05.559706       1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=19bd4c2616f675c6ab700cfc44145fa23f67b20c3c0ca24d71d75485545cb4f3
I0702 02:19:05.559721       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa
I0702 02:19:05.559757       1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=b5fea9ea3905a40835cb3e55d96a38a50dab5e6d59db8181fb41af45ff76b3fb
I0702 02:19:05.559784       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e
I0702 02:19:05.559798       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad
I0702 02:19:05.559810       1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.45174198s to process 37 records
W0702 02:19:06.106391       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0702 02:19:07.106673       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0702 02:19:08.104609       1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0702 02:19:08.104636       1 tasks_processing.go:74] worker 14 stopped.
E0702 02:19:08.104651       1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0702 02:19:08.104665       1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
I0702 02:19:08.104677       1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.017219814s to process 1 records
I0702 02:19:16.110876       1 tasks_processing.go:74] worker 20 stopped.
I0702 02:19:16.110929       1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2
I0702 02:19:16.110942       1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.024798957s to process 1 records
I0702 02:19:16.908786       1 tasks_processing.go:74] worker 0 stopped.
I0702 02:19:16.909154       1 recorder.go:70] Recording config/serviceaccounts with fingerprint=dabcdda6991bac1666e8c7d62a42c20e4eacf733a346e4ee546090403d855ed3
I0702 02:19:16.909179       1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.805280293s to process 1 records
E0702 02:19:16.909242       1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.824s with: function \"tsdb_status\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"metrics\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error"
I0702 02:19:16.910350       1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "tsdb_status" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "metrics" failed with an error, function "machine_healthchecks" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error
I0702 02:19:16.910366       1 periodic.go:212] Running workloads gatherer
I0702 02:19:16.910388       1 tasks_processing.go:45] number of workers: 2
I0702 02:19:16.910404       1 tasks_processing.go:69] worker 1 listening for tasks.
I0702 02:19:16.910412       1 tasks_processing.go:71] worker 1 working on workload_info task.
I0702 02:19:16.910417       1 tasks_processing.go:69] worker 0 listening for tasks.
I0702 02:19:16.910487       1 tasks_processing.go:71] worker 0 working on helmchart_info task.
I0702 02:19:16.916528       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-12.ec2.internal...
I0702 02:19:16.916528       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-207.ec2.internal...
I0702 02:19:16.916534       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-146.ec2.internal...
I0702 02:19:16.934781       1 tasks_processing.go:74] worker 0 stopped.
I0702 02:19:16.934798       1 gather.go:177] gatherer "workloads" function "helmchart_info" took 24.273075ms to process 0 records
I0702 02:19:20.779272       1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 4s
I0702 02:19:20.801424       1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 24s for image data
I0702 02:19:20.810185       1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (10ms)
I0702 02:19:20.822229       1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (12ms)
I0702 02:19:20.829853       1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (8ms)
I0702 02:19:20.838279       1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (8ms)
I0702 02:19:20.851839       1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (14ms)
I0702 02:19:20.869912       1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (18ms)
I0702 02:19:20.886337       1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (16ms)
I0702 02:19:20.906301       1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (20ms)
I0702 02:19:20.926942       1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (21ms)
I0702 02:19:20.941747       1 gather_workloads_info.go:387] No image sha256:6c3c7f77d7a3815bbb69cad5f6f1742c17d9597bc135ba3d116c9736d98fae33 (15ms)
I0702 02:19:20.966011       1 gather_workloads_info.go:398] Found image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (24ms)
I0702 02:19:21.012918       1 gather_workloads_info.go:387] No image sha256:e40bbab1e52f580ab471bd7ab19ae23a4bcbaf1893243a05238af6bede7ba9cc (47ms)
I0702 02:19:21.109910       1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (97ms)
I0702 02:19:21.210977       1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (101ms)
I0702 02:19:21.309632       1 gather_workloads_info.go:387] No image sha256:5cba745f09f3bd6b8028c6773597cbb30bf3639a84f2b4b6493fe20642339a2c (99ms)
I0702 02:19:21.408863       1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (99ms)
I0702 02:19:21.509669       1 gather_workloads_info.go:387] No image sha256:1f2aa1e1026570162984f7fbb634635bcf319e408cafa8f9034ee842a2f193ab (101ms)
I0702 02:19:21.609781       1 gather_workloads_info.go:387] No image sha256:6277dac65decba0ea094146bb99600f479eaf804696842e724de1f1b436f9a38 (100ms)
I0702 02:19:21.709389       1 gather_workloads_info.go:387] No image sha256:039479f355d6903e1018abf8427fece3465c4348d4de2144ec38114b51bec27e (100ms)
I0702 02:19:21.809147       1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (100ms)
I0702 02:19:21.908571       1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (99ms)
I0702 02:19:22.010271       1 gather_workloads_info.go:387] No image sha256:1cc2f3c83068c8c67d9070f67677e1bb6b4feff7ac5744cad08711893e56b55f (102ms)
I0702 02:19:22.109108       1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (99ms)
I0702 02:19:22.209315       1 gather_workloads_info.go:387] No image sha256:bcca5c17371caa2dce7e28da4c9fe30163c340fa172187f94db90ea1bd6ab80d (100ms)
I0702 02:19:22.308851       1 gather_workloads_info.go:387] No image sha256:38dd36da63b1f01316a02daf6c18b821318c6ec313712147292d74abf955e0da (100ms)
I0702 02:19:22.409386       1 gather_workloads_info.go:387] No image sha256:a3d34d8f38a540ce79d34a5248b1965346155497db57b72cb4758d659418059c (101ms)
I0702 02:19:22.509717       1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (100ms)
I0702 02:19:22.609011       1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (99ms)
I0702 02:19:22.710017       1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (101ms)
I0702 02:19:22.809540       1 gather_workloads_info.go:387] No image sha256:799f5628c18e77a49c08645c03179046b5200c8cbcfd65737fb59668132f393e (100ms)
I0702 02:19:22.908933       1 gather_workloads_info.go:387] No image sha256:68d8e92046969bcfcbca2d2b3dcf4dcad5f6edc5fcb44861eb22f8079a43ea4d (99ms)
I0702 02:19:23.009880       1 gather_workloads_info.go:387] No image sha256:7854174b4b98e9b10d9c8e9b43113df1217ab21db4b2395d9399af0c3d7911a3 (101ms)
I0702 02:19:23.108761       1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (99ms)
I0702 02:19:23.209819       1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (101ms)
I0702 02:19:23.309736       1 gather_workloads_info.go:387] No image sha256:46c2c396ca651699738c3f26b79b10af2922123dd27c2e32382d2a31a87e92c7 (100ms)
I0702 02:19:23.409295       1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (100ms)
I0702 02:19:23.508960       1 gather_workloads_info.go:387] No image sha256:929a4a9c96a08b57fe4c315deca55c30d1990c83e34b8b5692f7646d29f715c8 (100ms)
I0702 02:19:23.609078       1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (100ms)
I0702 02:19:23.708850       1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (100ms)
I0702 02:19:23.809376       1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (101ms)
I0702 02:19:23.909264       1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (100ms)
I0702 02:19:24.012020       1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (103ms)
I0702 02:19:24.110318       1 gather_workloads_info.go:387] No image sha256:ce3d8211c0bde5788a4fd04c3eff31ae591437ceab2b3168dbbdfe408673c8b1 (98ms)
I0702 02:19:24.209907       1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (100ms)
I0702 02:19:24.310353       1 gather_workloads_info.go:387] No image sha256:1d471ad866b8564b209214d7dd3a7363c47e9535211d660b63b46abb278af7ab (100ms)
I0702 02:19:24.409673       1 gather_workloads_info.go:387] No image sha256:00f977c2275f5bf03d423911159a39ca44fabc1862ecb7ae492198ec8c46c6bb (99ms)
I0702 02:19:24.511123       1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (101ms)
I0702 02:19:24.609702       1 gather_workloads_info.go:387] No image sha256:527ed405bf66234718321996dacf51f91c64c746de9f1509416ef6ce89c90a50 (99ms)
I0702 02:19:24.710891       1 gather_workloads_info.go:398] Found image sha256:59db91eadf1e1e5343777be43ff25fb712f300f9341be48ba05f45270944536f (101ms)
I0702 02:19:24.810398       1 gather_workloads_info.go:387] No image sha256:270a7bac889ed64d75ce11ae26e8634a6209ff718b83fae2c888cfc758316aa3 (99ms)
I0702 02:19:24.810429       1 tasks_processing.go:74] worker 1 stopped.
I0702 02:19:24.810750       1 recorder.go:70] Recording config/workload_info with fingerprint=08e54e5aedc0f41a9db4610b14f6db7189e786492839ea81b82dd2bb5ac0fe15
I0702 02:19:24.810771       1 gather.go:177] gatherer "workloads" function "workload_info" took 7.900009303s to process 1 records
I0702 02:19:24.810786       1 periodic.go:259] Periodic gather workloads completed in 7.9s
I0702 02:19:24.810794       1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message=
I0702 02:19:24.810799       1 periodic.go:212] Running conditional gatherer
I0702 02:19:24.819654       1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules
I0702 02:19:24.979594       1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer
I0702 02:19:26.052756       1 conditional_gatherer.go:382] updating version cache for conditional gatherer
I0702 02:19:26.061446       1 conditional_gatherer.go:390] cluster version is '4.19.9'
I0702 02:19:26.061475       1 tasks_processing.go:45] number of workers: 3
I0702 02:19:26.061486       1 tasks_processing.go:69] worker 2 listening for tasks.
I0702 02:19:26.061490       1 tasks_processing.go:71] worker 2 working on rapid_container_logs task.
I0702 02:19:26.061502       1 tasks_processing.go:69] worker 0 listening for tasks.
I0702 02:19:26.061508       1 tasks_processing.go:69] worker 1 listening for tasks.
I0702 02:19:26.061531       1 tasks_processing.go:71] worker 0 working on remote_configuration task.
I0702 02:19:26.061551       1 tasks_processing.go:74] worker 0 stopped.
I0702 02:19:26.061540       1 tasks_processing.go:71] worker 1 working on conditional_gatherer_rules task.
I0702 02:19:26.061640       1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d
I0702 02:19:26.061666       1 gather.go:177] gatherer "conditional" function "remote_configuration" took 2.039µs to process 1 records
I0702 02:19:26.061754       1 tasks_processing.go:74] worker 1 stopped.
I0702 02:19:26.061770       1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c
I0702 02:19:26.061783       1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.029µs to process 1 records
I0702 02:19:26.061854       1 tasks_processing.go:74] worker 2 stopped.
I0702 02:19:26.061866       1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 357.539µs to process 0 records
I0702 02:19:26.061890       1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message=
I0702 02:19:26.061907       1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f
I0702 02:19:26.088944       1 recorder.go:70] Recording insights-operator/gathers with fingerprint=76af85d07b06fb8b41d7aae6c05b5811b9736846df0564d760214b57fc9394c2
I0702 02:19:26.089128       1 diskrecorder.go:70] Writing 109 records to /var/lib/insights-operator/insights-2026-07-02-021926.tar.gz
I0702 02:19:26.096595       1 diskrecorder.go:51] Wrote 109 records to disk in 7ms
I0702 02:19:26.096624       1 periodic.go:281] Gathering cluster info every 2h0m0s
I0702 02:19:26.096643       1 periodic.go:282] Configuration is 
	dataReporting:
		interval: 2h0m0s,
		uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload,
		storagePath: /var/lib/insights-operator,
		downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, 
		conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules,
		obfuscation: []
	sca:
		disabled: false,
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates,
		interval: 8h0m0s
	alerting:
		disabled: false
	clusterTransfer:
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/,
		interval: 12h0m0s
	proxy:
		httpProxy: ,
		httpsProxy: ,
		noProxy: 
I0702 02:20:33.085565       1 diskrecorder.go:223] Found files to send: insights-2026-07-02-021926.tar.gz
I0702 02:20:33.085597       1 insightsuploader.go:150] Checking archives to upload periodically every 15m50.439963782s
I0702 02:20:33.085609       1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z
I0702 02:20:33.101162       1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload
I0702 02:20:33.242596       1 requests.go:87] Successfully reported id=2026-07-02T02:20:33Z x-rh-insights-request-id=95a1eba824074213bc4e2d37704b2c93, wrote=50974
I0702 02:20:33.242658       1 insightsuploader.go:187] Uploaded report successfully in 157.043054ms
I0702 02:20:33.242684       1 controller.go:119] Initializing last reported time to 2026-07-02T02:20:33Z
I0702 02:20:33.242707       1 insightsreport.go:304] Archive uploaded, starting pulling report...
I0702 02:20:33.242716       1 insightsreport.go:215] Starting retrieving report from Smart Proxy
I0702 02:20:33.242724       1 insightsreport.go:221] Initial delay for pulling: 1m0s
I0702 02:20:33.247700       1 controller.go:481] The operator is healthy
I0702 02:21:03.109802       1 controller.go:481] The operator is healthy
I0702 02:21:34.236977       1 insightsreport.go:137] Pulling report from smart-proxy
I0702 02:21:34.237023       1 insightsreport.go:149] Retrieving report
I0702 02:21:34.248374       1 requests.go:110] Retrieving report for cluster: cddd3fa8-816c-4420-9824-44949e3f3142
I0702 02:21:34.248386       1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/cddd3fa8-816c-4420-9824-44949e3f3142/reports
I0702 02:21:34.251208       1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/cddd3fa8-816c-4420-9824-44949e3f3142/reports
I0702 02:21:34.439321       1 insightsreport.go:184] Report retrieved
I0702 02:21:34.482284       1 insightsreport.go:239] Report retrieved correctly
I0702 02:23:03.111616       1 controller.go:481] The operator is healthy
I0702 02:24:03.078680       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0702 02:24:03.083834       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0702 02:24:03.083853       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0702 02:24:03.087790       1 secretconfigobserver.go:119] support secret does not exist
I0702 02:25:03.107148       1 controller.go:481] The operator is healthy
I0702 02:27:03.111379       1 controller.go:481] The operator is healthy
I0702 02:29:03.077655       1 configmapobserver.go:84] configmaps "insights-config" not found
I0702 02:29:03.081849       1 configmapobserver.go:84] configmaps "insights-config" not found
I0702 02:29:03.087934       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0702 02:29:03.093190       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0702 02:29:03.093207       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0702 02:29:03.097938       1 secretconfigobserver.go:119] support secret does not exist
I0702 02:29:03.112049       1 controller.go:481] The operator is healthy
I0702 02:31:03.108819       1 controller.go:481] The operator is healthy
I0702 02:33:03.108646       1 controller.go:481] The operator is healthy
I0702 02:34:03.098471       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0702 02:34:03.103821       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0702 02:34:03.103843       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0702 02:34:03.107587       1 secretconfigobserver.go:119] support secret does not exist
I0702 02:35:03.109043       1 controller.go:481] The operator is healthy
I0702 02:36:28.683965       1 insightsuploader.go:146] Nothing to report since 2026-07-02T02:20:33Z
I0702 02:37:03.109514       1 controller.go:481] The operator is healthy
I0702 02:39:03.078277       1 configmapobserver.go:84] configmaps "insights-config" not found
I0702 02:39:03.107890       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0702 02:39:03.108345       1 controller.go:481] The operator is healthy
I0702 02:39:03.112658       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0702 02:39:03.112678       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0702 02:39:03.116797       1 secretconfigobserver.go:119] support secret does not exist
I0702 02:41:03.108093       1 controller.go:481] The operator is healthy
I0702 02:43:03.107858       1 controller.go:481] The operator is healthy
I0702 02:44:03.117101       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0702 02:44:03.122401       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0702 02:44:03.122419       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0702 02:44:03.126729       1 secretconfigobserver.go:119] support secret does not exist
I0702 02:45:03.108378       1 controller.go:481] The operator is healthy
I0702 02:47:03.108747       1 controller.go:481] The operator is healthy
I0702 02:49:03.079679       1 configmapobserver.go:84] configmaps "insights-config" not found
I0702 02:49:03.107618       1 controller.go:481] The operator is healthy
I0702 02:49:03.127478       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0702 02:49:03.132087       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0702 02:49:03.132107       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0702 02:49:03.136046       1 secretconfigobserver.go:119] support secret does not exist
I0702 02:51:03.109540       1 controller.go:481] The operator is healthy
I0702 02:52:38.681854       1 insightsuploader.go:146] Nothing to report since 2026-07-02T02:20:33Z
I0702 02:53:03.109184       1 controller.go:481] The operator is healthy
I0702 02:54:03.136732       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0702 02:54:03.142474       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0702 02:54:03.142494       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0702 02:54:03.146628       1 secretconfigobserver.go:119] support secret does not exist
I0702 02:55:03.108247       1 controller.go:481] The operator is healthy
I0702 02:57:03.108174       1 controller.go:481] The operator is healthy