I0410 16:37:12.106723       1 cmd.go:253] Using service-serving-cert provided certificates
I0410 16:37:12.107127       1 observer_polling.go:159] Starting file observer
I0410 16:37:12.849994       1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$
I0410 16:37:12.850242       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0410 16:37:12.850736       1 secure_serving.go:57] Forcing use of http/1.1 only
W0410 16:37:12.850755       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0410 16:37:12.850759       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0410 16:37:12.850764       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
W0410 16:37:12.850767       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
W0410 16:37:12.850769       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
W0410 16:37:12.850772       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0410 16:37:12.850849       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
I0410 16:37:12.854957       1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot]
I0410 16:37:12.854980       1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"b20a259d-54f4-4a63-8ed3-d49fff6a7c80", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
I0410 16:37:12.855807       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0410 16:37:12.855824       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0410 16:37:12.855832       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0410 16:37:12.855828       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0410 16:37:12.855849       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0410 16:37:12.855884       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0410 16:37:12.856103       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key"
I0410 16:37:12.856384       1 secure_serving.go:213] Serving securely on [::]:8443
I0410 16:37:12.856425       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
W0410 16:37:12.861378       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0410 16:37:12.861403       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0410 16:37:12.861506       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0410 16:37:12.866278       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0410 16:37:12.866296       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0410 16:37:12.871118       1 secretconfigobserver.go:119] support secret does not exist
I0410 16:37:12.879078       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0410 16:37:12.883350       1 secretconfigobserver.go:119] support secret does not exist
I0410 16:37:12.885024       1 recorder.go:176] Pruning old reports every 6h1m4s, max age is 288h0m0s
I0410 16:37:12.889766       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0410 16:37:12.889773       1 periodic.go:216] Running clusterconfig gatherer
I0410 16:37:12.889789       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s
I0410 16:37:12.889812       1 tasks_processing.go:45] number of workers: 64
I0410 16:37:12.889813       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0410 16:37:12.889823       1 insightsreport.go:296] Starting report retriever
I0410 16:37:12.889827       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0410 16:37:12.889832       1 tasks_processing.go:69] worker 3 listening for tasks.
I0410 16:37:12.889835       1 tasks_processing.go:69] worker 0 listening for tasks.
I0410 16:37:12.889838       1 tasks_processing.go:69] worker 1 listening for tasks.
I0410 16:37:12.889843       1 tasks_processing.go:69] worker 2 listening for tasks.
I0410 16:37:12.889844       1 tasks_processing.go:69] worker 34 listening for tasks.
I0410 16:37:12.889851       1 tasks_processing.go:69] worker 13 listening for tasks.
I0410 16:37:12.889854       1 tasks_processing.go:69] worker 24 listening for tasks.
I0410 16:37:12.889856       1 tasks_processing.go:71] worker 34 working on dvo_metrics task.
I0410 16:37:12.889857       1 tasks_processing.go:69] worker 23 listening for tasks.
I0410 16:37:12.889864       1 tasks_processing.go:69] worker 4 listening for tasks.
I0410 16:37:12.889869       1 tasks_processing.go:71] worker 23 working on cluster_apiserver task.
I0410 16:37:12.889871       1 tasks_processing.go:69] worker 26 listening for tasks.
I0410 16:37:12.889871       1 tasks_processing.go:69] worker 9 listening for tasks.
I0410 16:37:12.889863       1 tasks_processing.go:71] worker 24 working on machines task.
I0410 16:37:12.889878       1 tasks_processing.go:69] worker 51 listening for tasks.
I0410 16:37:12.889883       1 tasks_processing.go:69] worker 7 listening for tasks.
I0410 16:37:12.889880       1 tasks_processing.go:69] worker 10 listening for tasks.
I0410 16:37:12.889887       1 tasks_processing.go:69] worker 11 listening for tasks.
I0410 16:37:12.889893       1 tasks_processing.go:69] worker 35 listening for tasks.
I0410 16:37:12.889899       1 tasks_processing.go:69] worker 12 listening for tasks.
I0410 16:37:12.889905       1 tasks_processing.go:69] worker 44 listening for tasks.
I0410 16:37:12.889907       1 tasks_processing.go:69] worker 17 listening for tasks.
I0410 16:37:12.889914       1 tasks_processing.go:69] worker 45 listening for tasks.
I0410 16:37:12.889946       1 tasks_processing.go:69] worker 6 listening for tasks.
I0410 16:37:12.889952       1 tasks_processing.go:69] worker 59 listening for tasks.
I0410 16:37:12.889864       1 tasks_processing.go:69] worker 25 listening for tasks.
I0410 16:37:12.889965       1 tasks_processing.go:69] worker 39 listening for tasks.
I0410 16:37:12.889971       1 tasks_processing.go:69] worker 36 listening for tasks.
I0410 16:37:12.889977       1 tasks_processing.go:69] worker 52 listening for tasks.
I0410 16:37:12.889980       1 tasks_processing.go:69] worker 38 listening for tasks.
I0410 16:37:12.889986       1 tasks_processing.go:69] worker 53 listening for tasks.
I0410 16:37:12.889997       1 tasks_processing.go:69] worker 54 listening for tasks.
I0410 16:37:12.890014       1 tasks_processing.go:69] worker 55 listening for tasks.
I0410 16:37:12.890018       1 tasks_processing.go:71] worker 55 working on number_of_pods_and_netnamespaces_with_sdn_annotations task.
I0410 16:37:12.890016       1 tasks_processing.go:71] worker 54 working on metrics task.
I0410 16:37:12.890017       1 tasks_processing.go:69] worker 16 listening for tasks.
I0410 16:37:12.890027       1 tasks_processing.go:69] worker 41 listening for tasks.
I0410 16:37:12.890032       1 tasks_processing.go:69] worker 40 listening for tasks.
I0410 16:37:12.890041       1 tasks_processing.go:69] worker 21 listening for tasks.
I0410 16:37:12.890041       1 tasks_processing.go:69] worker 46 listening for tasks.
I0410 16:37:12.890047       1 tasks_processing.go:69] worker 50 listening for tasks.
I0410 16:37:12.890046       1 tasks_processing.go:69] worker 20 listening for tasks.
I0410 16:37:12.890048       1 tasks_processing.go:71] worker 44 working on openshift_machine_api_events task.
I0410 16:37:12.890055       1 tasks_processing.go:71] worker 26 working on ingress_certificates task.
I0410 16:37:12.890051       1 tasks_processing.go:69] worker 37 listening for tasks.
I0410 16:37:12.890046       1 tasks_processing.go:69] worker 15 listening for tasks.
I0410 16:37:12.890064       1 tasks_processing.go:69] worker 47 listening for tasks.
I0410 16:37:12.889857       1 tasks_processing.go:71] worker 13 working on machine_autoscalers task.
I0410 16:37:12.890068       1 tasks_processing.go:69] worker 27 listening for tasks.
I0410 16:37:12.890072       1 tasks_processing.go:69] worker 18 listening for tasks.
I0410 16:37:12.890072       1 tasks_processing.go:69] worker 22 listening for tasks.
I0410 16:37:12.890080       1 tasks_processing.go:69] worker 28 listening for tasks.
I0410 16:37:12.890081       1 tasks_processing.go:71] worker 25 working on schedulers task.
I0410 16:37:12.890087       1 tasks_processing.go:71] worker 45 working on oauths task.
I0410 16:37:12.890089       1 tasks_processing.go:69] worker 32 listening for tasks.
I0410 16:37:12.890087       1 tasks_processing.go:69] worker 14 listening for tasks.
I0410 16:37:12.890094       1 tasks_processing.go:69] worker 49 listening for tasks.
I0410 16:37:12.890100       1 tasks_processing.go:71] worker 52 working on crds task.
I0410 16:37:12.890104       1 tasks_processing.go:69] worker 57 listening for tasks.
I0410 16:37:12.890107       1 tasks_processing.go:69] worker 48 listening for tasks.
I0410 16:37:12.890106       1 tasks_processing.go:69] worker 31 listening for tasks.
I0410 16:37:12.890115       1 tasks_processing.go:71] worker 14 working on version task.
I0410 16:37:12.890118       1 tasks_processing.go:71] worker 48 working on openstack_dataplanenodesets task.
I0410 16:37:12.890120       1 tasks_processing.go:71] worker 51 working on container_runtime_configs task.
I0410 16:37:12.890121       1 tasks_processing.go:69] worker 29 listening for tasks.
I0410 16:37:12.890120       1 tasks_processing.go:69] worker 42 listening for tasks.
I0410 16:37:12.890108       1 tasks_processing.go:71] worker 10 working on nodes task.
I0410 16:37:12.890132       1 tasks_processing.go:71] worker 7 working on machine_config_pools task.
I0410 16:37:12.890132       1 tasks_processing.go:71] worker 12 working on lokistack task.
I0410 16:37:12.890141       1 tasks_processing.go:71] worker 42 working on aggregated_monitoring_cr_names task.
I0410 16:37:12.890149       1 tasks_processing.go:69] worker 61 listening for tasks.
I0410 16:37:12.890177       1 tasks_processing.go:69] worker 19 listening for tasks.
I0410 16:37:12.890051       1 tasks_processing.go:71] worker 4 working on machine_sets task.
I0410 16:37:12.890186       1 tasks_processing.go:71] worker 19 working on storage_cluster task.
I0410 16:37:12.890188       1 tasks_processing.go:69] worker 62 listening for tasks.
I0410 16:37:12.890196       1 tasks_processing.go:71] worker 50 working on operators_pods_and_events task.
I0410 16:37:12.890112       1 tasks_processing.go:71] worker 9 working on container_images task.
I0410 16:37:12.890089       1 tasks_processing.go:71] worker 28 working on ingress task.
I0410 16:37:12.890208       1 tasks_processing.go:71] worker 38 working on sap_datahubs task.
I0410 16:37:12.890211       1 tasks_processing.go:71] worker 36 working on pod_network_connectivity_checks task.
I0410 16:37:12.890214       1 tasks_processing.go:71] worker 6 working on authentication task.
I0410 16:37:12.890096       1 tasks_processing.go:69] worker 56 listening for tasks.
I0410 16:37:12.890107       1 tasks_processing.go:71] worker 49 working on overlapping_namespace_uids task.
I0410 16:37:12.890270       1 tasks_processing.go:69] worker 33 listening for tasks.
I0410 16:37:12.889876       1 tasks_processing.go:69] worker 5 listening for tasks.
I0410 16:37:12.890113       1 tasks_processing.go:71] worker 57 working on sap_config task.
I0410 16:37:12.890142       1 tasks_processing.go:69] worker 60 listening for tasks.
I0410 16:37:12.890061       1 tasks_processing.go:69] worker 30 listening for tasks.
I0410 16:37:12.890127       1 tasks_processing.go:71] worker 35 working on cost_management_metrics_configs task.
I0410 16:37:12.890123       1 tasks_processing.go:71] worker 11 working on ceph_cluster task.
I0410 16:37:12.890388       1 tasks_processing.go:71] worker 1 working on image_registries task.
I0410 16:37:12.890402       1 tasks_processing.go:71] worker 59 working on silenced_alerts task.
I0410 16:37:12.890903       1 tasks_processing.go:69] worker 43 listening for tasks.
I0410 16:37:12.890918       1 tasks_processing.go:71] worker 3 working on openstack_controlplanes task.
I0410 16:37:12.890920       1 tasks_processing.go:71] worker 20 working on support_secret task.
I0410 16:37:12.890099       1 tasks_processing.go:71] worker 32 working on storage_classes task.
I0410 16:37:12.890134       1 tasks_processing.go:69] worker 63 listening for tasks.
I0410 16:37:12.890207       1 tasks_processing.go:71] worker 39 working on operators task.
I0410 16:37:12.891219       1 tasks_processing.go:71] worker 37 working on certificate_signing_requests task.
I0410 16:37:12.890084       1 tasks_processing.go:71] worker 17 working on tsdb_status task.
I0410 16:37:12.890121       1 tasks_processing.go:71] worker 31 working on infrastructures task.
I0410 16:37:12.891426       1 tasks_processing.go:71] worker 63 working on pdbs task.
I0410 16:37:12.891493       1 tasks_processing.go:69] worker 58 listening for tasks.
I0410 16:37:12.891505       1 tasks_processing.go:71] worker 58 working on config_maps task.
I0410 16:37:12.891539       1 tasks_processing.go:71] worker 2 working on openstack_dataplanedeployments task.
I0410 16:37:12.892054       1 tasks_processing.go:71] worker 46 working on node_features task.
I0410 16:37:12.890179       1 tasks_processing.go:71] worker 61 working on sap_pods task.
I0410 16:37:12.892193       1 tasks_processing.go:71] worker 5 working on olm_operators task.
I0410 16:37:12.891802       1 tasks_processing.go:71] worker 15 working on clusterroles task.
I0410 16:37:12.889857       1 tasks_processing.go:69] worker 8 listening for tasks.
I0410 16:37:12.891833       1 tasks_processing.go:71] worker 16 working on validating_webhook_configurations task.
I0410 16:37:12.892570       1 tasks_processing.go:71] worker 56 working on networks task.
I0410 16:37:12.891541       1 tasks_processing.go:71] worker 0 working on qemu_kubevirt_launcher_logs task.
I0410 16:37:12.891891       1 tasks_processing.go:71] worker 27 working on image_pruners task.
I0410 16:37:12.892687       1 tasks_processing.go:71] worker 33 working on install_plans task.
I0410 16:37:12.892785       1 tasks_processing.go:71] worker 30 working on jaegers task.
I0410 16:37:12.892848       1 tasks_processing.go:71] worker 62 working on machine_configs task.
I0410 16:37:12.891900       1 tasks_processing.go:71] worker 41 working on node_logs task.
I0410 16:37:12.891900       1 tasks_processing.go:71] worker 22 working on proxies task.
I0410 16:37:12.891907       1 tasks_processing.go:71] worker 40 working on image task.
I0410 16:37:12.891976       1 tasks_processing.go:71] worker 21 working on machine_healthchecks task.
I0410 16:37:12.892540       1 tasks_processing.go:71] worker 8 working on openstack_version task.
I0410 16:37:12.892882       1 tasks_processing.go:71] worker 60 working on active_alerts task.
I0410 16:37:12.890136       1 tasks_processing.go:71] worker 29 working on feature_gates task.
I0410 16:37:12.891895       1 tasks_processing.go:71] worker 18 working on monitoring_persistent_volumes task.
I0410 16:37:12.891821       1 tasks_processing.go:71] worker 53 working on service_accounts task.
I0410 16:37:12.892948       1 tasks_processing.go:71] worker 43 working on nodenetworkconfigurationpolicies task.
I0410 16:37:12.891885       1 tasks_processing.go:71] worker 47 working on mutating_webhook_configurations task.
I0410 16:37:12.896507       1 tasks_processing.go:71] worker 24 working on nodenetworkstates task.
E0410 16:37:12.896593       1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope
I0410 16:37:12.896610       1 gather.go:177] gatherer "clusterconfig" function "machines" took 6.620001ms to process 0 records
E0410 16:37:12.913715       1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.49.228:9091: connect: connection refused
I0410 16:37:12.913745       1 tasks_processing.go:71] worker 17 working on openshift_logging task.
E0410 16:37:12.913751       1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.49.228:9091: connect: connection refused
E0410 16:37:12.913801       1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.49.228:9091: connect: connection refused
I0410 16:37:12.913829       1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 22.441323ms to process 0 records
E0410 16:37:12.913849       1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.49.228:9091: connect: connection refused
I0410 16:37:12.913874       1 gather.go:177] gatherer "clusterconfig" function "metrics" took 23.764075ms to process 0 records
I0410 16:37:12.913896       1 tasks_processing.go:74] worker 54 stopped.
I0410 16:37:12.914027       1 tasks_processing.go:74] worker 23 stopped.
I0410 16:37:12.914056       1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z
I0410 16:37:12.914071       1 controller.go:368] The initial operator extension status is healthy
I0410 16:37:12.914079       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0410 16:37:12.914084       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0410 16:37:12.914088       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0410 16:37:12.914104       1 controller.go:531] The operator is still being initialized
I0410 16:37:12.914113       1 controller.go:554] The operator is healthy
I0410 16:37:12.914193       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
I0410 16:37:12.914209       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
I0410 16:37:12.914228       1 recorder.go:75] Recording config/apiserver with fingerprint=0c8660e365fe606b4caa6767199f1921e9a5689f76ba523e8f988917809f6868
I0410 16:37:12.914255       1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 24.143882ms to process 1 records
W0410 16:37:12.914407       1 operator.go:328] started
I0410 16:37:12.914466       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
I0410 16:37:12.956858       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0410 16:37:12.956935       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0410 16:37:12.957015       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0410 16:37:12.961562       1 base_controller.go:82] Caches are synced for ConfigController 
I0410 16:37:12.961580       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
I0410 16:37:12.976188       1 tasks_processing.go:74] worker 38 stopped.
I0410 16:37:12.976203       1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 85.968616ms to process 0 records
I0410 16:37:12.976218       1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 86.064893ms to process 0 records
I0410 16:37:12.976227       1 tasks_processing.go:74] worker 51 stopped.
I0410 16:37:12.976286       1 tasks_processing.go:74] worker 7 stopped.
I0410 16:37:12.976293       1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 86.141469ms to process 0 records
I0410 16:37:12.976301       1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 85.363729ms to process 0 records
I0410 16:37:12.976309       1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 86.106711ms to process 0 records
I0410 16:37:12.976318       1 tasks_processing.go:74] worker 19 stopped.
I0410 16:37:12.976323       1 tasks_processing.go:74] worker 3 stopped.
I0410 16:37:12.976626       1 tasks_processing.go:74] worker 22 stopped.
I0410 16:37:12.976755       1 recorder.go:75] Recording config/proxy with fingerprint=a0c500f7daacdaf9f8e442089b0005576cf109210d86487a5a932aa1a8975ba6
I0410 16:37:12.976775       1 gather.go:177] gatherer "clusterconfig" function "proxies" took 83.426141ms to process 1 records
I0410 16:37:12.976872       1 tasks_processing.go:74] worker 31 stopped.
I0410 16:37:12.977516       1 recorder.go:75] Recording config/infrastructure with fingerprint=18dbc1e22325eb17e882d711c195af2450e831a8f2096248ff9a9fc8aaa8501f
I0410 16:37:12.977536       1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 85.312424ms to process 1 records
I0410 16:37:12.977636       1 tasks_processing.go:74] worker 28 stopped.
I0410 16:37:12.977724       1 recorder.go:75] Recording config/ingress with fingerprint=143d32159c0de662846ac28498fe4dcd79b6d2325e4a6ec952b8f389a0caeafe
I0410 16:37:12.977734       1 gather.go:177] gatherer "clusterconfig" function "ingress" took 86.587309ms to process 1 records
I0410 16:37:12.977825       1 tasks_processing.go:74] worker 56 stopped.
I0410 16:37:12.977901       1 recorder.go:75] Recording config/network with fingerprint=7a0b74f43a5b71a73c859a3a41e26ef30754a977c661430e7ac7cb9c0faf6eea
I0410 16:37:12.977911       1 gather.go:177] gatherer "clusterconfig" function "networks" took 84.302634ms to process 1 records
I0410 16:37:12.977999       1 tasks_processing.go:74] worker 45 stopped.
I0410 16:37:12.978191       1 recorder.go:75] Recording config/oauth with fingerprint=62c7875c0466ee2b29b2b91413bcf6cb2016fab20b2013b1cb54cbfbeba64989
I0410 16:37:12.978204       1 gather.go:177] gatherer "clusterconfig" function "oauths" took 87.138543ms to process 1 records
I0410 16:37:12.984278       1 tasks_processing.go:74] worker 17 stopped.
I0410 16:37:12.984293       1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 70.523294ms to process 0 records
I0410 16:37:12.984361       1 tasks_processing.go:74] worker 36 stopped.
E0410 16:37:12.984375       1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io)
I0410 16:37:12.984383       1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 94.139572ms to process 0 records
I0410 16:37:12.984417       1 tasks_processing.go:74] worker 12 stopped.
I0410 16:37:12.984424       1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 94.271989ms to process 0 records
I0410 16:37:12.984429       1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 94.043511ms to process 0 records
I0410 16:37:12.984436       1 tasks_processing.go:74] worker 35 stopped.
I0410 16:37:12.984446       1 tasks_processing.go:74] worker 24 stopped.
I0410 16:37:12.984459       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 87.915651ms to process 0 records
I0410 16:37:12.984484       1 tasks_processing.go:74] worker 13 stopped.
I0410 16:37:12.984501       1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 94.404585ms to process 0 records
I0410 16:37:12.984611       1 tasks_processing.go:74] worker 4 stopped.
I0410 16:37:12.984634       1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 94.412488ms to process 0 records
I0410 16:37:12.984660       1 controller.go:254] Source scaController *sca.Controller is not ready
I0410 16:37:12.984671       1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready
I0410 16:37:12.984675       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0410 16:37:12.984679       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0410 16:37:12.984683       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0410 16:37:12.984688       1 tasks_processing.go:74] worker 11 stopped.
I0410 16:37:12.984700       1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 94.304268ms to process 0 records
I0410 16:37:12.984704       1 controller.go:531] The operator is still being initialized
I0410 16:37:12.984708       1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 92.515077ms to process 0 records
I0410 16:37:12.984711       1 controller.go:554] The operator is healthy
E0410 16:37:12.984716       1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope
I0410 16:37:12.984724       1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 91.477637ms to process 0 records
I0410 16:37:12.984736       1 tasks_processing.go:74] worker 21 stopped.
I0410 16:37:12.984741       1 tasks_processing.go:74] worker 61 stopped.
I0410 16:37:12.984757       1 tasks_processing.go:74] worker 27 stopped.
I0410 16:37:12.985029       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=784af4e9a8274ee162315534cd22218b7660752e34903e91dd7cacb4bbd2d267
I0410 16:37:12.985043       1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 92.085022ms to process 1 records
E0410 16:37:12.985054       1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found
I0410 16:37:12.985059       1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 93.853718ms to process 0 records
I0410 16:37:12.985069       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 94.667858ms to process 0 records
I0410 16:37:12.985069       1 tasks_processing.go:74] worker 20 stopped.
I0410 16:37:12.985075       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 91.439777ms to process 0 records
I0410 16:37:12.985081       1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 92.81983ms to process 0 records
I0410 16:37:12.985086       1 tasks_processing.go:74] worker 48 stopped.
I0410 16:37:12.985089       1 tasks_processing.go:74] worker 5 stopped.
I0410 16:37:12.985091       1 tasks_processing.go:74] worker 43 stopped.
I0410 16:37:12.985725       1 tasks_processing.go:74] worker 1 stopped.
I0410 16:37:12.987127       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=90ce7d970ad4f50420b88ab1c38185bf7f7732ce2bd52e9748bd6d061e9d6d95
I0410 16:37:12.987223       1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 95.320197ms to process 1 records
I0410 16:37:12.987245       1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 93.268386ms to process 0 records
I0410 16:37:12.987255       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 94.354706ms to process 0 records
I0410 16:37:12.987269       1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 96.225252ms to process 0 records
I0410 16:37:12.987277       1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 93.397057ms to process 0 records
I0410 16:37:12.987384       1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=173be49d89941122a7bbb66845a6edf3be0c6a8c7ba0eb90e89ffd01183ad06f
I0410 16:37:12.987401       1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 96.879295ms to process 1 records
I0410 16:37:12.987418       1 tasks_processing.go:74] worker 25 stopped.
I0410 16:37:12.987424       1 tasks_processing.go:74] worker 57 stopped.
I0410 16:37:12.987429       1 tasks_processing.go:74] worker 8 stopped.
I0410 16:37:12.987453       1 tasks_processing.go:74] worker 30 stopped.
I0410 16:37:12.987550       1 tasks_processing.go:74] worker 2 stopped.
I0410 16:37:12.995433       1 tasks_processing.go:74] worker 10 stopped.
I0410 16:37:12.995908       1 recorder.go:75] Recording config/node/ip-10-0-0-66.ec2.internal with fingerprint=977730888ab668907d4e46b83e12f6463971a26032c73ef5a262b619bddbf2cf
I0410 16:37:12.995990       1 recorder.go:75] Recording config/node/ip-10-0-1-177.ec2.internal with fingerprint=2be7abea1a02e6e687e87bbae35adbc38294af68fbc469dc0ed1767813a2148a
I0410 16:37:12.996062       1 recorder.go:75] Recording config/node/ip-10-0-2-187.ec2.internal with fingerprint=38f4416024481948c7d4519b72a1fb7be4cf1f14773b7a6e56578b542cc15714
I0410 16:37:12.996075       1 gather.go:177] gatherer "clusterconfig" function "nodes" took 105.29095ms to process 3 records
I0410 16:37:12.996200       1 tasks_processing.go:74] worker 29 stopped.
I0410 16:37:12.996219       1 recorder.go:75] Recording config/featuregate with fingerprint=ce11977dcf02e86f11a8db50fe0857a861e6cb57525b390455807f29c96c23d8
I0410 16:37:12.996229       1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 102.443377ms to process 1 records
I0410 16:37:12.996358       1 tasks_processing.go:74] worker 16 stopped.
E0410 16:37:12.996397       1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed)
I0410 16:37:12.996433       1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=c469183d72019c2a6fd18048e457f16012a07197be3986f10f30d2dbc4bcb1e0
I0410 16:37:12.996517       1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=73a7af2c3d2218551230dfd8e2e81195d0ff0f9585cdfc57c08028bf72bb2fc5
I0410 16:37:12.996665       1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=497a670a17e6b0b250efdbfd3448230288b25c73c9625979dc20de68043849d5
I0410 16:37:12.996708       1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=b3d9ef61e0cf2cf7a840424bf8fca01bbc7b67c161dbfd864216593b69c27aa4
I0410 16:37:12.996742       1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=5ca7db7829681a87bdeb9d81db5c7255f8cf7d99f908618401240e824635a61b
I0410 16:37:12.996780       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=828beebdb55c630134c07cebb9116fe593f76e258d435bd2379d3e08d21884f0
I0410 16:37:12.997091       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=31143c9c7ebbe42433c5dabd8672cbe966d808ec4042b6575a018e0edd310b91
I0410 16:37:12.997139       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=1148b54760be4f151c6bf74c24a55fbf533ba5735edb50b66f1b59bdd495ee84
I0410 16:37:12.997214       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=f003f84a9d872943ed1695edb353a35659a2a6c86092347b74ee8f5dedd6cba9
I0410 16:37:12.997370       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=9c1a5ac4dfed8bd5c5919b8e7799603200e12a5018e4651be9fe5fa02be4dae8
I0410 16:37:12.997441       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=7bf85a072cc30c922888af5b4612882c51dc0b5335dfb2eeb70f8b05b21b41cf
I0410 16:37:12.997502       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=ae6b00794bc267408d507d7b30868f7bf1c1035c8e4b191308f5cd480fe72403
I0410 16:37:12.997549       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=62707af9f4a18439b876addb1bf41562602ffbdf8d3854c770460a021b7e6d2d
I0410 16:37:12.997565       1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 103.59835ms to process 13 records
I0410 16:37:12.997665       1 tasks_processing.go:74] worker 63 stopped.
I0410 16:37:12.997735       1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=7803638427df964f25e8af43adf549f2679d30b895e304b5cb3de4a91f0a3cd1
I0410 16:37:12.997766       1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=02123ec5cbf344e160f64bef4a3bd19878ae48fa162a7bc370dfc665f06a6b35
I0410 16:37:12.997793       1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=38e8ece254dd59ca192b5e38e64196abc751283eba37397200b92062b0b5a9f8
I0410 16:37:12.997899       1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=e8bc3a57e2b221107ee92f3095b226e9583e5f88330deb8a0693caf6392ef4e9
I0410 16:37:12.997982       1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=9b4579525ecdc6b11009c21f2190dd4d2a2b19d49549876f19f086ac9752b375
I0410 16:37:12.998051       1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=53352ac48651b1f0746e7b2be776b0eacab4937f7fdfe36c117b679ccdc6b626
I0410 16:37:12.998109       1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=e6fb7980380d71c50bd7248f2847931958628fb8be029ad2f0839e0bfdfd2ee2
I0410 16:37:12.998189       1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=9065c2e6ca1b3e25a8b8d5850a997f3fa71f9a535ad2845dfc6aef53061df271
I0410 16:37:12.998260       1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=781112fac7b3b4cff029d6356bb6c1ca02a4a0cb014f3e6c99c66e446eeb0f35
I0410 16:37:12.998312       1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=4c386c959de65dc4efb129d78d352dae044321540c42caf9932f750c6258c515
I0410 16:37:12.998367       1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=514e4f6ad6b27fe762b62fd035bc368f67b1a126d590e2a45c4582f4400649bf
I0410 16:37:12.998398       1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 104.778819ms to process 11 records
I0410 16:37:12.998428       1 gather.go:177] gatherer "clusterconfig" function "node_features" took 104.301797ms to process 0 records
I0410 16:37:12.998484       1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
I0410 16:37:12.998517       1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 106.460766ms to process 1 records
I0410 16:37:12.998604       1 tasks_processing.go:74] worker 49 stopped.
I0410 16:37:12.998606       1 tasks_processing.go:74] worker 46 stopped.
I0410 16:37:12.998691       1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=c33e27b0ee0467086d938a2d384a537f6d50557072fc86b98f0f7304377100aa
I0410 16:37:12.998940       1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=a5d1e3ee5874632c98640c555ffdd1d6ff291f0f826da84cb2c1ebf604ddc47f
I0410 16:37:12.998996       1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 105.663699ms to process 2 records
I0410 16:37:12.998698       1 tasks_processing.go:74] worker 32 stopped.
I0410 16:37:12.999102       1 tasks_processing.go:74] worker 47 stopped.
I0410 16:37:12.999219       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=88d0a02bec263173d43e8c0faaadb6b03459be152a43217834fe6dc7277e1346
I0410 16:37:12.999256       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=42f020b1ff794f5051eaa3a4cd0ed0e90da23e74f8566694391a546668c1824e
I0410 16:37:12.999303       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=96b990860d63f0f6228ff0e573157d6722580628eb6932eb28d8f3da600b463a
I0410 16:37:12.999313       1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 103.283874ms to process 3 records
I0410 16:37:12.999342       1 tasks_processing.go:74] worker 40 stopped.
I0410 16:37:12.999484       1 recorder.go:75] Recording config/image with fingerprint=8fc2607184dddd2cb457032d0fc1c03daf5b378dc76b3143d632ca184a55babf
I0410 16:37:12.999509       1 gather.go:177] gatherer "clusterconfig" function "image" took 103.991254ms to process 1 records
E0410 16:37:12.999539       1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io)
I0410 16:37:12.999569       1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499
I0410 16:37:12.999593       1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 105.832058ms to process 1 records
I0410 16:37:12.999605       1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 108.959909ms to process 0 records
I0410 16:37:12.999611       1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 105.843328ms to process 0 records
I0410 16:37:12.999621       1 tasks_processing.go:74] worker 41 stopped.
I0410 16:37:12.999629       1 tasks_processing.go:74] worker 62 stopped.
I0410 16:37:12.999641       1 tasks_processing.go:74] worker 44 stopped.
I0410 16:37:12.999910       1 tasks_processing.go:74] worker 6 stopped.
I0410 16:37:13.000918       1 recorder.go:75] Recording config/authentication with fingerprint=24b9d06b10ca02ffe7cf3542734ec4f3ed363e156b4b136e71aa50522a712182
I0410 16:37:13.000941       1 gather.go:177] gatherer "clusterconfig" function "authentication" took 109.678507ms to process 1 records
W0410 16:37:13.001036       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0410 16:37:13.003119       1 tasks_processing.go:74] worker 37 stopped.
I0410 16:37:13.003134       1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 111.884108ms to process 0 records
I0410 16:37:13.003531       1 configmapobserver.go:84] configmaps "insights-config" not found
I0410 16:37:13.005065       1 gather_logs.go:145] no pods in  namespace were found
I0410 16:37:13.005080       1 tasks_processing.go:74] worker 0 stopped.
I0410 16:37:13.005090       1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 112.402906ms to process 0 records
I0410 16:37:13.006641       1 tasks_processing.go:74] worker 15 stopped.
I0410 16:37:13.006805       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=78e1c6ac50a2fe81f806bc827740caf6a3723b7b4c6e23edfd0030e6ca18aeb9
I0410 16:37:13.006887       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=7fe7deb8e5f6b5a2d8394cc8223c3b0f7502b88f7e272a62974052bfd922a6c3
I0410 16:37:13.006899       1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 114.282597ms to process 2 records
I0410 16:37:13.007922       1 tasks_processing.go:74] worker 18 stopped.
I0410 16:37:13.007942       1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 114.503811ms to process 0 records
I0410 16:37:13.014765       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0410 16:37:13.014777       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0410 16:37:13.017631       1 tasks_processing.go:74] worker 52 stopped.
I0410 16:37:13.018725       1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=5450aeabadd8b201d4adbb7c90a6e40836c4d9abaf170c0387a69e34a60c94cf
I0410 16:37:13.019263       1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=a7008776912acfc69f3a3d87a4c2b30fbd6215a860c681f55528ef4ec78ebd09
I0410 16:37:13.019317       1 gather.go:177] gatherer "clusterconfig" function "crds" took 127.522114ms to process 2 records
I0410 16:37:13.019343       1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 128.758785ms to process 0 records
I0410 16:37:13.019355       1 tasks_processing.go:74] worker 42 stopped.
I0410 16:37:13.022055       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
I0410 16:37:13.024117       1 tasks_processing.go:74] worker 14 stopped.
I0410 16:37:13.024382       1 recorder.go:75] Recording config/version with fingerprint=478ac13a3518d2eb7dc3a093e7a1eb3836efb48b4d90db5ae99319a9dd590d9a
I0410 16:37:13.024403       1 recorder.go:75] Recording config/id with fingerprint=2983b8f1b0a93f63ac0376e902369249a385c8211952c925bbc71ea4d1e242c9
I0410 16:37:13.024413       1 gather.go:177] gatherer "clusterconfig" function "version" took 133.991491ms to process 2 records
I0410 16:37:13.034401       1 tasks_processing.go:74] worker 55 stopped.
I0410 16:37:13.034418       1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 144.370033ms to process 0 records
I0410 16:37:13.036713       1 tasks_processing.go:74] worker 9 stopped.
I0410 16:37:13.038366       1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-75b46cc85-zz6lg with fingerprint=7e242aafb961ffe5cb1fb94cf1cc812fea3a97438ed3ef674e66d0b607f49683
I0410 16:37:13.038782       1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-hcjw9 with fingerprint=b5161bb4d83d16822355263efb316c4df12914598269eb22759a438ce8a92748
I0410 16:37:13.038862       1 recorder.go:75] Recording config/running_containers with fingerprint=7fd5834d6a6fc90874bebb41de85bad2669ffa694f3c68af6a1bb9dbdaec3bf0
I0410 16:37:13.038872       1 gather.go:177] gatherer "clusterconfig" function "container_images" took 146.492688ms to process 3 records
I0410 16:37:13.040081       1 tasks_processing.go:74] worker 58 stopped.
E0410 16:37:13.040099       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found
E0410 16:37:13.040105       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found
E0410 16:37:13.040109       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found
I0410 16:37:13.040118       1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=d6cdef0bc443452d8c3614a2b80a95b81c762e2cc791eba8d6dc6c490fe443be
I0410 16:37:13.040177       1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d
I0410 16:37:13.040200       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a
I0410 16:37:13.040206       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=38de253d99fc91c21ec0830eaa3643933091a8a87ea8e88c8c639b11fcb856c6
I0410 16:37:13.040234       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d
I0410 16:37:13.040274       1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0
I0410 16:37:13.040282       1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d
I0410 16:37:13.040287       1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 148.55885ms to process 7 records
I0410 16:37:13.059021       1 gather_cluster_operator_pods_and_events.go:121] Found 0 pods with 0 containers
I0410 16:37:13.059046       1 tasks_processing.go:74] worker 50 stopped.
I0410 16:37:13.059057       1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 168.837202ms to process 0 records
I0410 16:37:13.077346       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found
I0410 16:37:13.081933       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found
I0410 16:37:13.115622       1 cluster_transfer.go:102] no available accepted cluster transfer
I0410 16:37:13.115636       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer
I0410 16:37:13.124768       1 tasks_processing.go:74] worker 26 stopped.
E0410 16:37:13.124783       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found
E0410 16:37:13.124791       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pjda9eb2v9960j6pvh7mvgjb27ifi1u-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pjda9eb2v9960j6pvh7mvgjb27ifi1u-primary-cert-bundle-secret" not found
I0410 16:37:13.124851       1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=41f0fe3d368e8bbae06be9e3a426592ca37814b87600bba4643b81960a082a9c
I0410 16:37:13.124866       1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 234.700764ms to process 1 records
I0410 16:37:13.201545       1 sca.go:266] etc-pki-entitlement secret successfully created
I0410 16:37:13.201572       1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated
I0410 16:37:13.964273       1 tasks_processing.go:74] worker 59 stopped.
I0410 16:37:13.964294       1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570
I0410 16:37:13.964307       1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.073854193s to process 1 records
I0410 16:37:13.964616       1 tasks_processing.go:74] worker 60 stopped.
I0410 16:37:13.964661       1 recorder.go:75] Recording config/alerts with fingerprint=363f2d221aa19be972b7e34453c888ad3c94112f15b0c02b0af75be72e49a2de
I0410 16:37:13.964677       1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.071217588s to process 1 records
W0410 16:37:13.999605       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0410 16:37:14.999582       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0410 16:37:15.429884       1 tasks_processing.go:74] worker 39 stopped.
I0410 16:37:15.430022       1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=5651e25d438248b4718b989cdcfd1446288fdeb1e98e181038ebe8bced5406bf
I0410 16:37:15.430078       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1
I0410 16:37:15.430116       1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=9acdeab7000e4559ce46631a0d5c76acd1cf70f5ad54f2ad6ff53e8cd8218c6a
I0410 16:37:15.430128       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e
I0410 16:37:15.430150       1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=df6493f32d3975479a28e70d91ebdbc843ac5e1b356e8040d859e7f3b999f8e1
I0410 16:37:15.430190       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f
I0410 16:37:15.430233       1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=4fb387563eee937aa8fe2ded1c9359280e2461db7b2ef5117b7c490959d7979e
I0410 16:37:15.430263       1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=6a07b5793975da1f369ca6090f34cb515646b8971a7fb717deabd40b3a037274
I0410 16:37:15.430289       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=109f7f0ab1ab3227f105d269fccd1b56dc0d27fc81e5f45a93d30553976358a2
I0410 16:37:15.430322       1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=c5a6f0c63716499d71fd85a4ec37d8bbd670282827eaaa597da15afa73ac4491
I0410 16:37:15.430597       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=a2c059a6563f1d9576a94f41a529399cbc866d028b563480b32dac5ff6814845
I0410 16:37:15.430619       1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=75c4c5cc067919e01d2501c700b2c56891e571cdcefa39ddc98b3e2af778a381
I0410 16:37:15.430630       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762
I0410 16:37:15.430646       1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=fd98b94ca774c70a1b93be71ea75bfbe70ac04fab95ca76c1980722788332c71
I0410 16:37:15.430658       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11
I0410 16:37:15.430676       1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=b7037b256fe59c612556242eb2fa100bf8db36d954765d3d44bbc4e0df1e4594
I0410 16:37:15.430686       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a
I0410 16:37:15.430706       1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=2f7a63eb7277e544f880539d669f6a199de3900e341dd9864de2fd0a9de82f3b
I0410 16:37:15.430717       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db
I0410 16:37:15.430737       1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=84715315a4a8cfde7f090e9a94838222bec6495638829022da70fa0d2f08bf97
I0410 16:37:15.430841       1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=b5ea0d6dea61feb314bac084bc291fef5d385a8bb86a25e742aaaa787c5b6e80
I0410 16:37:15.430851       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab
I0410 16:37:15.430859       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d
I0410 16:37:15.430880       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75
I0410 16:37:15.430911       1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=47c89452ea3ed03753f6951818f402b09379da723cbf7c5a68182c0786ab9b46
I0410 16:37:15.430937       1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=a4298fddb9ec6b4c6ce61aa4baa0e599320b8b5da614dce7e79ffcb689565b56
I0410 16:37:15.430947       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76
I0410 16:37:15.430964       1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=62b99f4a6138ef44c277aee85bc008993e7d7908f4dd4a9653d62159e8f499cb
I0410 16:37:15.430977       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7
I0410 16:37:15.430995       1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=bfc630a1fafdcf7e23428bb05c016c91ce2601159cca39af9d98b049427403ea
I0410 16:37:15.431006       1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd
I0410 16:37:15.431019       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=6c26ef27b75eb17510b5c5c5566ed32fdbd456219d47ece47386a678b87ffd78
I0410 16:37:15.431036       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=8e9252d335e05f05833dbed15032c4a2c399761841cb1ea86708022897d692c5
I0410 16:37:15.431051       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=30ef16e8727f1f69213a3a22b09637c0fc2b1fa8c9d9fa99481ceb1e9569e9c4
I0410 16:37:15.431074       1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=c388c9ee70c4477862190639b7ec2a0b7ce32303a7f45834a041b0b885852de5
I0410 16:37:15.431084       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa
I0410 16:37:15.431114       1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=f4f9bd7e58a6f70258bebc58be0bbe2b2a851f49169c14ebcf81f217d5f1b21e
I0410 16:37:15.431133       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e
I0410 16:37:15.431141       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad
I0410 16:37:15.431148       1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.538655779s to process 39 records
W0410 16:37:15.999834       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0410 16:37:16.999172       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0410 16:37:17.997439       1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0410 16:37:17.997460       1 tasks_processing.go:74] worker 34 stopped.
E0410 16:37:17.997472       1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0410 16:37:17.997504       1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
I0410 16:37:17.997521       1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.107594237s to process 1 records
I0410 16:37:25.802170       1 tasks_processing.go:74] worker 33 stopped.
I0410 16:37:25.802218       1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539
I0410 16:37:25.802233       1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.909402212s to process 1 records
I0410 16:37:26.501600       1 tasks_processing.go:74] worker 53 stopped.
I0410 16:37:26.501926       1 recorder.go:75] Recording config/serviceaccounts with fingerprint=16e4c55b4d63cefcfc7800aa646e617d46f0ec5f940c3fd1a629fc5ae985c964
I0410 16:37:26.501947       1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.608164775s to process 1 records
E0410 16:37:26.502030       1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.612s with: function \"machines\" failed with an error, function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error"
I0410 16:37:26.503150       1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error
I0410 16:37:26.503183       1 periodic.go:216] Running workloads gatherer
I0410 16:37:26.503210       1 tasks_processing.go:45] number of workers: 2
I0410 16:37:26.503228       1 tasks_processing.go:69] worker 1 listening for tasks.
I0410 16:37:26.503237       1 tasks_processing.go:71] worker 1 working on workload_info task.
I0410 16:37:26.503242       1 tasks_processing.go:69] worker 0 listening for tasks.
I0410 16:37:26.503257       1 tasks_processing.go:71] worker 0 working on helmchart_info task.
I0410 16:37:26.510227       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-187.ec2.internal...
I0410 16:37:26.510236       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-66.ec2.internal...
I0410 16:37:26.510252       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-177.ec2.internal...
I0410 16:37:26.529106       1 tasks_processing.go:74] worker 0 stopped.
I0410 16:37:26.529122       1 gather.go:177] gatherer "workloads" function "helmchart_info" took 25.836288ms to process 0 records
I0410 16:37:31.174108       1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 5s
I0410 16:37:31.202438       1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 24s for image data
I0410 16:37:31.225757       1 gather_workloads_info.go:387] No image sha256:d7767202aecccd0af8251c5d40e16a93d2d6867ef7ab7f31314266cc5404dbba (25ms)
I0410 16:37:31.233397       1 gather_workloads_info.go:387] No image sha256:5e7db48dd4a7ff84ca21a35498799f35a001334e74e8a66bbd11244daab6d533 (8ms)
I0410 16:37:31.241357       1 gather_workloads_info.go:387] No image sha256:88be57daafab16ef117d2aa5dac938da96665b55319dcf01d0f2edc023c728b6 (8ms)
I0410 16:37:31.248758       1 gather_workloads_info.go:387] No image sha256:20e2e2505448513cbf0c95ba981ce87e4ba3f994d42d6b90370c3cfaab8b448b (7ms)
I0410 16:37:31.256461       1 gather_workloads_info.go:387] No image sha256:26a2580cdf01df7e6430eac9b36bbfe79e5223ec14d2a4dfe61a6e075c21832c (8ms)
I0410 16:37:31.264190       1 gather_workloads_info.go:387] No image sha256:926e521b1d07918c46104415d47ea633a6c25b918ef71140c34c7276153b85da (8ms)
I0410 16:37:31.274043       1 gather_workloads_info.go:387] No image sha256:255c506fb0b20a8afbd64f138e5cf0c695dfd039594560d91087647527e9501f (10ms)
I0410 16:37:31.282102       1 gather_workloads_info.go:387] No image sha256:1e346b05235ef4d371e9b803df800ca7de7999132e234b14cfaabbc1732cbef9 (8ms)
I0410 16:37:31.289467       1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (7ms)
I0410 16:37:31.298590       1 gather_workloads_info.go:387] No image sha256:30e6938f5f2008f88c6cbbd91367bafc78f96e9d287e550a66d891092804b5be (9ms)
I0410 16:37:31.309373       1 gather_workloads_info.go:387] No image sha256:adb9f2d773e253c4f43ba1b512162bc3e51c7893776bf31a0c790f172364fa71 (11ms)
I0410 16:37:31.410848       1 gather_workloads_info.go:398] Found image sha256:0ddc5cbde4b530f79c13064bde89c57223808a66e3d619aca1388e094706f16d (101ms)
I0410 16:37:31.511352       1 gather_workloads_info.go:398] Found image sha256:47049c087e791c86ad7f4bb21562a9b01565dfcbe374674016d27e23d8bb9c9e (100ms)
I0410 16:37:31.611091       1 gather_workloads_info.go:387] No image sha256:0f8dbfb8a31773a05e84a98aa16bf781424c21fa0706b6864b175d490176732a (100ms)
I0410 16:37:31.711044       1 gather_workloads_info.go:387] No image sha256:0c00070db090265c8efb666505fb6ebcde93da427961e5a00d2fab3fb3668868 (100ms)
I0410 16:37:31.810384       1 gather_workloads_info.go:387] No image sha256:437f1b1ab57ee9db467c2d04133da4f0ac96b8ac33ab501536e6450368bc9a82 (99ms)
I0410 16:37:31.913674       1 gather_workloads_info.go:387] No image sha256:ce98d5d844bfc2ba8de1893866ad38166c95157d54abd8192b181e819bc50bb5 (103ms)
I0410 16:37:32.010735       1 gather_workloads_info.go:387] No image sha256:1e17135e36b04ec71afd62c092cc60c4106f004b6c869b5a31da61ceac09fba2 (97ms)
I0410 16:37:32.111188       1 gather_workloads_info.go:387] No image sha256:3fc85649117d76ffdec2326d489603ff0a3d65597079e045515e3067f57be529 (100ms)
I0410 16:37:32.210524       1 gather_workloads_info.go:387] No image sha256:d54782e70dfc06f37e62e165fc257270bab0cb9ebde517449e237e99d50ebc66 (99ms)
I0410 16:37:32.314209       1 gather_workloads_info.go:387] No image sha256:1cf439ca0d409ba9e0c6a0e4dfcb55537607bf34c177630f9400780e46f268ab (104ms)
I0410 16:37:32.410340       1 gather_workloads_info.go:387] No image sha256:418fc884217cf60159ae406316322e717308ebf70cc87d4f7cd8409d2f4487ff (96ms)
I0410 16:37:32.510586       1 gather_workloads_info.go:387] No image sha256:658016cc7c947fda5f092fd8caece619163d22b3b6b508b11e527b9bb2a0057f (100ms)
I0410 16:37:32.611058       1 gather_workloads_info.go:387] No image sha256:17f7dc8737ce5e65f3bd9647c71537357250a2eaa1feef6621cc4ffb0ccc1994 (100ms)
I0410 16:37:32.710144       1 gather_workloads_info.go:387] No image sha256:49cbd2fe2f0fffdbf57623172b044a444ad219dad2b77997060d28ff6ebe2e22 (99ms)
I0410 16:37:32.810071       1 gather_workloads_info.go:387] No image sha256:bc4babb73d92d733167553919805cc652b71ee8e704e394edd9b7a7de7ea1814 (100ms)
I0410 16:37:32.910609       1 gather_workloads_info.go:387] No image sha256:2ce799af9d720d44b8bcf3eb5a0d27219b3bdab944d2ea12eb36e5f5f400e001 (101ms)
I0410 16:37:33.010319       1 gather_workloads_info.go:387] No image sha256:32c74f9352fbba501782cd251f73df8c35ea891fed7b8f1f23c12560dc1d85b6 (100ms)
I0410 16:37:33.110612       1 gather_workloads_info.go:387] No image sha256:a87cda44a9789e1f42af39759fa1f40c3f0c1b07e11c19b88c1719fb4fce5a62 (100ms)
I0410 16:37:33.211917       1 gather_workloads_info.go:387] No image sha256:80bb716e3db9615c2ee20bee50ba50d878be8af6b227879a9240e1cfbedd42c3 (101ms)
I0410 16:37:33.312483       1 gather_workloads_info.go:387] No image sha256:9014ddff98f9ac806dc8c6ffa0f2c6b7e8ae0ec816c9596f4604c909c2c43794 (101ms)
I0410 16:37:33.411058       1 gather_workloads_info.go:387] No image sha256:8fe9a4675d883073a41b2b05ff87c36c733de19dfdbc4e0256f23756a4ba1dc2 (99ms)
I0410 16:37:33.510236       1 gather_workloads_info.go:387] No image sha256:02874ef814fc7ac6a608fba34b4659f3c9694b29841e6e4376706665817e2532 (99ms)
I0410 16:37:33.610066       1 gather_workloads_info.go:387] No image sha256:3798c959e5a980414f30fcb7cb261cfb1aeda057193f553502a8aa9cfcdf75fa (100ms)
I0410 16:37:33.710385       1 gather_workloads_info.go:387] No image sha256:067fd85a0ea0622338fee711e142545ec5af90675680ff03a8510f91b009c3c8 (100ms)
I0410 16:37:33.810021       1 gather_workloads_info.go:387] No image sha256:619578ee4bc5fe42dc3fd908b03e0adce028318231d8aa3fd0542f09fd728ac2 (100ms)
I0410 16:37:33.911654       1 gather_workloads_info.go:387] No image sha256:17cd4386c9de87fe4d0214928edbb2f1325bd89c22dcd608f30061ea555d2983 (102ms)
I0410 16:37:34.010603       1 gather_workloads_info.go:387] No image sha256:9df8b58d8a1909593488b3388adce14fbe1275bde2b73ba9290aad53e8d16460 (99ms)
I0410 16:37:34.111100       1 gather_workloads_info.go:387] No image sha256:1d4b6fbc5ee7087e26e0b72f35a858a35f5cc4f92cf85fae43615797edb55920 (100ms)
I0410 16:37:34.210324       1 gather_workloads_info.go:387] No image sha256:0277b18d2c5c3b367751a8f18edaa69717d74b1b61eea20a31ddf43b0c06aeac (99ms)
I0410 16:37:34.310899       1 gather_workloads_info.go:387] No image sha256:1174fac047f9e099144e2409e693b920937e3825b00e91458077bce873c2065d (101ms)
I0410 16:37:34.410435       1 gather_workloads_info.go:387] No image sha256:2740036c4476448a58a6382e366fc11ab6de358cf7fdbc3eca9d130947d1eb12 (100ms)
I0410 16:37:34.511003       1 gather_workloads_info.go:387] No image sha256:74ed78ab581f98f9efdc02c8780d1ba71c70269780bc3b17897ffa7c383430a7 (101ms)
I0410 16:37:34.610309       1 gather_workloads_info.go:387] No image sha256:a0fcde40905fe7600ff0a84b4eceb9d167c3c94fb5c232b4a814bd07099aafd8 (99ms)
I0410 16:37:34.711035       1 gather_workloads_info.go:387] No image sha256:4e1204013986e4b796aee633d2f7dfb3ea040aaf9930e7094192baf88bf1783b (101ms)
I0410 16:37:34.809971       1 gather_workloads_info.go:387] No image sha256:5084d257ac981d93acba8f5c6b61cdfca2087d1c144ba278e2ce549ad9f0651a (99ms)
I0410 16:37:34.911222       1 gather_workloads_info.go:387] No image sha256:98cf746a3864f53e09e967a2aa2a4c54d18261b3d5e5c4c20b58f08ad44d6a7c (101ms)
I0410 16:37:35.011074       1 gather_workloads_info.go:387] No image sha256:0cbbf132a30f0d4015b8a3998cfc628705b4250c68385d842a2fbedd977338aa (100ms)
I0410 16:37:35.113196       1 gather_workloads_info.go:387] No image sha256:2573000c2cdc8025b95a355005633ad6e63548eda496705626ae574181ae958f (102ms)
I0410 16:37:35.113234       1 tasks_processing.go:74] worker 1 stopped.
I0410 16:37:35.113531       1 recorder.go:75] Recording config/workload_info with fingerprint=ff7b547397c3a9e18463f324da169f4cb5e7efcb3b29f75c13ba7e0c396abc25
I0410 16:37:35.113554       1 gather.go:177] gatherer "workloads" function "workload_info" took 8.609988363s to process 1 records
I0410 16:37:35.113583       1 periodic.go:263] Periodic gather workloads completed in 8.61s
I0410 16:37:35.113597       1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message=
I0410 16:37:35.113604       1 periodic.go:216] Running conditional gatherer
I0410 16:37:35.119535       1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.8/gathering_rules
I0410 16:37:35.370787       1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer
I0410 16:37:36.436429       1 conditional_gatherer.go:384] updating version cache for conditional gatherer
I0410 16:37:36.445191       1 conditional_gatherer.go:392] cluster version is '4.21.8'
I0410 16:37:36.445254       1 tasks_processing.go:45] number of workers: 3
I0410 16:37:36.445265       1 tasks_processing.go:69] worker 2 listening for tasks.
I0410 16:37:36.445269       1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task.
I0410 16:37:36.445286       1 tasks_processing.go:69] worker 0 listening for tasks.
I0410 16:37:36.445297       1 tasks_processing.go:69] worker 1 listening for tasks.
I0410 16:37:36.445316       1 tasks_processing.go:71] worker 2 working on rapid_container_logs task.
I0410 16:37:36.445337       1 tasks_processing.go:74] worker 1 stopped.
I0410 16:37:36.445321       1 tasks_processing.go:71] worker 0 working on remote_configuration task.
I0410 16:37:36.445415       1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c
I0410 16:37:36.445437       1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.307µs to process 1 records
I0410 16:37:36.445494       1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d
I0410 16:37:36.445504       1 gather.go:177] gatherer "conditional" function "remote_configuration" took 2.437µs to process 1 records
I0410 16:37:36.445513       1 tasks_processing.go:74] worker 0 stopped.
I0410 16:37:36.445656       1 tasks_processing.go:74] worker 2 stopped.
I0410 16:37:36.445667       1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 319.946µs to process 0 records
I0410 16:37:36.445683       1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message=
I0410 16:37:36.445701       1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f
I0410 16:37:36.477180       1 recorder.go:75] Recording insights-operator/gathers with fingerprint=23621193b6d00ea31a6f09dbca4f601a4a0ebce9ad8a90aa57824686d9b22c4e
I0410 16:37:36.477313       1 diskrecorder.go:70] Writing 111 records to /var/lib/insights-operator/insights-2026-04-10-163736.tar.gz
I0410 16:37:36.484534       1 diskrecorder.go:51] Wrote 111 records to disk in 7ms
I0410 16:37:36.484569       1 periodic.go:285] Gathering cluster info every 2h0m0s
I0410 16:37:36.484585       1 periodic.go:286] Configuration is 
	dataReporting:
		interval: 2h0m0s,
		uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload,
		storagePath: /var/lib/insights-operator,
		downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, 
		conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules,
		obfuscation: []
	sca:
		disabled: false,
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates,
		interval: 8h0m0s
	alerting:
		disabled: false
	clusterTransfer:
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/,
		interval: 12h0m0s
	proxy:
		httpProxy: ,
		httpsProxy: ,
		noProxy: 
I0410 16:38:42.890546       1 diskrecorder.go:223] Found files to send: insights-2026-04-10-163736.tar.gz
I0410 16:38:42.890576       1 insightsuploader.go:150] Checking archives to upload periodically every 15m4.259578552s
I0410 16:38:42.890585       1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z
I0410 16:38:42.900299       1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload
I0410 16:38:43.049341       1 requests.go:87] Successfully reported id=2026-04-10T16:38:42Z x-rh-insights-request-id=31fb02b22bb54610ab773bba71fa3ac6, wrote=50936
I0410 16:38:43.049397       1 insightsuploader.go:187] Uploaded report successfully in 158.804462ms
I0410 16:38:43.049418       1 controller.go:129] Initializing last reported time to 2026-04-10T16:38:42Z
I0410 16:38:43.049460       1 insightsreport.go:304] Archive uploaded, starting pulling report...
I0410 16:38:43.049470       1 insightsreport.go:215] Starting retrieving report from Smart Proxy
I0410 16:38:43.049477       1 insightsreport.go:221] Initial delay for pulling: 1m0s
I0410 16:38:43.056077       1 controller.go:554] The operator is healthy
I0410 16:39:12.920780       1 controller.go:554] The operator is healthy
I0410 16:39:47.441869       1 insightsreport.go:137] Pulling report from smart-proxy
I0410 16:39:47.441894       1 insightsreport.go:149] Retrieving report
I0410 16:39:47.448596       1 requests.go:110] Retrieving report for cluster: 43ce1c1c-b4b3-423d-bc0b-9378181b086c
I0410 16:39:47.448607       1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/43ce1c1c-b4b3-423d-bc0b-9378181b086c/reports
I0410 16:39:47.451894       1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/43ce1c1c-b4b3-423d-bc0b-9378181b086c/reports
I0410 16:39:48.006201       1 insightsreport.go:184] Report retrieved
I0410 16:39:48.032462       1 insightsreport.go:239] Report retrieved correctly
I0410 16:41:12.921953       1 controller.go:554] The operator is healthy