I0327 15:11:13.646714 1 cmd.go:253] Using service-serving-cert provided certificates I0327 15:11:13.647623 1 observer_polling.go:159] Starting file observer I0327 15:11:14.206210 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0327 15:11:14.206878 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0327 15:11:14.207677 1 secure_serving.go:57] Forcing use of http/1.1 only W0327 15:11:14.207698 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0327 15:11:14.207703 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0327 15:11:14.207707 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0327 15:11:14.207709 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0327 15:11:14.207711 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0327 15:11:14.207714 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0327 15:11:14.207889 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0327 15:11:14.211332 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0327 15:11:14.211359 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"ddf6bb33-2554-423c-82c8-dd5994810db2", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0327 15:11:14.213858 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0327 15:11:14.213871 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0327 15:11:14.213892 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0327 15:11:14.213879 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0327 15:11:14.213873 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0327 15:11:14.213971 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0327 15:11:14.214264 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0327 15:11:14.214691 1 secure_serving.go:213] Serving securely on [::]:8443 I0327 15:11:14.214739 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0327 15:11:14.218131 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0327 15:11:14.218160 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0327 15:11:14.218272 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0327 15:11:14.228006 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0327 15:11:14.228428 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0327 15:11:14.231990 1 secretconfigobserver.go:119] support secret does not exist I0327 15:11:14.235991 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0327 15:11:14.239880 1 secretconfigobserver.go:119] support secret does not exist I0327 15:11:14.244759 1 recorder.go:176] Pruning old reports every 6h35m19s, max age is 288h0m0s I0327 15:11:14.248788 1 periodic.go:216] Running clusterconfig gatherer I0327 15:11:14.248793 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0327 15:11:14.248809 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0327 15:11:14.248828 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0327 15:11:14.248828 1 tasks_processing.go:45] number of workers: 64 I0327 15:11:14.248833 1 insightsreport.go:296] Starting report retriever I0327 15:11:14.248838 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0327 15:11:14.248851 1 tasks_processing.go:69] worker 2 listening for tasks. I0327 15:11:14.248862 1 tasks_processing.go:69] worker 0 listening for tasks. I0327 15:11:14.248858 1 tasks_processing.go:69] worker 5 listening for tasks. I0327 15:11:14.248869 1 tasks_processing.go:69] worker 1 listening for tasks. I0327 15:11:14.248874 1 tasks_processing.go:69] worker 21 listening for tasks. I0327 15:11:14.248875 1 tasks_processing.go:69] worker 4 listening for tasks. I0327 15:11:14.248872 1 tasks_processing.go:69] worker 3 listening for tasks. I0327 15:11:14.248879 1 tasks_processing.go:69] worker 6 listening for tasks. I0327 15:11:14.248883 1 tasks_processing.go:69] worker 39 listening for tasks. I0327 15:11:14.248889 1 tasks_processing.go:69] worker 32 listening for tasks. I0327 15:11:14.248890 1 tasks_processing.go:69] worker 8 listening for tasks. I0327 15:11:14.248893 1 tasks_processing.go:69] worker 31 listening for tasks. I0327 15:11:14.248898 1 tasks_processing.go:69] worker 10 listening for tasks. I0327 15:11:14.248894 1 tasks_processing.go:71] worker 39 working on machines task. I0327 15:11:14.248902 1 tasks_processing.go:69] worker 40 listening for tasks. I0327 15:11:14.248909 1 tasks_processing.go:69] worker 37 listening for tasks. I0327 15:11:14.248909 1 tasks_processing.go:69] worker 38 listening for tasks. I0327 15:11:14.248916 1 tasks_processing.go:71] worker 37 working on support_secret task. I0327 15:11:14.248919 1 tasks_processing.go:69] worker 36 listening for tasks. I0327 15:11:14.248910 1 tasks_processing.go:71] worker 40 working on openstack_controlplanes task. I0327 15:11:14.248923 1 tasks_processing.go:69] worker 13 listening for tasks. I0327 15:11:14.248926 1 tasks_processing.go:69] worker 34 listening for tasks. I0327 15:11:14.248933 1 tasks_processing.go:69] worker 24 listening for tasks. I0327 15:11:14.248929 1 tasks_processing.go:71] worker 13 working on silenced_alerts task. I0327 15:11:14.248940 1 tasks_processing.go:71] worker 24 working on crds task. I0327 15:11:14.248921 1 tasks_processing.go:69] worker 26 listening for tasks. I0327 15:11:14.248935 1 tasks_processing.go:69] worker 23 listening for tasks. I0327 15:11:14.248905 1 tasks_processing.go:71] worker 10 working on nodenetworkstates task. I0327 15:11:14.248951 1 tasks_processing.go:69] worker 22 listening for tasks. I0327 15:11:14.248966 1 tasks_processing.go:69] worker 48 listening for tasks. I0327 15:11:14.248979 1 tasks_processing.go:69] worker 41 listening for tasks. I0327 15:11:14.248917 1 tasks_processing.go:69] worker 12 listening for tasks. I0327 15:11:14.248907 1 tasks_processing.go:69] worker 35 listening for tasks. I0327 15:11:14.248918 1 tasks_processing.go:71] worker 38 working on ingress task. I0327 15:11:14.248899 1 tasks_processing.go:71] worker 8 working on storage_classes task. I0327 15:11:14.248940 1 tasks_processing.go:69] worker 19 listening for tasks. I0327 15:11:14.248934 1 tasks_processing.go:71] worker 34 working on image_registries task. I0327 15:11:14.248910 1 tasks_processing.go:69] worker 11 listening for tasks. I0327 15:11:14.249044 1 tasks_processing.go:69] worker 45 listening for tasks. I0327 15:11:14.248894 1 tasks_processing.go:71] worker 6 working on storage_cluster task. I0327 15:11:14.249049 1 tasks_processing.go:71] worker 5 working on openshift_logging task. I0327 15:11:14.249056 1 tasks_processing.go:69] worker 43 listening for tasks. I0327 15:11:14.249061 1 tasks_processing.go:69] worker 17 listening for tasks. I0327 15:11:14.249066 1 tasks_processing.go:69] worker 44 listening for tasks. I0327 15:11:14.248925 1 tasks_processing.go:71] worker 36 working on install_plans task. I0327 15:11:14.249085 1 tasks_processing.go:71] worker 4 working on authentication task. I0327 15:11:14.249086 1 tasks_processing.go:71] worker 1 working on olm_operators task. I0327 15:11:14.249091 1 tasks_processing.go:69] worker 59 listening for tasks. I0327 15:11:14.249097 1 tasks_processing.go:71] worker 59 working on operators_pods_and_events task. I0327 15:11:14.248920 1 tasks_processing.go:69] worker 33 listening for tasks. I0327 15:11:14.249001 1 tasks_processing.go:71] worker 2 working on validating_webhook_configurations task. I0327 15:11:14.249107 1 tasks_processing.go:71] worker 23 working on feature_gates task. I0327 15:11:14.249115 1 tasks_processing.go:69] worker 47 listening for tasks. I0327 15:11:14.249124 1 tasks_processing.go:71] worker 35 working on container_images task. I0327 15:11:14.249132 1 tasks_processing.go:69] worker 16 listening for tasks. I0327 15:11:14.249136 1 tasks_processing.go:69] worker 56 listening for tasks. I0327 15:11:14.249106 1 tasks_processing.go:69] worker 46 listening for tasks. I0327 15:11:14.248904 1 tasks_processing.go:71] worker 31 working on infrastructures task. I0327 15:11:14.248934 1 tasks_processing.go:69] worker 18 listening for tasks. I0327 15:11:14.249044 1 tasks_processing.go:71] worker 0 working on schedulers task. I0327 15:11:14.249324 1 tasks_processing.go:71] worker 46 working on openstack_dataplanedeployments task. I0327 15:11:14.249096 1 tasks_processing.go:69] worker 42 listening for tasks. I0327 15:11:14.249065 1 tasks_processing.go:69] worker 57 listening for tasks. I0327 15:11:14.249146 1 tasks_processing.go:69] worker 62 listening for tasks. I0327 15:11:14.249084 1 tasks_processing.go:69] worker 58 listening for tasks. I0327 15:11:14.249097 1 tasks_processing.go:71] worker 44 working on machine_autoscalers task. I0327 15:11:14.249535 1 tasks_processing.go:71] worker 58 working on cluster_apiserver task. I0327 15:11:14.249550 1 tasks_processing.go:71] worker 18 working on openstack_version task. I0327 15:11:14.249102 1 tasks_processing.go:71] worker 26 working on dvo_metrics task. I0327 15:11:14.249539 1 tasks_processing.go:71] worker 42 working on qemu_kubevirt_launcher_logs task. I0327 15:11:14.249151 1 tasks_processing.go:69] worker 14 listening for tasks. I0327 15:11:14.249870 1 tasks_processing.go:71] worker 14 working on container_runtime_configs task. I0327 15:11:14.249145 1 tasks_processing.go:69] worker 15 listening for tasks. I0327 15:11:14.248894 1 tasks_processing.go:69] worker 9 listening for tasks. I0327 15:11:14.248884 1 tasks_processing.go:69] worker 7 listening for tasks. I0327 15:11:14.249158 1 tasks_processing.go:69] worker 61 listening for tasks. I0327 15:11:14.249153 1 tasks_processing.go:69] worker 25 listening for tasks. I0327 15:11:14.249162 1 tasks_processing.go:69] worker 29 listening for tasks. I0327 15:11:14.249166 1 tasks_processing.go:69] worker 27 listening for tasks. I0327 15:11:14.249165 1 tasks_processing.go:69] worker 30 listening for tasks. I0327 15:11:14.249167 1 tasks_processing.go:71] worker 21 working on node_logs task. I0327 15:11:14.249928 1 tasks_processing.go:71] worker 30 working on ceph_cluster task. I0327 15:11:14.249950 1 tasks_processing.go:71] worker 15 working on aggregated_monitoring_cr_names task. I0327 15:11:14.249961 1 tasks_processing.go:71] worker 9 working on certificate_signing_requests task. I0327 15:11:14.249170 1 tasks_processing.go:71] worker 48 working on mutating_webhook_configurations task. I0327 15:11:14.249934 1 tasks_processing.go:71] worker 61 working on tsdb_status task. I0327 15:11:14.248900 1 tasks_processing.go:71] worker 32 working on metrics task. I0327 15:11:14.249172 1 tasks_processing.go:69] worker 28 listening for tasks. I0327 15:11:14.250174 1 tasks_processing.go:71] worker 28 working on image_pruners task. I0327 15:11:14.249178 1 tasks_processing.go:71] worker 45 working on node_features task. I0327 15:11:14.249176 1 tasks_processing.go:69] worker 52 listening for tasks. I0327 15:11:14.249183 1 tasks_processing.go:71] worker 19 working on machine_configs task. I0327 15:11:14.250316 1 tasks_processing.go:71] worker 52 working on nodes task. I0327 15:11:14.249183 1 tasks_processing.go:69] worker 49 listening for tasks. I0327 15:11:14.249181 1 tasks_processing.go:71] worker 41 working on sap_pods task. I0327 15:11:14.250345 1 tasks_processing.go:71] worker 49 working on overlapping_namespace_uids task. I0327 15:11:14.249179 1 tasks_processing.go:69] worker 54 listening for tasks. I0327 15:11:14.250414 1 tasks_processing.go:71] worker 54 working on operators task. I0327 15:11:14.249189 1 tasks_processing.go:69] worker 53 listening for tasks. I0327 15:11:14.249189 1 tasks_processing.go:71] worker 12 working on jaegers task. I0327 15:11:14.249186 1 tasks_processing.go:71] worker 11 working on machine_sets task. I0327 15:11:14.249191 1 tasks_processing.go:69] worker 50 listening for tasks. I0327 15:11:14.249197 1 tasks_processing.go:71] worker 43 working on oauths task. I0327 15:11:14.250669 1 tasks_processing.go:71] worker 50 working on openstack_dataplanenodesets task. I0327 15:11:14.250685 1 tasks_processing.go:71] worker 53 working on openshift_machine_api_events task. I0327 15:11:14.249196 1 tasks_processing.go:69] worker 51 listening for tasks. I0327 15:11:14.249204 1 tasks_processing.go:71] worker 17 working on pdbs task. I0327 15:11:14.250718 1 tasks_processing.go:71] worker 51 working on machine_config_pools task. I0327 15:11:14.249210 1 tasks_processing.go:71] worker 16 working on cost_management_metrics_configs task. I0327 15:11:14.249210 1 tasks_processing.go:69] worker 63 listening for tasks. I0327 15:11:14.250939 1 tasks_processing.go:71] worker 63 working on nodenetworkconfigurationpolicies task. I0327 15:11:14.249214 1 tasks_processing.go:71] worker 33 working on ingress_certificates task. I0327 15:11:14.249214 1 tasks_processing.go:71] worker 47 working on config_maps task. I0327 15:11:14.249225 1 tasks_processing.go:69] worker 20 listening for tasks. I0327 15:11:14.251261 1 tasks_processing.go:71] worker 20 working on pod_network_connectivity_checks task. I0327 15:11:14.249201 1 tasks_processing.go:69] worker 55 listening for tasks. I0327 15:11:14.249256 1 tasks_processing.go:71] worker 56 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0327 15:11:14.249649 1 tasks_processing.go:71] worker 57 working on sap_config task. I0327 15:11:14.251459 1 tasks_processing.go:71] worker 55 working on networks task. I0327 15:11:14.249650 1 tasks_processing.go:71] worker 62 working on service_accounts task. I0327 15:11:14.249154 1 tasks_processing.go:69] worker 60 listening for tasks. I0327 15:11:14.251638 1 tasks_processing.go:71] worker 60 working on clusterroles task. I0327 15:11:14.249972 1 tasks_processing.go:71] worker 29 working on lokistack task. I0327 15:11:14.249968 1 tasks_processing.go:71] worker 7 working on sap_datahubs task. I0327 15:11:14.249976 1 tasks_processing.go:71] worker 25 working on image task. I0327 15:11:14.249978 1 tasks_processing.go:71] worker 27 working on active_alerts task. I0327 15:11:14.249173 1 tasks_processing.go:71] worker 22 working on machine_healthchecks task. I0327 15:11:14.249196 1 tasks_processing.go:71] worker 3 working on monitoring_persistent_volumes task. I0327 15:11:14.253853 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 4.775809ms to process 0 records I0327 15:11:14.253835 1 tasks_processing.go:71] worker 5 working on proxies task. I0327 15:11:14.254648 1 tasks_processing.go:71] worker 40 working on version task. I0327 15:11:14.254701 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 5.716757ms to process 0 records E0327 15:11:14.254727 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0327 15:11:14.254733 1 gather.go:177] gatherer "clusterconfig" function "machines" took 5.795723ms to process 0 records I0327 15:11:14.254765 1 tasks_processing.go:74] worker 39 stopped. I0327 15:11:14.255294 1 tasks_processing.go:74] worker 46 stopped. I0327 15:11:14.255306 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 5.950727ms to process 0 records E0327 15:11:14.256045 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.25.239:9091: connect: connection refused I0327 15:11:14.256068 1 tasks_processing.go:74] worker 61 stopped. E0327 15:11:14.256078 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.25.239:9091: connect: connection refused I0327 15:11:14.256093 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 5.990721ms to process 0 records E0327 15:11:14.256100 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.25.239:9091: connect: connection refused I0327 15:11:14.256126 1 tasks_processing.go:74] worker 32 stopped. E0327 15:11:14.256135 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.25.239:9091: connect: connection refused I0327 15:11:14.256156 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 5.98467ms to process 0 records I0327 15:11:14.256251 1 tasks_processing.go:74] worker 4 stopped. I0327 15:11:14.256509 1 recorder.go:75] Recording config/authentication with fingerprint=cbba288c4044ad47250cb3bcafad047673b26d9642bc12e2fa72b24aebd0fcab I0327 15:11:14.256524 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 7.154262ms to process 1 records I0327 15:11:14.256536 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 6.835025ms to process 0 records I0327 15:11:14.256544 1 tasks_processing.go:74] worker 18 stopped. I0327 15:11:14.265377 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0327 15:11:14.265395 1 controller.go:368] The initial operator extension status is healthy I0327 15:11:14.265403 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0327 15:11:14.265409 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0327 15:11:14.265414 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0327 15:11:14.265433 1 controller.go:531] The operator is still being initialized I0327 15:11:14.265439 1 controller.go:554] The operator is healthy I0327 15:11:14.265514 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0327 15:11:14.265605 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0327 15:11:14.265688 1 operator.go:328] started I0327 15:11:14.265714 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0327 15:11:14.276011 1 tasks_processing.go:74] worker 50 stopped. I0327 15:11:14.276027 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 25.323212ms to process 0 records I0327 15:11:14.278743 1 tasks_processing.go:74] worker 10 stopped. I0327 15:11:14.278761 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 29.761349ms to process 0 records I0327 15:11:14.278869 1 tasks_processing.go:74] worker 63 stopped. I0327 15:11:14.278888 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 27.919751ms to process 0 records I0327 15:11:14.278901 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 27.990955ms to process 0 records I0327 15:11:14.278906 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 28.164751ms to process 0 records E0327 15:11:14.278913 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0327 15:11:14.278923 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 29.981202ms to process 0 records I0327 15:11:14.278919 1 tasks_processing.go:74] worker 16 stopped. I0327 15:11:14.278931 1 tasks_processing.go:74] worker 37 stopped. I0327 15:11:14.278938 1 tasks_processing.go:74] worker 51 stopped. I0327 15:11:14.278962 1 tasks_processing.go:74] worker 6 stopped. E0327 15:11:14.278965 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0327 15:11:14.278981 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 29.905436ms to process 0 records I0327 15:11:14.278993 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 28.71736ms to process 0 records I0327 15:11:14.279000 1 tasks_processing.go:74] worker 45 stopped. I0327 15:11:14.279100 1 tasks_processing.go:74] worker 31 stopped. I0327 15:11:14.279711 1 recorder.go:75] Recording config/infrastructure with fingerprint=b6d6b02e3e9df63334a0313d46c5d87eb9c2cee1090bc4d95c075015dfdcf65b I0327 15:11:14.279727 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 29.825733ms to process 1 records I0327 15:11:14.279823 1 recorder.go:75] Recording config/featuregate with fingerprint=a358674c6e9dd8a7e21f421d361375a26d837252b2c3c49b1e027638f184937d I0327 15:11:14.279830 1 tasks_processing.go:74] worker 23 stopped. I0327 15:11:14.279831 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 29.986473ms to process 1 records I0327 15:11:14.279948 1 tasks_processing.go:74] worker 58 stopped. I0327 15:11:14.280042 1 recorder.go:75] Recording config/apiserver with fingerprint=bfd61244cec117de56af4e3099d27d25cd696ac39232c331a52b9b7da2a5c8ff I0327 15:11:14.280070 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 29.694825ms to process 1 records I0327 15:11:14.280087 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 29.371219ms to process 0 records I0327 15:11:14.280097 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 29.866101ms to process 0 records I0327 15:11:14.280103 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 28.807524ms to process 0 records I0327 15:11:14.280111 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 29.32522ms to process 0 records I0327 15:11:14.280117 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 28.804526ms to process 0 records I0327 15:11:14.280123 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 28.996548ms to process 0 records I0327 15:11:14.280131 1 tasks_processing.go:74] worker 41 stopped. I0327 15:11:14.280136 1 tasks_processing.go:74] worker 14 stopped. I0327 15:11:14.280140 1 tasks_processing.go:74] worker 44 stopped. I0327 15:11:14.280143 1 tasks_processing.go:74] worker 12 stopped. I0327 15:11:14.280146 1 tasks_processing.go:74] worker 30 stopped. I0327 15:11:14.280149 1 tasks_processing.go:74] worker 11 stopped. I0327 15:11:14.280239 1 tasks_processing.go:74] worker 7 stopped. I0327 15:11:14.280294 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 28.447885ms to process 0 records I0327 15:11:14.280431 1 tasks_processing.go:74] worker 8 stopped. I0327 15:11:14.280548 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=90f7d4f2cfbfce50ea81f8f4759b2b428fd60a14eec444edee21533cda489252 I0327 15:11:14.280656 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=ea642d4044da64f414f00c4265f4e6e4ead900b3cfca358a06a8560964251ce5 I0327 15:11:14.280675 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 31.413053ms to process 2 records I0327 15:11:14.280687 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 28.802572ms to process 0 records I0327 15:11:14.280712 1 tasks_processing.go:74] worker 29 stopped. I0327 15:11:14.280787 1 tasks_processing.go:74] worker 25 stopped. I0327 15:11:14.280792 1 recorder.go:75] Recording config/image with fingerprint=e3714158c864fb93aa86a9358ba667c3cff0f92abccb31595ec7b76a7634159a I0327 15:11:14.280814 1 gather.go:177] gatherer "clusterconfig" function "image" took 28.736406ms to process 1 records I0327 15:11:14.281023 1 tasks_processing.go:74] worker 38 stopped. I0327 15:11:14.281052 1 recorder.go:75] Recording config/ingress with fingerprint=acccaa995b110d787c7538e500450ef0766ec92a893e3f077d1e693733ea9a49 I0327 15:11:14.281068 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 31.753764ms to process 1 records E0327 15:11:14.281079 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0327 15:11:14.281103 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 28.870013ms to process 0 records I0327 15:11:14.281112 1 tasks_processing.go:74] worker 22 stopped. I0327 15:11:14.281241 1 tasks_processing.go:74] worker 55 stopped. I0327 15:11:14.281422 1 recorder.go:75] Recording config/network with fingerprint=c45972dbd95e09ece080d02d79347e566ac89e144f687643a8d6c5cc6173e6b8 I0327 15:11:14.281441 1 gather.go:177] gatherer "clusterconfig" function "networks" took 29.76634ms to process 1 records I0327 15:11:14.281537 1 tasks_processing.go:74] worker 34 stopped. I0327 15:11:14.282046 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=c6c02bb564d2f5aac13cf6848609919f4072f61cddd9c3ad29a1273f70398f34 I0327 15:11:14.282064 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 32.291082ms to process 1 records I0327 15:11:14.282072 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 31.756032ms to process 0 records I0327 15:11:14.282077 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 30.611867ms to process 0 records I0327 15:11:14.282090 1 tasks_processing.go:74] worker 21 stopped. I0327 15:11:14.282100 1 tasks_processing.go:74] worker 57 stopped. I0327 15:11:14.282153 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=4bc6c2f3e2494e7d1c0394c521354b75e4c17197b48f1846f605867c1d83aebe I0327 15:11:14.282163 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 31.87166ms to process 1 records I0327 15:11:14.282168 1 tasks_processing.go:74] worker 28 stopped. I0327 15:11:14.282215 1 tasks_processing.go:74] worker 5 stopped. I0327 15:11:14.282293 1 recorder.go:75] Recording config/proxy with fingerprint=64b63bb82b0b965706ea13ae646c3b549eee7ff0f0661b117c8bc769c3e1dd94 I0327 15:11:14.282307 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 28.194496ms to process 1 records W0327 15:11:14.282658 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0327 15:11:14.282663 1 tasks_processing.go:74] worker 43 stopped. I0327 15:11:14.282803 1 gather_logs.go:145] no pods in namespace were found I0327 15:11:14.282876 1 recorder.go:75] Recording config/oauth with fingerprint=c56ded58326bc77e2dbc0b89d26e7370185e1976a0b5124bec7c472e5b5be718 I0327 15:11:14.282898 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 32.02742ms to process 1 records I0327 15:11:14.282906 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 33.109876ms to process 0 records I0327 15:11:14.282912 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 32.176677ms to process 0 records I0327 15:11:14.282922 1 tasks_processing.go:74] worker 53 stopped. I0327 15:11:14.283014 1 tasks_processing.go:74] worker 17 stopped. I0327 15:11:14.283026 1 tasks_processing.go:74] worker 42 stopped. I0327 15:11:14.283131 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=85251bb00659353cb02d729cac4a0893c0d5aec3401bb6fe51e7b6a26b756bfb I0327 15:11:14.283160 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=0ac58d9ef6e0c190024d06ba59eb3fc1b793fe01599569c125a31655d1e77caf I0327 15:11:14.283184 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=6e34ca87374409e228403df6e10d46c34a1af38dee7b6a867345b441f0175470 I0327 15:11:14.283211 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=4f71bb3d460c635d83139063740c8d74aac8a3ce8058b19915d781727eea3b3f I0327 15:11:14.283233 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=f2c17c9bdbfbd52b53c583eb3c07c302368cf5a2a30d2793f21f90639a732afa I0327 15:11:14.283255 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=139f7da3163dc0cb232d334b054756b56e0849c431654ebcc02e805786c33331 I0327 15:11:14.283282 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=883f618bfbc1c5b08e11a3371c6d635ff85db37d38f09b20afa27065c20a7ec9 I0327 15:11:14.283302 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=0ced9544d469c7ebf245541257ee241c04d670499331da7aa0eac65bc5f3d64b I0327 15:11:14.283879 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=153c48b518e94e359e0890874ae0020b9e13ab0e909640c40f36905d3654ff06 I0327 15:11:14.283931 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=94d24704ed97f3ba03614c83a6096d9e079c4af0a318018fce1a7564bfffc232 I0327 15:11:14.283964 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=a881f74e548933607c9717367433475dd3103a5c2aa67e223a24fab4ffb4107b I0327 15:11:14.283977 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 32.285948ms to process 11 records E0327 15:11:14.284011 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0327 15:11:14.284034 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 31.968984ms to process 0 records I0327 15:11:14.284255 1 tasks_processing.go:74] worker 20 stopped. I0327 15:11:14.284262 1 tasks_processing.go:74] worker 48 stopped. I0327 15:11:14.284940 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0327 15:11:14.285016 1 controller.go:254] Source scaController *sca.Controller is not ready I0327 15:11:14.285032 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0327 15:11:14.285040 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0327 15:11:14.285045 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0327 15:11:14.285226 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=e32b2ad04bd933e5c825801844c7694083bc757be235e4f3a0684780c063e805 I0327 15:11:14.285285 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=a8689d9f3b77d5b3a0f664621765e3f676ee3a6cbce0a830b60f16a351badd1e I0327 15:11:14.285341 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=4ef183cb7ced68cfa2f38eb6285e04cfef92ac7f24d9458311579485bfda240e I0327 15:11:14.285353 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 33.697422ms to process 3 records I0327 15:11:14.285361 1 controller.go:531] The operator is still being initialized I0327 15:11:14.285370 1 controller.go:554] The operator is healthy I0327 15:11:14.285512 1 tasks_processing.go:74] worker 0 stopped. I0327 15:11:14.285575 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=e3238c1bfd55938c83c80b692905f51f056caa3f189e2083704ff86a2dfdd608 I0327 15:11:14.285621 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 34.615387ms to process 1 records I0327 15:11:14.285755 1 tasks_processing.go:74] worker 2 stopped. I0327 15:11:14.285810 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=129e2ede3a801567614736cdcc105860766d7a42e23288fb31595f992c389da9 I0327 15:11:14.286615 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=1cf6fc651a6b73baf8cbfecadcf3175336138bf5745cc96c238aabaafcc4756a I0327 15:11:14.287147 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=66edc62add237ff45449b34079f3b45794860f72794fe59e713779c85c02c9b4 I0327 15:11:14.287210 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=76108d6afa6b542498025c3ac6256beca7eb32c2113ecdbeb08b2bbac9aad986 I0327 15:11:14.287366 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=0b3c371e2223847234a5214f2177aad133c5dc82794ae89d70790c5ec9c2abb0 I0327 15:11:14.287406 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=8a8cc0088bf30cc4c96bbc7ce2b0cf9397acd1b48660be94e6402415e4d51a6e I0327 15:11:14.287453 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=eb858ec8ad5cab0773568582c8ebd34d52c8e0cf5247904aa4e0dd4740f5ffc3 I0327 15:11:14.287623 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=956f58d2a28d3599d67211b31be72a084e2ab3ec2b888813054cc3c0e597edb8 I0327 15:11:14.287716 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=ce2982d1644d9b4a0e7be5bffa3ea64845ff3be2a08e7736c2dc0b750837f1d6 I0327 15:11:14.287920 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=d0cdb37605ecd78378def9a05275d82b34ca17dcd389910eeb72aed0fcf271c0 I0327 15:11:14.289448 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=bb44811901c84278ca3461a4bd1cd00950639a1c198341979d97c4c04b4b2285 I0327 15:11:14.289513 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=94485e800c572e976ab664238a9b81c5ca0baf4949628bfe2c0478df57fe7c89 I0327 15:11:14.289564 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=086e83d79970ce09fbf4d32dca9ee357832a6b67f6fdc1dd69c3bb1e109c038a I0327 15:11:14.289578 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 35.2557ms to process 13 records I0327 15:11:14.289605 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 32.417714ms to process 0 records E0327 15:11:14.289613 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0327 15:11:14.289622 1 tasks_processing.go:74] worker 3 stopped. I0327 15:11:14.289645 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0327 15:11:14.289661 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 37.327023ms to process 1 records I0327 15:11:14.289675 1 tasks_processing.go:74] worker 19 stopped. I0327 15:11:14.289723 1 recorder.go:75] Recording config/olm_operators with fingerprint=abb4ce426393d9616085d1a6638078a2304a716e5fceb0c1cc153b124db91f48 I0327 15:11:14.289734 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 40.468795ms to process 1 records I0327 15:11:14.289742 1 tasks_processing.go:74] worker 1 stopped. I0327 15:11:14.289895 1 tasks_processing.go:74] worker 52 stopped. I0327 15:11:14.290426 1 recorder.go:75] Recording config/node/ip-10-0-0-192.ec2.internal with fingerprint=4ed9b1c5baca6704fbca203de0727864777a5cbe4f265a73438030601e5f09fa I0327 15:11:14.290528 1 recorder.go:75] Recording config/node/ip-10-0-1-144.ec2.internal with fingerprint=a9c0a6c464161133c2d9e6c70aeba6fffe60cd937f69d635b9f29934a3613d15 I0327 15:11:14.290655 1 recorder.go:75] Recording config/node/ip-10-0-2-34.ec2.internal with fingerprint=adbd0eb6173d83666988108b80464532083a7ee4c3c60940cae2309574ca197a I0327 15:11:14.290669 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 39.567012ms to process 3 records I0327 15:11:14.291397 1 tasks_processing.go:74] worker 9 stopped. I0327 15:11:14.291417 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 41.354306ms to process 0 records I0327 15:11:14.291991 1 tasks_processing.go:74] worker 49 stopped. I0327 15:11:14.292020 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0327 15:11:14.292046 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 41.625466ms to process 1 records I0327 15:11:14.292527 1 tasks_processing.go:74] worker 59 stopped. I0327 15:11:14.292544 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 43.412428ms to process 0 records I0327 15:11:14.293573 1 tasks_processing.go:74] worker 60 stopped. I0327 15:11:14.293942 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=44216a5a102b13e6d6e2073ce581ae383358a53171ccb70dc886b648e1284825 I0327 15:11:14.294169 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=8d513d09eb6039bf39180f93136bdeb0fe1747f455eb98a43a13a39de55a08a3 I0327 15:11:14.294206 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 41.922992ms to process 2 records I0327 15:11:14.294814 1 tasks_processing.go:74] worker 40 stopped. I0327 15:11:14.294996 1 recorder.go:75] Recording config/version with fingerprint=9d6085a8f995f45394a742f8c79aa9ea2698d137c4e397e3141417b266e77540 I0327 15:11:14.295063 1 recorder.go:75] Recording config/id with fingerprint=b8c9174460481be3ca338cba4fc14df3ec9ba1d387c28b16a5617b870b5dba80 I0327 15:11:14.295198 1 gather.go:177] gatherer "clusterconfig" function "version" took 39.106328ms to process 2 records I0327 15:11:14.296283 1 tasks_processing.go:74] worker 24 stopped. I0327 15:11:14.297439 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=11f40bf79d0c109f91d9ac2b041aad47fb25e75b5deb16a5ea3d94c5d3811fa1 I0327 15:11:14.297779 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=15d569cf06778bbccac569c020da040f60eaadf61a274d8a175bf6b1861a2b91 I0327 15:11:14.297797 1 gather.go:177] gatherer "clusterconfig" function "crds" took 47.327765ms to process 2 records I0327 15:11:14.299949 1 tasks_processing.go:74] worker 15 stopped. I0327 15:11:14.299968 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 49.941393ms to process 0 records I0327 15:11:14.302302 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0327 15:11:14.309898 1 tasks_processing.go:74] worker 47 stopped. E0327 15:11:14.310933 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0327 15:11:14.311002 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0327 15:11:14.311031 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0327 15:11:14.311066 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=7c953bef0cdbddb25a47a3c40772dfa7cbf73ae2ac9bb3dc97984dbf1bd43499 I0327 15:11:14.311143 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0327 15:11:14.311169 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0327 15:11:14.311201 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=4bec6f0bfa45f0ccf5709371166150dcb9cf2703d04f5f6de4476d0277c477a6 I0327 15:11:14.311265 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0327 15:11:14.311344 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0327 15:11:14.311375 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0327 15:11:14.311400 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 58.822547ms to process 7 records I0327 15:11:14.312471 1 tasks_processing.go:74] worker 35 stopped. I0327 15:11:14.313923 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0327 15:11:14.313936 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0327 15:11:14.314015 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0327 15:11:14.314149 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-8777bd9bb-8xc4s with fingerprint=664eb6bccc8c51968ec96d7f73af4b565db21cedfd72acf6a76c1d0bc1d170a3 I0327 15:11:14.314423 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-f76cq with fingerprint=30fc98788be9a8f5d0db480c22f8ea5d9dc9be15f520f4ba11d7b8cdee3a58b7 I0327 15:11:14.314495 1 recorder.go:75] Recording config/running_containers with fingerprint=e2aa14a6cbacf256cc67c521c35495e1bbd5d72e6122ff58dddd13597cdef466 I0327 15:11:14.314504 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 63.317355ms to process 3 records I0327 15:11:14.314518 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 63.040714ms to process 0 records I0327 15:11:14.314529 1 tasks_processing.go:74] worker 56 stopped. I0327 15:11:14.318600 1 base_controller.go:82] Caches are synced for ConfigController I0327 15:11:14.318611 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0327 15:11:14.322638 1 configmapobserver.go:84] configmaps "insights-config" not found I0327 15:11:14.365783 1 base_controller.go:82] Caches are synced for LoggingSyncer I0327 15:11:14.365799 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0327 15:11:14.374235 1 cluster_transfer.go:102] no available accepted cluster transfer I0327 15:11:14.374253 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0327 15:11:14.396825 1 tasks_processing.go:74] worker 33 stopped. E0327 15:11:14.396852 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0327 15:11:14.396863 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pa4nkn99kaqqvukhcr451snphcdn29u-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pa4nkn99kaqqvukhcr451snphcdn29u-primary-cert-bundle-secret" not found I0327 15:11:14.396957 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=c542303b480faca948e493bd43dbef3894e4a1679ce71cc3617e73093e345006 I0327 15:11:14.396980 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 145.860284ms to process 1 records I0327 15:11:14.483629 1 sca.go:266] etc-pki-entitlement secret successfully created I0327 15:11:14.483653 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated W0327 15:11:15.282506 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0327 15:11:15.302654 1 tasks_processing.go:74] worker 13 stopped. I0327 15:11:15.302687 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0327 15:11:15.302700 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.053697363s to process 1 records I0327 15:11:15.302769 1 tasks_processing.go:74] worker 27 stopped. I0327 15:11:15.302800 1 recorder.go:75] Recording config/alerts with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 W0327 15:11:15.302816 1 gather.go:155] issue recording gatherer "clusterconfig" function "active_alerts" result "config/alerts.json" because of the warning: warning: the record with the same fingerprint "4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945" was already recorded at path "config/namespaces_with_overlapping_uids.json", recording another one with a different path "config/alerts.json" I0327 15:11:15.302826 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.050881143s to process 1 records W0327 15:11:16.282450 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0327 15:11:16.713496 1 tasks_processing.go:74] worker 54 stopped. I0327 15:11:16.713673 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=146ed28fe144e165b0480c3fbc9809e14bea9b5fd4bed5a3b56874857e057314 I0327 15:11:16.713735 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0327 15:11:16.713774 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=f09bc59af3d31aca7e7c025ca368d6017077c154f02088d806bb5c86d2050570 I0327 15:11:16.713785 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0327 15:11:16.713809 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=370f168662f88b0468a3bc3fe147963da36070243971744094b2bd01493fecd7 I0327 15:11:16.713830 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0327 15:11:16.713852 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=cd18c1480a6edf61710eb632bedd5c787914e913d23b82299596195a6db1ec4b I0327 15:11:16.713880 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=58ed929b05d68c394df058c9e576624d096431c2c15a8da3d0f7f61f22763ed5 I0327 15:11:16.713909 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=699a602c004add79a1103523404fffd7a388e8fc42e2af799ef21bda74bf530f I0327 15:11:16.713938 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=8a088758b2086e589efbe540aa9d9d12a44cb0d3af5d447dd71f031f2a5a4445 I0327 15:11:16.714277 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=66d3244cd7eaeb4b666a0de67cff4dae3654ccd27be656583aa21cb8f0a6dacc I0327 15:11:16.714304 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=963fd6a724d01f690d9c308c89e8ec3d3f70d8e37399fceb697dcde964b127c5 I0327 15:11:16.714314 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0327 15:11:16.714330 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=37d4d479e80000627443ce767496796573e4f99ecf4ef213ac9d629216bbc1db I0327 15:11:16.714340 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0327 15:11:16.714355 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=2802c8955c2a09582d540a81cba1bff9e78fc07c3ff164aeb44ab80e4a86c715 I0327 15:11:16.714365 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0327 15:11:16.714384 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=c53f44ea36e19000268a40031ed83d54214e0d0b5ffcd3e6f178d6751040935e I0327 15:11:16.714396 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0327 15:11:16.714426 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=b0a9c5952984c60f5153c575ca5d39ea193ae939259fda8aed9f85f26bd2f3d7 I0327 15:11:16.714526 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=aa0ae6a849a239e38aa7093d324b8ba0a4ac27807185dd7351ed7779ad8af64d I0327 15:11:16.714536 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0327 15:11:16.714544 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0327 15:11:16.714568 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0327 15:11:16.714617 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=296fa6bea21158ce371e50bdfcc3bfd7b019cee6093d47a25987c56e6851c133 I0327 15:11:16.714642 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=943a875cfd1ced5d00fe624546646989c2367d1ff5f9d516a291ac46ea3f3f15 I0327 15:11:16.714660 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0327 15:11:16.714676 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=95e73e3e0e1ae3a4f6d994912d4664920e1cf5aa417d88f3c1b7598ae66a17f0 I0327 15:11:16.714685 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0327 15:11:16.714701 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=a1c4e05b73cd67d33ca30ec225469d6d6ef3866f3484ab703c4a1b85ca4a0e7e I0327 15:11:16.714714 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0327 15:11:16.714727 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=439effe2ca0629e4df7a7484f52baa42ae6042288f6a23e2526dec8265665cf0 I0327 15:11:16.714749 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=a4def06964ef5dccbbfb779805832f5b31112f653efdba6e19778daf5ac3f14c I0327 15:11:16.714774 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=00dcd5443603a86e1ada12e4b4ed5d107938b8e0b84b0370dc5e8b7297c75d9b I0327 15:11:16.714809 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=352fc49b72d8dd09e85febbf9cf924c60d3c3d7889644fbd870f90453ea525eb I0327 15:11:16.714822 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0327 15:11:16.714851 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=5b967715e8a8faf62cb811e6f245ca8c459ba11b13a59c3b07302bf586798845 I0327 15:11:16.714868 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0327 15:11:16.714875 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0327 15:11:16.714881 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.463061303s to process 39 records W0327 15:11:17.282755 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0327 15:11:18.282810 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0327 15:11:19.280489 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0327 15:11:19.280518 1 tasks_processing.go:74] worker 26 stopped. E0327 15:11:19.280529 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0327 15:11:19.280541 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0327 15:11:19.280552 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.030845658s to process 1 records I0327 15:11:27.094790 1 tasks_processing.go:74] worker 36 stopped. I0327 15:11:27.094846 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0327 15:11:27.094860 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.845687878s to process 1 records I0327 15:11:27.857820 1 tasks_processing.go:74] worker 62 stopped. I0327 15:11:27.858093 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=16e4c55b4d63cefcfc7800aa646e617d46f0ec5f940c3fd1a629fc5ae985c964 I0327 15:11:27.858110 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.606331137s to process 1 records E0327 15:11:27.858186 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.609s with: function \"machines\" failed with an error, function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0327 15:11:27.859295 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0327 15:11:27.859310 1 periodic.go:216] Running workloads gatherer I0327 15:11:27.859325 1 tasks_processing.go:45] number of workers: 2 I0327 15:11:27.859338 1 tasks_processing.go:69] worker 1 listening for tasks. I0327 15:11:27.859344 1 tasks_processing.go:71] worker 1 working on workload_info task. I0327 15:11:27.859349 1 tasks_processing.go:69] worker 0 listening for tasks. I0327 15:11:27.859370 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0327 15:11:27.864656 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-34.ec2.internal... I0327 15:11:27.864662 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-144.ec2.internal... I0327 15:11:27.864672 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-192.ec2.internal... I0327 15:11:27.880459 1 tasks_processing.go:74] worker 0 stopped. I0327 15:11:27.880474 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 21.067769ms to process 0 records I0327 15:11:32.234150 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 4s I0327 15:11:32.263053 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 25s for image data I0327 15:11:32.270716 1 gather_workloads_info.go:387] No image sha256:273930332d7b481bbca4521cf740507498a2a323a4010cd66e896806b299f85e (9ms) I0327 15:11:32.279353 1 gather_workloads_info.go:387] No image sha256:0fd69333c121efd68919e731cd3ea01e976e00415bda6e987bf1e949ec224eda (9ms) I0327 15:11:32.288532 1 gather_workloads_info.go:387] No image sha256:72ae38682f25786aec18625cfed5d7831017d2f0f1304c3320c00ce0b7fb09c1 (9ms) I0327 15:11:32.296379 1 gather_workloads_info.go:387] No image sha256:2a07c1b2ef06bbfa3a491b84f7410e24de7cb487f49bbbb3bfd7cb3510c8429a (8ms) I0327 15:11:32.304358 1 gather_workloads_info.go:387] No image sha256:a6b085cdad58db8529d99c22ec1ec79fe09ab00ab1c92ee38b29e7875dc0533c (8ms) I0327 15:11:32.311751 1 gather_workloads_info.go:387] No image sha256:64dbe77583c8b23dc6852fc482ea5b4081490734944ec8b765d5450b3fdb30ed (7ms) I0327 15:11:32.319625 1 gather_workloads_info.go:387] No image sha256:cfcb0bd30c537e677ac6856c36c0c923b415f24d944c7aa1386489f511f6491d (8ms) I0327 15:11:32.327907 1 gather_workloads_info.go:387] No image sha256:3b9f60077c475f2baad0dd51ffc9d469f3a9b54c474bb86a35f93cb9b8fdc734 (8ms) I0327 15:11:32.338813 1 gather_workloads_info.go:387] No image sha256:92a731e25801365be0ad0916bec5bf24b2035e443ad1414a1631d1e0473ddf77 (11ms) I0327 15:11:32.346533 1 gather_workloads_info.go:387] No image sha256:4c39dc633bf3560c2397281b74faf9d00500b0738dec6c1aad2cc8ce326be6fc (8ms) I0327 15:11:32.370677 1 gather_workloads_info.go:387] No image sha256:20a3e59566dd25058fff22e18569067fe6a12d8ac5ac62fa6508e0cee44d7897 (24ms) I0327 15:11:32.471323 1 gather_workloads_info.go:387] No image sha256:14e983ca10e1033822e1c4be0a1e4a40762951a5d6e4a77bf642891f291d32ae (101ms) I0327 15:11:32.571203 1 gather_workloads_info.go:387] No image sha256:2e3661304917ce7f3be49974faacc60c24cbe2833d7b50c8c205c2f3f2467950 (100ms) I0327 15:11:32.671088 1 gather_workloads_info.go:387] No image sha256:6ea0f19030ffc52a290e6eeb812ef2426c48a2f1083b1e415e0667998cbb7bf2 (100ms) I0327 15:11:32.771807 1 gather_workloads_info.go:387] No image sha256:12448aad6e9050c2b2445035be818a490cef502d39b73dbd51cc0f5ea7d67d40 (101ms) I0327 15:11:32.871616 1 gather_workloads_info.go:387] No image sha256:1ad039a130515504a258952cb18e67c3329da5182bb0623cc0891e6c15e2113a (100ms) I0327 15:11:32.971368 1 gather_workloads_info.go:387] No image sha256:4e62a2dcb8214491388d4c17f89fe699eb53cdb8039dcba6ab052edc28da3fbd (100ms) I0327 15:11:33.071840 1 gather_workloads_info.go:387] No image sha256:185a95b130b6a27ad88fcf39803215b7bd998472b1e37225858435f4eb7c3c04 (100ms) I0327 15:11:33.183275 1 gather_workloads_info.go:387] No image sha256:1c5b548d67e5c56e3297b2f8aa34428e544b5b5ac88bd8d0f465760375c501e6 (111ms) I0327 15:11:33.270567 1 gather_workloads_info.go:387] No image sha256:07a6c0a310270b830b96fcb8fca9cd11e45569276335bb5334b18b388d6eed51 (87ms) I0327 15:11:33.371494 1 gather_workloads_info.go:387] No image sha256:5f852f6127d27e6fc071afe58d80024370467cb2476f4d9f077f8ebca8600918 (101ms) I0327 15:11:33.471393 1 gather_workloads_info.go:387] No image sha256:24929612f2f0f2d4cd3ac163c04bbf4ac64cc47d3d0eef81db085d00c59058bd (100ms) I0327 15:11:33.572059 1 gather_workloads_info.go:387] No image sha256:1b58ba57c10e2ba03a0d8dba1f3f8faa866e1dca6170725b6909c2cc2b96efa6 (101ms) I0327 15:11:33.671190 1 gather_workloads_info.go:387] No image sha256:917de30c85816179b3f8db32b8c94bfed2a54adc65b1a8be7ea73e245fa88b55 (99ms) I0327 15:11:33.779763 1 gather_workloads_info.go:387] No image sha256:5b51a4d9d3b7ecad110fb6eb00f71e9e9b854067d79b220df397a58d9fa50eb0 (109ms) I0327 15:11:33.875995 1 gather_workloads_info.go:387] No image sha256:8f72efd51f564d8d3e4ecee6555d7bd5394d0776054d2112febea6b7c9e71225 (96ms) I0327 15:11:33.971656 1 gather_workloads_info.go:387] No image sha256:31e175b644c6627779ca6b9f48d9426760dd449788ad671dd0277cce8fb822e8 (96ms) I0327 15:11:34.072283 1 gather_workloads_info.go:387] No image sha256:44ceafe5147680d58a5c2d3720932b972e6bc9639faadc19aa6b360af154e1a3 (101ms) I0327 15:11:34.173502 1 gather_workloads_info.go:387] No image sha256:66640a3f7bd65090345552611701a73e74bc44897b9d29e43b11f73b96598ac0 (101ms) I0327 15:11:34.271027 1 gather_workloads_info.go:387] No image sha256:c59765325e6f286c067e555850b0d81f2de5e5ee8625ed83cdc2cea96f3a7ddb (98ms) I0327 15:11:34.406474 1 gather_workloads_info.go:387] No image sha256:3e8d51b4b12d970bf561f67d0fcd9c0966a6d49866e6466daa341ee43d95d6e2 (135ms) I0327 15:11:34.487678 1 gather_workloads_info.go:387] No image sha256:3739c0c55f7f7ccc84309ae11eb23d3d9e5ad50a68e849a8a8dfda7f2f2bc137 (81ms) I0327 15:11:34.573930 1 gather_workloads_info.go:387] No image sha256:aa65d1c7fb8805b767fc4878faea280472f372010efadc66e5641a2e634a80c0 (86ms) I0327 15:11:34.672006 1 gather_workloads_info.go:387] No image sha256:87de118dc29ca1b47d4768ec5ed4441bc1dada3fb2a78d53b1833249baa86dd4 (98ms) I0327 15:11:34.772140 1 gather_workloads_info.go:387] No image sha256:5bd409efe77c6a126418be2c098dde9431c1a290cec885a7e37c0c8ddc2337a8 (100ms) I0327 15:11:34.871043 1 gather_workloads_info.go:387] No image sha256:70dcc3c7d3a572ecacc7c838fd17d07ff21531e50a7ed9227a17c27437151bf4 (99ms) I0327 15:11:34.970820 1 gather_workloads_info.go:387] No image sha256:e476b4dafff885727b0057259c9df67a68e196f8cd92c21db2e4efe84a5f7a25 (100ms) I0327 15:11:35.070630 1 gather_workloads_info.go:387] No image sha256:6263faa8ef7759ec21f26df08314c5d64e52d967b49961cb9404c54532c03365 (100ms) I0327 15:11:35.171470 1 gather_workloads_info.go:387] No image sha256:2ade6dfb5406ef3a4264dea95d455298f54e8ef4d458d9ee3e94c33d48676a9b (101ms) I0327 15:11:35.270742 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (99ms) I0327 15:11:35.370447 1 gather_workloads_info.go:387] No image sha256:51e1b5dc9fccbee5b7df78d0e8bbe379f75529232c102c9ed5b1ae134c4b9b4c (100ms) I0327 15:11:35.471521 1 gather_workloads_info.go:387] No image sha256:2f26472542da4f89a2ac34a93fd438d385419dda16811bdfa7e679e0115abe56 (101ms) I0327 15:11:35.571731 1 gather_workloads_info.go:387] No image sha256:7e0a58aad44d5b09954f8261e3e428c8dfa076eb9c2b6ef46a91d27ac78ac17a (100ms) I0327 15:11:35.670714 1 gather_workloads_info.go:387] No image sha256:1e6d59867cbd750672bc9ccfb9c69c3d198174cd43dd6d71a0da358b4b766473 (99ms) I0327 15:11:35.770549 1 gather_workloads_info.go:387] No image sha256:ad0e262327997e8cdc4074a2373e67274d9b8a943aa274a2cd8ce98ffe1db4a0 (100ms) I0327 15:11:35.871483 1 gather_workloads_info.go:387] No image sha256:12aec97ddeb527881acf5949bea2b227baa1dbfccf30679e8d57ff0b82e42707 (101ms) I0327 15:11:35.971244 1 gather_workloads_info.go:387] No image sha256:3da5a449ace61cb7d002d8e7911c14905c74cf58a296527458d1af0f1abf0a72 (100ms) I0327 15:11:36.070995 1 gather_workloads_info.go:387] No image sha256:0e5fa2595714628c16cf590efd28715bde790d2dc6b3a793b2a38dfb3ffb591a (100ms) I0327 15:11:36.071027 1 tasks_processing.go:74] worker 1 stopped. I0327 15:11:36.071308 1 recorder.go:75] Recording config/workload_info with fingerprint=8168ef8a539cc67d9394c3211ed7918681cc929a12e45c213456eea78017e736 I0327 15:11:36.071324 1 gather.go:177] gatherer "workloads" function "workload_info" took 8.211675195s to process 1 records I0327 15:11:36.071337 1 periodic.go:263] Periodic gather workloads completed in 8.212s I0327 15:11:36.071346 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0327 15:11:36.071351 1 periodic.go:216] Running conditional gatherer I0327 15:11:36.076028 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.6/gathering_rules I0327 15:11:36.212909 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer E0327 15:11:36.215669 1 conditional_gatherer.go:324] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.25.239:9091: connect: connection refused I0327 15:11:36.215764 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0327 15:11:36.220968 1 conditional_gatherer.go:392] cluster version is '4.21.6' E0327 15:11:36.220982 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0327 15:11:36.220989 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0327 15:11:36.220993 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0327 15:11:36.220996 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0327 15:11:36.220998 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0327 15:11:36.221002 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0327 15:11:36.221004 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0327 15:11:36.221007 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0327 15:11:36.221010 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0327 15:11:36.221014 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0327 15:11:36.221028 1 tasks_processing.go:45] number of workers: 3 I0327 15:11:36.221040 1 tasks_processing.go:69] worker 2 listening for tasks. I0327 15:11:36.221044 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0327 15:11:36.221049 1 tasks_processing.go:69] worker 0 listening for tasks. I0327 15:11:36.221060 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0327 15:11:36.221065 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0327 15:11:36.221064 1 tasks_processing.go:69] worker 1 listening for tasks. I0327 15:11:36.221087 1 tasks_processing.go:74] worker 1 stopped. I0327 15:11:36.221133 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0327 15:11:36.221146 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.152µs to process 1 records I0327 15:11:36.221179 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0327 15:11:36.221187 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.132µs to process 1 records I0327 15:11:36.221192 1 tasks_processing.go:74] worker 0 stopped. I0327 15:11:36.221318 1 tasks_processing.go:74] worker 2 stopped. I0327 15:11:36.221331 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 245.316µs to process 0 records I0327 15:11:36.221347 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0327 15:11:36.221366 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0327 15:11:36.245386 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=5a95e894194333cb31e0b0e39975e21804c486e9f1f184292c7b7611bd752600 I0327 15:11:36.245546 1 diskrecorder.go:70] Writing 112 records to /var/lib/insights-operator/insights-2026-03-27-151136.tar.gz I0327 15:11:36.252484 1 diskrecorder.go:51] Wrote 112 records to disk in 7ms I0327 15:11:36.252517 1 periodic.go:285] Gathering cluster info every 2h0m0s I0327 15:11:36.252533 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0327 15:12:44.249190 1 diskrecorder.go:223] Found files to send: insights-2026-03-27-151136.tar.gz I0327 15:12:44.249224 1 insightsuploader.go:150] Checking archives to upload periodically every 15m19.516715153s I0327 15:12:44.249232 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0327 15:12:44.259674 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0327 15:12:44.481639 1 requests.go:87] Successfully reported id=2026-03-27T15:12:44Z x-rh-insights-request-id=dd3f281bc0dc472fabed0d7580c2819b, wrote=50632 I0327 15:12:44.481772 1 insightsuploader.go:187] Uploaded report successfully in 232.532735ms I0327 15:12:44.481792 1 controller.go:129] Initializing last reported time to 2026-03-27T15:12:44Z I0327 15:12:44.481817 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0327 15:12:44.481831 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0327 15:12:44.481843 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0327 15:12:44.487008 1 controller.go:554] The operator is healthy I0327 15:13:14.271897 1 controller.go:554] The operator is healthy I0327 15:13:45.038723 1 insightsreport.go:137] Pulling report from smart-proxy I0327 15:13:45.038752 1 insightsreport.go:149] Retrieving report I0327 15:13:45.048365 1 requests.go:110] Retrieving report for cluster: 38c646dd-6139-44f6-a856-5a3dc9e0c903 I0327 15:13:45.048378 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/38c646dd-6139-44f6-a856-5a3dc9e0c903/reports I0327 15:13:45.051519 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/38c646dd-6139-44f6-a856-5a3dc9e0c903/reports I0327 15:13:45.313421 1 insightsreport.go:184] Report retrieved I0327 15:13:45.338555 1 insightsreport.go:239] Report retrieved correctly I0327 15:15:14.274726 1 controller.go:554] The operator is healthy I0327 15:16:14.240863 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0327 15:16:14.246160 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0327 15:16:14.246178 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0327 15:16:14.249638 1 secretconfigobserver.go:119] support secret does not exist I0327 15:17:14.271279 1 controller.go:554] The operator is healthy I0327 15:19:14.275321 1 controller.go:554] The operator is healthy I0327 15:21:14.236635 1 configmapobserver.go:84] configmaps "insights-config" not found I0327 15:21:14.240298 1 configmapobserver.go:84] configmaps "insights-config" not found I0327 15:21:14.250369 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0327 15:21:14.254784 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0327 15:21:14.254804 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0327 15:21:14.258478 1 secretconfigobserver.go:119] support secret does not exist I0327 15:21:14.270362 1 controller.go:554] The operator is healthy I0327 15:23:14.273544 1 controller.go:554] The operator is healthy I0327 15:25:14.271209 1 controller.go:554] The operator is healthy I0327 15:26:14.258926 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0327 15:26:14.264106 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0327 15:26:14.264126 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0327 15:26:14.267737 1 secretconfigobserver.go:119] support secret does not exist I0327 15:27:14.272814 1 controller.go:554] The operator is healthy I0327 15:28:08.999754 1 insightsuploader.go:146] Nothing to report since 2026-03-27T15:12:44Z I0327 15:29:14.271299 1 controller.go:554] The operator is healthy I0327 15:31:14.234024 1 configmapobserver.go:84] configmaps "insights-config" not found I0327 15:31:14.268299 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0327 15:31:14.271612 1 controller.go:554] The operator is healthy I0327 15:31:14.272758 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0327 15:31:14.272774 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0327 15:31:14.276857 1 secretconfigobserver.go:119] support secret does not exist I0327 15:33:14.272501 1 controller.go:554] The operator is healthy I0327 15:35:14.273265 1 controller.go:554] The operator is healthy I0327 15:36:14.277079 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0327 15:36:14.282172 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0327 15:36:14.282190 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0327 15:36:14.285781 1 secretconfigobserver.go:119] support secret does not exist I0327 15:37:14.272516 1 controller.go:554] The operator is healthy I0327 15:39:14.271999 1 controller.go:554] The operator is healthy I0327 15:41:14.234890 1 configmapobserver.go:84] configmaps "insights-config" not found I0327 15:41:14.271363 1 controller.go:554] The operator is healthy I0327 15:41:14.286220 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0327 15:41:14.290225 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0327 15:41:14.290247 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0327 15:41:14.293903 1 secretconfigobserver.go:119] support secret does not exist I0327 15:43:14.272416 1 controller.go:554] The operator is healthy I0327 15:43:43.185536 1 insightsuploader.go:146] Nothing to report since 2026-03-27T15:12:44Z