I0326 23:36:46.803300 1 cmd.go:253] Using service-serving-cert provided certificates I0326 23:36:46.803768 1 observer_polling.go:159] Starting file observer I0326 23:36:47.432756 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0326 23:36:47.432938 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0326 23:36:47.433537 1 secure_serving.go:57] Forcing use of http/1.1 only W0326 23:36:47.433564 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0326 23:36:47.433569 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0326 23:36:47.433576 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0326 23:36:47.433579 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0326 23:36:47.433584 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0326 23:36:47.433587 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0326 23:36:47.433591 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0326 23:36:47.436857 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0326 23:36:47.436916 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"8a2fb1ac-41fc-4829-9861-fd548cd6a0df", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0326 23:36:47.437849 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0326 23:36:47.437863 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0326 23:36:47.437866 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0326 23:36:47.437884 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0326 23:36:47.437884 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0326 23:36:47.437886 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0326 23:36:47.438136 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0326 23:36:47.438445 1 secure_serving.go:213] Serving securely on [::]:8443 I0326 23:36:47.438474 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0326 23:36:47.441185 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0326 23:36:47.441210 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0326 23:36:47.441308 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0326 23:36:47.446939 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:36:47.446976 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0326 23:36:47.450855 1 secretconfigobserver.go:119] support secret does not exist I0326 23:36:47.454910 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:36:47.458211 1 secretconfigobserver.go:119] support secret does not exist I0326 23:36:47.460684 1 recorder.go:161] Pruning old reports every 8h18m42s, max age is 288h0m0s I0326 23:36:47.464618 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0326 23:36:47.464634 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0326 23:36:47.464642 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0326 23:36:47.464656 1 insightsreport.go:296] Starting report retriever I0326 23:36:47.464656 1 periodic.go:209] Running clusterconfig gatherer I0326 23:36:47.464662 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0326 23:36:47.464703 1 tasks_processing.go:45] number of workers: 64 I0326 23:36:47.464729 1 tasks_processing.go:69] worker 3 listening for tasks. I0326 23:36:47.464738 1 tasks_processing.go:69] worker 0 listening for tasks. I0326 23:36:47.464738 1 tasks_processing.go:69] worker 15 listening for tasks. I0326 23:36:47.464744 1 tasks_processing.go:69] worker 4 listening for tasks. I0326 23:36:47.464748 1 tasks_processing.go:69] worker 1 listening for tasks. I0326 23:36:47.464748 1 tasks_processing.go:69] worker 27 listening for tasks. I0326 23:36:47.464754 1 tasks_processing.go:71] worker 1 working on aggregated_monitoring_cr_names task. I0326 23:36:47.464756 1 tasks_processing.go:69] worker 11 listening for tasks. I0326 23:36:47.464760 1 tasks_processing.go:69] worker 6 listening for tasks. I0326 23:36:47.464762 1 tasks_processing.go:71] worker 11 working on jaegers task. I0326 23:36:47.464762 1 tasks_processing.go:69] worker 16 listening for tasks. I0326 23:36:47.464766 1 tasks_processing.go:69] worker 7 listening for tasks. I0326 23:36:47.464772 1 tasks_processing.go:69] worker 17 listening for tasks. I0326 23:36:47.464773 1 tasks_processing.go:69] worker 8 listening for tasks. I0326 23:36:47.464780 1 tasks_processing.go:69] worker 18 listening for tasks. I0326 23:36:47.464780 1 tasks_processing.go:69] worker 47 listening for tasks. I0326 23:36:47.464756 1 tasks_processing.go:71] worker 27 working on image_pruners task. I0326 23:36:47.464780 1 tasks_processing.go:69] worker 2 listening for tasks. I0326 23:36:47.464784 1 tasks_processing.go:69] worker 28 listening for tasks. I0326 23:36:47.464794 1 tasks_processing.go:69] worker 12 listening for tasks. I0326 23:36:47.464792 1 tasks_processing.go:69] worker 9 listening for tasks. I0326 23:36:47.464802 1 tasks_processing.go:69] worker 40 listening for tasks. I0326 23:36:47.464798 1 tasks_processing.go:69] worker 39 listening for tasks. I0326 23:36:47.464807 1 tasks_processing.go:69] worker 57 listening for tasks. I0326 23:36:47.464789 1 tasks_processing.go:69] worker 29 listening for tasks. I0326 23:36:47.464794 1 tasks_processing.go:69] worker 30 listening for tasks. I0326 23:36:47.464814 1 tasks_processing.go:69] worker 42 listening for tasks. I0326 23:36:47.464817 1 tasks_processing.go:69] worker 48 listening for tasks. I0326 23:36:47.464809 1 tasks_processing.go:69] worker 41 listening for tasks. I0326 23:36:47.464824 1 tasks_processing.go:69] worker 62 listening for tasks. I0326 23:36:47.464828 1 tasks_processing.go:69] worker 21 listening for tasks. I0326 23:36:47.464830 1 tasks_processing.go:69] worker 45 listening for tasks. I0326 23:36:47.464833 1 tasks_processing.go:71] worker 62 working on sap_datahubs task. I0326 23:36:47.464836 1 tasks_processing.go:69] worker 58 listening for tasks. I0326 23:36:47.464827 1 tasks_processing.go:69] worker 38 listening for tasks. I0326 23:36:47.464843 1 tasks_processing.go:69] worker 24 listening for tasks. I0326 23:36:47.464848 1 tasks_processing.go:71] worker 24 working on cluster_apiserver task. I0326 23:36:47.464849 1 tasks_processing.go:71] worker 38 working on tsdb_status task. I0326 23:36:47.464855 1 tasks_processing.go:69] worker 31 listening for tasks. I0326 23:36:47.464851 1 tasks_processing.go:69] worker 46 listening for tasks. I0326 23:36:47.464832 1 tasks_processing.go:69] worker 14 listening for tasks. I0326 23:36:47.464864 1 tasks_processing.go:69] worker 61 listening for tasks. I0326 23:36:47.464837 1 tasks_processing.go:69] worker 25 listening for tasks. I0326 23:36:47.464868 1 tasks_processing.go:69] worker 32 listening for tasks. I0326 23:36:47.464866 1 tasks_processing.go:69] worker 60 listening for tasks. I0326 23:36:47.464878 1 tasks_processing.go:69] worker 51 listening for tasks. I0326 23:36:47.464780 1 tasks_processing.go:69] worker 13 listening for tasks. I0326 23:36:47.464883 1 tasks_processing.go:69] worker 26 listening for tasks. I0326 23:36:47.464826 1 tasks_processing.go:69] worker 44 listening for tasks. I0326 23:36:47.464892 1 tasks_processing.go:69] worker 22 listening for tasks. I0326 23:36:47.464804 1 tasks_processing.go:69] worker 23 listening for tasks. I0326 23:36:47.464895 1 tasks_processing.go:71] worker 3 working on validating_webhook_configurations task. I0326 23:36:47.464898 1 tasks_processing.go:69] worker 37 listening for tasks. I0326 23:36:47.464901 1 tasks_processing.go:71] worker 15 working on authentication task. I0326 23:36:47.464903 1 tasks_processing.go:71] worker 4 working on sap_config task. I0326 23:36:47.464907 1 tasks_processing.go:71] worker 6 working on pdbs task. I0326 23:36:47.464903 1 tasks_processing.go:71] worker 45 working on machine_configs task. I0326 23:36:47.464909 1 tasks_processing.go:71] worker 39 working on nodenetworkstates task. I0326 23:36:47.464913 1 tasks_processing.go:71] worker 9 working on container_runtime_configs task. I0326 23:36:47.464919 1 tasks_processing.go:71] worker 16 working on openshift_logging task. I0326 23:36:47.464928 1 tasks_processing.go:71] worker 57 working on operators task. I0326 23:36:47.464986 1 tasks_processing.go:71] worker 46 working on schedulers task. I0326 23:36:47.464895 1 tasks_processing.go:69] worker 63 listening for tasks. I0326 23:36:47.465163 1 tasks_processing.go:71] worker 63 working on config_maps task. I0326 23:36:47.464986 1 tasks_processing.go:71] worker 58 working on cost_management_metrics_configs task. I0326 23:36:47.464755 1 tasks_processing.go:69] worker 10 listening for tasks. I0326 23:36:47.464836 1 tasks_processing.go:71] worker 21 working on service_accounts task. I0326 23:36:47.464837 1 tasks_processing.go:69] worker 49 listening for tasks. I0326 23:36:47.465345 1 tasks_processing.go:71] worker 49 working on version task. I0326 23:36:47.464868 1 tasks_processing.go:69] worker 50 listening for tasks. I0326 23:36:47.464874 1 tasks_processing.go:69] worker 53 listening for tasks. I0326 23:36:47.464873 1 tasks_processing.go:69] worker 59 listening for tasks. I0326 23:36:47.464877 1 tasks_processing.go:69] worker 54 listening for tasks. I0326 23:36:47.464882 1 tasks_processing.go:69] worker 33 listening for tasks. I0326 23:36:47.464881 1 tasks_processing.go:69] worker 52 listening for tasks. I0326 23:36:47.464884 1 tasks_processing.go:69] worker 55 listening for tasks. I0326 23:36:47.464887 1 tasks_processing.go:69] worker 35 listening for tasks. I0326 23:36:47.464882 1 tasks_processing.go:71] worker 0 working on image task. I0326 23:36:47.465424 1 tasks_processing.go:71] worker 35 working on nodes task. I0326 23:36:47.465451 1 tasks_processing.go:71] worker 54 working on certificate_signing_requests task. I0326 23:36:47.464890 1 tasks_processing.go:69] worker 36 listening for tasks. I0326 23:36:47.465514 1 tasks_processing.go:71] worker 36 working on olm_operators task. I0326 23:36:47.464751 1 tasks_processing.go:69] worker 5 listening for tasks. I0326 23:36:47.464893 1 tasks_processing.go:69] worker 34 listening for tasks. I0326 23:36:47.464894 1 tasks_processing.go:69] worker 56 listening for tasks. I0326 23:36:47.464821 1 tasks_processing.go:69] worker 20 listening for tasks. I0326 23:36:47.464903 1 tasks_processing.go:71] worker 12 working on openstack_dataplanedeployments task. I0326 23:36:47.465714 1 tasks_processing.go:71] worker 53 working on nodenetworkconfigurationpolicies task. I0326 23:36:47.465775 1 tasks_processing.go:71] worker 59 working on infrastructures task. I0326 23:36:47.465790 1 tasks_processing.go:71] worker 20 working on openstack_dataplanenodesets task. I0326 23:36:47.465884 1 tasks_processing.go:71] worker 52 working on oauths task. I0326 23:36:47.465892 1 tasks_processing.go:71] worker 55 working on machines task. I0326 23:36:47.465897 1 tasks_processing.go:71] worker 34 working on dvo_metrics task. I0326 23:36:47.465989 1 tasks_processing.go:71] worker 56 working on container_images task. I0326 23:36:47.466004 1 tasks_processing.go:71] worker 5 working on silenced_alerts task. I0326 23:36:47.466076 1 tasks_processing.go:71] worker 33 working on machine_healthchecks task. I0326 23:36:47.464905 1 tasks_processing.go:71] worker 29 working on mutating_webhook_configurations task. I0326 23:36:47.465884 1 tasks_processing.go:71] worker 50 working on storage_cluster task. I0326 23:36:47.464907 1 tasks_processing.go:71] worker 40 working on openstack_controlplanes task. I0326 23:36:47.464915 1 tasks_processing.go:71] worker 8 working on ingress task. I0326 23:36:47.464957 1 tasks_processing.go:71] worker 47 working on lokistack task. I0326 23:36:47.464961 1 tasks_processing.go:71] worker 2 working on crds task. I0326 23:36:47.464961 1 tasks_processing.go:71] worker 18 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0326 23:36:47.464967 1 tasks_processing.go:71] worker 42 working on storage_classes task. I0326 23:36:47.464965 1 tasks_processing.go:71] worker 28 working on ceph_cluster task. I0326 23:36:47.464959 1 tasks_processing.go:71] worker 7 working on feature_gates task. I0326 23:36:47.464971 1 tasks_processing.go:71] worker 48 working on metrics task. I0326 23:36:47.464972 1 tasks_processing.go:71] worker 30 working on openstack_version task. I0326 23:36:47.464822 1 tasks_processing.go:69] worker 43 listening for tasks. I0326 23:36:47.467643 1 tasks_processing.go:71] worker 43 working on networks task. I0326 23:36:47.464975 1 tasks_processing.go:71] worker 17 working on proxies task. I0326 23:36:47.464978 1 tasks_processing.go:71] worker 41 working on operators_pods_and_events task. I0326 23:36:47.464982 1 tasks_processing.go:71] worker 31 working on image_registries task. I0326 23:36:47.464983 1 tasks_processing.go:71] worker 61 working on support_secret task. I0326 23:36:47.464984 1 tasks_processing.go:71] worker 37 working on install_plans task. I0326 23:36:47.464988 1 tasks_processing.go:71] worker 25 working on machine_config_pools task. I0326 23:36:47.468518 1 tasks_processing.go:71] worker 9 working on openshift_machine_api_events task. I0326 23:36:47.468498 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 3.55669ms to process 0 records I0326 23:36:47.468534 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 3.641172ms to process 0 records I0326 23:36:47.468546 1 tasks_processing.go:71] worker 62 working on monitoring_persistent_volumes task. I0326 23:36:47.464987 1 tasks_processing.go:71] worker 14 working on ingress_certificates task. I0326 23:36:47.464990 1 tasks_processing.go:71] worker 13 working on node_logs task. I0326 23:36:47.464991 1 tasks_processing.go:71] worker 60 working on pod_network_connectivity_checks task. I0326 23:36:47.464992 1 tasks_processing.go:71] worker 26 working on overlapping_namespace_uids task. I0326 23:36:47.464994 1 tasks_processing.go:71] worker 51 working on active_alerts task. I0326 23:36:47.464994 1 tasks_processing.go:71] worker 22 working on machine_sets task. I0326 23:36:47.464994 1 tasks_processing.go:71] worker 23 working on clusterroles task. I0326 23:36:47.464998 1 tasks_processing.go:71] worker 44 working on sap_pods task. I0326 23:36:47.464998 1 tasks_processing.go:71] worker 32 working on qemu_kubevirt_launcher_logs task. I0326 23:36:47.464813 1 tasks_processing.go:69] worker 19 listening for tasks. I0326 23:36:47.465267 1 tasks_processing.go:71] worker 10 working on machine_autoscalers task. I0326 23:36:47.469778 1 tasks_processing.go:74] worker 19 stopped. E0326 23:36:47.471012 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.243.82:9094: connect: connection refused E0326 23:36:47.471019 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.243.82:9094: connect: connection refused I0326 23:36:47.471029 1 tasks_processing.go:74] worker 5 stopped. E0326 23:36:47.471037 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.243.82:9094: connect: connection refused I0326 23:36:47.471047 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 5.017311ms to process 0 records E0326 23:36:47.471057 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.243.82:9094: connect: connection refused I0326 23:36:47.471064 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.906641ms to process 0 records E0326 23:36:47.471058 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.172.115:9091: connect: connection refused E0326 23:36:47.471063 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.172.115:9091: connect: connection refused I0326 23:36:47.471072 1 tasks_processing.go:74] worker 51 stopped. I0326 23:36:47.471074 1 tasks_processing.go:74] worker 48 stopped. E0326 23:36:47.471080 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.172.115:9091: connect: connection refused I0326 23:36:47.471093 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 3.774292ms to process 0 records E0326 23:36:47.471130 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.172.115:9091: connect: connection refused I0326 23:36:47.471141 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 6.224029ms to process 0 records I0326 23:36:47.471155 1 tasks_processing.go:74] worker 38 stopped. I0326 23:36:47.472227 1 tasks_processing.go:74] worker 58 stopped. I0326 23:36:47.472244 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 7.03111ms to process 0 records I0326 23:36:47.472367 1 tasks_processing.go:74] worker 39 stopped. I0326 23:36:47.472380 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 7.444068ms to process 0 records I0326 23:36:47.472464 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0326 23:36:47.472480 1 controller.go:326] The initial operator extension status is healthy I0326 23:36:47.472487 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0326 23:36:47.472492 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0326 23:36:47.472495 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0326 23:36:47.472509 1 controller.go:489] The operator is still being initialized I0326 23:36:47.472517 1 controller.go:512] The operator is healthy I0326 23:36:47.472487 1 tasks_processing.go:74] worker 24 stopped. I0326 23:36:47.472579 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0326 23:36:47.472642 1 recorder.go:75] Recording config/apiserver with fingerprint=3764a32775d58376817c76aba84b7b5592b752bb2c8f53256019556536aa0cc6 I0326 23:36:47.472660 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 7.632721ms to process 1 records I0326 23:36:47.472646 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0326 23:36:47.472702 1 operator.go:288] started I0326 23:36:47.472725 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0326 23:36:47.472786 1 tasks_processing.go:74] worker 3 stopped. I0326 23:36:47.472965 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=add4e3e1766e269c9f398b8630e94b85067f5a7e4686426eb666aadce3132ccf I0326 23:36:47.473027 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=f12041f3585b17743fd336a7a1e894d58391220134426c14b1c15c5f2e1f8a9b I0326 23:36:47.473134 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=45f7042b0d0694926a19a246d819d1167fd7c13989700782a9d78c12ffcfe585 I0326 23:36:47.473162 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=a4521593c624691ff3c1938642df4393b863b4be80b8e15e17d703531f993304 I0326 23:36:47.473186 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=696cd0bc6865b70b2141a863259fc36d45782eb601f32fd751e77a3a8aafe874 I0326 23:36:47.473215 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=682dc362077f0be2b8464631b348bce2677eb308cdadf700b87a73f80677eeb2 I0326 23:36:47.473239 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=9a4da91098f677593457e178b430fb0e89557c37a3271fc21dc6aa89e7458c7d I0326 23:36:47.473262 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=ae71b4da06033f9b1e9c2db28db55a265c76f68e0be4417dbcd87b240c84d954 I0326 23:36:47.473293 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=c7ffa976ede429c1f2b813ae1882446fa629e13e7a935796b2c86664175e7756 I0326 23:36:47.473327 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=6ecc1e1ab86bca738589a6df492f1ccb2dfcf9191a29c284525e987fa53ac1a6 I0326 23:36:47.473354 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=f2e8ae6d95516518a23d5658aa6e95513749659123e6b300aec4d65a8e9059ff I0326 23:36:47.473379 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=d4e66a81e5439faf8b24de5acda15adc20b4f293409543a9b389ed17a2e2800a I0326 23:36:47.473401 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=8155dd15bbde0df886273506f258e485dafd6060c15bf42a85ca84b5058ee8b0 I0326 23:36:47.473409 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 7.879959ms to process 13 records I0326 23:36:47.473492 1 tasks_processing.go:74] worker 27 stopped. I0326 23:36:47.473616 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=e8d3b7954b1e5e82371b6dec198badcd090b48812a7fafe55966f3b1670068f5 I0326 23:36:47.473627 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 8.04511ms to process 1 records I0326 23:36:47.473694 1 recorder.go:75] Recording config/image with fingerprint=993e48efd5b17386c0d41936963911364bdb2288f98fb2514d70c0910a87dead I0326 23:36:47.473702 1 gather.go:177] gatherer "clusterconfig" function "image" took 7.572317ms to process 1 records I0326 23:36:47.473703 1 tasks_processing.go:74] worker 0 stopped. I0326 23:36:47.489784 1 tasks_processing.go:74] worker 53 stopped. I0326 23:36:47.489803 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 24.049988ms to process 0 records I0326 23:36:47.489915 1 tasks_processing.go:74] worker 20 stopped. I0326 23:36:47.489929 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 24.115548ms to process 0 records I0326 23:36:47.489950 1 tasks_processing.go:74] worker 55 stopped. E0326 23:36:47.489961 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0326 23:36:47.489969 1 gather.go:177] gatherer "clusterconfig" function "machines" took 24.048642ms to process 0 records E0326 23:36:47.489976 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0326 23:36:47.489983 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 23.866066ms to process 0 records I0326 23:36:47.489988 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 23.482293ms to process 0 records I0326 23:36:47.489993 1 tasks_processing.go:74] worker 40 stopped. I0326 23:36:47.490009 1 tasks_processing.go:74] worker 33 stopped. I0326 23:36:47.490080 1 tasks_processing.go:74] worker 50 stopped. I0326 23:36:47.490096 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 23.790031ms to process 0 records I0326 23:36:47.490146 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 25.333526ms to process 0 records I0326 23:36:47.490155 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 23.475066ms to process 0 records I0326 23:36:47.490161 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 25.201908ms to process 0 records I0326 23:36:47.490162 1 tasks_processing.go:74] worker 11 stopped. I0326 23:36:47.490166 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 25.220268ms to process 0 records I0326 23:36:47.490176 1 tasks_processing.go:74] worker 47 stopped. I0326 23:36:47.490181 1 tasks_processing.go:74] worker 16 stopped. I0326 23:36:47.490171 1 tasks_processing.go:74] worker 4 stopped. I0326 23:36:47.490253 1 tasks_processing.go:74] worker 59 stopped. I0326 23:36:47.490701 1 recorder.go:75] Recording config/infrastructure with fingerprint=f45cdfbe5ef3953383722cc3e61b680db01da19d6645b3307766b7aa07002a23 I0326 23:36:47.490719 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 24.366521ms to process 1 records I0326 23:36:47.490727 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 24.524825ms to process 0 records I0326 23:36:47.490733 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 23.419053ms to process 0 records I0326 23:36:47.490740 1 tasks_processing.go:74] worker 12 stopped. E0326 23:36:47.490741 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0326 23:36:47.490747 1 tasks_processing.go:74] worker 28 stopped. I0326 23:36:47.490748 1 tasks_processing.go:74] worker 60 stopped. I0326 23:36:47.490752 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 21.516288ms to process 0 records I0326 23:36:47.490824 1 tasks_processing.go:74] worker 52 stopped. I0326 23:36:47.490941 1 recorder.go:75] Recording config/oauth with fingerprint=195345447a1c9ac8ad6d30449afcf4062b844d38c39648e20d460c34c95914af I0326 23:36:47.490952 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 24.586585ms to process 1 records I0326 23:36:47.490958 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 22.945891ms to process 0 records I0326 23:36:47.491017 1 tasks_processing.go:74] worker 30 stopped. I0326 23:36:47.491099 1 recorder.go:75] Recording config/ingress with fingerprint=fc4fdf81ca72b1978a46379ef7b5bff972d6227e5b971fe98fdeda316cc092f4 I0326 23:36:47.491135 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 23.968115ms to process 1 records I0326 23:36:47.491144 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 21.845021ms to process 0 records I0326 23:36:47.491122 1 tasks_processing.go:74] worker 8 stopped. I0326 23:36:47.491156 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 21.8468ms to process 0 records I0326 23:36:47.491162 1 tasks_processing.go:74] worker 10 stopped. I0326 23:36:47.491171 1 tasks_processing.go:74] worker 44 stopped. I0326 23:36:47.491173 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 22.540225ms to process 0 records I0326 23:36:47.491184 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 21.957289ms to process 0 records I0326 23:36:47.491192 1 tasks_processing.go:74] worker 22 stopped. I0326 23:36:47.491193 1 tasks_processing.go:74] worker 62 stopped. I0326 23:36:47.491806 1 tasks_processing.go:74] worker 6 stopped. I0326 23:36:47.492071 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=e23dcbe89ef0b4999da901e109ac3a53e806349e48f65337f1d714c7799a1af8 I0326 23:36:47.492138 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=adcb718f7ca741a0b98c11c9fab5a21773724e39fd01c8ea9b4260dffe0f02ff I0326 23:36:47.492165 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=fd4687ce58245ee66851ba03c3b8104776a7205751385b1891f0f8d95d7ac124 I0326 23:36:47.492187 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=01d4e4612dce17af16c0e74190e082bae8d950cf523ff57cda574242dc8af70d I0326 23:36:47.492224 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=a31ace8f9ab188e1088d4402b7025f060b7ac86b5766827267812398eaaee505 I0326 23:36:47.492259 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=a1990458d85e9f4ef962f5d4542279cb8d081dffc11ba482a3e256d151188bbf I0326 23:36:47.492296 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=f20bd5c2507815b9ed5cd7e4c2f22c3af2b7bec8afe6335b97a4fd861a818ea8 I0326 23:36:47.492323 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=fdbdb148a1aae227213ad07a56bba79a69e824f57ab9396ac712f80b9d315787 I0326 23:36:47.492361 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=8a56407c2f2eab540ca9cd5d500e901923afbd63af9502faeb0ac41e275a9812 I0326 23:36:47.492389 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=2b50e4a5f358e27d193f4e58646b63a1d59c40249ca51e859a0baddb61c29f66 I0326 23:36:47.492420 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 26.887118ms to process 10 records I0326 23:36:47.492513 1 recorder.go:75] Recording config/proxy with fingerprint=a3c627248801895c20705a2be3f3b969fb7f898c3af0f9faa94ff9796228878e I0326 23:36:47.492525 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 24.209002ms to process 1 records I0326 23:36:47.492716 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=99379ac57244ee57c5d38911c04faa9ed9885b30956f5468af66e949e1da2afd I0326 23:36:47.492768 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=061b25603022fe395a94c4bf27f8cda48c3ad50747cd862c517b78f5e1c4e9c1 I0326 23:36:47.492810 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=a2a2b123d236ac22c8bf7ab18f58994ecadb2c0c5de7f751d0d1ace7612c5bf2 I0326 23:36:47.492826 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 26.193268ms to process 3 records I0326 23:36:47.492837 1 tasks_processing.go:74] worker 29 stopped. I0326 23:36:47.492843 1 tasks_processing.go:74] worker 17 stopped. I0326 23:36:47.493188 1 tasks_processing.go:74] worker 31 stopped. I0326 23:36:47.494149 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=d726e1a57fb85fd0dbde44621f84fb08227e263b4571e799b1d2b084e99fc7c0 I0326 23:36:47.494170 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 25.260543ms to process 1 records E0326 23:36:47.494184 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0326 23:36:47.494193 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 25.457594ms to process 0 records I0326 23:36:47.494194 1 tasks_processing.go:74] worker 61 stopped. I0326 23:36:47.494206 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 25.071679ms to process 0 records I0326 23:36:47.494218 1 tasks_processing.go:74] worker 9 stopped. I0326 23:36:47.496884 1 tasks_processing.go:74] worker 43 stopped. I0326 23:36:47.496997 1 recorder.go:75] Recording config/network with fingerprint=9910f906465b832024287f2b9fe70cec8224c00ee2dbd8521f43b484e22928f1 I0326 23:36:47.497008 1 gather.go:177] gatherer "clusterconfig" function "networks" took 29.230965ms to process 1 records I0326 23:36:47.497070 1 tasks_processing.go:74] worker 46 stopped. I0326 23:36:47.497145 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=db66327a82a7388675046fbe9117d8891112ed51309077f7a362f5b77a8f85a7 I0326 23:36:47.497157 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 31.924236ms to process 1 records I0326 23:36:47.497422 1 tasks_processing.go:74] worker 15 stopped. I0326 23:36:47.497643 1 recorder.go:75] Recording config/authentication with fingerprint=4145a18a22f9b7150a3375ee6902f4dc81aa342afe7389c8923181719ce8c02a I0326 23:36:47.497661 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 32.507216ms to process 1 records I0326 23:36:47.499493 1 tasks_processing.go:74] worker 54 stopped. I0326 23:36:47.499507 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 34.024559ms to process 0 records I0326 23:36:47.500339 1 tasks_processing.go:74] worker 35 stopped. I0326 23:36:47.500623 1 recorder.go:75] Recording config/node/ip-10-0-0-210.ec2.internal with fingerprint=fa3892f76d9d786885db8961326ad616e5eff6f183e551368effb951a2032779 I0326 23:36:47.500690 1 recorder.go:75] Recording config/node/ip-10-0-1-210.ec2.internal with fingerprint=25d5da1ef7ee8cdcb6f34a04db70944fd2e5ce0cc827bc0efa3a618da9de1a9f I0326 23:36:47.500751 1 recorder.go:75] Recording config/node/ip-10-0-2-233.ec2.internal with fingerprint=ad3e2b68cf49a2a19af5b06b1ca9a678a4a5d7f1cad3b72e1d63056a9f7cc737 I0326 23:36:47.500764 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 34.903126ms to process 3 records I0326 23:36:47.500852 1 tasks_processing.go:74] worker 7 stopped. I0326 23:36:47.500855 1 recorder.go:75] Recording config/featuregate with fingerprint=fc7ecbfb64cf70ce1b09438501c356357952f754f2b543811a1f80ee67024f7e I0326 23:36:47.500874 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 33.575442ms to process 1 records W0326 23:36:47.502754 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0326 23:36:47.506979 1 tasks_processing.go:74] worker 42 stopped. I0326 23:36:47.507059 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=4f57ff3d75e365aca7142bdedf2b641019b70f5ecabbaef5474bd9cdf9ed2865 I0326 23:36:47.507074 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=7cce524909781a7d0e418c426323c7e2349715b7a8681602f5c2aafccfe9c556 I0326 23:36:47.507081 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 40.041526ms to process 2 records I0326 23:36:47.507259 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0326 23:36:47.507272 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0326 23:36:47.507279 1 controller.go:212] Source scaController *sca.Controller is not ready I0326 23:36:47.507284 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0326 23:36:47.507288 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0326 23:36:47.507313 1 controller.go:489] The operator is still being initialized I0326 23:36:47.507325 1 controller.go:512] The operator is healthy I0326 23:36:47.507629 1 tasks_processing.go:74] worker 23 stopped. I0326 23:36:47.507792 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=6f8101fc38a6a909a884bf8f6a029b240d9938f1fce94863f20872f6ba76008b I0326 23:36:47.507873 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=8017bf38dc7e925e7748c5dcc41a7bfeda73a0356191af7b8105c87895fc6e75 I0326 23:36:47.507882 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 38.435807ms to process 2 records I0326 23:36:47.507917 1 recorder.go:75] Recording config/olm_operators with fingerprint=e0beeedb8916eff7ff74d4379357982083ae85a9b614fa471fdb2e5edaf3d2ab I0326 23:36:47.507925 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 42.335824ms to process 1 records I0326 23:36:47.507932 1 tasks_processing.go:74] worker 36 stopped. I0326 23:36:47.508239 1 tasks_processing.go:74] worker 1 stopped. I0326 23:36:47.508253 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 43.475476ms to process 0 records I0326 23:36:47.508438 1 tasks_processing.go:74] worker 2 stopped. I0326 23:36:47.509184 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=2cd4d4d72ad4c5b3e770fcf65bc4270d6aa42fcc0cf85d4b9f67cb315dbccb9e I0326 23:36:47.509686 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=4f5e9dfc642de2fe2faf78323f1827737e292c68fd13e91fd634d63c16ed7f6b I0326 23:36:47.509712 1 gather.go:177] gatherer "clusterconfig" function "crds" took 41.68954ms to process 2 records I0326 23:36:47.523421 1 tasks_processing.go:74] worker 56 stopped. I0326 23:36:47.524881 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-tgpw6 with fingerprint=b1c2d033c64de4562db7fad2de8a45a72348da2b2303bfb5d5d02f887fa7f4f7 I0326 23:36:47.525211 1 recorder.go:75] Recording config/running_containers with fingerprint=de52672e594254da656158b69b8726c17c436afd73b135c9629dbf0b786ab2b0 I0326 23:36:47.525239 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 57.406163ms to process 2 records I0326 23:36:47.525251 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 58.362443ms to process 0 records I0326 23:36:47.525260 1 tasks_processing.go:74] worker 18 stopped. I0326 23:36:47.530869 1 tasks_processing.go:74] worker 63 stopped. E0326 23:36:47.530884 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0326 23:36:47.530890 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0326 23:36:47.530893 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0326 23:36:47.530907 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0326 23:36:47.530934 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0326 23:36:47.530942 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0326 23:36:47.530946 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0326 23:36:47.530954 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0326 23:36:47.530999 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0326 23:36:47.531007 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0326 23:36:47.531027 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 65.690707ms to process 7 records I0326 23:36:47.538415 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0326 23:36:47.538427 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0326 23:36:47.538494 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0326 23:36:47.541688 1 base_controller.go:82] Caches are synced for ConfigController I0326 23:36:47.541701 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0326 23:36:47.545853 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:36:47.573413 1 base_controller.go:82] Caches are synced for LoggingSyncer I0326 23:36:47.573429 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0326 23:36:47.576636 1 cluster_transfer.go:102] no available accepted cluster transfer I0326 23:36:47.576651 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0326 23:36:47.582870 1 tasks_processing.go:74] worker 26 stopped. I0326 23:36:47.582911 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0326 23:36:47.582924 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 113.837346ms to process 1 records I0326 23:36:47.583313 1 gather_logs.go:145] no pods in namespace were found I0326 23:36:47.583330 1 tasks_processing.go:74] worker 32 stopped. I0326 23:36:47.583338 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 114.101305ms to process 0 records I0326 23:36:47.583488 1 tasks_processing.go:74] worker 13 stopped. I0326 23:36:47.583501 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 114.648705ms to process 0 records I0326 23:36:47.583513 1 tasks_processing.go:74] worker 49 stopped. I0326 23:36:47.583787 1 recorder.go:75] Recording config/version with fingerprint=7490c840416150c4dbea02bd22fa958674b8731a35b033d823a6650acb650684 I0326 23:36:47.583799 1 recorder.go:75] Recording config/id with fingerprint=55f6cc8d7e8936263d36845abc30ceed6dcfbde886f9d2aad3749c92eda95582 I0326 23:36:47.583805 1 gather.go:177] gatherer "clusterconfig" function "version" took 118.163192ms to process 2 records I0326 23:36:47.583815 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 115.084767ms to process 0 records I0326 23:36:47.583821 1 tasks_processing.go:74] worker 25 stopped. I0326 23:36:47.585908 1 tasks_processing.go:74] worker 45 stopped. I0326 23:36:47.585933 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0326 23:36:47.585944 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 120.984136ms to process 1 records I0326 23:36:47.591941 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0326 23:36:47.609733 1 gather_cluster_operator_pods_and_events.go:121] Found 7 pods with 7 containers I0326 23:36:47.609752 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 3595117 bytes I0326 23:36:47.611607 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-575f49d475-2v5bx pod in namespace openshift-ingress (previous: false). I0326 23:36:47.623398 1 tasks_processing.go:74] worker 14 stopped. E0326 23:36:47.623416 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0326 23:36:47.623421 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2p9n1c8c9cfpj6p7b17r525iussa5smo-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2p9n1c8c9cfpj6p7b17r525iussa5smo-primary-cert-bundle-secret" not found I0326 23:36:47.623484 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=97af57f183ddd14e19d67cb5a2be8a79ecb5daae8e411819b8ca2d872c46fa7a I0326 23:36:47.623498 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 154.738341ms to process 1 records I0326 23:36:47.623601 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-575f49d475-6bk7n pod in namespace openshift-ingress (previous: false). I0326 23:36:47.633940 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-575f49d475-99mpf pod in namespace openshift-ingress (previous: false). I0326 23:36:47.647597 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-78845544f5-wm5m9 pod in namespace openshift-ingress (previous: false). I0326 23:36:47.659285 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-d48hn pod in namespace openshift-ingress-canary (previous: false). I0326 23:36:47.767380 1 sca.go:266] etc-pki-entitlement secret successfully created I0326 23:36:47.767400 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0326 23:36:47.791433 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-lj4jj pod in namespace openshift-ingress-canary (previous: false). I0326 23:36:47.994859 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-pvdch pod in namespace openshift-ingress-canary (previous: false). I0326 23:36:48.191340 1 tasks_processing.go:74] worker 41 stopped. I0326 23:36:48.191454 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=1cfba618b416074bcd1bed9842088095050bec622ba068658aef544aef817872 I0326 23:36:48.191538 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=ff56d396fe4389b996e83256fda949c8a8521a7bb865388c3a2a8fd94b6bac4e I0326 23:36:48.191577 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=9c1e506daa0747026d48ff10b5e19008ddc8228c395a442118b1d5303dbca21f I0326 23:36:48.191630 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-575f49d475-2v5bx/router_current.log with fingerprint=a5453f9ab08077eaef120a20b11f12fd40abff3d24fdc6fb404ec87a089cc278 I0326 23:36:48.191655 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-575f49d475-6bk7n/router_current.log with fingerprint=bcb60ef2dbf4d0d73214be87af3a61176f0aea33d005d2ef680f40a45da49558 I0326 23:36:48.191693 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-575f49d475-99mpf/router_current.log with fingerprint=ecf792378a5aedd91adb3df1e86f0ac23efdcbfb8709c27f3289ce89fc76eaab I0326 23:36:48.191722 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-78845544f5-wm5m9/router_current.log with fingerprint=ac32a0768c23d66ee8a60c9feb4ceda8d96d4cdb3cd18ed3478975c30be9eeb4 I0326 23:36:48.191729 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-d48hn/serve-healthcheck-canary_current.log with fingerprint=278865837ab052862697810f875c2baf0627100f691154d98da40f4b6898628f I0326 23:36:48.191734 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-lj4jj/serve-healthcheck-canary_current.log with fingerprint=b8f08c6f745de03d91eb72ff97f8202a973c99a514c986db2006bcc5d25f68f2 I0326 23:36:48.191738 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-pvdch/serve-healthcheck-canary_current.log with fingerprint=f03f99ae5c6ac654d4e25bf4d4bfd2f8900838eb4b375767fd591ed88fb7cade I0326 23:36:48.191744 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 723.520222ms to process 10 records W0326 23:36:48.502361 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0326 23:36:49.502682 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0326 23:36:49.925101 1 tasks_processing.go:74] worker 57 stopped. I0326 23:36:49.925274 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=f43762d66f6b302c2b2256ecb75d68ec22f5538dfa7a803600158a153adce3a1 I0326 23:36:49.925334 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0326 23:36:49.925360 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=dba61ed60d403c6995c1282b599945e48f165b56cd7d07cbb07a0f386981f20d I0326 23:36:49.925371 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0326 23:36:49.925392 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=6affd7a4b10d9f2463d4e453e49ae54e2f69b1d812814614c19da25205e5d8a0 I0326 23:36:49.925408 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0326 23:36:49.925429 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=af57abbc8e329ac62c93044fbb651cd2fb151d1c8f337af670edd8aed53118e4 I0326 23:36:49.925458 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=c8a94b6f9e19e18f9f84bd56e00aae1c97ec4df739003b0e873ad43df9af6636 I0326 23:36:49.925481 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=213098ab3a68315e1f8730dc14023220630844016f10c4290a8cc298e2cd8624 I0326 23:36:49.925522 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=035092f5c192bab9af73dee098098577e83e470b0bd6cfe28f26f42f3a3d3598 I0326 23:36:49.925821 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=bc60b1b3a8b22a039f4008ae56e20a8804095e2fc2a7b48ac10b81deff4a5b1d I0326 23:36:49.925844 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=a22c855ca908ba47cc1374e0eba929f52d97e3d6afee27b93f30d698675f5d8a I0326 23:36:49.925853 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0326 23:36:49.925870 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=64c99f8617160b06befeb673b527b070aeee73333331cd4a39fb67d6c7cbdc66 I0326 23:36:49.925881 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0326 23:36:49.925896 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=233efebaa8bdf7601d94516205b0be62e72e773021b056d16651f4f418824d5d I0326 23:36:49.925905 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0326 23:36:49.925924 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=9e7333eb6f44ccecc69eeedc8778dfb2d7c1625a3ddc145521b49fb29b8504d1 I0326 23:36:49.925933 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0326 23:36:49.925952 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=18cc5ccea4da94f89771f7b38311cf3e77c66dc1b26b46f7fc74d3237ced1771 I0326 23:36:49.926056 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=a0e061d840d134a14415922da242526a4d9ee59e8a9cb369729eeea2d937d191 I0326 23:36:49.926065 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0326 23:36:49.926073 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0326 23:36:49.926095 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0326 23:36:49.926133 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=d6ccf51cd89d5889a85bda2c6a0456326e83623eb4e30eaac9cbfce515dbf719 I0326 23:36:49.926158 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=4b799542d4c48e8332c960c9c65fc0e1aebb0b511a3cc5b2a94bd627659369d0 I0326 23:36:49.926168 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0326 23:36:49.926184 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=fcfd7ff0d454f3d0b22e8b5cf9079553e926ae44f78452e8d03636f0c8a3589b I0326 23:36:49.926193 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0326 23:36:49.926210 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=bcc0e4803631f9e6a076a94512a3af956bfe7f2cd821a5f44d3edc0ddac5becf I0326 23:36:49.926221 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0326 23:36:49.926235 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=ead7d4689a9ef2a1cbb48b22d5c01bd4d9682a45958c69a1b77c9a834ddf35cd I0326 23:36:49.926250 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=766a041001016bf05a20b7d75c2c108987bc1425290c78faf83af880a94808c1 I0326 23:36:49.926267 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=be01ac1ca35252078dab0d81bd837bd10fdd9fe836a2dc214832be2b6e8f3a0f I0326 23:36:49.926296 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=6dee647bbc903b502834709c7128b6e7a7e4449f56590e860e1f0143ef89480e I0326 23:36:49.926308 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0326 23:36:49.926332 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=0b0bd408023093b85f7fc768bfcc829b27b7b95f8026d653764297b578c63a8d I0326 23:36:49.926349 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0326 23:36:49.926358 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0326 23:36:49.926366 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.460094917s to process 39 records W0326 23:36:50.504291 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0326 23:36:51.503028 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0326 23:36:52.502293 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0326 23:36:52.502321 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0326 23:36:52.502348 1 tasks_processing.go:74] worker 34 stopped. E0326 23:36:52.502359 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0326 23:36:52.502372 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0326 23:36:52.502383 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.036439102s to process 1 records I0326 23:37:00.387189 1 tasks_processing.go:74] worker 37 stopped. I0326 23:37:00.387230 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0326 23:37:00.387271 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.919111633s to process 1 records I0326 23:37:01.070905 1 tasks_processing.go:74] worker 21 stopped. I0326 23:37:01.071266 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=4aff5860ec073ddfdf1bec96303c96ef7753a0d476f8315de0a2062bde3a2fd5 I0326 23:37:01.071284 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.605621446s to process 1 records E0326 23:37:01.071351 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.606s with: function \"silenced_alerts\" failed with an error, function \"active_alerts\" failed with an error, function \"metrics\" failed with an error, function \"tsdb_status\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0326 23:37:01.072466 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "silenced_alerts" failed with an error, function "active_alerts" failed with an error, function "metrics" failed with an error, function "tsdb_status" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0326 23:37:01.072478 1 periodic.go:209] Running workloads gatherer I0326 23:37:01.072493 1 tasks_processing.go:45] number of workers: 2 I0326 23:37:01.072499 1 tasks_processing.go:69] worker 1 listening for tasks. I0326 23:37:01.072502 1 tasks_processing.go:71] worker 1 working on workload_info task. I0326 23:37:01.072570 1 tasks_processing.go:69] worker 0 listening for tasks. I0326 23:37:01.072643 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0326 23:37:01.079616 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-233.ec2.internal... I0326 23:37:01.079624 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-210.ec2.internal... I0326 23:37:01.079637 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-210.ec2.internal... I0326 23:37:01.095066 1 tasks_processing.go:74] worker 0 stopped. I0326 23:37:01.095083 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 22.39947ms to process 0 records I0326 23:37:06.577420 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 6s I0326 23:37:06.602718 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 25s for image data I0326 23:37:06.609704 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (8ms) I0326 23:37:06.617081 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (7ms) I0326 23:37:06.624768 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (8ms) I0326 23:37:06.631923 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (7ms) I0326 23:37:06.639333 1 gather_workloads_info.go:387] No image sha256:3d6ea9e1633f38070718a1357fcb80e6cb3932aafcc4d65e659795b186c5da15 (7ms) I0326 23:37:06.646142 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (7ms) I0326 23:37:06.653349 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (7ms) I0326 23:37:06.661243 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (8ms) I0326 23:37:06.668310 1 gather_workloads_info.go:387] No image sha256:90bdf9e678fe18e35401e34e1cb0912d822e9cb32b9e41cc545870540e9a87f2 (7ms) I0326 23:37:06.675682 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (7ms) I0326 23:37:06.709571 1 gather_workloads_info.go:398] Found image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (34ms) I0326 23:37:06.810846 1 gather_workloads_info.go:387] No image sha256:09e27b3a67ebeda04d3e597e0561bfb40550de78bdecb53f2f9ff3dfb1cfe7ea (101ms) I0326 23:37:06.911838 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (101ms) I0326 23:37:07.010514 1 gather_workloads_info.go:387] No image sha256:101993f6e65d6fda8b90c583b718b720809182961f69bc777295f47e6df4d7ce (99ms) I0326 23:37:07.110213 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0326 23:37:07.211190 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (101ms) I0326 23:37:07.311892 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (101ms) I0326 23:37:07.411508 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (100ms) I0326 23:37:07.511188 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms) I0326 23:37:07.611288 1 gather_workloads_info.go:398] Found image sha256:32d4561d4bf1b3c4e3a7878f918f9c1422bab85bdf8711fbdf905d59692fee81 (100ms) I0326 23:37:07.710157 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (99ms) I0326 23:37:07.811932 1 gather_workloads_info.go:387] No image sha256:1477f3287cc75352305274f248f781c1b7c2a8696f4f7bc450c45a4a5f5b10ea (102ms) I0326 23:37:07.910314 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (98ms) I0326 23:37:08.010697 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0326 23:37:08.110268 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0326 23:37:08.211031 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (101ms) I0326 23:37:08.311398 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (100ms) I0326 23:37:08.410839 1 gather_workloads_info.go:387] No image sha256:74713675d580a47a56b628469c4c05c41e114e0b935960d718ff0cf7e72f613d (99ms) I0326 23:37:08.510324 1 gather_workloads_info.go:387] No image sha256:7bd3e88d6d3f878a89203df590b684c5a77bf08df4717451d3197ab74683a80e (99ms) I0326 23:37:08.610145 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms) I0326 23:37:08.711376 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (101ms) I0326 23:37:08.810756 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (99ms) I0326 23:37:08.910578 1 gather_workloads_info.go:387] No image sha256:6e5df2aab9ce759e8f957341a11c087c233307e3c8f8760d21270efc19ccd3ce (100ms) I0326 23:37:09.011090 1 gather_workloads_info.go:387] No image sha256:76cc47f3775560477ec548c7b6fddbd99112ad6604f790697eef546576051fb7 (100ms) I0326 23:37:09.110999 1 gather_workloads_info.go:387] No image sha256:1e65f9f5490fbc930d2dce96f03ddcb28990b839d7dc011ef5de5bec6c5095bf (100ms) I0326 23:37:09.210760 1 gather_workloads_info.go:387] No image sha256:0092c6ff139f8698c91349d507eb3182bc5d6c4ae040f672e347ff504accdea2 (100ms) I0326 23:37:09.312383 1 gather_workloads_info.go:387] No image sha256:0af73ad7a47c9ff53269ae2bc5163bf9e389085220c34e4bd42c92c4e7a85f6d (102ms) I0326 23:37:09.410513 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (98ms) I0326 23:37:09.511509 1 gather_workloads_info.go:387] No image sha256:3612c5a433effd17b7aff7ff6edf4fb27b61153908e3a0294158e4886a1d600d (101ms) I0326 23:37:09.610652 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (99ms) I0326 23:37:09.710916 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0326 23:37:09.811319 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (100ms) I0326 23:37:09.910490 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (99ms) I0326 23:37:10.011773 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (101ms) I0326 23:37:10.111647 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0326 23:37:10.210567 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (99ms) I0326 23:37:10.310576 1 gather_workloads_info.go:387] No image sha256:b99613494e9d6a4a8207323872d63cc02b830fc80a8bf972e62c64381aa4cd17 (100ms) I0326 23:37:10.410434 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (100ms) I0326 23:37:10.510961 1 gather_workloads_info.go:387] No image sha256:513b1166e376feca472fdd5174f6abf0abf02925d6a21b7b4d89a2ff2fc67bed (101ms) I0326 23:37:10.510992 1 tasks_processing.go:74] worker 1 stopped. I0326 23:37:10.511324 1 recorder.go:75] Recording config/workload_info with fingerprint=1dc219baad78b179002fc984cd88b3cc91054a53d18fde57257e97937a3d4096 I0326 23:37:10.511340 1 gather.go:177] gatherer "workloads" function "workload_info" took 9.438483595s to process 1 records I0326 23:37:10.511368 1 periodic.go:256] Periodic gather workloads completed in 9.438s I0326 23:37:10.511378 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0326 23:37:10.511382 1 periodic.go:209] Running conditional gatherer I0326 23:37:10.515854 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0326 23:37:10.649680 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer E0326 23:37:10.652051 1 conditional_gatherer.go:324] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.172.115:9091: connect: connection refused I0326 23:37:10.652157 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0326 23:37:10.659816 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0326 23:37:10.659903 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:37:10.659940 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:37:10.659965 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:37:10.659988 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:37:10.660010 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:37:10.660032 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:37:10.660056 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:37:10.660085 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:37:10.660125 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0326 23:37:10.660166 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0326 23:37:10.660203 1 tasks_processing.go:45] number of workers: 3 I0326 23:37:10.660225 1 tasks_processing.go:69] worker 2 listening for tasks. I0326 23:37:10.660230 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0326 23:37:10.660251 1 tasks_processing.go:69] worker 0 listening for tasks. I0326 23:37:10.660266 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0326 23:37:10.660286 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0326 23:37:10.660275 1 tasks_processing.go:69] worker 1 listening for tasks. I0326 23:37:10.660305 1 tasks_processing.go:74] worker 1 stopped. I0326 23:37:10.660589 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0326 23:37:10.660607 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.355µs to process 1 records I0326 23:37:10.660642 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0326 23:37:10.660651 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.042µs to process 1 records I0326 23:37:10.660657 1 tasks_processing.go:74] worker 0 stopped. I0326 23:37:10.660742 1 tasks_processing.go:74] worker 2 stopped. I0326 23:37:10.660754 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 453.341µs to process 0 records I0326 23:37:10.660769 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0326 23:37:10.660787 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0326 23:37:10.686651 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=ff1f0ff093db4669fb1edbd0d37e2c6f13eb7fc5b24953643f0dc8bb4f72f6f1 I0326 23:37:10.686779 1 diskrecorder.go:70] Writing 118 records to /var/lib/insights-operator/insights-2026-03-26-233710.tar.gz I0326 23:37:10.693733 1 diskrecorder.go:51] Wrote 118 records to disk in 7ms I0326 23:37:10.693770 1 periodic.go:278] Gathering cluster info every 2h0m0s I0326 23:37:10.693784 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0326 23:38:17.465073 1 diskrecorder.go:223] Found files to send: insights-2026-03-26-233710.tar.gz I0326 23:38:17.465102 1 insightsuploader.go:150] Checking archives to upload periodically every 15m6.275978261s I0326 23:38:17.465128 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0326 23:38:17.475723 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0326 23:38:17.629161 1 requests.go:87] Successfully reported id=2026-03-26T23:38:17Z x-rh-insights-request-id=0b082beea54b43998a4d2c8ce324c8f2, wrote=53669 I0326 23:38:17.629283 1 insightsuploader.go:187] Uploaded report successfully in 164.144923ms I0326 23:38:17.629311 1 controller.go:128] Initializing last reported time to 2026-03-26T23:38:17Z I0326 23:38:17.629387 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0326 23:38:17.629400 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0326 23:38:17.629408 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0326 23:38:17.634293 1 controller.go:512] The operator is healthy I0326 23:38:47.478750 1 controller.go:512] The operator is healthy I0326 23:39:19.618905 1 insightsreport.go:137] Pulling report from smart-proxy I0326 23:39:19.618931 1 insightsreport.go:149] Retrieving report I0326 23:39:19.625263 1 requests.go:110] Retrieving report for cluster: 9c0621cc-1b93-49d6-8682-2ef52ebe5a1c I0326 23:39:19.625275 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/9c0621cc-1b93-49d6-8682-2ef52ebe5a1c/reports I0326 23:39:19.628080 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/9c0621cc-1b93-49d6-8682-2ef52ebe5a1c/reports I0326 23:39:19.795070 1 insightsreport.go:184] Report retrieved I0326 23:39:19.820812 1 insightsreport.go:239] Report retrieved correctly I0326 23:40:47.479323 1 controller.go:512] The operator is healthy I0326 23:41:47.458998 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0326 23:41:47.463891 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:41:47.463909 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0326 23:41:47.467388 1 secretconfigobserver.go:119] support secret does not exist I0326 23:42:47.480953 1 controller.go:512] The operator is healthy I0326 23:44:47.478897 1 controller.go:512] The operator is healthy I0326 23:46:47.456846 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:46:47.467955 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0326 23:46:47.471981 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:46:47.472001 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0326 23:46:47.475453 1 secretconfigobserver.go:119] support secret does not exist I0326 23:46:47.477538 1 controller.go:512] The operator is healthy I0326 23:48:47.478268 1 controller.go:512] The operator is healthy I0326 23:50:47.479127 1 controller.go:512] The operator is healthy I0326 23:51:47.476271 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0326 23:51:47.481664 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:51:47.481688 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0326 23:51:47.485266 1 secretconfigobserver.go:119] support secret does not exist I0326 23:52:47.479023 1 controller.go:512] The operator is healthy I0326 23:53:28.906472 1 insightsuploader.go:146] Nothing to report since 2026-03-26T23:38:17Z I0326 23:54:47.478614 1 controller.go:512] The operator is healthy I0326 23:56:47.456539 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:56:47.460289 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:56:47.477894 1 controller.go:512] The operator is healthy I0326 23:56:47.485755 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0326 23:56:47.489323 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:56:47.489341 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0326 23:56:47.492407 1 secretconfigobserver.go:119] support secret does not exist I0326 23:58:47.478932 1 controller.go:512] The operator is healthy I0327 00:00:47.478747 1 controller.go:512] The operator is healthy I0327 00:01:47.493021 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0327 00:01:47.498016 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0327 00:01:47.498033 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0327 00:01:47.502002 1 secretconfigobserver.go:119] support secret does not exist I0327 00:02:47.478890 1 controller.go:512] The operator is healthy I0327 00:04:47.478814 1 controller.go:512] The operator is healthy I0327 00:06:47.457172 1 configmapobserver.go:84] configmaps "insights-config" not found I0327 00:06:47.477858 1 controller.go:512] The operator is healthy I0327 00:06:47.502888 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0327 00:06:47.506927 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0327 00:06:47.506945 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0327 00:06:47.510602 1 secretconfigobserver.go:119] support secret does not exist I0327 00:08:47.478875 1 controller.go:512] The operator is healthy I0327 00:09:04.980777 1 insightsuploader.go:146] Nothing to report since 2026-03-26T23:38:17Z I0327 00:10:47.479131 1 controller.go:512] The operator is healthy I0327 00:11:47.511292 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0327 00:11:47.518049 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0327 00:11:47.518069 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0327 00:11:47.523450 1 secretconfigobserver.go:119] support secret does not exist