I0216 09:40:18.796591 1 cmd.go:241] Using service-serving-cert provided certificates I0216 09:40:18.796851 1 observer_polling.go:159] Starting file observer I0216 09:40:19.309813 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0216 09:40:19.310022 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0216 09:40:19.310310 1 secure_serving.go:57] Forcing use of http/1.1 only W0216 09:40:19.310327 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0216 09:40:19.310330 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0216 09:40:19.310333 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0216 09:40:19.310337 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0216 09:40:19.310338 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0216 09:40:19.310340 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0216 09:40:19.310342 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0216 09:40:19.313806 1 event.go:364] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"d85f63fd-c542-43f5-9999-76668af7b860", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ClusterAPIInstallAWS", "ClusterAPIInstallAzure", "ClusterAPIInstallGCP", "ClusterAPIInstallNutanix", "ClusterAPIInstallOpenStack", "ClusterAPIInstallPowerVS", "ClusterAPIInstallVSphere", "DisableKubeletCloudCredentialProviders", "ExternalCloudProvider", "ExternalCloudProviderAzure", "ExternalCloudProviderExternal", "ExternalCloudProviderGCP", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "MetricsServer", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NodeDisruptionPolicy", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "StreamingCollectionEncodingToJSON", "StreamingCollectionEncodingToProtobuf", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InstallAlternateInfrastructureAWS", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "ManagedBootImagesAWS", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MixedCPUsAllocation", "MultiArchInstallAzure", "NetworkSegmentation", "NewOLM", "NodeSwap", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PersistentIPsForVirtualization", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesSupport", "VSphereMultiVCenters", "VolumeGroupSnapshot"}} I0216 09:40:19.313812 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AutomatedEtcdBackup AzureWorkloadIdentity BareMetalLoadBalancer BootcNodeManagement BuildCSIVolumes CSIDriverSharedResource ChunkSizeMiB CloudDualStackNodeIPs ClusterAPIInstall ClusterAPIInstallAWS ClusterAPIInstallAzure ClusterAPIInstallGCP ClusterAPIInstallIBMCloud ClusterAPIInstallNutanix ClusterAPIInstallOpenStack ClusterAPIInstallPowerVS ClusterAPIInstallVSphere ClusterMonitoringConfig DNSNameResolver DisableKubeletCloudCredentialProviders DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example ExternalCloudProvider ExternalCloudProviderAzure ExternalCloudProviderExternal ExternalCloudProviderGCP ExternalOIDC GCPClusterHostedDNS GCPLabelsTags GatewayAPI HardwareSpeed IngressControllerLBSubnetsAWS InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InstallAlternateInfrastructureAWS KMSv1 MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MaxUnavailableStatefulSet MetricsCollectionProfiles MetricsServer MixedCPUsAllocation MultiArchInstallAWS MultiArchInstallAzure MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NewOLM NodeDisruptionPolicy NodeSwap OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PersistentIPsForVirtualization PinnedImages PlatformOperators PrivateHostedZoneAWS ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SignatureStores SigstoreImageVerification StreamingCollectionEncodingToJSON StreamingCollectionEncodingToProtobuf TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesSupport VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy VolumeGroupSnapshot] I0216 09:40:19.314856 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0216 09:40:19.314865 1 shared_informer.go:311] Waiting for caches to sync for RequestHeaderAuthRequestController I0216 09:40:19.314868 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0216 09:40:19.314879 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0216 09:40:19.314888 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0216 09:40:19.314881 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0216 09:40:19.315112 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0216 09:40:19.315180 1 secure_serving.go:213] Serving securely on [::]:8443 I0216 09:40:19.315204 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" W0216 09:40:19.320008 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0216 09:40:19.320039 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0216 09:40:19.320129 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0216 09:40:19.324186 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 09:40:19.324203 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0216 09:40:19.328077 1 secretconfigobserver.go:119] support secret does not exist I0216 09:40:19.332253 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 09:40:19.335893 1 secretconfigobserver.go:119] support secret does not exist I0216 09:40:19.339069 1 recorder.go:161] Pruning old reports every 8h29m48s, max age is 288h0m0s I0216 09:40:19.343774 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0216 09:40:19.343787 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0216 09:40:19.343792 1 insightsreport.go:296] Starting report retriever I0216 09:40:19.343776 1 periodic.go:214] Running clusterconfig gatherer I0216 09:40:19.343796 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0216 09:40:19.343791 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0216 09:40:19.343824 1 tasks_processing.go:45] number of workers: 64 I0216 09:40:19.343839 1 tasks_processing.go:69] worker 0 listening for tasks. I0216 09:40:19.343851 1 tasks_processing.go:69] worker 12 listening for tasks. I0216 09:40:19.343857 1 tasks_processing.go:69] worker 27 listening for tasks. I0216 09:40:19.343859 1 tasks_processing.go:69] worker 36 listening for tasks. I0216 09:40:19.343861 1 tasks_processing.go:69] worker 1 listening for tasks. I0216 09:40:19.343862 1 tasks_processing.go:71] worker 27 working on monitoring_persistent_volumes task. I0216 09:40:19.343865 1 tasks_processing.go:69] worker 13 listening for tasks. I0216 09:40:19.343866 1 tasks_processing.go:71] worker 1 working on nodenetworkstates task. I0216 09:40:19.343870 1 tasks_processing.go:69] worker 8 listening for tasks. I0216 09:40:19.343872 1 tasks_processing.go:71] worker 13 working on lokistack task. I0216 09:40:19.343876 1 tasks_processing.go:69] worker 9 listening for tasks. I0216 09:40:19.343881 1 tasks_processing.go:69] worker 10 listening for tasks. I0216 09:40:19.343885 1 tasks_processing.go:69] worker 11 listening for tasks. I0216 09:40:19.343889 1 tasks_processing.go:69] worker 4 listening for tasks. I0216 09:40:19.343893 1 tasks_processing.go:69] worker 3 listening for tasks. I0216 09:40:19.343887 1 tasks_processing.go:69] worker 7 listening for tasks. I0216 09:40:19.343893 1 tasks_processing.go:69] worker 51 listening for tasks. I0216 09:40:19.343898 1 tasks_processing.go:69] worker 5 listening for tasks. I0216 09:40:19.343904 1 tasks_processing.go:69] worker 44 listening for tasks. I0216 09:40:19.343905 1 tasks_processing.go:69] worker 6 listening for tasks. I0216 09:40:19.343906 1 tasks_processing.go:69] worker 37 listening for tasks. I0216 09:40:19.343909 1 tasks_processing.go:69] worker 38 listening for tasks. I0216 09:40:19.343863 1 tasks_processing.go:71] worker 36 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0216 09:40:19.343913 1 tasks_processing.go:69] worker 41 listening for tasks. I0216 09:40:19.343914 1 tasks_processing.go:69] worker 45 listening for tasks. I0216 09:40:19.343915 1 tasks_processing.go:69] worker 52 listening for tasks. I0216 09:40:19.343916 1 tasks_processing.go:69] worker 31 listening for tasks. I0216 09:40:19.343920 1 tasks_processing.go:69] worker 53 listening for tasks. I0216 09:40:19.343921 1 tasks_processing.go:69] worker 39 listening for tasks. I0216 09:40:19.343925 1 tasks_processing.go:69] worker 46 listening for tasks. I0216 09:40:19.343929 1 tasks_processing.go:69] worker 40 listening for tasks. I0216 09:40:19.343932 1 tasks_processing.go:69] worker 47 listening for tasks. I0216 09:40:19.343933 1 tasks_processing.go:69] worker 56 listening for tasks. I0216 09:40:19.343925 1 tasks_processing.go:69] worker 54 listening for tasks. I0216 09:40:19.343937 1 tasks_processing.go:69] worker 30 listening for tasks. I0216 09:40:19.343938 1 tasks_processing.go:69] worker 48 listening for tasks. I0216 09:40:19.343930 1 tasks_processing.go:69] worker 55 listening for tasks. I0216 09:40:19.343936 1 tasks_processing.go:69] worker 42 listening for tasks. I0216 09:40:19.343952 1 tasks_processing.go:69] worker 59 listening for tasks. I0216 09:40:19.343953 1 tasks_processing.go:69] worker 49 listening for tasks. I0216 09:40:19.343954 1 tasks_processing.go:69] worker 58 listening for tasks. I0216 09:40:19.343954 1 tasks_processing.go:69] worker 28 listening for tasks. I0216 09:40:19.343958 1 tasks_processing.go:71] worker 12 working on container_images task. I0216 09:40:19.343939 1 tasks_processing.go:69] worker 57 listening for tasks. I0216 09:40:19.343960 1 tasks_processing.go:69] worker 50 listening for tasks. I0216 09:40:19.343944 1 tasks_processing.go:69] worker 62 listening for tasks. I0216 09:40:19.343955 1 tasks_processing.go:69] worker 63 listening for tasks. I0216 09:40:19.343964 1 tasks_processing.go:69] worker 61 listening for tasks. I0216 09:40:19.343969 1 tasks_processing.go:69] worker 32 listening for tasks. I0216 09:40:19.343975 1 tasks_processing.go:69] worker 16 listening for tasks. I0216 09:40:19.343959 1 tasks_processing.go:69] worker 60 listening for tasks. I0216 09:40:19.343976 1 tasks_processing.go:69] worker 43 listening for tasks. I0216 09:40:19.343977 1 tasks_processing.go:69] worker 14 listening for tasks. I0216 09:40:19.343981 1 tasks_processing.go:69] worker 18 listening for tasks. I0216 09:40:19.343981 1 tasks_processing.go:69] worker 15 listening for tasks. I0216 09:40:19.343985 1 tasks_processing.go:69] worker 19 listening for tasks. I0216 09:40:19.343866 1 tasks_processing.go:69] worker 2 listening for tasks. I0216 09:40:19.343989 1 tasks_processing.go:69] worker 22 listening for tasks. I0216 09:40:19.343990 1 tasks_processing.go:69] worker 21 listening for tasks. I0216 09:40:19.343992 1 tasks_processing.go:69] worker 35 listening for tasks. I0216 09:40:19.343969 1 tasks_processing.go:69] worker 34 listening for tasks. I0216 09:40:19.343969 1 tasks_processing.go:69] worker 20 listening for tasks. I0216 09:40:19.343993 1 tasks_processing.go:69] worker 26 listening for tasks. I0216 09:40:19.343933 1 tasks_processing.go:69] worker 29 listening for tasks. I0216 09:40:19.343981 1 tasks_processing.go:69] worker 24 listening for tasks. I0216 09:40:19.343980 1 tasks_processing.go:69] worker 17 listening for tasks. I0216 09:40:19.343959 1 tasks_processing.go:71] worker 0 working on cost_management_metrics_configs task. I0216 09:40:19.344041 1 tasks_processing.go:71] worker 17 working on tsdb_status task. I0216 09:40:19.344057 1 tasks_processing.go:71] worker 55 working on service_accounts task. I0216 09:40:19.344060 1 tasks_processing.go:71] worker 21 working on proxies task. I0216 09:40:19.344060 1 tasks_processing.go:71] worker 43 working on openshift_logging task. I0216 09:40:19.344062 1 tasks_processing.go:71] worker 38 working on clusterroles task. I0216 09:40:19.344068 1 tasks_processing.go:71] worker 34 working on storage_cluster task. I0216 09:40:19.344068 1 tasks_processing.go:71] worker 29 working on config_maps task. I0216 09:40:19.344067 1 tasks_processing.go:71] worker 3 working on overlapping_namespace_uids task. I0216 09:40:19.344077 1 tasks_processing.go:71] worker 5 working on operators_pods_and_events task. I0216 09:40:19.344090 1 tasks_processing.go:71] worker 24 working on openstack_dataplanenodesets task. I0216 09:40:19.344105 1 tasks_processing.go:71] worker 41 working on networks task. I0216 09:40:19.343988 1 tasks_processing.go:69] worker 23 listening for tasks. I0216 09:40:19.344110 1 tasks_processing.go:71] worker 19 working on sap_datahubs task. I0216 09:40:19.344064 1 tasks_processing.go:71] worker 35 working on feature_gates task. I0216 09:40:19.344115 1 tasks_processing.go:71] worker 18 working on sap_license_management_logs task. I0216 09:40:19.344123 1 tasks_processing.go:71] worker 42 working on olm_operators task. I0216 09:40:19.344124 1 tasks_processing.go:71] worker 51 working on kube_controller_manager_logs task. I0216 09:40:19.344122 1 tasks_processing.go:71] worker 2 working on certificate_signing_requests task. I0216 09:40:19.344134 1 tasks_processing.go:71] worker 52 working on sap_config task. I0216 09:40:19.344136 1 tasks_processing.go:71] worker 22 working on openstack_version task. I0216 09:40:19.344138 1 tasks_processing.go:71] worker 4 working on node_logs task. I0216 09:40:19.344142 1 tasks_processing.go:71] worker 40 working on openshift_machine_api_events task. I0216 09:40:19.344145 1 tasks_processing.go:71] worker 31 working on mutating_webhook_configurations task. I0216 09:40:19.344113 1 tasks_processing.go:71] worker 23 working on oauths task. I0216 09:40:19.344134 1 tasks_processing.go:71] worker 11 working on machine_autoscalers task. I0216 09:40:19.344173 1 tasks_processing.go:71] worker 47 working on active_alerts task. I0216 09:40:19.344179 1 tasks_processing.go:71] worker 39 working on ceph_cluster task. I0216 09:40:19.343968 1 tasks_processing.go:69] worker 33 listening for tasks. I0216 09:40:19.344241 1 tasks_processing.go:71] worker 62 working on install_plans task. I0216 09:40:19.344279 1 tasks_processing.go:71] worker 28 working on silenced_alerts task. I0216 09:40:19.344316 1 tasks_processing.go:71] worker 37 working on openstack_controlplanes task. I0216 09:40:19.344111 1 tasks_processing.go:71] worker 14 working on ingress_certificates task. I0216 09:40:19.344061 1 tasks_processing.go:71] worker 20 working on openshift_apiserver_operator_logs task. I0216 09:40:19.344118 1 tasks_processing.go:71] worker 8 working on jaegers task. I0216 09:40:19.344123 1 tasks_processing.go:71] worker 46 working on operators task. I0216 09:40:19.344129 1 tasks_processing.go:71] worker 45 working on image_registries task. I0216 09:40:19.344281 1 tasks_processing.go:71] worker 50 working on container_runtime_configs task. I0216 09:40:19.344119 1 tasks_processing.go:71] worker 7 working on storage_classes task. I0216 09:40:19.344245 1 tasks_processing.go:71] worker 33 working on pdbs task. I0216 09:40:19.344138 1 tasks_processing.go:71] worker 53 working on machine_config_pools task. I0216 09:40:19.344117 1 tasks_processing.go:71] worker 26 working on infrastructures task. I0216 09:40:19.344231 1 tasks_processing.go:71] worker 6 working on machine_healthchecks task. I0216 09:40:19.344235 1 tasks_processing.go:71] worker 44 working on support_secret task. I0216 09:40:19.344250 1 tasks_processing.go:71] worker 56 working on machine_sets task. I0216 09:40:19.344253 1 tasks_processing.go:71] worker 54 working on openstack_dataplanedeployments task. I0216 09:40:19.344122 1 tasks_processing.go:71] worker 9 working on machines task. I0216 09:40:19.344260 1 tasks_processing.go:71] worker 30 working on qemu_kubevirt_launcher_logs task. I0216 09:40:19.344264 1 tasks_processing.go:71] worker 48 working on pod_network_connectivity_checks task. I0216 09:40:19.344104 1 tasks_processing.go:71] worker 15 working on cluster_apiserver task. I0216 09:40:19.344271 1 tasks_processing.go:71] worker 59 working on image task. I0216 09:40:19.344275 1 tasks_processing.go:71] worker 57 working on scheduler_logs task. I0216 09:40:19.344268 1 tasks_processing.go:71] worker 58 working on nodenetworkconfigurationpolicies task. I0216 09:40:19.344275 1 tasks_processing.go:71] worker 49 working on schedulers task. I0216 09:40:19.343991 1 tasks_processing.go:69] worker 25 listening for tasks. I0216 09:40:19.344385 1 tasks_processing.go:71] worker 16 working on nodes task. I0216 09:40:19.345877 1 tasks_processing.go:71] worker 25 working on ingress task. I0216 09:40:19.344389 1 tasks_processing.go:71] worker 63 working on sap_pods task. I0216 09:40:19.344390 1 tasks_processing.go:71] worker 32 working on crds task. I0216 09:40:19.344397 1 tasks_processing.go:71] worker 60 working on authentication task. I0216 09:40:19.344128 1 tasks_processing.go:71] worker 10 working on version task. I0216 09:40:19.344386 1 tasks_processing.go:71] worker 61 working on openshift_authentication_logs task. I0216 09:40:19.347151 1 tasks_processing.go:71] worker 0 working on machine_configs task. I0216 09:40:19.347162 1 gather.go:180] gatherer "clusterconfig" function "cost_management_metrics_configs" took 3.136324ms to process 0 records I0216 09:40:19.347274 1 tasks_processing.go:71] worker 13 working on validating_webhook_configurations task. I0216 09:40:19.347284 1 gather.go:180] gatherer "clusterconfig" function "lokistack" took 3.39012ms to process 0 records I0216 09:40:19.347295 1 gather.go:180] gatherer "clusterconfig" function "nodenetworkstates" took 3.398099ms to process 0 records I0216 09:40:19.347372 1 tasks_processing.go:71] worker 1 working on image_pruners task. E0216 09:40:19.348502 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.253.217:9094: connect: connection refused I0216 09:40:19.348522 1 tasks_processing.go:71] worker 47 working on metrics task. E0216 09:40:19.348516 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.253.217:9094: connect: connection refused E0216 09:40:19.348524 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.175.164:9091: connect: connection refused E0216 09:40:19.348539 1 gather.go:143] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.253.217:9094: connect: connection refused I0216 09:40:19.348561 1 gather.go:180] gatherer "clusterconfig" function "active_alerts" took 4.335048ms to process 0 records E0216 09:40:19.348576 1 gather.go:143] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.253.217:9094: connect: connection refused I0216 09:40:19.348590 1 gather.go:180] gatherer "clusterconfig" function "silenced_alerts" took 4.238282ms to process 0 records E0216 09:40:19.348600 1 gather.go:143] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.175.164:9091: connect: connection refused I0216 09:40:19.348609 1 gather.go:180] gatherer "clusterconfig" function "tsdb_status" took 4.486462ms to process 0 records I0216 09:40:19.348619 1 tasks_processing.go:71] worker 17 working on aggregated_monitoring_cr_names task. I0216 09:40:19.348716 1 tasks_processing.go:71] worker 28 working on dvo_metrics task. E0216 09:40:19.349927 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.175.164:9091: connect: connection refused I0216 09:40:19.349947 1 tasks_processing.go:74] worker 47 stopped. E0216 09:40:19.349952 1 gather.go:143] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.175.164:9091: connect: connection refused I0216 09:40:19.349961 1 gather.go:180] gatherer "clusterconfig" function "metrics" took 1.417743ms to process 0 records I0216 09:40:19.356419 1 tasks_processing.go:74] worker 34 stopped. I0216 09:40:19.356431 1 gather.go:180] gatherer "clusterconfig" function "storage_cluster" took 12.344326ms to process 0 records I0216 09:40:19.356437 1 gather.go:180] gatherer "clusterconfig" function "machine_autoscalers" took 12.25921ms to process 0 records I0216 09:40:19.356441 1 gather.go:180] gatherer "clusterconfig" function "openstack_version" took 12.288278ms to process 0 records I0216 09:40:19.356445 1 tasks_processing.go:74] worker 22 stopped. I0216 09:40:19.356447 1 tasks_processing.go:74] worker 37 stopped. I0216 09:40:19.356451 1 tasks_processing.go:74] worker 11 stopped. I0216 09:40:19.356453 1 gather.go:180] gatherer "clusterconfig" function "openstack_controlplanes" took 12.120383ms to process 0 records I0216 09:40:19.356458 1 gather.go:180] gatherer "clusterconfig" function "ceph_cluster" took 12.263563ms to process 0 records I0216 09:40:19.356462 1 tasks_processing.go:74] worker 39 stopped. I0216 09:40:19.370172 1 tasks_processing.go:74] worker 52 stopped. I0216 09:40:19.370183 1 gather.go:180] gatherer "clusterconfig" function "sap_config" took 26.030656ms to process 0 records I0216 09:40:19.370396 1 tasks_processing.go:74] worker 4 stopped. I0216 09:40:19.370410 1 gather.go:180] gatherer "clusterconfig" function "node_logs" took 26.249231ms to process 0 records I0216 09:40:19.370503 1 tasks_processing.go:74] worker 21 stopped. I0216 09:40:19.370551 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0216 09:40:19.370565 1 controller.go:317] The initial operator extension status is healthy I0216 09:40:19.370572 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0216 09:40:19.370576 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0216 09:40:19.370579 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0216 09:40:19.370591 1 controller.go:457] The operator is still being initialized I0216 09:40:19.370598 1 controller.go:482] The operator is healthy I0216 09:40:19.370601 1 recorder.go:75] Recording config/proxy with fingerprint=f9734bfa8ce46d7a6c2b88c0e340fb6d1b72a250dc7ea9d292990e3c4b35b42f I0216 09:40:19.370608 1 gather_sap_vsystem_iptables_logs.go:60] SAP resources weren't found I0216 09:40:19.370609 1 gather.go:180] gatherer "clusterconfig" function "proxies" took 26.435918ms to process 1 records I0216 09:40:19.370615 1 gather.go:180] gatherer "clusterconfig" function "sap_license_management_logs" took 26.489312ms to process 0 records I0216 09:40:19.370619 1 gather.go:180] gatherer "clusterconfig" function "container_runtime_configs" took 25.935421ms to process 0 records I0216 09:40:19.370623 1 tasks_processing.go:74] worker 50 stopped. I0216 09:40:19.370626 1 tasks_processing.go:74] worker 18 stopped. I0216 09:40:19.370654 1 cluster_transfer.go:78] checking the availability of cluster transfer. Next check is in 12h0m0s I0216 09:40:19.370707 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s W0216 09:40:19.370741 1 operator.go:286] started I0216 09:40:19.370756 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0216 09:40:19.370784 1 tasks_processing.go:74] worker 43 stopped. I0216 09:40:19.370792 1 gather.go:180] gatherer "clusterconfig" function "openshift_logging" took 26.71461ms to process 0 records I0216 09:40:19.370863 1 tasks_processing.go:74] worker 23 stopped. I0216 09:40:19.370907 1 gather_logs.go:145] no pods in openshift-kube-controller-manager namespace were found I0216 09:40:19.371054 1 recorder.go:75] Recording config/oauth with fingerprint=c669b61444bd5e6539ac73788deb97071c72ea79ef9b39392727097d7d4a427d I0216 09:40:19.371064 1 gather.go:180] gatherer "clusterconfig" function "oauths" took 26.708145ms to process 1 records I0216 09:40:19.371072 1 gather.go:180] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 26.803203ms to process 0 records I0216 09:40:19.371080 1 gather.go:180] gatherer "clusterconfig" function "kube_controller_manager_logs" took 26.786509ms to process 0 records I0216 09:40:19.371085 1 gather.go:180] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 27.11004ms to process 0 records I0216 09:40:19.371091 1 tasks_processing.go:74] worker 27 stopped. I0216 09:40:19.371094 1 tasks_processing.go:74] worker 24 stopped. I0216 09:40:19.371096 1 tasks_processing.go:74] worker 51 stopped. I0216 09:40:19.371975 1 gather_logs.go:145] no pods in openshift-kube-scheduler namespace were found I0216 09:40:19.371978 1 tasks_processing.go:74] worker 53 stopped. I0216 09:40:19.371984 1 gather.go:180] gatherer "clusterconfig" function "machine_config_pools" took 27.253664ms to process 0 records I0216 09:40:19.371991 1 gather.go:180] gatherer "clusterconfig" function "sap_datahubs" took 27.864202ms to process 0 records I0216 09:40:19.371995 1 gather.go:180] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 26.19771ms to process 0 records I0216 09:40:19.371997 1 gather_logs.go:145] no pods in openshift-authentication namespace were found I0216 09:40:19.371999 1 gather.go:180] gatherer "clusterconfig" function "scheduler_logs" took 26.27541ms to process 0 records I0216 09:40:19.372002 1 tasks_processing.go:74] worker 19 stopped. I0216 09:40:19.372002 1 gather.go:180] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 26.712778ms to process 0 records I0216 09:40:19.372006 1 gather.go:180] gatherer "clusterconfig" function "openshift_authentication_logs" took 25.789499ms to process 0 records I0216 09:40:19.372006 1 tasks_processing.go:74] worker 58 stopped. I0216 09:40:19.372008 1 tasks_processing.go:74] worker 57 stopped. I0216 09:40:19.372010 1 gather.go:180] gatherer "clusterconfig" function "machine_configs" took 24.842861ms to process 0 records I0216 09:40:19.372012 1 tasks_processing.go:74] worker 54 stopped. I0216 09:40:19.372015 1 tasks_processing.go:74] worker 0 stopped. I0216 09:40:19.372022 1 tasks_processing.go:74] worker 9 stopped. I0216 09:40:19.372028 1 tasks_processing.go:74] worker 61 stopped. E0216 09:40:19.372029 1 gather.go:143] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0216 09:40:19.372044 1 gather.go:180] gatherer "clusterconfig" function "machines" took 26.716494ms to process 0 records E0216 09:40:19.372055 1 gather.go:143] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0216 09:40:19.372066 1 gather.go:180] gatherer "clusterconfig" function "machine_healthchecks" took 26.946698ms to process 0 records I0216 09:40:19.372073 1 tasks_processing.go:74] worker 6 stopped. I0216 09:40:19.372076 1 tasks_processing.go:74] worker 31 stopped. I0216 09:40:19.372249 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=820969cee7ec12761083a736333a9187e84dcd610c2239b44e0322e9262ec98b I0216 09:40:19.372275 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=98d28bb4b9187cae1662c99f627aee6221dd226d856f9cced8958f89802999a3 I0216 09:40:19.372292 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=dac9c74d18c9ceb92a4cbb47d0d862713e31eb8ef2c8343e8fb5e0c9e17e3347 I0216 09:40:19.372297 1 gather.go:180] gatherer "clusterconfig" function "mutating_webhook_configurations" took 27.923702ms to process 3 records I0216 09:40:19.372306 1 gather.go:180] gatherer "clusterconfig" function "jaegers" took 27.590005ms to process 0 records I0216 09:40:19.372316 1 tasks_processing.go:74] worker 8 stopped. I0216 09:40:19.372367 1 tasks_processing.go:74] worker 35 stopped. I0216 09:40:19.372414 1 recorder.go:75] Recording config/featuregate with fingerprint=64942d547c666ba8efe99da749e8de1de31b10a9345112eea5f0da5b267227b7 I0216 09:40:19.372422 1 gather.go:180] gatherer "clusterconfig" function "feature_gates" took 28.073171ms to process 1 records I0216 09:40:19.375896 1 tasks_processing.go:74] worker 2 stopped. I0216 09:40:19.375911 1 gather.go:180] gatherer "clusterconfig" function "certificate_signing_requests" took 31.757264ms to process 0 records I0216 09:40:19.376265 1 tasks_processing.go:74] worker 3 stopped. I0216 09:40:19.376288 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0216 09:40:19.376297 1 gather.go:180] gatherer "clusterconfig" function "overlapping_namespace_uids" took 32.181208ms to process 1 records I0216 09:40:19.379242 1 tasks_processing.go:74] worker 56 stopped. I0216 09:40:19.379257 1 gather.go:180] gatherer "clusterconfig" function "machine_sets" took 33.99007ms to process 0 records I0216 09:40:19.379287 1 tasks_processing.go:74] worker 44 stopped. E0216 09:40:19.379299 1 gather.go:143] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0216 09:40:19.379308 1 gather.go:180] gatherer "clusterconfig" function "support_secret" took 34.076016ms to process 0 records I0216 09:40:19.379490 1 tasks_processing.go:74] worker 48 stopped. E0216 09:40:19.379502 1 gather.go:143] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0216 09:40:19.379511 1 gather.go:180] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 34.016335ms to process 0 records I0216 09:40:19.379531 1 tasks_processing.go:74] worker 40 stopped. I0216 09:40:19.379542 1 gather.go:180] gatherer "clusterconfig" function "openshift_machine_api_events" took 35.380176ms to process 0 records I0216 09:40:19.379574 1 tasks_processing.go:74] worker 16 stopped. I0216 09:40:19.379834 1 recorder.go:75] Recording config/node/ip-10-0-137-137.ec2.internal with fingerprint=03fc01e76c14116a3e3351de7087b29c3ba6291b73996a1f1de88e164402a32d I0216 09:40:19.379884 1 recorder.go:75] Recording config/node/ip-10-0-151-16.ec2.internal with fingerprint=cd6c0c072008ba2516555b09de80c2ad19015e1eb7cee8fc7e1478dde09b2f23 I0216 09:40:19.379927 1 recorder.go:75] Recording config/node/ip-10-0-160-73.ec2.internal with fingerprint=f499e5bc29229063c0eaf25cd69944e5f5a95a2cae0b5159613fae24e039859e I0216 09:40:19.379937 1 gather.go:180] gatherer "clusterconfig" function "nodes" took 33.694491ms to process 3 records I0216 09:40:19.380029 1 tasks_processing.go:74] worker 60 stopped. I0216 09:40:19.380084 1 recorder.go:75] Recording config/authentication with fingerprint=1e3ca508e73168a7eba6d8b446d3afc60766329d87bfad326189a606f7ee1424 I0216 09:40:19.380095 1 gather.go:180] gatherer "clusterconfig" function "authentication" took 33.454344ms to process 1 records I0216 09:40:19.380172 1 tasks_processing.go:74] worker 25 stopped. I0216 09:40:19.380205 1 recorder.go:75] Recording config/ingress with fingerprint=e0ecdfad6ab0f62c98b5ef41dcbb5e61f26bd6ff0ff44505762c29cfef271d8c I0216 09:40:19.380216 1 gather.go:180] gatherer "clusterconfig" function "ingress" took 33.725171ms to process 1 records I0216 09:40:19.380292 1 tasks_processing.go:74] worker 15 stopped. I0216 09:40:19.380307 1 recorder.go:75] Recording config/apiserver with fingerprint=6e7643ba5875350f0d6bf9bb059aa7d7a7c4176a7955e983fea0ab6a99d11f7b I0216 09:40:19.380314 1 gather.go:180] gatherer "clusterconfig" function "cluster_apiserver" took 34.254982ms to process 1 records I0216 09:40:19.380368 1 tasks_processing.go:74] worker 41 stopped. I0216 09:40:19.380418 1 recorder.go:75] Recording config/network with fingerprint=e2611062c8cae703aa55334325290c7e606bfb6233f8051aeb14ec7b429a7cd4 I0216 09:40:19.380430 1 gather.go:180] gatherer "clusterconfig" function "networks" took 35.631897ms to process 1 records I0216 09:40:19.384866 1 tasks_processing.go:74] worker 63 stopped. I0216 09:40:19.384878 1 gather.go:180] gatherer "clusterconfig" function "sap_pods" took 38.879046ms to process 0 records I0216 09:40:19.384963 1 tasks_processing.go:74] worker 49 stopped. I0216 09:40:19.385018 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=02ef33090a29412f021a9e713aedfdeb9e5d71e7cc89673e15567682a7899508 I0216 09:40:19.385030 1 gather.go:180] gatherer "clusterconfig" function "schedulers" took 39.156441ms to process 1 records I0216 09:40:19.385105 1 tasks_processing.go:74] worker 59 stopped. I0216 09:40:19.385167 1 recorder.go:75] Recording config/image with fingerprint=033b9d8f32fedbd19a3feda570ed6b84cbe4dcba7e8e0c33e7c6950824390ef4 I0216 09:40:19.385178 1 gather.go:180] gatherer "clusterconfig" function "image" took 39.433298ms to process 1 records I0216 09:40:19.385217 1 gather_logs.go:145] no pods in openshift-apiserver-operator namespace were found I0216 09:40:19.385291 1 tasks_processing.go:74] worker 1 stopped. I0216 09:40:19.385337 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=e391272f60c7eb96afee0397d22a5822b098655076ba75336a333302dab659ea I0216 09:40:19.385345 1 gather.go:180] gatherer "clusterconfig" function "image_pruners" took 37.752593ms to process 1 records I0216 09:40:19.385367 1 gather.go:180] gatherer "clusterconfig" function "openshift_apiserver_operator_logs" took 40.745849ms to process 0 records I0216 09:40:19.385373 1 tasks_processing.go:74] worker 20 stopped. I0216 09:40:19.391522 1 tasks_processing.go:74] worker 10 stopped. I0216 09:40:19.392004 1 recorder.go:75] Recording config/version with fingerprint=4d72ffe24d190d5b69e488acc057a7858c6455504bc5c72e2b402bf52cec0bd8 I0216 09:40:19.392056 1 recorder.go:75] Recording config/id with fingerprint=644993f2633a5732fa4c4ec3d23ed44eb63c9c3b7bf5bf28b838223e71dae1a7 I0216 09:40:19.392081 1 gather.go:180] gatherer "clusterconfig" function "version" took 45.372401ms to process 2 records I0216 09:40:19.393077 1 tasks_processing.go:74] worker 38 stopped. I0216 09:40:19.393660 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=2346f58b53b8689a03605ea91f78697f61b16935738c8ff9d1546178b59c8a01 I0216 09:40:19.393852 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=367ceaa01c1ff1a9ad8a72ff2bf57cfa45e090c16a420e10fd04fc0d8cba3db8 I0216 09:40:19.393873 1 gather.go:180] gatherer "clusterconfig" function "clusterroles" took 48.998882ms to process 2 records I0216 09:40:19.393953 1 tasks_processing.go:74] worker 45 stopped. I0216 09:40:19.394479 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=e7e960dbb9c167b95337a2ad7f98271d14ced9650296f4830015f26e852b043a I0216 09:40:19.394495 1 gather.go:180] gatherer "clusterconfig" function "image_registries" took 48.485119ms to process 1 records I0216 09:40:19.401129 1 tasks_processing.go:74] worker 26 stopped. I0216 09:40:19.401137 1 gather_logs.go:145] no pods in namespace were found I0216 09:40:19.402034 1 recorder.go:75] Recording config/infrastructure with fingerprint=025cfb5d76dea02aa7dbd570ac7f9dc588b90cbb03735016f05085244e1cf6b7 I0216 09:40:19.402053 1 gather.go:180] gatherer "clusterconfig" function "infrastructures" took 56.194596ms to process 1 records I0216 09:40:19.402065 1 gather.go:180] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 55.748841ms to process 0 records I0216 09:40:19.402084 1 tasks_processing.go:74] worker 30 stopped. I0216 09:40:19.402139 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=5e610a189cfe4ba9577492faad079553e1c5f0e3c728ef26fc6eea6b36362a02 I0216 09:40:19.402158 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=f5d81db3a70415c70fbabe4632790950503c2883fe8fa39959951e8158062163 I0216 09:40:19.402159 1 tasks_processing.go:74] worker 7 stopped. I0216 09:40:19.402167 1 gather.go:180] gatherer "clusterconfig" function "storage_classes" took 56.619593ms to process 2 records I0216 09:40:19.402230 1 recorder.go:75] Recording config/olm_operators with fingerprint=c8cded3ebcfd5f255f6d61a50147945c66d86444c0374aab96950f5ebf10b70b I0216 09:40:19.402241 1 gather.go:180] gatherer "clusterconfig" function "olm_operators" took 57.563319ms to process 1 records I0216 09:40:19.402250 1 tasks_processing.go:74] worker 42 stopped. I0216 09:40:19.402268 1 tasks_processing.go:74] worker 13 stopped. I0216 09:40:19.402404 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=29f02aa6880b08f823b5a28228be2975a76a58afd2b840637ae1cc2594a82070 I0216 09:40:19.402441 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=bf2effa1dbe75f61f1650ded4f00dbb556fe1c796df0dd92847f09f5f62c0367 I0216 09:40:19.402484 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=29bf5371adbd609065604660936c747c24d2356ca9124efb84a70c1ffb7d29d8 I0216 09:40:19.402502 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=5adf326d1247b119edc269206c62113afd67b62bf7789926021795bba6f29f58 I0216 09:40:19.402519 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=2fe1c60e3452cf4de5cf7d3966f276cb6435591a50cae259487b37f2cf0f3f66 I0216 09:40:19.402539 1 recorder.go:75] Recording config/validatingwebhookconfigurations/snapshot.storage.k8s.io with fingerprint=7938ec325e7b240ff477ec80ba7f38cb30c4a02dd6c32bed3d3d55ae941c113a I0216 09:40:19.402577 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=7aa32a9faebbe142faaf0e8ef7f5e0d36d2157d3befd7d314d8065b1e20c0dac I0216 09:40:19.402602 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=659d216c6513b702f86813a01d5af8f4ad841f09f0bd35aacdd68a09250ddab3 I0216 09:40:19.402646 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=cc909969293ffe517cd62c35146f2137ae11d798f5bad1b1f80c398ac1a08853 I0216 09:40:19.402674 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=8407a2e0fc478218fb90d1c0ba6baef08aa36e313c2fb7c315adb472e27f9614 I0216 09:40:19.402714 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=a7a31501d9bd302aa5aa53ed8311ecd9c61aefd75f6446f96a6ef543e05ce15f I0216 09:40:19.402744 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=61842b01a904c0e73e19e6257dde7d9983c039f6be4b72b4614b803757031f6b I0216 09:40:19.402770 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=60f9c4cd0e07b3f8f80ddfb1dd4ff60f52639dbc758976f5a69e9d5ccd25c258 I0216 09:40:19.402796 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=d10d68fcf3643ea796682815da5dab55e98852b845cafebd57fc68f7bdb7d3e6 I0216 09:40:19.402804 1 gather.go:180] gatherer "clusterconfig" function "validating_webhook_configurations" took 54.976734ms to process 14 records I0216 09:40:19.402896 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=57a1ed135d195721ab6f51621c634a1db1ed20920b69485e1c58602e0ab393e6 I0216 09:40:19.402914 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=65bc911962940d615efeaa98cdb2062f672ce43e8a0c693aade9c5884fd7d0f5 I0216 09:40:19.402926 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=fabf525da008511868fb13789e67d8a852ddf8d0bcf31f0cd6661dc2fddc6319 I0216 09:40:19.402937 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=fa6966709af84d92e1505dd6bf79c03b23c340ecf503919672d008cfe168b7b1 I0216 09:40:19.402939 1 tasks_processing.go:74] worker 33 stopped. I0216 09:40:19.402947 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=78031e90119142dccfbd2022fb41de49468936576dc32f84df137b8dec3ba31f I0216 09:40:19.402957 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=57b90a915173984881ac32aa588f28d9d8fa7bb99cbc2fceb6037b80399681a5 I0216 09:40:19.402974 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=347f5d492b9b7ecb88d879b3814dd1286c3225531220c0d5138f2865568b2a5e I0216 09:40:19.402987 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=7242c88561f9a4e56e90209a0edc8cef61122ebbae6a32e303be390973d48a49 I0216 09:40:19.402996 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=70371d16c83895a690056e8c9f12e89e1451cdaf9647c641bfd1b2f2e555e165 I0216 09:40:19.403005 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=df9764c36f28e6fe07a5169f645c04193fdb14ac70e30fd847508c2bc2bd3570 I0216 09:40:19.403008 1 gather.go:180] gatherer "clusterconfig" function "pdbs" took 57.691018ms to process 10 records I0216 09:40:19.403180 1 tasks_processing.go:74] worker 32 stopped. I0216 09:40:19.403381 1 controller.go:203] Source scaController *sca.Controller is not ready I0216 09:40:19.403394 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0216 09:40:19.403398 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0216 09:40:19.403402 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0216 09:40:19.403406 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0216 09:40:19.403424 1 controller.go:457] The operator is still being initialized I0216 09:40:19.403435 1 controller.go:482] The operator is healthy I0216 09:40:19.403470 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=aac2937747f314ee6b5cf2913b77eea6cd7f617153be04ac22e05c6fd60e164d I0216 09:40:19.403924 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=f51ea842e33460392962777d83f51920ea36fdd3c547180cdf367a7498859968 I0216 09:40:19.403943 1 gather.go:180] gatherer "clusterconfig" function "crds" took 56.663923ms to process 2 records I0216 09:40:19.406012 1 tasks_processing.go:74] worker 17 stopped. I0216 09:40:19.406026 1 gather.go:180] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 57.377219ms to process 0 records I0216 09:40:19.407378 1 requests.go:204] Asking for SCA certificate for x86_64 architecture I0216 09:40:19.409301 1 tasks_processing.go:74] worker 28 stopped. I0216 09:40:19.409320 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=108780cb24f15bf572a4031966507398a0d0c6a28b3a008952f53b481dc191a9 I0216 09:40:19.409332 1 gather.go:180] gatherer "clusterconfig" function "dvo_metrics" took 60.57382ms to process 1 records I0216 09:40:19.411737 1 tasks_processing.go:74] worker 12 stopped. I0216 09:40:19.413441 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-5889c54ccc-xgb28 with fingerprint=78ff4ce98d5512ee94a69fbb68673c6657b2cf56485b3c7999ae10531f39e0ac I0216 09:40:19.413658 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-9sgs4 with fingerprint=dfa2930f4c9030b268f81fc9f5e3004deff71cb8167e1364f4602705f33c81a4 I0216 09:40:19.413754 1 recorder.go:75] Recording config/running_containers with fingerprint=f6234095352413c2cacdb693bd5a1f11e844bbb8d5d50a831a51f6335c80701e I0216 09:40:19.413771 1 gather.go:180] gatherer "clusterconfig" function "container_images" took 67.76774ms to process 3 records I0216 09:40:19.413789 1 gather.go:180] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 69.458181ms to process 0 records I0216 09:40:19.413799 1 tasks_processing.go:74] worker 36 stopped. I0216 09:40:19.413949 1 tasks_processing.go:74] worker 5 stopped. I0216 09:40:19.413958 1 gather.go:180] gatherer "clusterconfig" function "operators_pods_and_events" took 69.861473ms to process 0 records I0216 09:40:19.415293 1 shared_informer.go:318] Caches are synced for RequestHeaderAuthRequestController I0216 09:40:19.415303 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0216 09:40:19.415312 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0216 09:40:19.418921 1 tasks_processing.go:74] worker 29 stopped. E0216 09:40:19.418933 1 gather.go:143] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0216 09:40:19.418937 1 gather.go:143] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0216 09:40:19.418939 1 gather.go:143] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0216 09:40:19.418957 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0216 09:40:19.418967 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0216 09:40:19.418970 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=0bddb88b072029f25dde6f44cb877a44fb2f65ed4864939fbf7a3e42c0a485f6 I0216 09:40:19.418976 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0216 09:40:19.419001 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0216 09:40:19.419008 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0216 09:40:19.419012 1 gather.go:180] gatherer "clusterconfig" function "config_maps" took 74.838582ms to process 6 records I0216 09:40:19.420827 1 base_controller.go:73] Caches are synced for ConfigController I0216 09:40:19.420835 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0216 09:40:19.423065 1 tasks_processing.go:74] worker 14 stopped. E0216 09:40:19.423078 1 gather.go:143] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0216 09:40:19.423085 1 gather.go:143] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2og973rakngo25dmpkdns9g42cg4mfm0-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2og973rakngo25dmpkdns9g42cg4mfm0-primary-cert-bundle-secret" not found I0216 09:40:19.423128 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=2f31627c984214a841f7c5ea3d5773a31e1fd56a10efd5343523d487d1c0127a I0216 09:40:19.423138 1 gather.go:180] gatherer "clusterconfig" function "ingress_certificates" took 78.651575ms to process 1 records I0216 09:40:19.424879 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 09:40:19.471080 1 base_controller.go:73] Caches are synced for LoggingSyncer I0216 09:40:19.471093 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0216 09:40:19.498640 1 cluster_transfer.go:97] no available accepted cluster transfer I0216 09:40:19.498661 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0216 09:40:19.598888 1 sca.go:141] etc-pki-entitlement secret successfully updated I0216 09:40:19.598958 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated in the etc-pki-entitlement secret I0216 09:40:21.623337 1 tasks_processing.go:74] worker 46 stopped. I0216 09:40:21.623486 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=633dc849cecd7ea0cd65743610b74927ae294b611f806dd5e41d635d9ced084b I0216 09:40:21.623524 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=777490e650fc4f269d89afce0970d1e9b5dd10872e645f48c06497f314de30f6 I0216 09:40:21.623543 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=cbb6601e7f24529c91e9d589c59f3e60f88cd47ac8abf9bc78ab81aaffce85ee I0216 09:40:21.623552 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0216 09:40:21.623568 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=1a069d61ce5ddfead196f67b41158eddfd48df7d6220c78f04afe7f403daade1 I0216 09:40:21.623584 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0216 09:40:21.623597 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=3cb5ac2a05e09cace96fae3e1c1ac3cc34b5b6417000974e491e8e23f2a5ae47 I0216 09:40:21.623616 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=5258ae85e89e64b586384fb3d9aa84c48f8cf4202c99ee4685cb5969c72a6f97 I0216 09:40:21.623634 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=c9f65d7683d1ec256f9c3c0637d481c36823278cb9862f8d54b02c6cf0ae5b3a I0216 09:40:21.623656 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=b8e751884b6ebd9dcfa7570cba90c25c55b93a3904e1e998ba3dde05e6d16344 I0216 09:40:21.623849 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=c9afa4820740d5a0a90fad37a2ba5e2d216029558dc22b950c6e64dea8368c0f I0216 09:40:21.623861 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=fdeefd3a0ca4c904fdc97c731548ebb2dba28a39619751a819d17013960a98e2 I0216 09:40:21.623869 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0216 09:40:21.623879 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=58ac94c42b0eb5006fb143833e9bc1f898a365b6a8c70de3c707b070ae9f8443 I0216 09:40:21.623887 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0216 09:40:21.623897 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=0b2dd7bf2c0018b5d80bb589b6a1215f5bc23e9652b3f022f4524df43a2b8eb5 I0216 09:40:21.623904 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0216 09:40:21.623914 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=3bbe65b568138160f3fde32941625e8714ca11a88a06f2b9ea3f6504c3656d07 I0216 09:40:21.623922 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0216 09:40:21.623932 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=3ecca6f1f6a93d5a3d0a648ddcdd21b156532a5ee956ee2718bd2f2e38a1bed2 I0216 09:40:21.623993 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=b4b448372cd3a01ae42d2f2a065f90c865adadbd01715f8b672a18fd2192c630 I0216 09:40:21.624004 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0216 09:40:21.624009 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0216 09:40:21.624025 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0216 09:40:21.624040 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=0b5fd5cdd6344e779fefdd8ec126d6a1b167d66ff0b58511b22e6245b77e3703 I0216 09:40:21.624054 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=86a1f430c02b90164466e8831929aa44d2199488fb082d8e6ff4900c4a43af33 I0216 09:40:21.624063 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0216 09:40:21.624075 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=756facdb31cbf42038e635b1593d160bb5f41458865a9efa35b97ed9f7a88708 I0216 09:40:21.624083 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0216 09:40:21.624093 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=2ea9f63d34d0d76541d5df70592c4ea2ba4815a2b392e0d66085552c1aa71a12 I0216 09:40:21.624100 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0216 09:40:21.624108 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=9dad675762ebc432d0d4a1a2b422e8393a0383a8ac3a240864656df9f87d1a88 I0216 09:40:21.624119 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=d900978db1df44099ada7aa9060fb07ef137b9d6c9b35d15de6a8c8c4a7ea840 I0216 09:40:21.624127 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=90916e26ec54cdaebf6ac2b80be48efa1bdaa2757679277ccbb8801f200e124e I0216 09:40:21.624141 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=e5ee39536cd3dc8ce8368d8b21e050d299ff201dea2243b251084fc3f241b11a I0216 09:40:21.624149 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0216 09:40:21.624164 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=11f5a1e028e70537d1d31723ff6b01fd7b3658cf0c5c7a70e4a41d19114e66d8 I0216 09:40:21.624178 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=7e1ab8f8cfcd9d249b5b213939fe5144bb83db3725475461728bea44a002c3be I0216 09:40:21.624185 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0216 09:40:21.624190 1 gather.go:180] gatherer "clusterconfig" function "operators" took 2.278741382s to process 39 records I0216 09:40:31.978311 1 tasks_processing.go:74] worker 62 stopped. I0216 09:40:31.978345 1 recorder.go:75] Recording config/installplans with fingerprint=b6ae0e2549358513c087729c711e8e1ad6f2144adc0ffa716b1a475ed1e6ddde I0216 09:40:31.978370 1 gather.go:180] gatherer "clusterconfig" function "install_plans" took 12.634018656s to process 1 records I0216 09:40:32.750010 1 tasks_processing.go:74] worker 55 stopped. I0216 09:40:32.750212 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=a9930da55479d2261b995da09433043134026429cc3ec58a984db3d12fb5256b I0216 09:40:32.750225 1 gather.go:180] gatherer "clusterconfig" function "service_accounts" took 13.405937835s to process 1 records E0216 09:40:32.750288 1 periodic.go:252] clusterconfig failed after 13.406s with: function "active_alerts" failed with an error, function "silenced_alerts" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0216 09:40:32.750300 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "active_alerts" failed with an error, function "silenced_alerts" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0216 09:40:32.750307 1 periodic.go:214] Running workloads gatherer I0216 09:40:32.750318 1 tasks_processing.go:45] number of workers: 2 I0216 09:40:32.750327 1 tasks_processing.go:69] worker 1 listening for tasks. I0216 09:40:32.750330 1 tasks_processing.go:71] worker 1 working on workload_info task. I0216 09:40:32.750337 1 tasks_processing.go:69] worker 0 listening for tasks. I0216 09:40:32.750367 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0216 09:40:32.776636 1 gather_workloads_info.go:257] Loaded pods in 0s, will wait 24s for image data I0216 09:40:32.780656 1 tasks_processing.go:74] worker 0 stopped. I0216 09:40:32.780669 1 gather.go:180] gatherer "workloads" function "helmchart_info" took 30.276977ms to process 0 records I0216 09:40:32.818690 1 gather_workloads_info.go:366] No image sha256:79449e16b1207223f1209d19888b879eb56a8202c53df4800e09b231392cf219 (43ms) I0216 09:40:32.831058 1 gather_workloads_info.go:366] No image sha256:0d1d37dbdb726e924b519ef27e52e9719601fab838ae75f72c8aca11e8c3b4cc (12ms) I0216 09:40:32.842557 1 gather_workloads_info.go:366] No image sha256:0f31e990f9ca9d15dcb1b25325c8265515fcc06381909349bb021103827585c6 (11ms) I0216 09:40:32.854432 1 gather_workloads_info.go:366] No image sha256:2bf8536171476b2d616cf62b4d94d2f1dae34aca6ea6bfdb65e764a8d9675891 (12ms) I0216 09:40:32.864422 1 gather_workloads_info.go:366] No image sha256:b34e84d56775e42b7d832d14c4f9dc302fee37cd81ba221397cd8acba2089d20 (10ms) I0216 09:40:32.879608 1 gather_workloads_info.go:366] No image sha256:43e426ac9df633be58006907aede6f9b6322c6cc7985cd43141ad7518847c637 (15ms) I0216 09:40:32.892512 1 gather_workloads_info.go:366] No image sha256:88e6cc2192e682bb9c4ac5aec8e41254696d909c5dc337e720b9ec165a728064 (13ms) I0216 09:40:32.911708 1 gather_workloads_info.go:366] No image sha256:2150fb1cec29c317c45efb0871f25c8a8c48fee4794f06f455346f4cf56d7a8f (19ms) I0216 09:40:32.921572 1 gather_workloads_info.go:366] No image sha256:357821852af925e0c8a19df2f9fceec8d2e49f9d13575b86ecd3fbedce488afa (10ms) I0216 09:40:32.930894 1 gather_workloads_info.go:377] Found image sha256:0249b5fca8f8210324cea01cca2364f0dda3f9eb95facffd8c051fac3040aaf6 (9ms) I0216 09:40:32.940137 1 gather_workloads_info.go:366] No image sha256:ba2890d43d0cd18906bd67968541d1b58c76ea731092c15829ae3fce37576d75 (9ms) I0216 09:40:32.986695 1 gather_workloads_info.go:366] No image sha256:f550296753e9898c67d563b7deb16ba540ca1367944c905415f35537b6b949d4 (47ms) I0216 09:40:33.086098 1 gather_workloads_info.go:366] No image sha256:712ad2760c350db1e23b9393bdda83149452931dc7b5a5038a3bcdb4663917c0 (99ms) I0216 09:40:33.187817 1 gather_workloads_info.go:366] No image sha256:deffb0293fd11f5b40609aa9e80b16b0f90a9480013b2b7f61bd350bbd9b6f07 (102ms) I0216 09:40:33.286406 1 gather_workloads_info.go:366] No image sha256:3a6c7106060bf56007d8a72b34c69379fb9f18dac51ccdadda78734719de6ad4 (99ms) I0216 09:40:33.386563 1 gather_workloads_info.go:366] No image sha256:87103e9af9b836dd5edc9eae46885d7ed9471574fa3874459a335a8d01a58136 (100ms) I0216 09:40:33.487085 1 gather_workloads_info.go:366] No image sha256:e9f61e6313d8f97d537846db239e33a1250d4734cfaf2b1d136711b47c21d885 (101ms) I0216 09:40:33.586179 1 gather_workloads_info.go:366] No image sha256:822db36f8e1353ac24785b88d1fb2150d3ef34a5e739c1f67b61079336e9798b (99ms) I0216 09:40:33.686970 1 gather_workloads_info.go:366] No image sha256:27e725f1250f6a17da5eba7ada315a244592b5b822d61e95722bb7e2f884b00f (101ms) I0216 09:40:33.786333 1 gather_workloads_info.go:366] No image sha256:64e79d9be6744864b9272f01d104018616343c121c968d8a96a6c962e394c572 (99ms) I0216 09:40:33.886479 1 gather_workloads_info.go:366] No image sha256:185305b7da4ef5b90a90046f145e8c66bab3a16b12771d2e98bf78104d6a60f2 (100ms) I0216 09:40:33.987247 1 gather_workloads_info.go:366] No image sha256:59f553035bc347fc7205f1c071897bc2606b98525d6b9a3aca62fc9cd7078a57 (101ms) I0216 09:40:34.086786 1 gather_workloads_info.go:366] No image sha256:3958f525bae8ad011915244c9c8c1c2c750b761094046b2719fae36f6ac8903c (100ms) I0216 09:40:34.186740 1 gather_workloads_info.go:366] No image sha256:745f2186738a57bb1b484f68431e77aa2f68a1b8dcb434b1f7a4b429eafdf091 (100ms) I0216 09:40:34.286554 1 gather_workloads_info.go:366] No image sha256:586e9c2756f50e562a6123f47fe38dba5496b63413c3dd18e0b85d6167094f0c (100ms) I0216 09:40:34.386579 1 gather_workloads_info.go:366] No image sha256:9cc55a501aaad1adbefdd573e57c2f756a3a6a8723c43052995be6389edf1fa8 (100ms) I0216 09:40:34.487033 1 gather_workloads_info.go:366] No image sha256:072b006abd58ce063deddf5a5ad349f355d8bb1942c81a0d999ad49580274aac (100ms) I0216 09:40:34.588099 1 gather_workloads_info.go:366] No image sha256:0ed9562476aad855edc32bdd4a2ebd759a2c010144a53e4da003cd82af460b1a (101ms) I0216 09:40:34.686671 1 gather_workloads_info.go:366] No image sha256:29d1672ef44c59d065737eca330075dd2f6da4ba743153973a739aa9e9d73ad3 (99ms) I0216 09:40:34.787225 1 gather_workloads_info.go:366] No image sha256:28dd932f83bb9b7d81c7dcd15ddb0bbb10f784b39519b2b493bbbf0262392526 (101ms) I0216 09:40:34.886165 1 gather_workloads_info.go:366] No image sha256:ad395a616f60c87f7b1ccd4beb3f78310c17ee98b719802208c4326b1dccc663 (99ms) I0216 09:40:34.986202 1 gather_workloads_info.go:366] No image sha256:0a62577e0731d4421a54b438b79a29d9b9d651d0086ef41d8579c3bc4ff89da7 (100ms) I0216 09:40:35.087134 1 gather_workloads_info.go:366] No image sha256:457372d9f22e1c726ea1a6fcc54ddca8335bd607d2c357bcd7b63a7017aa5c2b (101ms) I0216 09:40:35.186429 1 gather_workloads_info.go:366] No image sha256:1b53023f7bc2a3d048982d116fcb2b59d8bbccb1760d1bbeaa7dc5753bc3d6d8 (99ms) I0216 09:40:35.288393 1 gather_workloads_info.go:366] No image sha256:7f55b7dbfb15fe36d83d64027eacee22fb00688ccbc03550cc2dbedfa633f288 (102ms) I0216 09:40:35.386976 1 gather_workloads_info.go:366] No image sha256:5335f64616c3a6c55a9a6dc4bc084b46a4957fb4fc250afc5343e4547ebb3598 (99ms) I0216 09:40:35.488469 1 gather_workloads_info.go:366] No image sha256:91d9cb208e6d0c39a87dfe8276d162c75ff3fcd3b005b3e7b537f65c53475a42 (101ms) I0216 09:40:35.586827 1 gather_workloads_info.go:366] No image sha256:f82357030795138d2081ecc5172092222b0f4faea27e9a7a0474fbeae29111ad (98ms) I0216 09:40:35.686073 1 gather_workloads_info.go:366] No image sha256:7cfe7513e4f271cd533d4519e0fbcd80eb23739ed030c9f08c82be820c5c2a99 (99ms) I0216 09:40:35.786963 1 gather_workloads_info.go:366] No image sha256:33d7e5c63340e93b5a063de538017ac693f154e3c27ee2ef8a8a53bb45583552 (101ms) I0216 09:40:35.886633 1 gather_workloads_info.go:366] No image sha256:036e6f9a4609a7499f200032dac2294e4a2d98764464ed17453ef725f2f0264d (100ms) I0216 09:40:35.994105 1 gather_workloads_info.go:366] No image sha256:29eca6fff7b20514d9b2cf682ba27f5372f5c03fb04b742c175aad19efbb67e6 (107ms) I0216 09:40:36.087052 1 gather_workloads_info.go:366] No image sha256:2193d7361704b0ae4bca052e9158761e06ecbac9ca3f0a9c8f0f101127e8f370 (93ms) I0216 09:40:36.187549 1 gather_workloads_info.go:366] No image sha256:06529ff00c3a32128936e06afa90253af88823be4adb0ea4e2d11a17ebcf4528 (100ms) I0216 09:40:36.286587 1 gather_workloads_info.go:366] No image sha256:1762ee46965d2d631365be0dda8cdaf54c86f98ae2f60381e805a490acbdd4ef (99ms) I0216 09:40:36.386634 1 gather_workloads_info.go:377] Found image sha256:2121717e0222b9e8892a44907b461a4f62b3f1e5429a0e2eee802d48d04fff30 (100ms) I0216 09:40:36.386742 1 tasks_processing.go:74] worker 1 stopped. I0216 09:40:36.386949 1 recorder.go:75] Recording config/workload_info with fingerprint=9df9c34b9988bd997f8160bd762da4db21267d06d5a5855b134cc8da2302928f I0216 09:40:36.386967 1 gather.go:180] gatherer "workloads" function "workload_info" took 3.636404495s to process 1 records I0216 09:40:36.386980 1 periodic.go:261] Periodic gather workloads completed in 3.636s I0216 09:40:36.386986 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0216 09:40:36.386991 1 periodic.go:214] Running conditional gatherer I0216 09:40:36.391674 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.17.48/gathering_rules I0216 09:40:36.616282 1 conditional_gatherer.go:340] updating alerts cache for conditional gatherer E0216 09:40:36.618901 1 conditional_gatherer.go:326] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.175.164:9091: connect: connection refused I0216 09:40:36.618963 1 conditional_gatherer.go:386] updating version cache for conditional gatherer I0216 09:40:36.624104 1 conditional_gatherer.go:394] cluster version is '4.17.48' E0216 09:40:36.624120 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 09:40:36.624125 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 09:40:36.624128 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 09:40:36.624131 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 09:40:36.624133 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 09:40:36.624135 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 09:40:36.624137 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 09:40:36.624140 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 09:40:36.624142 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 09:40:36.624145 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing I0216 09:40:36.624158 1 tasks_processing.go:45] number of workers: 3 I0216 09:40:36.624172 1 tasks_processing.go:69] worker 2 listening for tasks. I0216 09:40:36.624176 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0216 09:40:36.624178 1 tasks_processing.go:69] worker 0 listening for tasks. I0216 09:40:36.624193 1 tasks_processing.go:69] worker 1 listening for tasks. I0216 09:40:36.624249 1 tasks_processing.go:71] worker 1 working on conditional_gatherer_rules task. I0216 09:40:36.624257 1 tasks_processing.go:74] worker 1 stopped. I0216 09:40:36.624267 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0216 09:40:36.624331 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0216 09:40:36.624346 1 gather.go:180] gatherer "conditional" function "conditional_gatherer_rules" took 850ns to process 1 records I0216 09:40:36.624387 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0216 09:40:36.624397 1 gather.go:180] gatherer "conditional" function "remote_configuration" took 798ns to process 1 records I0216 09:40:36.624403 1 gather.go:180] gatherer "conditional" function "rapid_container_logs" took 136.519µs to process 0 records I0216 09:40:36.624410 1 tasks_processing.go:74] worker 2 stopped. I0216 09:40:36.624414 1 tasks_processing.go:74] worker 0 stopped. I0216 09:40:36.624433 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I0216 09:40:36.624442 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f W0216 09:40:36.648137 1 gather.go:212] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0216 09:40:36.648246 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=08bb1311a872403f3946428678e296a652111ba4387c8df5409a250c33b817c9 I0216 09:40:36.648377 1 diskrecorder.go:70] Writing 108 records to /var/lib/insights-operator/insights-2026-02-16-094036.tar.gz I0216 09:40:36.653776 1 diskrecorder.go:51] Wrote 108 records to disk in 5ms I0216 09:40:36.653807 1 periodic.go:283] Gathering cluster info every 2h0m0s I0216 09:40:36.653825 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0216 09:41:49.344189 1 diskrecorder.go:170] Found files to send: insights-2026-02-16-094036.tar.gz I0216 09:41:49.344218 1 insightsuploader.go:150] Checking archives to upload periodically every 16m15.543220095s I0216 09:41:49.344225 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0216 09:41:49.353171 1 requests.go:47] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0216 09:41:49.527993 1 requests.go:88] Successfully reported id=2026-02-16T09:41:49Z x-rh-insights-request-id=dd54619cf917430bb08022973cd47837, wrote=49351 I0216 09:41:49.528063 1 insightsuploader.go:187] Uploaded report successfully in 183.829063ms I0216 09:41:49.528085 1 controller.go:119] Initializing last reported time to 2026-02-16T09:41:49Z I0216 09:41:49.528099 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0216 09:41:49.528105 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0216 09:41:49.528112 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0216 09:41:49.533545 1 controller.go:482] The operator is healthy I0216 09:42:19.377296 1 controller.go:482] The operator is healthy I0216 09:42:51.660663 1 insightsreport.go:137] Pulling report from smart-proxy I0216 09:42:51.660687 1 insightsreport.go:149] Retrieving report I0216 09:42:51.667139 1 requests.go:111] Retrieving report for cluster: 457c54c5-3c4d-4518-b770-02fd84b0db21 I0216 09:42:51.667151 1 requests.go:112] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/457c54c5-3c4d-4518-b770-02fd84b0db21/reports I0216 09:42:51.669251 1 requests.go:122] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/457c54c5-3c4d-4518-b770-02fd84b0db21/reports I0216 09:42:51.835644 1 insightsreport.go:184] Report retrieved I0216 09:42:51.861284 1 insightsreport.go:239] Report retrieved correctly I0216 09:44:19.377152 1 controller.go:482] The operator is healthy I0216 09:45:19.336115 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 09:45:19.344489 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 09:45:19.344507 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 09:45:19.348294 1 secretconfigobserver.go:119] support secret does not exist I0216 09:46:19.378282 1 controller.go:482] The operator is healthy I0216 09:48:19.379835 1 controller.go:482] The operator is healthy I0216 09:50:19.334161 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 09:50:19.339446 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 09:50:19.348514 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 09:50:19.352981 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 09:50:19.352994 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 09:50:19.356580 1 secretconfigobserver.go:119] support secret does not exist I0216 09:50:19.376260 1 controller.go:482] The operator is healthy I0216 09:52:19.376736 1 controller.go:482] The operator is healthy I0216 09:54:19.382223 1 controller.go:482] The operator is healthy I0216 09:55:19.357112 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 09:55:19.362505 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 09:55:19.362521 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 09:55:19.366575 1 secretconfigobserver.go:119] support secret does not exist I0216 09:56:19.377178 1 controller.go:482] The operator is healthy I0216 09:58:10.072728 1 insightsuploader.go:146] Nothing to report since 2026-02-16T09:41:49Z I0216 09:58:19.376711 1 controller.go:482] The operator is healthy I0216 10:00:19.335161 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 10:00:19.367172 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 10:00:19.372192 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 10:00:19.372209 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 10:00:19.376413 1 secretconfigobserver.go:119] support secret does not exist I0216 10:00:19.376469 1 controller.go:482] The operator is healthy