I0216 11:15:32.321921 1 cmd.go:241] Using service-serving-cert provided certificates I0216 11:15:32.322326 1 observer_polling.go:159] Starting file observer I0216 11:15:32.509572 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0216 11:15:32.509764 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0216 11:15:32.510100 1 secure_serving.go:57] Forcing use of http/1.1 only W0216 11:15:32.510120 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0216 11:15:32.510125 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0216 11:15:32.510128 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0216 11:15:32.510131 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0216 11:15:32.510132 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0216 11:15:32.510134 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0216 11:15:32.510151 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0216 11:15:32.513992 1 event.go:364] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"c0bbf315-d849-4f72-86c6-bf775987c592", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ClusterAPIInstallAWS", "ClusterAPIInstallAzure", "ClusterAPIInstallGCP", "ClusterAPIInstallNutanix", "ClusterAPIInstallOpenStack", "ClusterAPIInstallPowerVS", "ClusterAPIInstallVSphere", "DisableKubeletCloudCredentialProviders", "ExternalCloudProvider", "ExternalCloudProviderAzure", "ExternalCloudProviderExternal", "ExternalCloudProviderGCP", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "MetricsServer", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NodeDisruptionPolicy", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "StreamingCollectionEncodingToJSON", "StreamingCollectionEncodingToProtobuf", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InstallAlternateInfrastructureAWS", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "ManagedBootImagesAWS", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MixedCPUsAllocation", "MultiArchInstallAzure", "NetworkSegmentation", "NewOLM", "NodeSwap", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PersistentIPsForVirtualization", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesSupport", "VSphereMultiVCenters", "VolumeGroupSnapshot"}} I0216 11:15:32.514034 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AutomatedEtcdBackup AzureWorkloadIdentity BareMetalLoadBalancer BootcNodeManagement BuildCSIVolumes CSIDriverSharedResource ChunkSizeMiB CloudDualStackNodeIPs ClusterAPIInstall ClusterAPIInstallAWS ClusterAPIInstallAzure ClusterAPIInstallGCP ClusterAPIInstallIBMCloud ClusterAPIInstallNutanix ClusterAPIInstallOpenStack ClusterAPIInstallPowerVS ClusterAPIInstallVSphere ClusterMonitoringConfig DNSNameResolver DisableKubeletCloudCredentialProviders DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example ExternalCloudProvider ExternalCloudProviderAzure ExternalCloudProviderExternal ExternalCloudProviderGCP ExternalOIDC GCPClusterHostedDNS GCPLabelsTags GatewayAPI HardwareSpeed IngressControllerLBSubnetsAWS InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InstallAlternateInfrastructureAWS KMSv1 MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MaxUnavailableStatefulSet MetricsCollectionProfiles MetricsServer MixedCPUsAllocation MultiArchInstallAWS MultiArchInstallAzure MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NewOLM NodeDisruptionPolicy NodeSwap OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PersistentIPsForVirtualization PinnedImages PlatformOperators PrivateHostedZoneAWS ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SignatureStores SigstoreImageVerification StreamingCollectionEncodingToJSON StreamingCollectionEncodingToProtobuf TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesSupport VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy VolumeGroupSnapshot] I0216 11:15:32.517825 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0216 11:15:32.517840 1 shared_informer.go:311] Waiting for caches to sync for RequestHeaderAuthRequestController I0216 11:15:32.517868 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0216 11:15:32.517896 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0216 11:15:32.517896 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0216 11:15:32.517945 1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0216 11:15:32.518123 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0216 11:15:32.518190 1 secure_serving.go:213] Serving securely on [::]:8443 I0216 11:15:32.518227 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" W0216 11:15:32.523565 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0216 11:15:32.523595 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0216 11:15:32.523625 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0216 11:15:32.530357 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 11:15:32.530375 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0216 11:15:32.538525 1 secretconfigobserver.go:119] support secret does not exist I0216 11:15:32.544737 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 11:15:32.550280 1 secretconfigobserver.go:119] support secret does not exist I0216 11:15:32.556414 1 recorder.go:161] Pruning old reports every 6h16m58s, max age is 288h0m0s I0216 11:15:32.563018 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0216 11:15:32.563039 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0216 11:15:32.563040 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0216 11:15:32.563022 1 periodic.go:214] Running clusterconfig gatherer I0216 11:15:32.563051 1 insightsreport.go:296] Starting report retriever I0216 11:15:32.563058 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0216 11:15:32.563094 1 tasks_processing.go:45] number of workers: 64 I0216 11:15:32.563124 1 tasks_processing.go:69] worker 2 listening for tasks. I0216 11:15:32.563133 1 tasks_processing.go:69] worker 0 listening for tasks. I0216 11:15:32.563138 1 tasks_processing.go:69] worker 1 listening for tasks. I0216 11:15:32.563144 1 tasks_processing.go:69] worker 36 listening for tasks. I0216 11:15:32.563145 1 tasks_processing.go:69] worker 21 listening for tasks. I0216 11:15:32.563151 1 tasks_processing.go:71] worker 36 working on image_pruners task. I0216 11:15:32.563152 1 tasks_processing.go:69] worker 29 listening for tasks. I0216 11:15:32.563153 1 tasks_processing.go:69] worker 25 listening for tasks. I0216 11:15:32.563159 1 tasks_processing.go:71] worker 29 working on metrics task. I0216 11:15:32.563162 1 tasks_processing.go:69] worker 24 listening for tasks. I0216 11:15:32.563176 1 tasks_processing.go:71] worker 24 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0216 11:15:32.563177 1 tasks_processing.go:69] worker 22 listening for tasks. I0216 11:15:32.563168 1 tasks_processing.go:69] worker 26 listening for tasks. I0216 11:15:32.563184 1 tasks_processing.go:69] worker 35 listening for tasks. I0216 11:15:32.563187 1 tasks_processing.go:69] worker 23 listening for tasks. I0216 11:15:32.563153 1 tasks_processing.go:71] worker 21 working on sap_config task. I0216 11:15:32.563192 1 tasks_processing.go:69] worker 12 listening for tasks. I0216 11:15:32.563195 1 tasks_processing.go:69] worker 7 listening for tasks. I0216 11:15:32.563198 1 tasks_processing.go:69] worker 8 listening for tasks. I0216 11:15:32.563195 1 tasks_processing.go:69] worker 34 listening for tasks. I0216 11:15:32.563177 1 tasks_processing.go:69] worker 32 listening for tasks. I0216 11:15:32.563169 1 tasks_processing.go:69] worker 31 listening for tasks. I0216 11:15:32.563203 1 tasks_processing.go:69] worker 5 listening for tasks. I0216 11:15:32.563206 1 tasks_processing.go:69] worker 9 listening for tasks. I0216 11:15:32.563211 1 tasks_processing.go:69] worker 6 listening for tasks. I0216 11:15:32.563212 1 tasks_processing.go:69] worker 10 listening for tasks. I0216 11:15:32.563210 1 tasks_processing.go:69] worker 4 listening for tasks. I0216 11:15:32.563218 1 tasks_processing.go:69] worker 11 listening for tasks. I0216 11:15:32.563161 1 tasks_processing.go:69] worker 30 listening for tasks. I0216 11:15:32.563221 1 tasks_processing.go:69] worker 3 listening for tasks. I0216 11:15:32.563225 1 tasks_processing.go:69] worker 37 listening for tasks. I0216 11:15:32.563222 1 tasks_processing.go:69] worker 33 listening for tasks. I0216 11:15:32.563228 1 tasks_processing.go:69] worker 18 listening for tasks. I0216 11:15:32.563230 1 tasks_processing.go:71] worker 3 working on kube_controller_manager_logs task. I0216 11:15:32.563234 1 tasks_processing.go:69] worker 38 listening for tasks. I0216 11:15:32.563232 1 tasks_processing.go:69] worker 15 listening for tasks. I0216 11:15:32.563234 1 tasks_processing.go:69] worker 16 listening for tasks. I0216 11:15:32.563237 1 tasks_processing.go:69] worker 14 listening for tasks. I0216 11:15:32.563236 1 tasks_processing.go:69] worker 41 listening for tasks. I0216 11:15:32.563238 1 tasks_processing.go:69] worker 45 listening for tasks. I0216 11:15:32.563240 1 tasks_processing.go:69] worker 39 listening for tasks. I0216 11:15:32.563244 1 tasks_processing.go:69] worker 43 listening for tasks. I0216 11:15:32.563245 1 tasks_processing.go:69] worker 44 listening for tasks. I0216 11:15:32.563224 1 tasks_processing.go:69] worker 19 listening for tasks. I0216 11:15:32.563250 1 tasks_processing.go:71] worker 23 working on infrastructures task. I0216 11:15:32.563223 1 tasks_processing.go:69] worker 17 listening for tasks. I0216 11:15:32.563248 1 tasks_processing.go:69] worker 52 listening for tasks. I0216 11:15:32.563251 1 tasks_processing.go:69] worker 40 listening for tasks. I0216 11:15:32.563254 1 tasks_processing.go:69] worker 42 listening for tasks. I0216 11:15:32.563256 1 tasks_processing.go:71] worker 8 working on feature_gates task. I0216 11:15:32.563261 1 tasks_processing.go:69] worker 61 listening for tasks. I0216 11:15:32.563261 1 tasks_processing.go:71] worker 22 working on container_runtime_configs task. I0216 11:15:32.563265 1 tasks_processing.go:69] worker 59 listening for tasks. I0216 11:15:32.563265 1 tasks_processing.go:69] worker 62 listening for tasks. I0216 11:15:32.563262 1 tasks_processing.go:69] worker 58 listening for tasks. I0216 11:15:32.563269 1 tasks_processing.go:69] worker 60 listening for tasks. I0216 11:15:32.563268 1 tasks_processing.go:69] worker 47 listening for tasks. I0216 11:15:32.563271 1 tasks_processing.go:71] worker 9 working on schedulers task. I0216 11:15:32.563269 1 tasks_processing.go:69] worker 56 listening for tasks. I0216 11:15:32.563276 1 tasks_processing.go:69] worker 57 listening for tasks. I0216 11:15:32.563278 1 tasks_processing.go:69] worker 49 listening for tasks. I0216 11:15:32.563248 1 tasks_processing.go:71] worker 34 working on monitoring_persistent_volumes task. I0216 11:15:32.563283 1 tasks_processing.go:69] worker 50 listening for tasks. I0216 11:15:32.563284 1 tasks_processing.go:71] worker 5 working on image task. I0216 11:15:32.563286 1 tasks_processing.go:71] worker 0 working on install_plans task. I0216 11:15:32.563283 1 tasks_processing.go:71] worker 7 working on oauths task. I0216 11:15:32.563294 1 tasks_processing.go:69] worker 51 listening for tasks. I0216 11:15:32.563262 1 tasks_processing.go:69] worker 46 listening for tasks. I0216 11:15:32.563302 1 tasks_processing.go:69] worker 20 listening for tasks. I0216 11:15:32.563303 1 tasks_processing.go:71] worker 32 working on sap_pods task. I0216 11:15:32.563228 1 tasks_processing.go:69] worker 13 listening for tasks. I0216 11:15:32.563225 1 tasks_processing.go:71] worker 30 working on lokistack task. I0216 11:15:32.563313 1 tasks_processing.go:69] worker 48 listening for tasks. I0216 11:15:32.563313 1 tasks_processing.go:71] worker 4 working on proxies task. I0216 11:15:32.563319 1 tasks_processing.go:71] worker 26 working on networks task. I0216 11:15:32.563257 1 tasks_processing.go:69] worker 55 listening for tasks. I0216 11:15:32.563252 1 tasks_processing.go:71] worker 12 working on mutating_webhook_configurations task. I0216 11:15:32.563363 1 tasks_processing.go:71] worker 35 working on openstack_version task. I0216 11:15:32.563160 1 tasks_processing.go:71] worker 25 working on qemu_kubevirt_launcher_logs task. I0216 11:15:32.563223 1 tasks_processing.go:71] worker 11 working on container_images task. I0216 11:15:32.563177 1 tasks_processing.go:69] worker 27 listening for tasks. I0216 11:15:32.563663 1 tasks_processing.go:71] worker 27 working on authentication task. I0216 11:15:32.563802 1 tasks_processing.go:71] worker 16 working on machine_sets task. I0216 11:15:32.563813 1 tasks_processing.go:71] worker 37 working on dvo_metrics task. I0216 11:15:32.563838 1 tasks_processing.go:71] worker 33 working on active_alerts task. I0216 11:15:32.563845 1 tasks_processing.go:71] worker 45 working on operators task. I0216 11:15:32.563251 1 tasks_processing.go:69] worker 54 listening for tasks. I0216 11:15:32.563309 1 tasks_processing.go:71] worker 10 working on silenced_alerts task. I0216 11:15:32.563865 1 tasks_processing.go:71] worker 54 working on support_secret task. I0216 11:15:32.563875 1 tasks_processing.go:71] worker 14 working on pod_network_connectivity_checks task. I0216 11:15:32.563888 1 tasks_processing.go:71] worker 41 working on service_accounts task. I0216 11:15:32.563894 1 tasks_processing.go:71] worker 61 working on ingress task. I0216 11:15:32.563355 1 tasks_processing.go:71] worker 1 working on machine_configs task. I0216 11:15:32.563245 1 tasks_processing.go:69] worker 53 listening for tasks. I0216 11:15:32.563924 1 tasks_processing.go:71] worker 57 working on machine_autoscalers task. I0216 11:15:32.563926 1 tasks_processing.go:71] worker 52 working on openstack_dataplanedeployments task. I0216 11:15:32.563305 1 tasks_processing.go:71] worker 6 working on nodenetworkconfigurationpolicies task. I0216 11:15:32.563146 1 tasks_processing.go:69] worker 28 listening for tasks. I0216 11:15:32.563936 1 tasks_processing.go:71] worker 20 working on openshift_authentication_logs task. I0216 11:15:32.563941 1 tasks_processing.go:71] worker 18 working on sap_license_management_logs task. I0216 11:15:32.563293 1 tasks_processing.go:71] worker 31 working on image_registries task. I0216 11:15:32.563947 1 tasks_processing.go:71] worker 17 working on ceph_cluster task. I0216 11:15:32.563948 1 tasks_processing.go:71] worker 42 working on machines task. I0216 11:15:32.563955 1 tasks_processing.go:71] worker 49 working on config_maps task. I0216 11:15:32.563916 1 tasks_processing.go:71] worker 51 working on pdbs task. I0216 11:15:32.563960 1 tasks_processing.go:71] worker 38 working on machine_healthchecks task. I0216 11:15:32.563938 1 tasks_processing.go:71] worker 28 working on overlapping_namespace_uids task. I0216 11:15:32.563987 1 tasks_processing.go:71] worker 46 working on operators_pods_and_events task. I0216 11:15:32.563989 1 tasks_processing.go:71] worker 13 working on openstack_dataplanenodesets task. I0216 11:15:32.563992 1 tasks_processing.go:71] worker 48 working on olm_operators task. I0216 11:15:32.564007 1 tasks_processing.go:71] worker 43 working on storage_classes task. I0216 11:15:32.564014 1 tasks_processing.go:71] worker 44 working on validating_webhook_configurations task. I0216 11:15:32.564016 1 tasks_processing.go:71] worker 62 working on certificate_signing_requests task. I0216 11:15:32.564020 1 tasks_processing.go:71] worker 58 working on node_logs task. I0216 11:15:32.564010 1 tasks_processing.go:71] worker 15 working on scheduler_logs task. I0216 11:15:32.563927 1 tasks_processing.go:71] worker 53 working on openshift_machine_api_events task. I0216 11:15:32.564044 1 tasks_processing.go:71] worker 60 working on cluster_apiserver task. I0216 11:15:32.564047 1 tasks_processing.go:71] worker 39 working on nodenetworkstates task. I0216 11:15:32.563983 1 tasks_processing.go:71] worker 50 working on openshift_logging task. I0216 11:15:32.564039 1 tasks_processing.go:71] worker 59 working on version task. I0216 11:15:32.563920 1 tasks_processing.go:71] worker 56 working on machine_config_pools task. I0216 11:15:32.563282 1 tasks_processing.go:71] worker 2 working on jaegers task. I0216 11:15:32.563278 1 tasks_processing.go:69] worker 63 listening for tasks. I0216 11:15:32.564148 1 tasks_processing.go:71] worker 63 working on openshift_apiserver_operator_logs task. I0216 11:15:32.563944 1 tasks_processing.go:71] worker 40 working on openstack_controlplanes task. I0216 11:15:32.566499 1 tasks_processing.go:71] worker 19 working on aggregated_monitoring_cr_names task. I0216 11:15:32.566633 1 tasks_processing.go:71] worker 55 working on sap_datahubs task. I0216 11:15:32.566874 1 tasks_processing.go:71] worker 47 working on crds task. I0216 11:15:32.567075 1 tasks_processing.go:71] worker 35 working on tsdb_status task. I0216 11:15:32.567093 1 gather.go:180] gatherer "clusterconfig" function "openstack_version" took 3.703665ms to process 0 records E0216 11:15:32.569141 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.30.209:9094: connect: connection refused I0216 11:15:32.569158 1 tasks_processing.go:71] worker 33 working on nodes task. E0216 11:15:32.569159 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.152.131:9091: connect: connection refused E0216 11:15:32.569178 1 gather.go:143] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.30.209:9094: connect: connection refused I0216 11:15:32.569198 1 gather.go:180] gatherer "clusterconfig" function "active_alerts" took 5.312808ms to process 0 records E0216 11:15:32.569197 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.152.131:9091: connect: connection refused E0216 11:15:32.569213 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.30.209:9094: connect: connection refused I0216 11:15:32.569224 1 tasks_processing.go:71] worker 35 working on ingress_certificates task. E0216 11:15:32.569215 1 gather.go:143] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.152.131:9091: connect: connection refused I0216 11:15:32.569234 1 gather.go:180] gatherer "clusterconfig" function "tsdb_status" took 2.083608ms to process 0 records E0216 11:15:32.569242 1 gather.go:143] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.152.131:9091: connect: connection refused I0216 11:15:32.569252 1 gather.go:180] gatherer "clusterconfig" function "metrics" took 6.046424ms to process 0 records E0216 11:15:32.569261 1 gather.go:143] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.30.209:9094: connect: connection refused I0216 11:15:32.569271 1 gather.go:180] gatherer "clusterconfig" function "silenced_alerts" took 5.363979ms to process 0 records I0216 11:15:32.569335 1 tasks_processing.go:71] worker 29 working on clusterroles task. I0216 11:15:32.569344 1 tasks_processing.go:71] worker 10 working on storage_cluster task. I0216 11:15:32.569841 1 tasks_processing.go:71] worker 57 working on cost_management_metrics_configs task. I0216 11:15:32.569848 1 gather.go:180] gatherer "clusterconfig" function "machine_autoscalers" took 5.908032ms to process 0 records I0216 11:15:32.570086 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0216 11:15:32.570100 1 controller.go:317] The initial operator extension status is healthy I0216 11:15:32.570106 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0216 11:15:32.570115 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0216 11:15:32.570117 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0216 11:15:32.570130 1 controller.go:457] The operator is still being initialized I0216 11:15:32.570136 1 controller.go:482] The operator is healthy I0216 11:15:32.570190 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s I0216 11:15:32.570205 1 cluster_transfer.go:78] checking the availability of cluster transfer. Next check is in 12h0m0s W0216 11:15:32.570289 1 operator.go:286] started I0216 11:15:32.570303 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0216 11:15:32.583306 1 tasks_processing.go:74] worker 5 stopped. I0216 11:15:32.583414 1 recorder.go:75] Recording config/image with fingerprint=1edeb8176e3f493f76384cd49bdd6197a0a0497fff9beb1a0c808f6e2421bc08 I0216 11:15:32.583426 1 gather.go:180] gatherer "clusterconfig" function "image" took 20.010216ms to process 1 records I0216 11:15:32.583510 1 tasks_processing.go:74] worker 26 stopped. I0216 11:15:32.583526 1 recorder.go:75] Recording config/network with fingerprint=6194ccbdbbe28ddb11ed084275cb39c51ff4e0956629f2911d204027cf467ce5 I0216 11:15:32.583533 1 gather.go:180] gatherer "clusterconfig" function "networks" took 20.008847ms to process 1 records I0216 11:15:32.583607 1 tasks_processing.go:74] worker 7 stopped. I0216 11:15:32.583688 1 recorder.go:75] Recording config/oauth with fingerprint=f528bf01acf8b8c1fe17ff85ba98fbb5390133c828c1fa5e8c20e76267b7d2b8 I0216 11:15:32.583695 1 gather.go:180] gatherer "clusterconfig" function "oauths" took 20.088702ms to process 1 records I0216 11:15:32.593461 1 tasks_processing.go:74] worker 50 stopped. I0216 11:15:32.593479 1 gather.go:180] gatherer "clusterconfig" function "openshift_logging" took 29.381478ms to process 0 records E0216 11:15:32.593491 1 gather.go:143] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0216 11:15:32.593499 1 gather.go:180] gatherer "clusterconfig" function "machine_healthchecks" took 29.524403ms to process 0 records I0216 11:15:32.593508 1 gather.go:180] gatherer "clusterconfig" function "sap_pods" took 30.183612ms to process 0 records I0216 11:15:32.593514 1 tasks_processing.go:74] worker 32 stopped. I0216 11:15:32.593516 1 tasks_processing.go:74] worker 38 stopped. I0216 11:15:32.593552 1 tasks_processing.go:74] worker 6 stopped. I0216 11:15:32.593567 1 gather.go:180] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 29.61437ms to process 0 records E0216 11:15:32.593612 1 gather.go:143] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0216 11:15:32.593620 1 gather.go:180] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 29.663739ms to process 0 records E0216 11:15:32.593626 1 gather.go:143] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0216 11:15:32.593631 1 gather.go:180] gatherer "clusterconfig" function "machines" took 29.629108ms to process 0 records I0216 11:15:32.593638 1 gather.go:180] gatherer "clusterconfig" function "machine_sets" took 29.772669ms to process 0 records I0216 11:15:32.593643 1 gather.go:180] gatherer "clusterconfig" function "sap_config" took 30.398067ms to process 0 records I0216 11:15:32.593648 1 gather.go:180] gatherer "clusterconfig" function "nodenetworkstates" took 29.547402ms to process 0 records I0216 11:15:32.593653 1 gather.go:180] gatherer "clusterconfig" function "machine_config_pools" took 29.535902ms to process 0 records I0216 11:15:32.593660 1 tasks_processing.go:74] worker 42 stopped. I0216 11:15:32.593672 1 tasks_processing.go:74] worker 14 stopped. I0216 11:15:32.593676 1 tasks_processing.go:74] worker 39 stopped. I0216 11:15:32.593676 1 tasks_processing.go:74] worker 21 stopped. I0216 11:15:32.593680 1 tasks_processing.go:74] worker 16 stopped. I0216 11:15:32.593687 1 tasks_processing.go:74] worker 56 stopped. I0216 11:15:32.593730 1 tasks_processing.go:74] worker 36 stopped. I0216 11:15:32.594009 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=64a98d26de28288c57ddc30d3d4955818c80252734eb12f4da86fb4dacda97de I0216 11:15:32.594026 1 gather.go:180] gatherer "clusterconfig" function "image_pruners" took 30.461712ms to process 1 records I0216 11:15:32.594068 1 gather_logs.go:145] no pods in openshift-authentication namespace were found I0216 11:15:32.594078 1 recorder.go:75] Recording config/proxy with fingerprint=a2ff68d944a0a962fd7dfe69ff2531f257831bd6c731b427825bdbaff7df45a0 I0216 11:15:32.594083 1 tasks_processing.go:74] worker 4 stopped. I0216 11:15:32.594084 1 gather.go:180] gatherer "clusterconfig" function "proxies" took 30.352787ms to process 1 records I0216 11:15:32.594082 1 controller.go:203] Source scaController *sca.Controller is not ready I0216 11:15:32.594089 1 gather.go:180] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 29.678921ms to process 0 records I0216 11:15:32.594092 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0216 11:15:32.594093 1 gather.go:180] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 29.75729ms to process 0 records I0216 11:15:32.594097 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0216 11:15:32.594098 1 tasks_processing.go:74] worker 13 stopped. I0216 11:15:32.594101 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0216 11:15:32.594102 1 tasks_processing.go:74] worker 52 stopped. I0216 11:15:32.594105 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0216 11:15:32.594121 1 controller.go:457] The operator is still being initialized I0216 11:15:32.594126 1 controller.go:482] The operator is healthy I0216 11:15:32.594167 1 tasks_processing.go:74] worker 27 stopped. I0216 11:15:32.594237 1 recorder.go:75] Recording config/authentication with fingerprint=89ad3280e80a33bc4f437c6629e4ceaafdb0c0d9cbd9b440c7c7a69ad37db6aa I0216 11:15:32.594248 1 gather.go:180] gatherer "clusterconfig" function "authentication" took 30.032801ms to process 1 records I0216 11:15:32.594250 1 gather_logs.go:145] no pods in openshift-kube-controller-manager namespace were found I0216 11:15:32.594255 1 gather.go:180] gatherer "clusterconfig" function "container_runtime_configs" took 30.471646ms to process 0 records I0216 11:15:32.594263 1 tasks_processing.go:74] worker 22 stopped. I0216 11:15:32.594293 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=1eadc3cc8d9b1e14413d980108ca43f6667e09402fda0083d7eb211d45f760eb I0216 11:15:32.594301 1 gather.go:180] gatherer "clusterconfig" function "schedulers" took 30.495173ms to process 1 records I0216 11:15:32.594332 1 tasks_processing.go:74] worker 9 stopped. I0216 11:15:32.594395 1 recorder.go:75] Recording config/apiserver with fingerprint=c78fc5f1397a0ada76bb1a9c24b86241b91e122e4ca2eaf1819f875e48162e4d I0216 11:15:32.594406 1 gather.go:180] gatherer "clusterconfig" function "cluster_apiserver" took 29.808436ms to process 1 records I0216 11:15:32.594411 1 gather.go:180] gatherer "clusterconfig" function "lokistack" took 30.580812ms to process 0 records I0216 11:15:32.594411 1 tasks_processing.go:74] worker 60 stopped. I0216 11:15:32.594425 1 tasks_processing.go:74] worker 30 stopped. I0216 11:15:32.594488 1 tasks_processing.go:74] worker 8 stopped. I0216 11:15:32.594875 1 recorder.go:75] Recording config/featuregate with fingerprint=21f31d451fd03517736bd8cb67c746acfb38ebe4248afbcd9c10eb0ffbe3e9cb I0216 11:15:32.594940 1 gather_sap_vsystem_iptables_logs.go:60] SAP resources weren't found I0216 11:15:32.594941 1 gather.go:180] gatherer "clusterconfig" function "feature_gates" took 30.647238ms to process 1 records I0216 11:15:32.595002 1 gather.go:180] gatherer "clusterconfig" function "node_logs" took 29.970253ms to process 0 records I0216 11:15:32.595155 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=996e8e9ea62d9ab3f8804b5070aa318e383409fcc3436e34c7206a1d85fc5a68 I0216 11:15:32.595168 1 tasks_processing.go:74] worker 58 stopped. I0216 11:15:32.595206 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=f8c551bb0b4c45fdfd054a8496dc48bc7221d1bc6bd6db656b3351dd8271df9f I0216 11:15:32.595229 1 gather.go:180] gatherer "clusterconfig" function "storage_classes" took 30.011909ms to process 2 records I0216 11:15:32.595258 1 gather.go:180] gatherer "clusterconfig" function "openstack_controlplanes" took 29.864023ms to process 0 records I0216 11:15:32.595277 1 gather.go:180] gatherer "clusterconfig" function "openshift_authentication_logs" took 30.13657ms to process 0 records I0216 11:15:32.595345 1 tasks_processing.go:74] worker 40 stopped. I0216 11:15:32.595391 1 tasks_processing.go:74] worker 43 stopped. I0216 11:15:32.595412 1 tasks_processing.go:74] worker 20 stopped. I0216 11:15:32.596011 1 tasks_processing.go:74] worker 23 stopped. I0216 11:15:32.596018 1 gather_logs.go:145] no pods in openshift-apiserver-operator namespace were found I0216 11:15:32.597509 1 recorder.go:75] Recording config/infrastructure with fingerprint=a2cd75494f90b7d995c7720c08b0af14f833319efefaf1fbe390c7eb20c11493 I0216 11:15:32.597529 1 gather.go:180] gatherer "clusterconfig" function "infrastructures" took 30.893084ms to process 1 records I0216 11:15:32.597536 1 gather.go:180] gatherer "clusterconfig" function "kube_controller_manager_logs" took 31.02182ms to process 0 records I0216 11:15:32.597544 1 gather.go:180] gatherer "clusterconfig" function "jaegers" took 30.289907ms to process 0 records I0216 11:15:32.597550 1 gather.go:180] gatherer "clusterconfig" function "sap_datahubs" took 27.777958ms to process 0 records I0216 11:15:32.597555 1 gather.go:180] gatherer "clusterconfig" function "machine_configs" took 30.509994ms to process 0 records I0216 11:15:32.597553 1 tasks_processing.go:74] worker 3 stopped. I0216 11:15:32.597562 1 gather.go:180] gatherer "clusterconfig" function "cost_management_metrics_configs" took 24.893545ms to process 0 records I0216 11:15:32.597568 1 gather.go:180] gatherer "clusterconfig" function "ceph_cluster" took 31.024013ms to process 0 records I0216 11:15:32.597574 1 gather.go:180] gatherer "clusterconfig" function "sap_license_management_logs" took 31.03419ms to process 0 records I0216 11:15:32.597578 1 gather.go:180] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 31.955513ms to process 0 records I0216 11:15:32.597590 1 tasks_processing.go:74] worker 57 stopped. I0216 11:15:32.597602 1 tasks_processing.go:74] worker 2 stopped. I0216 11:15:32.597605 1 tasks_processing.go:74] worker 55 stopped. I0216 11:15:32.597608 1 tasks_processing.go:74] worker 1 stopped. I0216 11:15:32.597615 1 tasks_processing.go:74] worker 18 stopped. I0216 11:15:32.597619 1 tasks_processing.go:74] worker 17 stopped. I0216 11:15:32.597624 1 tasks_processing.go:74] worker 34 stopped. I0216 11:15:32.597692 1 tasks_processing.go:74] worker 61 stopped. I0216 11:15:32.597767 1 recorder.go:75] Recording config/ingress with fingerprint=d0e376bbd3b64f68a18ffb143d5732c222de40280473668d49e2a85ec05623bb I0216 11:15:32.597778 1 gather.go:180] gatherer "clusterconfig" function "ingress" took 31.526784ms to process 1 records I0216 11:15:32.597820 1 tasks_processing.go:74] worker 44 stopped. I0216 11:15:32.597951 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=082e635ab3bc84cd6917588180826ed2f51f81c6f3855626e164f1bb87394dec I0216 11:15:32.597995 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=558f3c8f88d57bc74dadd10746c99cc59bc340f08f13cb131d8b272366552fce I0216 11:15:32.598055 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=5cf51e6990b00a942ac7b297de9d16910030ec6f4319f4b31ee8fc333e38545f I0216 11:15:32.598081 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=7d306feb90a119d6bad96e878de92f4f8fd0536f9f3cb69699bb60ed2ae269dd I0216 11:15:32.598103 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=6b49b33f4441e375dea61968b302defa8b6f2f21f153dc616bd2bbaa2f7c9a7b I0216 11:15:32.598161 1 recorder.go:75] Recording config/validatingwebhookconfigurations/snapshot.storage.k8s.io with fingerprint=9f31112bd911fe00749e6cccc5f6b2385d1909707575b3754e7a9217123a9846 I0216 11:15:32.598191 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=574fd25954bf61bb5f6d0468cd9e978064f0126bfd34cb89a4e42d48818796d1 I0216 11:15:32.598220 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=cb4e2541003b2161dc956fe15525c65a314f6a789b8bf4dd0a4f92d28dd1dc53 I0216 11:15:32.598247 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=046cc62d774402048db73555d0a21ff5d32a0d75853368d6d6c78ce396552ebd I0216 11:15:32.598299 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=513cb88a5f427fa8b83ff11903a176e23eebb9923d73119b2c5dd07923df98a5 I0216 11:15:32.598329 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=53744c6835d4794ffa8bee9901e3ab41473838aee8f9bc6f9c79fb29ad38780f I0216 11:15:32.598361 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=46f0e12a72ad7792ed8ebaaf1c881a6f4b85c9e94b8d0463bd06ca463b1b99bf I0216 11:15:32.598388 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=2508c03a8530455561ab4269cda8c1d4e4026870b52442e7ea50ff071f69381e I0216 11:15:32.598398 1 gather.go:180] gatherer "clusterconfig" function "validating_webhook_configurations" took 31.743333ms to process 13 records I0216 11:15:32.598410 1 gather.go:180] gatherer "clusterconfig" function "storage_cluster" took 26.41907ms to process 0 records I0216 11:15:32.598421 1 tasks_processing.go:74] worker 10 stopped. I0216 11:15:32.598498 1 tasks_processing.go:74] worker 33 stopped. I0216 11:15:32.598766 1 recorder.go:75] Recording config/node/ip-10-0-136-116.ec2.internal with fingerprint=a1e2e6d67a544c2a2920da55df7dbc25b3a2d1749362f770acef76d6e195b629 I0216 11:15:32.598809 1 recorder.go:75] Recording config/node/ip-10-0-158-1.ec2.internal with fingerprint=e90221c26fde0dd62d392d6552354b6d257b71f0c8f1fb2e9336a6194dc8812b I0216 11:15:32.598845 1 recorder.go:75] Recording config/node/ip-10-0-170-188.ec2.internal with fingerprint=bd7d6b7bd3514a873e941dddbf1c1bd840b83d9de43c0dfcb3c93c7adc814f19 I0216 11:15:32.598853 1 gather.go:180] gatherer "clusterconfig" function "nodes" took 26.635397ms to process 3 records I0216 11:15:32.598940 1 tasks_processing.go:74] worker 12 stopped. I0216 11:15:32.598953 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=0925707cc572b9cb461829bfe7120944058be808d25b1461deac2491bf6237c3 I0216 11:15:32.598976 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=6cdd31609088ea44df23a48cfd3abd57cd7104b2e67fe194f6955b8bb7499a20 I0216 11:15:32.598993 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=93072dcd33beefaf4b9b6e52ad4bdc8ce2a0cde15cf1d8fa858a8ed822c8ffcc I0216 11:15:32.599000 1 gather.go:180] gatherer "clusterconfig" function "mutating_webhook_configurations" took 32.514699ms to process 3 records I0216 11:15:32.599004 1 gather.go:180] gatherer "clusterconfig" function "openshift_apiserver_operator_logs" took 32.149852ms to process 0 records W0216 11:15:32.598953 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0216 11:15:32.599049 1 tasks_processing.go:74] worker 63 stopped. I0216 11:15:32.599052 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=c460805dd65f5ffb6831477b483c001805ff2d422fd674948bb34012d679887f I0216 11:15:32.599063 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=c1054cfd9a3e8ff30a5252f809a36a3f853a49cd1f4fa25b08640c55562efad0 I0216 11:15:32.599074 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=d75a64bb3edba63a5b86ec6e6fae694fe83361695ad1ce4946e438f2a4fd9c48 I0216 11:15:32.599085 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=a2e99ea69145a9d32756676797dad51efcc6048e600a1c7447777bf7a00e3df1 I0216 11:15:32.599093 1 tasks_processing.go:74] worker 51 stopped. I0216 11:15:32.599098 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=986b44ac7195df66c28562da4a63d846f7492044331d001fce8bff02030b76f0 I0216 11:15:32.599108 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=687dc248629ae93d682cbba587d3a3cdcddac2df1065e859b909834ee2f20f43 I0216 11:15:32.599119 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=45cab31934b3abd967aec4b8eb6f71214e92e01079e55aa4d7f335ce680113d5 I0216 11:15:32.599131 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=e9df28254f2693e9f3794868b2f94260ddb95205b09cbfdd9b277a4cfd50de00 I0216 11:15:32.599140 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=2bd028e517f27ce600c45c41e2cfc27df5fd5970a43d40f512006c014e128f4d I0216 11:15:32.599152 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=e07672a7e6a0cb8c6eabbd7218cfcc5b6c5264fdbae59e15402ad438a39a148e I0216 11:15:32.599158 1 gather.go:180] gatherer "clusterconfig" function "pdbs" took 34.018697ms to process 10 records I0216 11:15:32.599165 1 gather.go:180] gatherer "clusterconfig" function "certificate_signing_requests" took 35.029199ms to process 0 records I0216 11:15:32.599172 1 tasks_processing.go:74] worker 62 stopped. I0216 11:15:32.599797 1 requests.go:204] Asking for SCA certificate for x86_64 architecture I0216 11:15:32.618178 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0216 11:15:32.618214 1 gather_logs.go:145] no pods in openshift-kube-scheduler namespace were found I0216 11:15:32.618224 1 shared_informer.go:318] Caches are synced for RequestHeaderAuthRequestController I0216 11:15:32.618228 1 tasks_processing.go:74] worker 15 stopped. I0216 11:15:32.618232 1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0216 11:15:32.618240 1 gather.go:180] gatherer "clusterconfig" function "scheduler_logs" took 54.179337ms to process 0 records I0216 11:15:32.618499 1 tasks_processing.go:74] worker 53 stopped. I0216 11:15:32.618510 1 gather.go:180] gatherer "clusterconfig" function "openshift_machine_api_events" took 54.447681ms to process 0 records I0216 11:15:32.618567 1 tasks_processing.go:74] worker 48 stopped. I0216 11:15:32.618577 1 gather_logs.go:145] no pods in namespace were found I0216 11:15:32.618582 1 gather.go:180] gatherer "clusterconfig" function "olm_operators" took 54.567631ms to process 0 records I0216 11:15:32.618589 1 gather.go:180] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 55.10064ms to process 0 records I0216 11:15:32.618593 1 tasks_processing.go:74] worker 25 stopped. I0216 11:15:32.618835 1 tasks_processing.go:74] worker 54 stopped. E0216 11:15:32.618842 1 gather.go:143] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0216 11:15:32.618851 1 gather.go:180] gatherer "clusterconfig" function "support_secret" took 54.958317ms to process 0 records I0216 11:15:32.620481 1 tasks_processing.go:74] worker 31 stopped. I0216 11:15:32.620989 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=b04b8148762b7bfd23b214f97c3f2968c670080ad2b605936be94e040e883114 I0216 11:15:32.621009 1 gather.go:180] gatherer "clusterconfig" function "image_registries" took 56.524402ms to process 1 records I0216 11:15:32.623518 1 tasks_processing.go:74] worker 29 stopped. I0216 11:15:32.623771 1 base_controller.go:73] Caches are synced for ConfigController I0216 11:15:32.623892 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0216 11:15:32.624570 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=98ab43fa856913bdb215b0d07dfc1c791e8bee1adb9a3eb38373b20de930041e I0216 11:15:32.625092 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=d0f12909f57096aa5312135e6ab377e2be10cf78f481b02274faecd37024160f I0216 11:15:32.625125 1 gather.go:180] gatherer "clusterconfig" function "clusterroles" took 54.092323ms to process 2 records I0216 11:15:32.625148 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0216 11:15:32.625161 1 gather.go:180] gatherer "clusterconfig" function "overlapping_namespace_uids" took 60.557148ms to process 1 records I0216 11:15:32.625176 1 tasks_processing.go:74] worker 28 stopped. I0216 11:15:32.628976 1 tasks_processing.go:74] worker 19 stopped. I0216 11:15:32.628992 1 gather.go:180] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 62.44721ms to process 0 records I0216 11:15:32.629244 1 tasks_processing.go:74] worker 47 stopped. I0216 11:15:32.629843 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=03ef2a6dd87769af041815d915f98984815cbde5844f0e6cd66f1e4a4a32e65e I0216 11:15:32.630064 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=06aedeb1c5dec76e36f8da5e9185ec39e2d907039113d93896998b5efa12d04d I0216 11:15:32.630077 1 gather.go:180] gatherer "clusterconfig" function "crds" took 62.350918ms to process 2 records I0216 11:15:32.638280 1 tasks_processing.go:74] worker 59 stopped. I0216 11:15:32.638305 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 11:15:32.638922 1 recorder.go:75] Recording config/version with fingerprint=e12b009e3ed793e863cbafedda4ce29ca95674fa7f02bb93df5022c41c3f8c7a I0216 11:15:32.638940 1 recorder.go:75] Recording config/id with fingerprint=0e3aed1a993efbd09aa6f3300cac555755c7958a4703736f81c3bdc2df77c9da I0216 11:15:32.638946 1 gather.go:180] gatherer "clusterconfig" function "version" took 74.209515ms to process 2 records I0216 11:15:32.641797 1 tasks_processing.go:74] worker 11 stopped. I0216 11:15:32.642901 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-5889c54ccc-fj8cf with fingerprint=fe8362c4e498418db68fccdcf81f2338020b0593967bc9f6aafb120f1168096b I0216 11:15:32.643045 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-glqs4 with fingerprint=ad5d731b4a49b9ba86f67de999502235fd68160a372e1fa855818333a3e32a8e I0216 11:15:32.643098 1 recorder.go:75] Recording config/running_containers with fingerprint=55c732d3e14756ab742dfb60c4aaa9ed5d1744501657f07087ac576580940430 I0216 11:15:32.643111 1 gather.go:180] gatherer "clusterconfig" function "container_images" took 78.249584ms to process 3 records I0216 11:15:32.648337 1 tasks_processing.go:74] worker 24 stopped. I0216 11:15:32.648352 1 gather.go:180] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 85.148383ms to process 0 records I0216 11:15:32.659359 1 tasks_processing.go:74] worker 49 stopped. E0216 11:15:32.659381 1 gather.go:143] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0216 11:15:32.659387 1 gather.go:143] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0216 11:15:32.659392 1 gather.go:143] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0216 11:15:32.659419 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0216 11:15:32.659428 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=0bddb88b072029f25dde6f44cb877a44fb2f65ed4864939fbf7a3e42c0a485f6 I0216 11:15:32.659432 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0216 11:15:32.659441 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0216 11:15:32.659460 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0216 11:15:32.659472 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0216 11:15:32.659478 1 gather.go:180] gatherer "clusterconfig" function "config_maps" took 95.388745ms to process 6 records I0216 11:15:32.663266 1 tasks_processing.go:74] worker 35 stopped. E0216 11:15:32.663281 1 gather.go:143] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0216 11:15:32.663287 1 gather.go:143] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ogak4isp3kfeculplc268j75l7kt9p5-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ogak4isp3kfeculplc268j75l7kt9p5-primary-cert-bundle-secret" not found I0216 11:15:32.663354 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=276770a040d9ffb5f89939f4e1e1b2e342b3b816443c29eaff49d2bc4ee1d9c2 I0216 11:15:32.663365 1 gather.go:180] gatherer "clusterconfig" function "ingress_certificates" took 94.025071ms to process 1 records I0216 11:15:32.670354 1 base_controller.go:73] Caches are synced for LoggingSyncer I0216 11:15:32.670372 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0216 11:15:32.684606 1 cluster_transfer.go:97] no available accepted cluster transfer I0216 11:15:32.684628 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0216 11:15:32.706900 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0216 11:15:32.709692 1 gather_cluster_operator_pods_and_events.go:119] Found 13 pods with 13 containers I0216 11:15:32.709703 1 gather_cluster_operator_pods_and_events.go:233] Maximum buffer size: 1935832 bytes I0216 11:15:32.710471 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for console-operator container console-operator-5889c54ccc-fj8cf pod in namespace openshift-console-operator (previous: true). I0216 11:15:32.835080 1 sca.go:141] etc-pki-entitlement secret successfully updated I0216 11:15:32.835173 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated in the etc-pki-entitlement secret I0216 11:15:32.862401 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for console-operator container console-operator-5889c54ccc-fj8cf pod in namespace openshift-console-operator (previous: false). I0216 11:15:33.042949 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for console container console-6f8dbb759c-mx85g pod in namespace openshift-console (previous: false). I0216 11:15:33.236626 1 gather_cluster_operator_pods_and_events.go:278] Error: "log buffer is empty" I0216 11:15:33.236645 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for console container console-6f8dbb759c-w6hgx pod in namespace openshift-console (previous: false). I0216 11:15:33.443142 1 gather_cluster_operator_pods_and_events.go:406] Failed to fetch log for console-6f8dbb759c-w6hgx pod in namespace openshift-console for failing operator console (previous: false): "container \"console\" in pod \"console-6f8dbb759c-w6hgx\" is waiting to start: ContainerCreating" I0216 11:15:33.443159 1 gather_cluster_operator_pods_and_events.go:278] Error: "container \"console\" in pod \"console-6f8dbb759c-w6hgx\" is waiting to start: ContainerCreating" I0216 11:15:33.443167 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for console container console-76644fd9f6-kwct7 pod in namespace openshift-console (previous: false). W0216 11:15:33.596273 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0216 11:15:33.664124 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for console container console-76644fd9f6-nchmk pod in namespace openshift-console (previous: false). I0216 11:15:33.859998 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for download-server container downloads-5b45c9c7bf-c6pc9 pod in namespace openshift-console (previous: false). I0216 11:15:34.041839 1 gather_cluster_operator_pods_and_events.go:278] Error: "log buffer is empty" I0216 11:15:34.041855 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for download-server container downloads-5b45c9c7bf-t2b2t pod in namespace openshift-console (previous: false). I0216 11:15:34.245038 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for router container router-default-5878cf9d4c-d9h57 pod in namespace openshift-ingress (previous: false). I0216 11:15:34.443855 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for router container router-default-5878cf9d4c-w9djj pod in namespace openshift-ingress (previous: false). W0216 11:15:34.596869 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0216 11:15:34.643975 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for router container router-default-7d6b8b7d65-nw7q5 pod in namespace openshift-ingress (previous: false). I0216 11:15:34.843109 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for serve-healthcheck-canary container ingress-canary-6gv9v pod in namespace openshift-ingress-canary (previous: false). I0216 11:15:34.848685 1 tasks_processing.go:74] worker 45 stopped. I0216 11:15:34.848855 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=31af74e585c125481189306153d9646ca523fcdb933bbebdf71e5d775d1e671c I0216 11:15:34.848899 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=777490e650fc4f269d89afce0970d1e9b5dd10872e645f48c06497f314de30f6 I0216 11:15:34.848916 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=29657ddcf188525aca2f4dcbd2b6e356133eb0324c8561ea49bf5fd150615eaf I0216 11:15:34.848927 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0216 11:15:34.848942 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=a82c84be3d3f38b8e9788953f1c455a0e8c17e4b269386144259ad9a1c99af0a I0216 11:15:34.848958 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0216 11:15:34.848976 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=a6f8d91b18a4e28e307b3d48e9aa64542ed95b3b61f076430d76a5e4100b9f14 I0216 11:15:34.848994 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=a180a217cb7e7f11519493e7f5b1e7f3f3293e1cb3b2509c45642a2c0d3c584f I0216 11:15:34.849014 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=bd9f75811c5ba20f267ae5c4669440bd46a38b904ae83a7b33f16ddfff44dbe2 I0216 11:15:34.849033 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=50952001625012e8ecaf0239df2ff289e8aeaa5a0634440d8f082974c1ecc709 I0216 11:15:34.849238 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e1d6629c18e003cabebc3be1e2c0eccaeaad713149e6ad02aea1ee2f6068e4f4 I0216 11:15:34.849252 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=02e989eef1b4fe60e6adb6422fc68b3171ba88fe4503b72d96f9bee44ac080c4 I0216 11:15:34.849259 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0216 11:15:34.849270 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=eb6d93615b6a03f9dc1a6f150945952eed0556c97dbdfb140a1e170904d443c7 I0216 11:15:34.849278 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0216 11:15:34.849288 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=59717afed44a7eb087d9310d7d6384b1a68df89bed239061efae8e79f5be3507 I0216 11:15:34.849297 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0216 11:15:34.849330 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=a34baf78eda449ae283c327707f4f1670579a9d87e476e696cd001c6c746af06 I0216 11:15:34.849339 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0216 11:15:34.849351 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=ae21707896ab6ffce89ec9da8ce9b3b7c7f94cb5df471544fe542a5c6336cbad I0216 11:15:34.849402 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=84d47738f77ee3a545fe6c601aaefe9d66e88eb99678d50defc86bf7185e74ae I0216 11:15:34.849411 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0216 11:15:34.849417 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0216 11:15:34.849436 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0216 11:15:34.849451 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=7d8574a749b49cdd9e49bbf1b80559802513748f1b13dc596f17298977686620 I0216 11:15:34.849467 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=0605926098b56866ce049d886e68099ee784cc2810c2583e4d83f9974a0a543f I0216 11:15:34.849475 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0216 11:15:34.849486 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=53803b37b9a92dad5fb1e64c532b44d2130946e457239b1040b02d85aeca5bf5 I0216 11:15:34.849494 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0216 11:15:34.849505 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=7fa3a35aa7f48885481051173beb61273cf92c27460ce645a708afa9b62ce354 I0216 11:15:34.849513 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0216 11:15:34.849520 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=71af02942debdf8416d8aa628662281fc2a31c29cca62b007cf1ca44b4679544 I0216 11:15:34.849531 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=cc4ae6e6842e97b06b5d6c9e290859bf740049a8d88d3e81d1329196f08aa04a I0216 11:15:34.849542 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=eccea9fd11a36db0ae524f3ee526844299d38d986faccdb0dbd50879e22ddfae I0216 11:15:34.849554 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=07e6737ee55ab9077e6130df789c79e8e97e2b915d15c7a04925cf732ed7d2a2 I0216 11:15:34.849562 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0216 11:15:34.849577 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=22f9f7fbcf824e6e62ad28462770953143152b56679eeeb80abc5009bf88bf35 I0216 11:15:34.849590 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=7e1ab8f8cfcd9d249b5b213939fe5144bb83db3725475461728bea44a002c3be I0216 11:15:34.849597 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0216 11:15:34.849604 1 gather.go:180] gatherer "clusterconfig" function "operators" took 2.284821865s to process 39 records I0216 11:15:35.043094 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for serve-healthcheck-canary container ingress-canary-c5wc5 pod in namespace openshift-ingress-canary (previous: false). I0216 11:15:35.242936 1 gather_cluster_operator_pods_and_events.go:363] Fetching logs for serve-healthcheck-canary container ingress-canary-st6gx pod in namespace openshift-ingress-canary (previous: false). I0216 11:15:35.441535 1 tasks_processing.go:74] worker 46 stopped. I0216 11:15:35.441669 1 recorder.go:75] Recording events/openshift-console-operator with fingerprint=5bcb1e33dccfae281caf84ea5c1478fd6553aad478e66bbad341a87118f1c1c3 I0216 11:15:35.441731 1 recorder.go:75] Recording events/openshift-console with fingerprint=cec19950360dfb66fc71f8c54106bd6994567908debebbec395af9a914f1e068 I0216 11:15:35.441749 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=af2dc4042f3138ac20076da23fef7fec444eb146d9ab442f0e95ac2e1f3ad491 I0216 11:15:35.441792 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=d9028db1b2482d13a5ca63db32f882bb28cd225ae641b1d31d0774b682af1ff1 I0216 11:15:35.441818 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=afaabbe6c2b53366c76f869ed33f91dd48936c9a6974c1d4d972381d26d345f5 I0216 11:15:35.441924 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-5889c54ccc-fj8cf with fingerprint=fe8362c4e498418db68fccdcf81f2338020b0593967bc9f6aafb120f1168096b E0216 11:15:35.441940 1 gather.go:164] error recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-5889c54ccc-fj8cf.json" because of the error: the record with the same name "config/pod/openshift-console-operator/console-operator-5889c54ccc-fj8cf.json" was already recorded and had the fingerprint "fe8362c4e498418db68fccdcf81f2338020b0593967bc9f6aafb120f1168096b", overwriting with the record having fingerprint "fe8362c4e498418db68fccdcf81f2338020b0593967bc9f6aafb120f1168096b" W0216 11:15:35.441951 1 gather.go:158] issue recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-5889c54ccc-fj8cf.json" because of the warning: warning: the record with the same fingerprint "fe8362c4e498418db68fccdcf81f2338020b0593967bc9f6aafb120f1168096b" was already recorded at path "config/pod/openshift-console-operator/console-operator-5889c54ccc-fj8cf.json", recording another one with a different path "config/pod/openshift-console-operator/console-operator-5889c54ccc-fj8cf.json" I0216 11:15:35.441963 1 recorder.go:75] Recording config/pod/openshift-console-operator/logs/console-operator-5889c54ccc-fj8cf/console-operator_previous.log with fingerprint=2b7e6841aab727aa8e7852fd65e6154c4ecae5329f9f91963736bfd30651e07a I0216 11:15:35.441982 1 recorder.go:75] Recording config/pod/openshift-console-operator/logs/console-operator-5889c54ccc-fj8cf/console-operator_current.log with fingerprint=38ab9e06080b860ba0a39457b47417bd94816991b0e0015d547afe88a77c9e83 I0216 11:15:35.441991 1 recorder.go:75] Recording config/pod/openshift-console/logs/console-76644fd9f6-kwct7/console_current.log with fingerprint=801b17c44b61a09df5d97619ac4240caabb486170dc7ed5167d51fdf1782bf9f I0216 11:15:35.441997 1 recorder.go:75] Recording config/pod/openshift-console/logs/console-76644fd9f6-nchmk/console_current.log with fingerprint=1e7228e1d08b561aa2bbe156a4749c847833963f55467cb306876e1d973e0bb2 I0216 11:15:35.442004 1 recorder.go:75] Recording config/pod/openshift-console/logs/downloads-5b45c9c7bf-t2b2t/download-server_current.log with fingerprint=5950eaa96105595bb2a4123d56ea90f26382377f3c273f8f08227b8271b02633 I0216 11:15:35.442011 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-5878cf9d4c-d9h57/router_current.log with fingerprint=a8848476af089f562d1b924351f9bda55b786f919cf69ab9f996794a281af17a I0216 11:15:35.442021 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-5878cf9d4c-w9djj/router_current.log with fingerprint=e137b3deebc5df3da58ca84cc7bb4ecfe78556983af32f972a75e909c2224fa5 I0216 11:15:35.442031 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-7d6b8b7d65-nw7q5/router_current.log with fingerprint=3fcfd35b0abe20125ac55b9052d4b2de27f2e8128c642edec4c133ccd33ae671 I0216 11:15:35.442036 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-6gv9v/serve-healthcheck-canary_current.log with fingerprint=ee32f72d8cbf6d1c8c491cfa373d171f5c7e4ca471c8cb592a3a2b9effdcc01a I0216 11:15:35.442040 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-c5wc5/serve-healthcheck-canary_current.log with fingerprint=ea16668de97b58fae5b03b22673827c745d8256d4139b2dc501efbd7d13aeb24 I0216 11:15:35.442045 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-st6gx/serve-healthcheck-canary_current.log with fingerprint=38184aa13ac8cec82e4f1adf39f42c0d3520fe72496ea9e6ac43a4373e537599 I0216 11:15:35.442049 1 gather.go:180] gatherer "clusterconfig" function "operators_pods_and_events" took 2.877531407s to process 17 records W0216 11:15:35.596736 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0216 11:15:36.596895 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0216 11:15:37.596949 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0216 11:15:37.596981 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0216 11:15:37.597000 1 tasks_processing.go:74] worker 37 stopped. E0216 11:15:37.597011 1 gather.go:143] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0216 11:15:37.597022 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0216 11:15:37.597038 1 gather.go:180] gatherer "clusterconfig" function "dvo_metrics" took 5.033175362s to process 1 records I0216 11:15:45.231455 1 tasks_processing.go:74] worker 0 stopped. I0216 11:15:45.231487 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0216 11:15:45.231497 1 gather.go:180] gatherer "clusterconfig" function "install_plans" took 12.668152789s to process 1 records I0216 11:15:45.973373 1 tasks_processing.go:74] worker 41 stopped. I0216 11:15:45.973600 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=e8fa8e05dd38dd3c2a22ed048b78e32d1ae73c34810996e8da6147bc4693ea99 I0216 11:15:45.973615 1 gather.go:180] gatherer "clusterconfig" function "service_accounts" took 13.409467031s to process 1 records E0216 11:15:45.973691 1 periodic.go:252] clusterconfig failed after 13.41s with: function "active_alerts" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "silenced_alerts" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, unable to record function "operators_pods_and_events" record "config/pod/openshift-console-operator/console-operator-5889c54ccc-fj8cf.json", function "dvo_metrics" failed with an error I0216 11:15:45.973706 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "active_alerts" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "silenced_alerts" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, unable to record function "operators_pods_and_events" record "config/pod/openshift-console-operator/console-operator-5889c54ccc-fj8cf.json", function "dvo_metrics" failed with an error I0216 11:15:45.973730 1 periodic.go:214] Running workloads gatherer I0216 11:15:45.973743 1 tasks_processing.go:45] number of workers: 2 I0216 11:15:45.973754 1 tasks_processing.go:69] worker 1 listening for tasks. I0216 11:15:45.973757 1 tasks_processing.go:71] worker 1 working on workload_info task. I0216 11:15:45.973772 1 tasks_processing.go:69] worker 0 listening for tasks. I0216 11:15:45.973849 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0216 11:15:46.006922 1 gather_workloads_info.go:257] Loaded pods in 0s, will wait 24s for image data I0216 11:15:46.018814 1 gather_workloads_info.go:366] No image sha256:2bf8536171476b2d616cf62b4d94d2f1dae34aca6ea6bfdb65e764a8d9675891 (13ms) I0216 11:15:46.018824 1 tasks_processing.go:74] worker 0 stopped. I0216 11:15:46.018836 1 gather.go:180] gatherer "workloads" function "helmchart_info" took 44.954789ms to process 0 records I0216 11:15:46.029414 1 gather_workloads_info.go:366] No image sha256:79449e16b1207223f1209d19888b879eb56a8202c53df4800e09b231392cf219 (11ms) I0216 11:15:46.039950 1 gather_workloads_info.go:366] No image sha256:0f31e990f9ca9d15dcb1b25325c8265515fcc06381909349bb021103827585c6 (11ms) I0216 11:15:46.050240 1 gather_workloads_info.go:366] No image sha256:0d1d37dbdb726e924b519ef27e52e9719601fab838ae75f72c8aca11e8c3b4cc (10ms) I0216 11:15:46.060850 1 gather_workloads_info.go:366] No image sha256:b34e84d56775e42b7d832d14c4f9dc302fee37cd81ba221397cd8acba2089d20 (11ms) I0216 11:15:46.071021 1 gather_workloads_info.go:366] No image sha256:6c833db28ce2e77ef5f9bfc29d052aaa04ba7807b19504cf85866c6c7808a2b0 (10ms) I0216 11:15:46.083059 1 gather_workloads_info.go:366] No image sha256:072b006abd58ce063deddf5a5ad349f355d8bb1942c81a0d999ad49580274aac (12ms) I0216 11:15:46.093481 1 gather_workloads_info.go:366] No image sha256:1b53023f7bc2a3d048982d116fcb2b59d8bbccb1760d1bbeaa7dc5753bc3d6d8 (10ms) I0216 11:15:46.103617 1 gather_workloads_info.go:366] No image sha256:357821852af925e0c8a19df2f9fceec8d2e49f9d13575b86ecd3fbedce488afa (10ms) I0216 11:15:46.113847 1 gather_workloads_info.go:366] No image sha256:7f55b7dbfb15fe36d83d64027eacee22fb00688ccbc03550cc2dbedfa633f288 (10ms) I0216 11:15:46.124594 1 gather_workloads_info.go:377] Found image sha256:0249b5fca8f8210324cea01cca2364f0dda3f9eb95facffd8c051fac3040aaf6 (11ms) I0216 11:15:46.219091 1 gather_workloads_info.go:366] No image sha256:2193d7361704b0ae4bca052e9158761e06ecbac9ca3f0a9c8f0f101127e8f370 (94ms) I0216 11:15:46.319160 1 gather_workloads_info.go:366] No image sha256:f82357030795138d2081ecc5172092222b0f4faea27e9a7a0474fbeae29111ad (100ms) I0216 11:15:46.418223 1 gather_workloads_info.go:366] No image sha256:185305b7da4ef5b90a90046f145e8c66bab3a16b12771d2e98bf78104d6a60f2 (99ms) I0216 11:15:46.518274 1 gather_workloads_info.go:366] No image sha256:29d1672ef44c59d065737eca330075dd2f6da4ba743153973a739aa9e9d73ad3 (100ms) I0216 11:15:46.619240 1 gather_workloads_info.go:366] No image sha256:e9f61e6313d8f97d537846db239e33a1250d4734cfaf2b1d136711b47c21d885 (101ms) I0216 11:15:46.719904 1 gather_workloads_info.go:366] No image sha256:822db36f8e1353ac24785b88d1fb2150d3ef34a5e739c1f67b61079336e9798b (101ms) I0216 11:15:46.819183 1 gather_workloads_info.go:366] No image sha256:7cfe7513e4f271cd533d4519e0fbcd80eb23739ed030c9f08c82be820c5c2a99 (99ms) I0216 11:15:46.918503 1 gather_workloads_info.go:366] No image sha256:712ad2760c350db1e23b9393bdda83149452931dc7b5a5038a3bcdb4663917c0 (99ms) I0216 11:15:47.018596 1 gather_workloads_info.go:366] No image sha256:586e9c2756f50e562a6123f47fe38dba5496b63413c3dd18e0b85d6167094f0c (100ms) I0216 11:15:47.118402 1 gather_workloads_info.go:366] No image sha256:27e725f1250f6a17da5eba7ada315a244592b5b822d61e95722bb7e2f884b00f (100ms) I0216 11:15:47.218282 1 gather_workloads_info.go:366] No image sha256:745f2186738a57bb1b484f68431e77aa2f68a1b8dcb434b1f7a4b429eafdf091 (100ms) I0216 11:15:47.317372 1 gather_workloads_info.go:366] No image sha256:2150fb1cec29c317c45efb0871f25c8a8c48fee4794f06f455346f4cf56d7a8f (99ms) I0216 11:15:47.418462 1 gather_workloads_info.go:366] No image sha256:3a6c7106060bf56007d8a72b34c69379fb9f18dac51ccdadda78734719de6ad4 (101ms) I0216 11:15:47.518759 1 gather_workloads_info.go:366] No image sha256:06529ff00c3a32128936e06afa90253af88823be4adb0ea4e2d11a17ebcf4528 (100ms) I0216 11:15:47.619011 1 gather_workloads_info.go:377] Found image sha256:2121717e0222b9e8892a44907b461a4f62b3f1e5429a0e2eee802d48d04fff30 (100ms) I0216 11:15:47.717446 1 gather_workloads_info.go:366] No image sha256:43e426ac9df633be58006907aede6f9b6322c6cc7985cd43141ad7518847c637 (98ms) I0216 11:15:47.818187 1 gather_workloads_info.go:366] No image sha256:59f553035bc347fc7205f1c071897bc2606b98525d6b9a3aca62fc9cd7078a57 (101ms) I0216 11:15:47.917653 1 gather_workloads_info.go:366] No image sha256:6cd25a10ff8c1c3de1a7238817c698ca624bfc245acf17ac9756a1751c688211 (99ms) I0216 11:15:48.018259 1 gather_workloads_info.go:366] No image sha256:457372d9f22e1c726ea1a6fcc54ddca8335bd607d2c357bcd7b63a7017aa5c2b (101ms) I0216 11:15:48.117683 1 gather_workloads_info.go:366] No image sha256:29eca6fff7b20514d9b2cf682ba27f5372f5c03fb04b742c175aad19efbb67e6 (99ms) I0216 11:15:48.218436 1 gather_workloads_info.go:366] No image sha256:0a62577e0731d4421a54b438b79a29d9b9d651d0086ef41d8579c3bc4ff89da7 (101ms) I0216 11:15:48.317677 1 gather_workloads_info.go:366] No image sha256:1762ee46965d2d631365be0dda8cdaf54c86f98ae2f60381e805a490acbdd4ef (99ms) I0216 11:15:48.418118 1 gather_workloads_info.go:366] No image sha256:64e79d9be6744864b9272f01d104018616343c121c968d8a96a6c962e394c572 (100ms) I0216 11:15:48.517503 1 gather_workloads_info.go:366] No image sha256:33d7e5c63340e93b5a063de538017ac693f154e3c27ee2ef8a8a53bb45583552 (99ms) I0216 11:15:48.620420 1 gather_workloads_info.go:366] No image sha256:9cc55a501aaad1adbefdd573e57c2f756a3a6a8723c43052995be6389edf1fa8 (103ms) I0216 11:15:48.718106 1 gather_workloads_info.go:366] No image sha256:036e6f9a4609a7499f200032dac2294e4a2d98764464ed17453ef725f2f0264d (98ms) I0216 11:15:48.819447 1 gather_workloads_info.go:366] No image sha256:88e6cc2192e682bb9c4ac5aec8e41254696d909c5dc337e720b9ec165a728064 (101ms) I0216 11:15:48.920365 1 gather_workloads_info.go:366] No image sha256:ba2890d43d0cd18906bd67968541d1b58c76ea731092c15829ae3fce37576d75 (101ms) I0216 11:15:49.017676 1 gather_workloads_info.go:366] No image sha256:28dd932f83bb9b7d81c7dcd15ddb0bbb10f784b39519b2b493bbbf0262392526 (97ms) I0216 11:15:49.117612 1 gather_workloads_info.go:366] No image sha256:0ed9562476aad855edc32bdd4a2ebd759a2c010144a53e4da003cd82af460b1a (100ms) I0216 11:15:49.217981 1 gather_workloads_info.go:366] No image sha256:5335f64616c3a6c55a9a6dc4bc084b46a4957fb4fc250afc5343e4547ebb3598 (100ms) I0216 11:15:49.317151 1 gather_workloads_info.go:366] No image sha256:b697301f15b5d15e0fe2a294d26ff02170c4f858617077952376e12037eba7c1 (99ms) I0216 11:15:49.418355 1 gather_workloads_info.go:366] No image sha256:87103e9af9b836dd5edc9eae46885d7ed9471574fa3874459a335a8d01a58136 (101ms) I0216 11:15:49.518731 1 gather_workloads_info.go:366] No image sha256:ad395a616f60c87f7b1ccd4beb3f78310c17ee98b719802208c4326b1dccc663 (100ms) I0216 11:15:49.618314 1 gather_workloads_info.go:366] No image sha256:41aa7e4b739ce22c7c510e1bc8084654785ce439e238b3dee01583a1f5a1ebad (100ms) I0216 11:15:49.718060 1 gather_workloads_info.go:366] No image sha256:91d9cb208e6d0c39a87dfe8276d162c75ff3fcd3b005b3e7b537f65c53475a42 (100ms) I0216 11:15:49.718094 1 tasks_processing.go:74] worker 1 stopped. I0216 11:15:49.718340 1 recorder.go:75] Recording config/workload_info with fingerprint=14aab8f85d881680654cd5c79a2eba99f6db399af9af8b292c565dc2a08d821b I0216 11:15:49.718363 1 gather.go:180] gatherer "workloads" function "workload_info" took 3.74433091s to process 1 records I0216 11:15:49.718380 1 periodic.go:261] Periodic gather workloads completed in 3.744s I0216 11:15:49.718389 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0216 11:15:49.718395 1 periodic.go:214] Running conditional gatherer I0216 11:15:49.725349 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.17.48/gathering_rules I0216 11:15:49.975954 1 conditional_gatherer.go:340] updating alerts cache for conditional gatherer E0216 11:15:49.978094 1 conditional_gatherer.go:326] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.152.131:9091: connect: connection refused I0216 11:15:49.978162 1 conditional_gatherer.go:386] updating version cache for conditional gatherer I0216 11:15:49.985332 1 conditional_gatherer.go:394] cluster version is '4.17.48' E0216 11:15:49.985348 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 11:15:49.985353 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 11:15:49.985356 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 11:15:49.985359 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 11:15:49.985361 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 11:15:49.985364 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 11:15:49.985366 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 11:15:49.985368 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 11:15:49.985370 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing E0216 11:15:49.985373 1 conditional_gatherer.go:211] error checking conditions for a gathering rule: alerts cache is missing I0216 11:15:49.985385 1 tasks_processing.go:45] number of workers: 3 I0216 11:15:49.985397 1 tasks_processing.go:69] worker 2 listening for tasks. I0216 11:15:49.985400 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0216 11:15:49.985408 1 tasks_processing.go:69] worker 0 listening for tasks. I0216 11:15:49.985420 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0216 11:15:49.985426 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0216 11:15:49.985429 1 tasks_processing.go:69] worker 1 listening for tasks. I0216 11:15:49.985439 1 tasks_processing.go:74] worker 1 stopped. I0216 11:15:49.985488 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0216 11:15:49.985499 1 gather.go:180] gatherer "conditional" function "conditional_gatherer_rules" took 620ns to process 1 records I0216 11:15:49.985524 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0216 11:15:49.985531 1 gather.go:180] gatherer "conditional" function "remote_configuration" took 1.161µs to process 1 records I0216 11:15:49.985535 1 tasks_processing.go:74] worker 0 stopped. I0216 11:15:49.985604 1 tasks_processing.go:74] worker 2 stopped. I0216 11:15:49.985619 1 gather.go:180] gatherer "conditional" function "rapid_container_logs" took 171.23µs to process 0 records I0216 11:15:49.985640 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I0216 11:15:49.985656 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f W0216 11:15:50.025237 1 gather.go:212] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0216 11:15:50.025374 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=64517756caceaf14a52c1223b9bb37f68d9a1b650714e42760520427cd8cf947 I0216 11:15:50.025495 1 diskrecorder.go:70] Writing 122 records to /var/lib/insights-operator/insights-2026-02-16-111550.tar.gz I0216 11:15:50.031775 1 diskrecorder.go:51] Wrote 122 records to disk in 6ms I0216 11:15:50.031820 1 periodic.go:283] Gathering cluster info every 2h0m0s I0216 11:15:50.031840 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0216 11:17:02.563360 1 diskrecorder.go:170] Found files to send: insights-2026-02-16-111550.tar.gz I0216 11:17:02.563386 1 insightsuploader.go:150] Checking archives to upload periodically every 15m56.811901108s I0216 11:17:02.563394 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0216 11:17:02.575404 1 requests.go:47] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0216 11:17:02.812250 1 requests.go:88] Successfully reported id=2026-02-16T11:17:02Z x-rh-insights-request-id=dbd323e8cfde469180f14e48e15c346d, wrote=57085 I0216 11:17:02.812326 1 insightsuploader.go:187] Uploaded report successfully in 248.919963ms I0216 11:17:02.812353 1 controller.go:119] Initializing last reported time to 2026-02-16T11:17:02Z I0216 11:17:02.812370 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0216 11:17:02.812375 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0216 11:17:02.812381 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0216 11:17:02.819340 1 controller.go:482] The operator is healthy I0216 11:17:32.578100 1 controller.go:482] The operator is healthy I0216 11:18:07.699496 1 insightsreport.go:137] Pulling report from smart-proxy I0216 11:18:07.699527 1 insightsreport.go:149] Retrieving report I0216 11:18:07.707350 1 requests.go:111] Retrieving report for cluster: 374bc256-c115-4836-b825-e79c3c016999 I0216 11:18:07.707362 1 requests.go:112] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/374bc256-c115-4836-b825-e79c3c016999/reports I0216 11:18:07.709237 1 requests.go:122] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/374bc256-c115-4836-b825-e79c3c016999/reports I0216 11:18:08.168945 1 insightsreport.go:184] Report retrieved I0216 11:18:08.199642 1 insightsreport.go:239] Report retrieved correctly I0216 11:19:32.578258 1 controller.go:482] The operator is healthy I0216 11:20:32.550392 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 11:20:32.557540 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 11:20:32.557559 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 11:20:32.563397 1 secretconfigobserver.go:119] support secret does not exist I0216 11:21:32.581001 1 controller.go:482] The operator is healthy I0216 11:23:32.578877 1 controller.go:482] The operator is healthy I0216 11:25:32.543986 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 11:25:32.549876 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 11:25:32.563955 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 11:25:32.570860 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 11:25:32.570878 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 11:25:32.577543 1 controller.go:482] The operator is healthy I0216 11:25:32.578338 1 secretconfigobserver.go:119] support secret does not exist I0216 11:27:32.583932 1 controller.go:482] The operator is healthy I0216 11:29:32.582792 1 controller.go:482] The operator is healthy I0216 11:30:32.578590 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 11:30:32.607912 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 11:30:32.607944 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 11:30:32.633362 1 secretconfigobserver.go:119] support secret does not exist I0216 11:31:32.582088 1 controller.go:482] The operator is healthy I0216 11:33:04.624757 1 insightsuploader.go:146] Nothing to report since 2026-02-16T11:17:02Z I0216 11:33:32.582699 1 controller.go:482] The operator is healthy I0216 11:35:32.544423 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 11:35:32.578110 1 controller.go:482] The operator is healthy I0216 11:35:32.634359 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 11:35:32.644415 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 11:35:32.644433 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 11:35:32.653073 1 secretconfigobserver.go:119] support secret does not exist I0216 11:37:32.582314 1 controller.go:482] The operator is healthy I0216 11:39:32.581347 1 controller.go:482] The operator is healthy I0216 11:40:32.653556 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 11:40:32.661279 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 11:40:32.661299 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 11:40:32.670555 1 secretconfigobserver.go:119] support secret does not exist I0216 11:41:32.580841 1 controller.go:482] The operator is healthy I0216 11:43:32.583940 1 controller.go:482] The operator is healthy I0216 11:45:32.543444 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 11:45:32.578052 1 controller.go:482] The operator is healthy I0216 11:45:32.671341 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 11:45:32.679364 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 11:45:32.679387 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 11:45:32.685363 1 secretconfigobserver.go:119] support secret does not exist I0216 11:47:32.578574 1 controller.go:482] The operator is healthy I0216 11:49:32.581438 1 controller.go:482] The operator is healthy I0216 11:49:39.073551 1 insightsuploader.go:146] Nothing to report since 2026-02-16T11:17:02Z I0216 11:50:32.688009 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 11:50:32.705057 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 11:50:32.705090 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 11:50:32.717007 1 secretconfigobserver.go:119] support secret does not exist I0216 11:51:32.619145 1 controller.go:482] The operator is healthy I0216 11:53:32.578672 1 controller.go:482] The operator is healthy I0216 11:55:32.543550 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 11:55:32.579573 1 controller.go:482] The operator is healthy I0216 11:55:32.717823 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 11:55:32.725037 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 11:55:32.725059 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 11:55:32.730983 1 secretconfigobserver.go:119] support secret does not exist I0216 11:57:32.580654 1 controller.go:482] The operator is healthy I0216 11:59:32.578003 1 controller.go:482] The operator is healthy I0216 12:00:32.731347 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 12:00:32.785247 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 12:00:32.785270 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 12:00:32.839994 1 secretconfigobserver.go:119] support secret does not exist I0216 12:01:32.583117 1 controller.go:482] The operator is healthy I0216 12:03:32.581287 1 controller.go:482] The operator is healthy I0216 12:05:32.546261 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 12:05:32.577811 1 controller.go:482] The operator is healthy I0216 12:05:32.840111 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 12:05:32.846371 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 12:05:32.846404 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 12:05:32.852291 1 secretconfigobserver.go:119] support secret does not exist I0216 12:05:52.833889 1 insightsuploader.go:146] Nothing to report since 2026-02-16T11:17:02Z I0216 12:07:32.581965 1 controller.go:482] The operator is healthy I0216 12:09:32.578807 1 controller.go:482] The operator is healthy I0216 12:10:32.852749 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 12:10:32.860188 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 12:10:32.860211 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 12:10:32.866070 1 secretconfigobserver.go:119] support secret does not exist I0216 12:11:32.579129 1 controller.go:482] The operator is healthy I0216 12:13:32.577697 1 controller.go:482] The operator is healthy I0216 12:15:32.545208 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 12:15:32.577344 1 controller.go:482] The operator is healthy I0216 12:15:32.867042 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 12:15:32.873419 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 12:15:32.873447 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 12:15:32.879541 1 secretconfigobserver.go:119] support secret does not exist I0216 12:17:32.584286 1 controller.go:482] The operator is healthy I0216 12:19:32.579755 1 controller.go:482] The operator is healthy I0216 12:20:32.880374 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 12:20:32.887538 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 12:20:32.887561 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 12:20:32.893238 1 secretconfigobserver.go:119] support secret does not exist I0216 12:21:32.578689 1 controller.go:482] The operator is healthy I0216 12:21:45.699816 1 insightsuploader.go:146] Nothing to report since 2026-02-16T11:17:02Z I0216 12:23:32.578541 1 controller.go:482] The operator is healthy I0216 12:25:32.549227 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 12:25:32.555279 1 configmapobserver.go:84] configmaps "insights-config" not found I0216 12:25:32.577957 1 controller.go:482] The operator is healthy I0216 12:25:32.893447 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 12:25:32.903000 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 12:25:32.903018 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 12:25:32.908772 1 secretconfigobserver.go:119] support secret does not exist I0216 12:27:32.581869 1 controller.go:482] The operator is healthy I0216 12:29:32.583801 1 controller.go:482] The operator is healthy I0216 12:30:32.909310 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0216 12:30:32.917576 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0216 12:30:32.917595 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0216 12:30:32.924666 1 secretconfigobserver.go:119] support secret does not exist