W0504 12:25:21.540782 1 cmd.go:257] Using insecure, self-signed certificates I0504 12:25:21.931959 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 12:25:21.932249 1 observer_polling.go:159] Starting file observer I0504 12:25:22.231880 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0504 12:25:22.232719 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0504 12:25:22.233324 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0504 12:25:22.233848 1 secure_serving.go:57] Forcing use of http/1.1 only W0504 12:25:22.233871 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0504 12:25:22.233877 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0504 12:25:22.233883 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0504 12:25:22.233887 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0504 12:25:22.233891 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0504 12:25:22.233894 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0504 12:25:22.237680 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0504 12:25:22.237747 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"90724d37-9f9a-4597-a434-3084311b735c", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0504 12:25:22.238921 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0504 12:25:22.238940 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0504 12:25:22.238945 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0504 12:25:22.238949 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0504 12:25:22.238962 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0504 12:25:22.238971 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0504 12:25:22.239133 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3706793107/tls.crt::/tmp/serving-cert-3706793107/tls.key" I0504 12:25:22.239410 1 secure_serving.go:213] Serving securely on [::]:8443 I0504 12:25:22.239436 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0504 12:25:22.243141 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0504 12:25:22.243164 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0504 12:25:22.243260 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0504 12:25:22.248329 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0504 12:25:22.248345 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0504 12:25:22.253272 1 secretconfigobserver.go:119] support secret does not exist I0504 12:25:22.257799 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0504 12:25:22.261896 1 secretconfigobserver.go:119] support secret does not exist I0504 12:25:22.264292 1 recorder.go:161] Pruning old reports every 5h59m34s, max age is 288h0m0s I0504 12:25:22.269265 1 periodic.go:209] Running clusterconfig gatherer I0504 12:25:22.269425 1 tasks_processing.go:45] number of workers: 64 I0504 12:25:22.269530 1 tasks_processing.go:69] worker 63 listening for tasks. I0504 12:25:22.269562 1 tasks_processing.go:71] worker 63 working on sap_config task. I0504 12:25:22.269678 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0504 12:25:22.269746 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0504 12:25:22.269808 1 tasks_processing.go:69] worker 31 listening for tasks. I0504 12:25:22.269807 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0504 12:25:22.269892 1 tasks_processing.go:69] worker 3 listening for tasks. I0504 12:25:22.269919 1 tasks_processing.go:69] worker 32 listening for tasks. I0504 12:25:22.269930 1 tasks_processing.go:69] worker 17 listening for tasks. I0504 12:25:22.269937 1 tasks_processing.go:69] worker 46 listening for tasks. I0504 12:25:22.269938 1 tasks_processing.go:69] worker 45 listening for tasks. I0504 12:25:22.269947 1 tasks_processing.go:69] worker 4 listening for tasks. I0504 12:25:22.269947 1 tasks_processing.go:69] worker 40 listening for tasks. I0504 12:25:22.269952 1 tasks_processing.go:69] worker 10 listening for tasks. I0504 12:25:22.269951 1 tasks_processing.go:69] worker 34 listening for tasks. I0504 12:25:22.269961 1 tasks_processing.go:69] worker 41 listening for tasks. I0504 12:25:22.269961 1 tasks_processing.go:69] worker 38 listening for tasks. I0504 12:25:22.269970 1 tasks_processing.go:69] worker 42 listening for tasks. I0504 12:25:22.269972 1 tasks_processing.go:69] worker 9 listening for tasks. I0504 12:25:22.269947 1 tasks_processing.go:69] worker 37 listening for tasks. I0504 12:25:22.269956 1 tasks_processing.go:69] worker 44 listening for tasks. I0504 12:25:22.269981 1 tasks_processing.go:69] worker 36 listening for tasks. I0504 12:25:22.269983 1 tasks_processing.go:69] worker 51 listening for tasks. I0504 12:25:22.269868 1 tasks_processing.go:69] worker 1 listening for tasks. I0504 12:25:22.269988 1 tasks_processing.go:69] worker 24 listening for tasks. I0504 12:25:22.269995 1 tasks_processing.go:69] worker 50 listening for tasks. I0504 12:25:22.269996 1 tasks_processing.go:69] worker 12 listening for tasks. I0504 12:25:22.269999 1 tasks_processing.go:69] worker 62 listening for tasks. I0504 12:25:22.269995 1 tasks_processing.go:69] worker 53 listening for tasks. I0504 12:25:22.270000 1 tasks_processing.go:69] worker 7 listening for tasks. I0504 12:25:22.270001 1 tasks_processing.go:69] worker 49 listening for tasks. I0504 12:25:22.270011 1 tasks_processing.go:69] worker 19 listening for tasks. I0504 12:25:22.270014 1 tasks_processing.go:69] worker 48 listening for tasks. I0504 12:25:22.270016 1 tasks_processing.go:69] worker 14 listening for tasks. I0504 12:25:22.270014 1 tasks_processing.go:69] worker 61 listening for tasks. I0504 12:25:22.269990 1 tasks_processing.go:69] worker 59 listening for tasks. I0504 12:25:22.270032 1 tasks_processing.go:69] worker 23 listening for tasks. I0504 12:25:22.270035 1 tasks_processing.go:69] worker 21 listening for tasks. I0504 12:25:22.270039 1 tasks_processing.go:71] worker 17 working on machines task. I0504 12:25:22.270042 1 tasks_processing.go:69] worker 26 listening for tasks. I0504 12:25:22.270043 1 tasks_processing.go:69] worker 30 listening for tasks. I0504 12:25:22.270032 1 tasks_processing.go:69] worker 29 listening for tasks. I0504 12:25:22.270048 1 tasks_processing.go:71] worker 31 working on nodenetworkstates task. I0504 12:25:22.269933 1 tasks_processing.go:69] worker 43 listening for tasks. I0504 12:25:22.270051 1 tasks_processing.go:71] worker 32 working on networks task. I0504 12:25:22.270055 1 tasks_processing.go:71] worker 45 working on openshift_logging task. I0504 12:25:22.270060 1 tasks_processing.go:71] worker 19 working on openstack_version task. I0504 12:25:22.270061 1 tasks_processing.go:71] worker 43 working on lokistack task. I0504 12:25:22.270068 1 tasks_processing.go:71] worker 44 working on cluster_apiserver task. I0504 12:25:22.270069 1 tasks_processing.go:71] worker 14 working on machine_config_pools task. I0504 12:25:22.270073 1 tasks_processing.go:71] worker 59 working on ingress task. I0504 12:25:22.270076 1 tasks_processing.go:71] worker 38 working on active_alerts task. I0504 12:25:22.270073 1 tasks_processing.go:71] worker 12 working on service_accounts task. I0504 12:25:22.270101 1 tasks_processing.go:71] worker 24 working on monitoring_persistent_volumes task. I0504 12:25:22.270067 1 tasks_processing.go:71] worker 61 working on feature_gates task. I0504 12:25:22.270251 1 tasks_processing.go:71] worker 62 working on support_secret task. I0504 12:25:22.269910 1 tasks_processing.go:69] worker 47 listening for tasks. I0504 12:25:22.270263 1 tasks_processing.go:71] worker 21 working on jaegers task. I0504 12:25:22.269941 1 tasks_processing.go:69] worker 39 listening for tasks. I0504 12:25:22.270057 1 tasks_processing.go:71] worker 1 working on validating_webhook_configurations task. I0504 12:25:22.270283 1 tasks_processing.go:71] worker 39 working on ingress_certificates task. I0504 12:25:22.270291 1 tasks_processing.go:71] worker 50 working on oauths task. I0504 12:25:22.270300 1 tasks_processing.go:71] worker 42 working on image_registries task. I0504 12:25:22.269939 1 tasks_processing.go:69] worker 35 listening for tasks. I0504 12:25:22.270438 1 tasks_processing.go:71] worker 35 working on storage_classes task. W0504 12:25:22.270104 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 12:25:22.270496 1 tasks_processing.go:71] worker 53 working on openstack_controlplanes task. I0504 12:25:22.270509 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 416.285µs to process 0 records I0504 12:25:22.270061 1 tasks_processing.go:71] worker 23 working on nodenetworkconfigurationpolicies task. I0504 12:25:22.269997 1 tasks_processing.go:69] worker 60 listening for tasks. I0504 12:25:22.270617 1 tasks_processing.go:71] worker 51 working on dvo_metrics task. I0504 12:25:22.270624 1 tasks_processing.go:71] worker 60 working on pdbs task. I0504 12:25:22.270264 1 tasks_processing.go:71] worker 47 working on container_runtime_configs task. I0504 12:25:22.269974 1 tasks_processing.go:69] worker 55 listening for tasks. I0504 12:25:22.269970 1 tasks_processing.go:69] worker 5 listening for tasks. I0504 12:25:22.269981 1 tasks_processing.go:69] worker 13 listening for tasks. I0504 12:25:22.269987 1 tasks_processing.go:69] worker 52 listening for tasks. I0504 12:25:22.269877 1 tasks_processing.go:69] worker 2 listening for tasks. I0504 12:25:22.269988 1 tasks_processing.go:69] worker 11 listening for tasks. I0504 12:25:22.271000 1 tasks_processing.go:71] worker 2 working on infrastructures task. I0504 12:25:22.271004 1 tasks_processing.go:71] worker 11 working on nodes task. I0504 12:25:22.271012 1 tasks_processing.go:71] worker 13 working on operators task. I0504 12:25:22.269860 1 tasks_processing.go:69] worker 0 listening for tasks. I0504 12:25:22.271103 1 tasks_processing.go:71] worker 0 working on clusterroles task. I0504 12:25:22.269998 1 tasks_processing.go:69] worker 56 listening for tasks. I0504 12:25:22.269898 1 insightsreport.go:296] Starting report retriever I0504 12:25:22.271261 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0504 12:25:22.270003 1 tasks_processing.go:69] worker 54 listening for tasks. I0504 12:25:22.271317 1 tasks_processing.go:71] worker 54 working on container_images task. I0504 12:25:22.270007 1 tasks_processing.go:69] worker 57 listening for tasks. I0504 12:25:22.270007 1 tasks_processing.go:69] worker 6 listening for tasks. I0504 12:25:22.270016 1 tasks_processing.go:69] worker 15 listening for tasks. I0504 12:25:22.270015 1 tasks_processing.go:69] worker 58 listening for tasks. I0504 12:25:22.270023 1 tasks_processing.go:69] worker 20 listening for tasks. I0504 12:25:22.270025 1 tasks_processing.go:69] worker 22 listening for tasks. I0504 12:25:22.270026 1 tasks_processing.go:69] worker 27 listening for tasks. I0504 12:25:22.270025 1 tasks_processing.go:69] worker 16 listening for tasks. I0504 12:25:22.270033 1 tasks_processing.go:69] worker 25 listening for tasks. I0504 12:25:22.270035 1 tasks_processing.go:69] worker 28 listening for tasks. I0504 12:25:22.270043 1 tasks_processing.go:71] worker 3 working on node_logs task. I0504 12:25:22.270047 1 tasks_processing.go:71] worker 4 working on storage_cluster task. I0504 12:25:22.270048 1 tasks_processing.go:71] worker 10 working on pod_network_connectivity_checks task. I0504 12:25:22.270050 1 tasks_processing.go:71] worker 46 working on machine_healthchecks task. I0504 12:25:22.270053 1 tasks_processing.go:71] worker 40 working on machine_autoscalers task. I0504 12:25:22.270058 1 tasks_processing.go:71] worker 9 working on openstack_dataplanedeployments task. I0504 12:25:22.270063 1 tasks_processing.go:71] worker 41 working on proxies task. I0504 12:25:22.270063 1 tasks_processing.go:71] worker 37 working on tsdb_status task. I0504 12:25:22.271383 1 tasks_processing.go:71] worker 6 working on config_maps task. I0504 12:25:22.271389 1 tasks_processing.go:71] worker 22 working on aggregated_monitoring_cr_names task. I0504 12:25:22.271391 1 tasks_processing.go:71] worker 27 working on certificate_signing_requests task. W0504 12:25:22.271412 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 12:25:22.270067 1 tasks_processing.go:71] worker 34 working on image_pruners task. I0504 12:25:22.270405 1 tasks_processing.go:71] worker 7 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0504 12:25:22.270412 1 tasks_processing.go:71] worker 26 working on crds task. I0504 12:25:22.270416 1 tasks_processing.go:71] worker 30 working on overlapping_namespace_uids task. I0504 12:25:22.270426 1 tasks_processing.go:71] worker 29 working on olm_operators task. I0504 12:25:22.270606 1 tasks_processing.go:71] worker 38 working on qemu_kubevirt_launcher_logs task. I0504 12:25:22.270612 1 tasks_processing.go:71] worker 36 working on sap_datahubs task. I0504 12:25:22.269950 1 tasks_processing.go:69] worker 33 listening for tasks. I0504 12:25:22.270799 1 tasks_processing.go:71] worker 49 working on openstack_dataplanenodesets task. I0504 12:25:22.269971 1 tasks_processing.go:69] worker 8 listening for tasks. I0504 12:25:22.270989 1 tasks_processing.go:71] worker 55 working on install_plans task. I0504 12:25:22.271053 1 tasks_processing.go:71] worker 52 working on cost_management_metrics_configs task. I0504 12:25:22.271065 1 tasks_processing.go:71] worker 5 working on machine_configs task. I0504 12:25:22.270004 1 tasks_processing.go:69] worker 18 listening for tasks. I0504 12:25:22.271151 1 tasks_processing.go:71] worker 56 working on silenced_alerts task. I0504 12:25:22.272202 1 tasks_processing.go:74] worker 18 stopped. W0504 12:25:22.272230 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 12:25:22.271355 1 tasks_processing.go:71] worker 15 working on mutating_webhook_configurations task. I0504 12:25:22.271368 1 tasks_processing.go:71] worker 28 working on operators_pods_and_events task. I0504 12:25:22.271373 1 tasks_processing.go:71] worker 20 working on version task. I0504 12:25:22.271377 1 tasks_processing.go:71] worker 58 working on openshift_machine_api_events task. I0504 12:25:22.270397 1 tasks_processing.go:71] worker 48 working on schedulers task. I0504 12:25:22.271779 1 tasks_processing.go:71] worker 16 working on authentication task. I0504 12:25:22.271784 1 tasks_processing.go:71] worker 25 working on metrics task. W0504 12:25:22.272689 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 12:25:22.271856 1 tasks_processing.go:71] worker 37 working on ceph_cluster task. I0504 12:25:22.271865 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 464.779µs to process 0 records I0504 12:25:22.272063 1 tasks_processing.go:71] worker 33 working on sap_pods task. I0504 12:25:22.272813 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 80.863µs to process 0 records I0504 12:25:22.272823 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 3.112538ms to process 0 records I0504 12:25:22.272828 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 26.067µs to process 0 records I0504 12:25:22.272836 1 tasks_processing.go:74] worker 25 stopped. I0504 12:25:22.272841 1 tasks_processing.go:74] worker 56 stopped. I0504 12:25:22.272844 1 tasks_processing.go:74] worker 63 stopped. I0504 12:25:22.272183 1 tasks_processing.go:71] worker 8 working on image task. I0504 12:25:22.271339 1 tasks_processing.go:71] worker 57 working on machine_sets task. I0504 12:25:22.274214 1 tasks_processing.go:74] worker 21 stopped. I0504 12:25:22.274228 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 3.940658ms to process 0 records I0504 12:25:22.274241 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 4.162674ms to process 0 records I0504 12:25:22.274246 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 4.171758ms to process 0 records I0504 12:25:22.274251 1 tasks_processing.go:74] worker 43 stopped. I0504 12:25:22.274255 1 tasks_processing.go:74] worker 19 stopped. I0504 12:25:22.274869 1 tasks_processing.go:74] worker 45 stopped. I0504 12:25:22.274883 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 4.798841ms to process 0 records I0504 12:25:22.275298 1 tasks_processing.go:74] worker 23 stopped. I0504 12:25:22.275313 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 4.718796ms to process 0 records I0504 12:25:22.279682 1 tasks_processing.go:74] worker 53 stopped. I0504 12:25:22.279694 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 9.176633ms to process 0 records I0504 12:25:22.279776 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0504 12:25:22.279795 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0504 12:25:22.279803 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0504 12:25:22.279809 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0504 12:25:22.279827 1 controller.go:489] The operator is still being initialized I0504 12:25:22.279838 1 controller.go:512] The operator is healthy I0504 12:25:22.285860 1 tasks_processing.go:74] worker 31 stopped. I0504 12:25:22.285879 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 15.803121ms to process 0 records E0504 12:25:22.285893 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0504 12:25:22.285902 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 14.49071ms to process 0 records I0504 12:25:22.285909 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 14.940364ms to process 0 records I0504 12:25:22.285917 1 tasks_processing.go:74] worker 47 stopped. I0504 12:25:22.285929 1 tasks_processing.go:74] worker 10 stopped. I0504 12:25:22.285973 1 tasks_processing.go:74] worker 17 stopped. E0504 12:25:22.285986 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0504 12:25:22.285997 1 gather.go:177] gatherer "clusterconfig" function "machines" took 15.921552ms to process 0 records I0504 12:25:22.286058 1 tasks_processing.go:74] worker 46 stopped. E0504 12:25:22.286068 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0504 12:25:22.286077 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 14.635459ms to process 0 records I0504 12:25:22.286245 1 tasks_processing.go:74] worker 40 stopped. I0504 12:25:22.286264 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 14.843328ms to process 0 records I0504 12:25:22.286352 1 tasks_processing.go:74] worker 44 stopped. I0504 12:25:22.286597 1 recorder.go:75] Recording config/apiserver with fingerprint=5bf31f95518fa85345804a19643411944524528752020cbf6d9326e6e03e4212 I0504 12:25:22.286614 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 16.273152ms to process 1 records I0504 12:25:22.286626 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 14.328884ms to process 0 records I0504 12:25:22.286646 1 tasks_processing.go:74] worker 36 stopped. I0504 12:25:22.286674 1 tasks_processing.go:74] worker 2 stopped. I0504 12:25:22.287381 1 recorder.go:75] Recording config/infrastructure with fingerprint=8531498afa9ae42d68f272b30defa63b5c9c86179488b507b3a3b088dfb85629 I0504 12:25:22.287395 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 15.40727ms to process 1 records I0504 12:25:22.287501 1 tasks_processing.go:74] worker 50 stopped. I0504 12:25:22.287616 1 recorder.go:75] Recording config/oauth with fingerprint=e132fb6e9e6debee8541fe4d14befb4c2b2e90d097994f7b80764bbae38c7977 I0504 12:25:22.287626 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 16.16666ms to process 1 records I0504 12:25:22.287634 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 16.407221ms to process 0 records I0504 12:25:22.287643 1 tasks_processing.go:74] worker 14 stopped. I0504 12:25:22.287666 1 tasks_processing.go:74] worker 61 stopped. I0504 12:25:22.287773 1 recorder.go:75] Recording config/featuregate with fingerprint=13051f4a2f54fc2e6c80e7c1c25a3ce95192f8b279a9fc957b4120dc4fff7839 I0504 12:25:22.287792 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 16.284589ms to process 1 records E0504 12:25:22.287802 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0504 12:25:22.287806 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 16.279742ms to process 0 records I0504 12:25:22.287810 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 16.413488ms to process 0 records I0504 12:25:22.287821 1 tasks_processing.go:74] worker 62 stopped. I0504 12:25:22.287836 1 tasks_processing.go:74] worker 24 stopped. I0504 12:25:22.287893 1 tasks_processing.go:74] worker 60 stopped. I0504 12:25:22.287946 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=a01690944fb45df4f0cdbd80897f37300d91f69902d3407653ac8ac947d2e795 I0504 12:25:22.287972 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=81b35c8a36863a9842fc61545a685060feced51e3c8b1b325caafcc1cfe060a2 I0504 12:25:22.287998 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=3faf4ade8fb9c2fe050e2c60447e6d1096f7c802676cd1a30d2391e3de85e5cf I0504 12:25:22.288009 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 15.786226ms to process 3 records I0504 12:25:22.288019 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 14.866134ms to process 0 records I0504 12:25:22.288029 1 tasks_processing.go:74] worker 9 stopped. I0504 12:25:22.288099 1 tasks_processing.go:74] worker 32 stopped. I0504 12:25:22.288145 1 recorder.go:75] Recording config/network with fingerprint=c77f511046f2982b90877c4ad56c9c936ba279aae4c8e89297611c8c4d3465f7 I0504 12:25:22.288152 1 gather.go:177] gatherer "clusterconfig" function "networks" took 16.57801ms to process 1 records I0504 12:25:22.288230 1 tasks_processing.go:74] worker 41 stopped. I0504 12:25:22.288237 1 recorder.go:75] Recording config/proxy with fingerprint=9808e39e4b2752156c0671486cb78fb713e735195f01c7a0f1f8db52853e07e5 I0504 12:25:22.288246 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 14.984714ms to process 1 records W0504 12:25:22.290820 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0504 12:25:22.293514 1 tasks_processing.go:74] worker 4 stopped. I0504 12:25:22.293524 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 22.14278ms to process 0 records I0504 12:25:22.293624 1 tasks_processing.go:74] worker 35 stopped. I0504 12:25:22.293725 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=a2a918240679a3ff6f56d9acfed997e1d70e8933451cd371aa0529a75367ac54 I0504 12:25:22.293748 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=bcb87950ea5a57191f608a03d918dbd214b10c62c457491457c6e18f48f72b10 I0504 12:25:22.293754 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 23.168797ms to process 2 records I0504 12:25:22.294524 1 tasks_processing.go:74] worker 34 stopped. I0504 12:25:22.295543 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=35c4ce34f577052c7122332e3dfc35f5b6dc0b4bb11e9a2a3af97b916390ec91 I0504 12:25:22.295561 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 22.653692ms to process 1 records I0504 12:25:22.297542 1 tasks_processing.go:74] worker 52 stopped. I0504 12:25:22.297559 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 25.339881ms to process 0 records I0504 12:25:22.297733 1 tasks_processing.go:74] worker 1 stopped. I0504 12:25:22.297937 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=978041385644cff809c68252f7a95539a7c4ee6b2880117dea0c6de63e775c1e I0504 12:25:22.298035 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=9f8aa8a5a80d9f0c80f311a4606ad735fd825c1b7482f3b8861805e4fcf68312 I0504 12:25:22.298065 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=197f3ecdb350af0178e7a918a359f46bc0a08847ea6e8bdd5398d88ed4cb5915 I0504 12:25:22.298093 1 gather_logs.go:145] no pods in namespace were found I0504 12:25:22.298097 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=75a6b5290673c896abb60bb0a0cf31f19233055b92c1014dda557302f012800a I0504 12:25:22.298166 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=832732676519d697e46df984de3d8d726bcc74a69dd91d8b89fd29c202e561c6 I0504 12:25:22.298197 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=eb2ba8b825280759d96f42f6a168b9ce59bbd0a2c6d0cfaad2296d9803c914e2 I0504 12:25:22.298220 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=90db89a1d6822f82e53d65bbca240be29cb39d9ae46beb749497795ba115a7e8 I0504 12:25:22.298252 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=cb9dac7ae01d4b9e014faf562fabbdec6f7cd23caf1e9995994a33903737b7bf I0504 12:25:22.298276 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=54aa94bad2fb59ca18a2f986ab77d38a537d92c1d0c1e1982e0f10dffe6c6992 I0504 12:25:22.298299 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=5088c5b0888d461f392b5105d22522268aee1ca2c7374e76451fc93254509492 I0504 12:25:22.298319 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=b3f44990bb7bb7d857d11a1c7ed1e9aff88dae65fcf8549c03313fb055abf179 I0504 12:25:22.298327 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 27.435419ms to process 11 records I0504 12:25:22.298333 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 25.8692ms to process 0 records I0504 12:25:22.298337 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 26.629575ms to process 0 records I0504 12:25:22.298341 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 26.087276ms to process 0 records I0504 12:25:22.298395 1 tasks_processing.go:74] worker 3 stopped. I0504 12:25:22.298405 1 tasks_processing.go:74] worker 49 stopped. I0504 12:25:22.298408 1 tasks_processing.go:74] worker 38 stopped. I0504 12:25:22.298476 1 tasks_processing.go:74] worker 42 stopped. I0504 12:25:22.298734 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=dd7a699d62dc231c0853fd62bfeea8a10dda3bd2639b1fc125713e86e0ba4ce7 I0504 12:25:22.298746 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 27.87846ms to process 1 records I0504 12:25:22.298756 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 26.170144ms to process 0 records I0504 12:25:22.298762 1 tasks_processing.go:74] worker 58 stopped. I0504 12:25:22.298772 1 tasks_processing.go:74] worker 37 stopped. I0504 12:25:22.298787 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 26.06204ms to process 0 records I0504 12:25:22.298849 1 tasks_processing.go:74] worker 29 stopped. I0504 12:25:22.298866 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 26.758171ms to process 0 records I0504 12:25:22.298955 1 tasks_processing.go:74] worker 59 stopped. I0504 12:25:22.298966 1 recorder.go:75] Recording config/ingress with fingerprint=d4af081d09d892f1a4668495477a97f6f4ce99484f55957fadfafafd9aa01b2a I0504 12:25:22.298974 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 28.778375ms to process 1 records I0504 12:25:22.298979 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 26.081882ms to process 0 records I0504 12:25:22.298984 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 26.170098ms to process 0 records I0504 12:25:22.298989 1 tasks_processing.go:74] worker 33 stopped. I0504 12:25:22.298993 1 tasks_processing.go:74] worker 57 stopped. I0504 12:25:22.300422 1 tasks_processing.go:74] worker 8 stopped. I0504 12:25:22.300503 1 recorder.go:75] Recording config/image with fingerprint=d8a42b05fa296fb00ef901022193b6d02515e4abf784dc282fca32d553bba382 I0504 12:25:22.300515 1 gather.go:177] gatherer "clusterconfig" function "image" took 27.532814ms to process 1 records I0504 12:25:22.301533 1 tasks_processing.go:74] worker 48 stopped. I0504 12:25:22.301590 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=61d6178166421a7d3e68c41660bc912025bfe887d5f96a7bf53083b7abc1d81b I0504 12:25:22.301600 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 28.999941ms to process 1 records I0504 12:25:22.301911 1 tasks_processing.go:74] worker 16 stopped. I0504 12:25:22.302042 1 recorder.go:75] Recording config/authentication with fingerprint=b1f95ff3208909e4fac52db2b35927c2c37889e25b940648b3aef5b3c74fd4d2 I0504 12:25:22.302052 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 29.265722ms to process 1 records I0504 12:25:22.303360 1 tasks_processing.go:74] worker 15 stopped. I0504 12:25:22.303996 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=26f77af747fba134233293dec5b503e2f27d5b1d45b895e3d251119f1dceaecb I0504 12:25:22.305157 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=fa8683f5519447ebfc28cf1067b50638e8b7d7da52309eac67bd393f17f3aead I0504 12:25:22.305237 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=803f4a11a597d715247cae2cae02c78185aedd29730b10de4568620743bc1e72 I0504 12:25:22.305306 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 31.065228ms to process 3 records I0504 12:25:22.306463 1 tasks_processing.go:74] worker 11 stopped. I0504 12:25:22.307993 1 recorder.go:75] Recording config/node/ip-10-0-0-234.ec2.internal with fingerprint=581be5cadac50ff9386ade2a2c32f7241756c7fa6be35a24c066257108ab247f I0504 12:25:22.308092 1 recorder.go:75] Recording config/node/ip-10-0-1-43.ec2.internal with fingerprint=1dea5f983eada94baa2a32d2dbc861ee720a4999651b3392788000b4d5a3984a I0504 12:25:22.308181 1 recorder.go:75] Recording config/node/ip-10-0-2-113.ec2.internal with fingerprint=60eedea4c8dd8b973b70d2b6e8159679f3ed11b66fcfd68133d7268ef060943f I0504 12:25:22.308195 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 35.448459ms to process 3 records I0504 12:25:22.308289 1 tasks_processing.go:74] worker 0 stopped. I0504 12:25:22.308444 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=fbdffc303d23422b11722ed87b88e18915344d517e5f4bf7a829eb7513dba6c6 I0504 12:25:22.308580 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=e30744502f90e9ca2c6c428db51c80e1dda1c50753e21fb335b9a8e2b5f176ec I0504 12:25:22.308594 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 36.097629ms to process 2 records I0504 12:25:22.308604 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 36.706769ms to process 0 records I0504 12:25:22.308619 1 tasks_processing.go:74] worker 22 stopped. I0504 12:25:22.308671 1 tasks_processing.go:74] worker 20 stopped. I0504 12:25:22.308944 1 recorder.go:75] Recording config/version with fingerprint=70a168861c7a0edeb7738958e7140f70b350567b1a11e75c49192af788d2da54 I0504 12:25:22.308956 1 recorder.go:75] Recording config/id with fingerprint=daa7182d36a7d5ea01494d5feb7fc7031d6a4b66a5ad56ddeb0dc1ac9f7db5aa I0504 12:25:22.308963 1 gather.go:177] gatherer "clusterconfig" function "version" took 36.026558ms to process 2 records I0504 12:25:22.308974 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0504 12:25:22.308979 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 36.803842ms to process 1 records I0504 12:25:22.308986 1 tasks_processing.go:74] worker 30 stopped. I0504 12:25:22.309960 1 tasks_processing.go:74] worker 27 stopped. I0504 12:25:22.309984 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 38.547522ms to process 0 records I0504 12:25:22.312093 1 tasks_processing.go:74] worker 26 stopped. I0504 12:25:22.312741 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=d7f706e27b25acbb90404619b3d9782d85190017cce837d1680658ad6ec133a4 I0504 12:25:22.312975 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=8443c3376c52442c7978d3ffc3ca3addc91ae7ab3c05bf133df4f342bcd6fa5c I0504 12:25:22.312985 1 gather.go:177] gatherer "clusterconfig" function "crds" took 40.077954ms to process 2 records I0504 12:25:22.313808 1 tasks_processing.go:74] worker 5 stopped. I0504 12:25:22.313828 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0504 12:25:22.313837 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 41.611824ms to process 1 records I0504 12:25:22.314274 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0504 12:25:22.314281 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0504 12:25:22.314399 1 operator.go:288] started I0504 12:25:22.314412 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0504 12:25:22.328728 1 tasks_processing.go:74] worker 7 stopped. I0504 12:25:22.328743 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 56.830519ms to process 0 records I0504 12:25:22.335126 1 tasks_processing.go:74] worker 54 stopped. I0504 12:25:22.335205 1 recorder.go:75] Recording config/running_containers with fingerprint=1e2ac6b78970fdf60aa780050877f0e9890b744ceba08c4dfd4cf166590a089a I0504 12:25:22.335221 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 63.781398ms to process 1 records E0504 12:25:22.337373 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%275e898114-0448-4380-814a-a8c33ef17158%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:54112->172.30.0.10:53: read: connection refused I0504 12:25:22.337386 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%275e898114-0448-4380-814a-a8c33ef17158%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:54112->172.30.0.10:53: read: connection refused I0504 12:25:22.337584 1 prometheus_rules.go:88] Prometheus rules successfully created I0504 12:25:22.339404 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0504 12:25:22.339475 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0504 12:25:22.339543 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0504 12:25:22.341763 1 controller.go:212] Source scaController *sca.Controller is not ready I0504 12:25:22.341773 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0504 12:25:22.341777 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0504 12:25:22.341779 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0504 12:25:22.341794 1 controller.go:489] The operator is still being initialized I0504 12:25:22.341800 1 controller.go:512] The operator is healthy I0504 12:25:22.343680 1 base_controller.go:82] Caches are synced for ConfigController I0504 12:25:22.343690 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0504 12:25:22.362302 1 configmapobserver.go:84] configmaps "insights-config" not found I0504 12:25:22.368361 1 tasks_processing.go:74] worker 6 stopped. E0504 12:25:22.368376 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0504 12:25:22.368384 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0504 12:25:22.368387 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0504 12:25:22.368396 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0504 12:25:22.368417 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0504 12:25:22.368424 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0504 12:25:22.368428 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0504 12:25:22.368432 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0504 12:25:22.368480 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0504 12:25:22.368488 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0504 12:25:22.368493 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 96.959461ms to process 7 records I0504 12:25:22.397667 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0504 12:25:22.401166 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:49272->172.30.0.10:53: read: connection refused I0504 12:25:22.401182 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:49272->172.30.0.10:53: read: connection refused I0504 12:25:22.415100 1 base_controller.go:82] Caches are synced for LoggingSyncer I0504 12:25:22.415112 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0504 12:25:22.417435 1 tasks_processing.go:74] worker 39 stopped. E0504 12:25:22.417447 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0504 12:25:22.417452 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q33rmgsatk3imnpgv7nsa0mkjlk72vl-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q33rmgsatk3imnpgv7nsa0mkjlk72vl-primary-cert-bundle-secret" not found I0504 12:25:22.417498 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=5d09e10cbdfc5c815be390478e3286ff8734958b4a12211a5a132ee118c71e98 I0504 12:25:22.417509 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 147.139688ms to process 1 records I0504 12:25:22.716438 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0504 12:25:22.716453 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0504 12:25:22.718003 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-b87sn pod in namespace openshift-dns (previous: false). I0504 12:25:22.984862 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-b87sn pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-b87sn\" is waiting to start: ContainerCreating" I0504 12:25:22.984881 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-b87sn\" is waiting to start: ContainerCreating" I0504 12:25:22.984889 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-b87sn pod in namespace openshift-dns (previous: false). I0504 12:25:23.121512 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-b87sn pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-b87sn\" is waiting to start: ContainerCreating" I0504 12:25:23.121530 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-b87sn\" is waiting to start: ContainerCreating" I0504 12:25:23.121542 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-pqxqj pod in namespace openshift-dns (previous: false). W0504 12:25:23.289987 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0504 12:25:23.344830 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-pqxqj pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-pqxqj\" is waiting to start: ContainerCreating" I0504 12:25:23.344846 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-pqxqj\" is waiting to start: ContainerCreating" I0504 12:25:23.344863 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-pqxqj pod in namespace openshift-dns (previous: false). I0504 12:25:23.522851 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-pqxqj pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-pqxqj\" is waiting to start: ContainerCreating" I0504 12:25:23.522865 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-pqxqj\" is waiting to start: ContainerCreating" I0504 12:25:23.522878 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-wnqv6 pod in namespace openshift-dns (previous: false). I0504 12:25:23.739713 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0504 12:25:23.757738 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-wnqv6 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-wnqv6\" is waiting to start: ContainerCreating" I0504 12:25:23.757751 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-wnqv6\" is waiting to start: ContainerCreating" I0504 12:25:23.757759 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-wnqv6 pod in namespace openshift-dns (previous: false). I0504 12:25:23.922380 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-wnqv6 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-wnqv6\" is waiting to start: ContainerCreating" I0504 12:25:23.922392 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-wnqv6\" is waiting to start: ContainerCreating" I0504 12:25:23.922401 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-j5h8t pod in namespace openshift-dns (previous: false). I0504 12:25:24.122137 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0504 12:25:24.122150 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-sg29q pod in namespace openshift-dns (previous: false). I0504 12:25:24.141420 1 tasks_processing.go:74] worker 13 stopped. I0504 12:25:24.141475 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=3eef5b5930308bf5388c8da19b42f6dbeea8e66d44f9613850d6b62e87c13b49 I0504 12:25:24.141513 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=020adf25291660af2c9784d3c6183c36fdd1e80a1679efe84acfa1698b604df3 I0504 12:25:24.141572 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0504 12:25:24.141600 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=e7e794052bc944d73f6c0544b279182a09420356d73da077bedd37df85145b45 I0504 12:25:24.141617 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0504 12:25:24.141640 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=d1065331ce7b5712dc6591fb9d6c26c9809e2eb06fe4ef4a8aa473a38f8909d8 I0504 12:25:24.141718 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=ad5971b4bf9c6ba0739031d35e23ec34a12f70ae2e04bf08845791ecf507ff38 I0504 12:25:24.141747 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=35647c70544c4cc62fa7f16184e581f3b3333d1eb0bc2eb0e1816ad175c6e86f I0504 12:25:24.141761 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=8ad548961c7d1f3acf5eea9f25cb8eedc407bade732d3be64c77e8c7914bdea4 I0504 12:25:24.141781 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=e6bdd9d256ba09382d488aad73492018a5910ff6a65e64a1a47ae0ff3ac06811 I0504 12:25:24.141790 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0504 12:25:24.141806 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=3ca50cb1f750c31609bcf0d1560366e4b0443b51f7e3cc281775fc91c230af04 I0504 12:25:24.141817 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0504 12:25:24.141834 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=b1d856d9d6cc3eeeb879af18f01ba561cfd5f5bca6c634cac9f48dbf4acfab6f I0504 12:25:24.141843 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0504 12:25:24.141855 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=1185940c00bd62e6ecc4bd861e65299bfdba14f2cd04775268b8e01abac76b84 I0504 12:25:24.141863 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0504 12:25:24.141878 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=0b5c42ca3bd69d224a9f584504be4803fd9bb76c1ac73f91172ca15a3bceb730 I0504 12:25:24.142001 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=f41635952e550416bcc57f25f91a68382cdd118c5b0546f33dbd9d1c2db2af78 I0504 12:25:24.142009 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0504 12:25:24.142017 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0504 12:25:24.142040 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0504 12:25:24.142062 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=783f4b5172fa279cd4f9539dac9a62ee085eff6fe53b4eab05bdac1c5281429c I0504 12:25:24.142085 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=de55b6a5a7bb68eb63d30a74838ce51c26d20750972834c302aac9172e7458d6 I0504 12:25:24.142094 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0504 12:25:24.142110 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=e1ae12ab5b1037d28806b49c8883e763366bb4eda81802dbde9030f6817e6d6d I0504 12:25:24.142119 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0504 12:25:24.142132 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=399a1d21db9529bb4653c54f886f54f1e702a80d40192ee0ed698473919f7ef2 I0504 12:25:24.142148 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=dd41f3cd2de00be2a4b8eb414494f42a5720acd2d4e626ebe31be869d46a1002 I0504 12:25:24.142165 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=672a5aff9693d736f42bcec999e6d533e138cd516ef0b80f7f4ab14ca6a0387f I0504 12:25:24.142181 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=2a3cbe8b4f89b8d257cd7629b5b693d81ba96ca8eb8c469f9cd4de1cfcde50bf I0504 12:25:24.142195 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=8aad3f884bc37ec45c394ce6809ba1413f66930066d7551cac88a2250ec9951a I0504 12:25:24.142225 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=a4d97e955603bb8f70c474480f0cda633199cd65cf1e736b0f90de967d808347 I0504 12:25:24.142240 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0504 12:25:24.142249 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0504 12:25:24.142255 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.87039219s to process 35 records W0504 12:25:24.289788 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0504 12:25:24.321844 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0504 12:25:24.321860 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-tnfxm pod in namespace openshift-dns (previous: false). I0504 12:25:24.520700 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0504 12:25:24.520716 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-55446fbdd-7kbht pod in namespace openshift-image-registry (previous: false). I0504 12:25:24.721495 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-55446fbdd-7kbht pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-55446fbdd-7kbht\" is waiting to start: ContainerCreating" I0504 12:25:24.721508 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-55446fbdd-7kbht\" is waiting to start: ContainerCreating" I0504 12:25:24.721517 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-55446fbdd-vfndx pod in namespace openshift-image-registry (previous: false). I0504 12:25:24.922145 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-55446fbdd-vfndx pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-55446fbdd-vfndx\" is waiting to start: ContainerCreating" I0504 12:25:24.922159 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-55446fbdd-vfndx\" is waiting to start: ContainerCreating" I0504 12:25:24.922173 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-664d6576d7-qp5w2 pod in namespace openshift-image-registry (previous: false). I0504 12:25:25.122446 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-664d6576d7-qp5w2 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-664d6576d7-qp5w2\" is waiting to start: ContainerCreating" I0504 12:25:25.122460 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-664d6576d7-qp5w2\" is waiting to start: ContainerCreating" I0504 12:25:25.122469 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-9tc89 pod in namespace openshift-image-registry (previous: false). W0504 12:25:25.290268 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0504 12:25:25.321354 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0504 12:25:25.321367 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-hlq66 pod in namespace openshift-image-registry (previous: false). I0504 12:25:25.522887 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0504 12:25:25.522901 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-nrkgf pod in namespace openshift-image-registry (previous: false). I0504 12:25:25.721531 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0504 12:25:25.721546 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5c4998748f-gbnk4 pod in namespace openshift-ingress (previous: false). I0504 12:25:25.922699 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5c4998748f-gbnk4 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5c4998748f-gbnk4\" is waiting to start: ContainerCreating" I0504 12:25:25.922713 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5c4998748f-gbnk4\" is waiting to start: ContainerCreating" I0504 12:25:25.922723 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7cb9f64d94-jdrzm pod in namespace openshift-ingress (previous: false). I0504 12:25:26.122281 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7cb9f64d94-jdrzm pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7cb9f64d94-jdrzm\" is waiting to start: ContainerCreating" I0504 12:25:26.122298 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7cb9f64d94-jdrzm\" is waiting to start: ContainerCreating" I0504 12:25:26.122307 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7cb9f64d94-sk5w4 pod in namespace openshift-ingress (previous: false). W0504 12:25:26.289985 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0504 12:25:26.322579 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7cb9f64d94-sk5w4 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7cb9f64d94-sk5w4\" is waiting to start: ContainerCreating" I0504 12:25:26.322592 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7cb9f64d94-sk5w4\" is waiting to start: ContainerCreating" I0504 12:25:26.322602 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-kgvvn pod in namespace openshift-ingress-canary (previous: false). I0504 12:25:26.522121 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-kgvvn pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-kgvvn\" is waiting to start: ContainerCreating" I0504 12:25:26.522134 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-kgvvn\" is waiting to start: ContainerCreating" I0504 12:25:26.522144 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-q8jqw pod in namespace openshift-ingress-canary (previous: false). I0504 12:25:26.720850 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-q8jqw pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-q8jqw\" is waiting to start: ContainerCreating" I0504 12:25:26.720864 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-q8jqw\" is waiting to start: ContainerCreating" I0504 12:25:26.720874 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-zmfjr pod in namespace openshift-ingress-canary (previous: false). I0504 12:25:26.926023 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-zmfjr pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-zmfjr\" is waiting to start: ContainerCreating" I0504 12:25:26.926036 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-zmfjr\" is waiting to start: ContainerCreating" I0504 12:25:26.926051 1 tasks_processing.go:74] worker 28 stopped. I0504 12:25:26.926125 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=b0d6d93bfff82bcdace84be10dc567edbc82b8bf71fca795b513a1b0bc90bdbc I0504 12:25:26.926176 1 recorder.go:75] Recording events/openshift-dns with fingerprint=4a0634335a558dd3b79796cca8044f628b47a55fe942ce457623b0d74fa42b76 I0504 12:25:26.926278 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=d4e2377621b5235d8584b8d0f843361eca2d64429cc660617cf61376e12378ab I0504 12:25:26.926305 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=04b86fd8a06531391ed8ae1e97b3993fea5cdf0aa8f1b46480c43f00ec8d32f7 I0504 12:25:26.926350 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=1a4d52f39ae47007f8c27a364be8a9aa61670ae151460d69d066d503820fc883 I0504 12:25:26.926366 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=c2a7bd80c86016057b9cee71f698acfb1482e1b3194b893fafcc586666c05251 I0504 12:25:26.926373 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.653643952s to process 6 records W0504 12:25:27.290930 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0504 12:25:27.290958 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0504 12:25:27.290978 1 tasks_processing.go:74] worker 51 stopped. E0504 12:25:27.290992 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0504 12:25:27.291003 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0504 12:25:27.291021 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0504 12:25:27.291032 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.020288532s to process 1 records I0504 12:25:34.714251 1 tasks_processing.go:74] worker 55 stopped. I0504 12:25:34.714286 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0504 12:25:34.714299 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.4420785s to process 1 records I0504 12:25:35.492592 1 tasks_processing.go:74] worker 12 stopped. I0504 12:25:35.492903 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=6f02bbed9776fbc53f719d04062abe458034f9ac95b2963e439b1381b6c8e3c4 I0504 12:25:35.492921 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.222491711s to process 1 records E0504 12:25:35.492978 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.223s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0504 12:25:35.494077 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0504 12:25:35.494092 1 periodic.go:209] Running workloads gatherer I0504 12:25:35.494110 1 tasks_processing.go:45] number of workers: 2 I0504 12:25:35.494119 1 tasks_processing.go:69] worker 1 listening for tasks. I0504 12:25:35.494124 1 tasks_processing.go:71] worker 1 working on workload_info task. I0504 12:25:35.494132 1 tasks_processing.go:69] worker 0 listening for tasks. I0504 12:25:35.494150 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0504 12:25:35.530593 1 configmapobserver.go:84] configmaps "insights-config" not found I0504 12:25:35.546506 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0504 12:25:35.560608 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (15ms) I0504 12:25:35.572337 1 tasks_processing.go:74] worker 0 stopped. I0504 12:25:35.572351 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 78.157067ms to process 0 records I0504 12:25:35.582252 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (22ms) I0504 12:25:35.604279 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (22ms) I0504 12:25:35.630304 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (26ms) I0504 12:25:35.650081 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (20ms) I0504 12:25:35.671278 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (21ms) I0504 12:25:35.689837 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (19ms) I0504 12:25:35.700717 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (11ms) I0504 12:25:35.712501 1 gather_workloads_info.go:387] No image sha256:1d9034b8dddb11d606bdcb5fa3c5d8c681941a64c07efb00e7f0f1ec71de1f9f (12ms) I0504 12:25:35.725732 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (13ms) I0504 12:25:35.735363 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (10ms) I0504 12:25:35.759893 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (25ms) I0504 12:25:35.857794 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (98ms) I0504 12:25:35.959312 1 gather_workloads_info.go:387] No image sha256:84a344c64bf6b1cf2227dbc98e3d80cb7e5b11022be8b1b5aeadac3591f70a6c (102ms) I0504 12:25:36.057094 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (98ms) I0504 12:25:36.164430 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (107ms) I0504 12:25:36.264123 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (100ms) I0504 12:25:36.355846 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (92ms) I0504 12:25:36.455401 1 gather_workloads_info.go:387] No image sha256:295fdda3bdb8bc5a12a5b038d087001f9e37481cf6f1b3a6d80d39dfabe17af9 (100ms) I0504 12:25:36.556211 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (101ms) I0504 12:25:36.655576 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (99ms) I0504 12:25:36.755242 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms) I0504 12:25:36.855746 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0504 12:25:36.955203 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (99ms) I0504 12:25:37.055961 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (101ms) I0504 12:25:37.154742 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (99ms) I0504 12:25:37.256348 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (102ms) I0504 12:25:37.355584 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (99ms) I0504 12:25:37.456155 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (101ms) I0504 12:25:37.555826 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (100ms) I0504 12:25:37.621373 1 configmapobserver.go:84] configmaps "insights-config" not found I0504 12:25:37.655403 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0504 12:25:37.754832 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (99ms) I0504 12:25:37.823134 1 configmapobserver.go:84] configmaps "insights-config" not found I0504 12:25:37.855327 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms) I0504 12:25:37.956740 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (101ms) I0504 12:25:38.054773 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (98ms) I0504 12:25:38.054799 1 tasks_processing.go:74] worker 1 stopped. E0504 12:25:38.054810 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0504 12:25:38.055050 1 recorder.go:75] Recording config/workload_info with fingerprint=2732ae7972a1eac242cc520de6faa581ba0f997f9944b4f73da62b64fd23bca4 I0504 12:25:38.055063 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.560668796s to process 1 records E0504 12:25:38.055086 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.56s with: function \"workload_info\" failed with an error" I0504 12:25:38.056187 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0504 12:25:38.056199 1 periodic.go:209] Running conditional gatherer I0504 12:25:38.061962 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0504 12:25:38.069575 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.10:37646->172.30.0.10:53: read: connection refused E0504 12:25:38.069849 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0504 12:25:38.069904 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0504 12:25:38.076671 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0504 12:25:38.076683 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 12:25:38.076688 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 12:25:38.076691 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 12:25:38.076695 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 12:25:38.076698 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 12:25:38.076701 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 12:25:38.076704 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 12:25:38.076707 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0504 12:25:38.076710 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0504 12:25:38.076724 1 tasks_processing.go:45] number of workers: 3 I0504 12:25:38.076735 1 tasks_processing.go:69] worker 2 listening for tasks. I0504 12:25:38.076739 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0504 12:25:38.076747 1 tasks_processing.go:69] worker 0 listening for tasks. I0504 12:25:38.076764 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0504 12:25:38.076760 1 tasks_processing.go:69] worker 1 listening for tasks. I0504 12:25:38.076773 1 tasks_processing.go:74] worker 1 stopped. I0504 12:25:38.076773 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0504 12:25:38.076813 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0504 12:25:38.076825 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 863ns to process 1 records I0504 12:25:38.076853 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0504 12:25:38.076860 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.044µs to process 1 records I0504 12:25:38.076866 1 tasks_processing.go:74] worker 0 stopped. I0504 12:25:38.076999 1 tasks_processing.go:74] worker 2 stopped. I0504 12:25:38.077011 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 214.437µs to process 0 records I0504 12:25:38.077029 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.10:37646->172.30.0.10:53: read: connection refused I0504 12:25:38.077046 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0504 12:25:38.102222 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=123c91b3d9efc7ca8009c5aefb19fbbe3b6ec87ff0b6016fa9005ae27b11d71c I0504 12:25:38.102362 1 diskrecorder.go:70] Writing 99 records to /var/lib/insights-operator/insights-2026-05-04-122538.tar.gz I0504 12:25:38.108049 1 diskrecorder.go:51] Wrote 99 records to disk in 5ms I0504 12:25:38.108074 1 periodic.go:278] Gathering cluster info every 2h0m0s I0504 12:25:38.108088 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0504 12:25:47.873764 1 configmapobserver.go:84] configmaps "insights-config" not found I0504 12:26:36.932718 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="146329442d5d26ca28a89a5e072839d7cd93946761a87c6053118a8de10c2279") W0504 12:26:36.932752 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.key was created I0504 12:26:36.932831 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="d74c4187619664859aa14b84bd8f083ccf3d508202b1014ca3611fa41e2b7e05") I0504 12:26:36.932847 1 base_controller.go:181] Shutting down ConfigController ... I0504 12:26:36.932872 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0504 12:26:36.932876 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="11afe64c390898b6863f36d24e477730aed2d5dc68cf5947bd4ed7908c241d78") I0504 12:26:36.932881 1 base_controller.go:113] All ConfigController workers have been terminated I0504 12:26:36.932875 1 base_controller.go:181] Shutting down LoggingSyncer ... I0504 12:26:36.932878 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0504 12:26:36.932901 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0504 12:26:36.932922 1 periodic.go:170] Shutting down