W0408 02:39:20.978572 1 cmd.go:257] Using insecure, self-signed certificates I0408 02:39:21.400386 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0408 02:39:21.400683 1 observer_polling.go:159] Starting file observer I0408 02:39:21.881153 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0408 02:39:21.881351 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0408 02:39:21.881904 1 secure_serving.go:57] Forcing use of http/1.1 only W0408 02:39:21.881931 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0408 02:39:21.881936 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0408 02:39:21.881941 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. I0408 02:39:21.881936 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0408 02:39:21.881945 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0408 02:39:21.881960 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0408 02:39:21.881964 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0408 02:39:21.884903 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0408 02:39:21.884932 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"2d378905-4d13-404e-8451-f957185b52d6", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0408 02:39:21.887618 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0408 02:39:21.887633 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0408 02:39:21.887635 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0408 02:39:21.887648 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0408 02:39:21.887653 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0408 02:39:21.887640 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0408 02:39:21.887969 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3774878194/tls.crt::/tmp/serving-cert-3774878194/tls.key" I0408 02:39:21.888332 1 secure_serving.go:213] Serving securely on [::]:8443 I0408 02:39:21.888350 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0408 02:39:21.906852 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0408 02:39:21.906873 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0408 02:39:21.906981 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0408 02:39:21.912833 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0408 02:39:21.912850 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0408 02:39:21.917406 1 secretconfigobserver.go:119] support secret does not exist I0408 02:39:21.922107 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0408 02:39:21.926280 1 secretconfigobserver.go:119] support secret does not exist I0408 02:39:21.929315 1 recorder.go:176] Pruning old reports every 7h14m29s, max age is 288h0m0s I0408 02:39:21.935128 1 periodic.go:216] Running clusterconfig gatherer I0408 02:39:21.935140 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0408 02:39:21.935159 1 insightsreport.go:296] Starting report retriever I0408 02:39:21.935225 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0408 02:39:21.935519 1 tasks_processing.go:45] number of workers: 64 I0408 02:39:21.935584 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0408 02:39:21.935614 1 tasks_processing.go:69] worker 0 listening for tasks. I0408 02:39:21.935630 1 tasks_processing.go:69] worker 3 listening for tasks. I0408 02:39:21.935636 1 tasks_processing.go:69] worker 1 listening for tasks. I0408 02:39:21.935642 1 tasks_processing.go:69] worker 2 listening for tasks. I0408 02:39:21.935632 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0408 02:39:21.935643 1 tasks_processing.go:69] worker 6 listening for tasks. I0408 02:39:21.935630 1 tasks_processing.go:69] worker 5 listening for tasks. I0408 02:39:21.935651 1 tasks_processing.go:69] worker 4 listening for tasks. I0408 02:39:21.935684 1 tasks_processing.go:69] worker 8 listening for tasks. I0408 02:39:21.935702 1 tasks_processing.go:69] worker 7 listening for tasks. I0408 02:39:21.935729 1 tasks_processing.go:69] worker 15 listening for tasks. I0408 02:39:21.935753 1 tasks_processing.go:69] worker 11 listening for tasks. I0408 02:39:21.935752 1 tasks_processing.go:69] worker 12 listening for tasks. I0408 02:39:21.935742 1 tasks_processing.go:69] worker 10 listening for tasks. I0408 02:39:21.935739 1 tasks_processing.go:69] worker 14 listening for tasks. I0408 02:39:21.935762 1 tasks_processing.go:69] worker 17 listening for tasks. I0408 02:39:21.935769 1 tasks_processing.go:69] worker 20 listening for tasks. I0408 02:39:21.935765 1 tasks_processing.go:69] worker 16 listening for tasks. I0408 02:39:21.935753 1 tasks_processing.go:69] worker 13 listening for tasks. I0408 02:39:21.935762 1 tasks_processing.go:69] worker 9 listening for tasks. I0408 02:39:21.935778 1 tasks_processing.go:69] worker 26 listening for tasks. I0408 02:39:21.935779 1 tasks_processing.go:69] worker 23 listening for tasks. I0408 02:39:21.935788 1 tasks_processing.go:69] worker 24 listening for tasks. I0408 02:39:21.935786 1 tasks_processing.go:69] worker 21 listening for tasks. I0408 02:39:21.935799 1 tasks_processing.go:69] worker 28 listening for tasks. I0408 02:39:21.935805 1 tasks_processing.go:69] worker 25 listening for tasks. I0408 02:39:21.935812 1 tasks_processing.go:69] worker 31 listening for tasks. I0408 02:39:21.935814 1 tasks_processing.go:69] worker 27 listening for tasks. I0408 02:39:21.935818 1 tasks_processing.go:69] worker 32 listening for tasks. I0408 02:39:21.935814 1 tasks_processing.go:71] worker 28 working on mutating_webhook_configurations task. I0408 02:39:21.935817 1 tasks_processing.go:69] worker 29 listening for tasks. I0408 02:39:21.935836 1 tasks_processing.go:69] worker 46 listening for tasks. I0408 02:39:21.935838 1 tasks_processing.go:71] worker 31 working on container_runtime_configs task. I0408 02:39:21.936256 1 tasks_processing.go:69] worker 38 listening for tasks. I0408 02:39:21.936251 1 tasks_processing.go:69] worker 45 listening for tasks. I0408 02:39:21.936266 1 tasks_processing.go:71] worker 11 working on ceph_cluster task. I0408 02:39:21.936267 1 tasks_processing.go:69] worker 54 listening for tasks. I0408 02:39:21.936273 1 tasks_processing.go:71] worker 45 working on operators_pods_and_events task. I0408 02:39:21.936278 1 tasks_processing.go:69] worker 56 listening for tasks. I0408 02:39:21.936287 1 tasks_processing.go:71] worker 56 working on image_registries task. I0408 02:39:21.936294 1 tasks_processing.go:69] worker 40 listening for tasks. I0408 02:39:21.936295 1 tasks_processing.go:71] worker 20 working on storage_cluster task. I0408 02:39:21.936295 1 tasks_processing.go:69] worker 43 listening for tasks. I0408 02:39:21.936286 1 tasks_processing.go:69] worker 39 listening for tasks. I0408 02:39:21.936309 1 tasks_processing.go:69] worker 44 listening for tasks. I0408 02:39:21.936312 1 tasks_processing.go:71] worker 17 working on openstack_dataplanedeployments task. I0408 02:39:21.936319 1 tasks_processing.go:69] worker 55 listening for tasks. I0408 02:39:21.936317 1 tasks_processing.go:69] worker 42 listening for tasks. I0408 02:39:21.936324 1 tasks_processing.go:71] worker 44 working on overlapping_namespace_uids task. I0408 02:39:21.936329 1 tasks_processing.go:71] worker 16 working on cost_management_metrics_configs task. I0408 02:39:21.936338 1 tasks_processing.go:71] worker 43 working on service_accounts task. I0408 02:39:21.936336 1 tasks_processing.go:71] worker 42 working on openstack_version task. I0408 02:39:21.936346 1 tasks_processing.go:71] worker 13 working on sap_pods task. I0408 02:39:21.936366 1 tasks_processing.go:71] worker 26 working on lokistack task. I0408 02:39:21.935845 1 tasks_processing.go:71] worker 29 working on machines task. I0408 02:39:21.936422 1 tasks_processing.go:71] worker 23 working on node_logs task. I0408 02:39:21.935814 1 tasks_processing.go:71] worker 25 working on active_alerts task. W0408 02:39:21.936495 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0408 02:39:21.936256 1 tasks_processing.go:71] worker 4 working on container_images task. I0408 02:39:21.936513 1 tasks_processing.go:71] worker 25 working on image_pruners task. I0408 02:39:21.935804 1 tasks_processing.go:71] worker 21 working on machine_config_pools task. I0408 02:39:21.936272 1 tasks_processing.go:69] worker 41 listening for tasks. I0408 02:39:21.936267 1 tasks_processing.go:71] worker 38 working on openshift_logging task. I0408 02:39:21.935824 1 tasks_processing.go:71] worker 27 working on ingress_certificates task. I0408 02:39:21.935826 1 tasks_processing.go:69] worker 58 listening for tasks. I0408 02:39:21.936750 1 tasks_processing.go:71] worker 58 working on sap_config task. I0408 02:39:21.936211 1 tasks_processing.go:69] worker 47 listening for tasks. I0408 02:39:21.936215 1 tasks_processing.go:69] worker 60 listening for tasks. I0408 02:39:21.936220 1 tasks_processing.go:69] worker 48 listening for tasks. I0408 02:39:21.936223 1 tasks_processing.go:69] worker 61 listening for tasks. I0408 02:39:21.936228 1 tasks_processing.go:69] worker 62 listening for tasks. I0408 02:39:21.936225 1 tasks_processing.go:69] worker 33 listening for tasks. I0408 02:39:21.936230 1 tasks_processing.go:69] worker 49 listening for tasks. I0408 02:39:21.936233 1 tasks_processing.go:69] worker 63 listening for tasks. I0408 02:39:21.936234 1 tasks_processing.go:69] worker 34 listening for tasks. I0408 02:39:21.936236 1 tasks_processing.go:71] worker 0 working on certificate_signing_requests task. I0408 02:39:21.936232 1 tasks_processing.go:69] worker 30 listening for tasks. I0408 02:39:21.936894 1 tasks_processing.go:71] worker 48 working on feature_gates task. I0408 02:39:21.936893 1 tasks_processing.go:71] worker 47 working on machine_configs task. I0408 02:39:21.936899 1 tasks_processing.go:71] worker 49 working on monitoring_persistent_volumes task. I0408 02:39:21.936238 1 tasks_processing.go:69] worker 50 listening for tasks. I0408 02:39:21.936929 1 tasks_processing.go:71] worker 50 working on openstack_controlplanes task. I0408 02:39:21.936239 1 tasks_processing.go:69] worker 35 listening for tasks. I0408 02:39:21.936238 1 tasks_processing.go:69] worker 19 listening for tasks. I0408 02:39:21.936243 1 tasks_processing.go:71] worker 3 working on dvo_metrics task. I0408 02:39:21.936241 1 tasks_processing.go:71] worker 46 working on silenced_alerts task. W0408 02:39:21.937010 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0408 02:39:21.936245 1 tasks_processing.go:69] worker 36 listening for tasks. I0408 02:39:21.936246 1 tasks_processing.go:71] worker 1 working on ingress task. I0408 02:39:21.937074 1 tasks_processing.go:71] worker 36 working on cluster_apiserver task. I0408 02:39:21.937080 1 tasks_processing.go:71] worker 35 working on sap_datahubs task. I0408 02:39:21.937106 1 tasks_processing.go:71] worker 19 working on jaegers task. I0408 02:39:21.936246 1 tasks_processing.go:69] worker 51 listening for tasks. I0408 02:39:21.937163 1 tasks_processing.go:71] worker 51 working on validating_webhook_configurations task. I0408 02:39:21.936249 1 tasks_processing.go:71] worker 2 working on metrics task. W0408 02:39:21.937214 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0408 02:39:21.936250 1 tasks_processing.go:69] worker 37 listening for tasks. I0408 02:39:21.936251 1 tasks_processing.go:71] worker 6 working on openshift_machine_api_events task. I0408 02:39:21.936252 1 tasks_processing.go:69] worker 18 listening for tasks. I0408 02:39:21.936242 1 tasks_processing.go:69] worker 59 listening for tasks. I0408 02:39:21.936247 1 tasks_processing.go:69] worker 22 listening for tasks. I0408 02:39:21.936254 1 tasks_processing.go:71] worker 5 working on qemu_kubevirt_launcher_logs task. I0408 02:39:21.936253 1 tasks_processing.go:69] worker 52 listening for tasks. I0408 02:39:21.937298 1 tasks_processing.go:71] worker 18 working on aggregated_monitoring_cr_names task. I0408 02:39:21.937301 1 tasks_processing.go:71] worker 52 working on storage_classes task. I0408 02:39:21.936259 1 tasks_processing.go:71] worker 8 working on nodes task. I0408 02:39:21.937307 1 tasks_processing.go:71] worker 59 working on machine_sets task. I0408 02:39:21.937308 1 tasks_processing.go:71] worker 37 working on infrastructures task. I0408 02:39:21.937302 1 tasks_processing.go:71] worker 22 working on pdbs task. I0408 02:39:21.936261 1 tasks_processing.go:71] worker 7 working on tsdb_status task. W0408 02:39:21.937390 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0408 02:39:21.936264 1 tasks_processing.go:71] worker 15 working on olm_operators task. I0408 02:39:21.936280 1 tasks_processing.go:71] worker 54 working on proxies task. I0408 02:39:21.936288 1 tasks_processing.go:69] worker 57 listening for tasks. I0408 02:39:21.937541 1 tasks_processing.go:71] worker 57 working on networks task. I0408 02:39:21.936299 1 tasks_processing.go:71] worker 12 working on config_maps task. I0408 02:39:21.936304 1 tasks_processing.go:71] worker 10 working on nodenetworkconfigurationpolicies task. I0408 02:39:21.936308 1 tasks_processing.go:71] worker 14 working on clusterroles task. I0408 02:39:21.936323 1 tasks_processing.go:71] worker 9 working on image task. I0408 02:39:21.936327 1 tasks_processing.go:71] worker 55 working on operators task. I0408 02:39:21.936328 1 tasks_processing.go:71] worker 40 working on version task. I0408 02:39:21.936574 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 31.935µs to process 0 records I0408 02:39:21.936618 1 tasks_processing.go:71] worker 39 working on machine_healthchecks task. I0408 02:39:21.937786 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 37.513µs to process 0 records I0408 02:39:21.937797 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 36.119µs to process 0 records I0408 02:39:21.937800 1 tasks_processing.go:71] worker 46 working on authentication task. I0408 02:39:21.937806 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 28.08µs to process 0 records I0408 02:39:21.936625 1 tasks_processing.go:71] worker 41 working on machine_autoscalers task. I0408 02:39:21.937871 1 tasks_processing.go:71] worker 7 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0408 02:39:21.937875 1 tasks_processing.go:74] worker 2 stopped. I0408 02:39:21.935826 1 tasks_processing.go:71] worker 32 working on schedulers task. I0408 02:39:21.935801 1 tasks_processing.go:71] worker 24 working on oauths task. I0408 02:39:21.936885 1 tasks_processing.go:71] worker 34 working on crds task. I0408 02:39:21.936887 1 tasks_processing.go:71] worker 61 working on node_features task. I0408 02:39:21.936890 1 tasks_processing.go:71] worker 62 working on support_secret task. I0408 02:39:21.936894 1 tasks_processing.go:71] worker 33 working on install_plans task. I0408 02:39:21.936889 1 tasks_processing.go:71] worker 60 working on nodenetworkstates task. I0408 02:39:21.936902 1 tasks_processing.go:71] worker 30 working on openstack_dataplanenodesets task. I0408 02:39:21.936898 1 tasks_processing.go:71] worker 63 working on pod_network_connectivity_checks task. I0408 02:39:21.936261 1 tasks_processing.go:69] worker 53 listening for tasks. I0408 02:39:21.938331 1 tasks_processing.go:74] worker 53 stopped. I0408 02:39:21.940838 1 tasks_processing.go:74] worker 17 stopped. I0408 02:39:21.940851 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 4.513703ms to process 0 records I0408 02:39:21.940858 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 4.575135ms to process 0 records I0408 02:39:21.940862 1 tasks_processing.go:74] worker 11 stopped. I0408 02:39:21.940985 1 tasks_processing.go:74] worker 16 stopped. I0408 02:39:21.941001 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 4.639677ms to process 0 records I0408 02:39:21.941013 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 4.639587ms to process 0 records I0408 02:39:21.941018 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 4.695015ms to process 0 records I0408 02:39:21.941023 1 tasks_processing.go:74] worker 20 stopped. I0408 02:39:21.941027 1 tasks_processing.go:74] worker 42 stopped. I0408 02:39:21.941072 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0408 02:39:21.941092 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0408 02:39:21.941102 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0408 02:39:21.941103 1 tasks_processing.go:74] worker 29 stopped. I0408 02:39:21.941106 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready E0408 02:39:21.941112 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0408 02:39:21.941123 1 gather.go:177] gatherer "clusterconfig" function "machines" took 4.670788ms to process 0 records I0408 02:39:21.941126 1 controller.go:531] The operator is still being initialized I0408 02:39:21.941138 1 controller.go:554] The operator is healthy I0408 02:39:21.944673 1 tasks_processing.go:74] worker 38 stopped. I0408 02:39:21.944682 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 8.028958ms to process 0 records I0408 02:39:21.944689 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 8.300132ms to process 0 records I0408 02:39:21.944694 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 8.431168ms to process 0 records I0408 02:39:21.944698 1 tasks_processing.go:74] worker 31 stopped. I0408 02:39:21.944702 1 tasks_processing.go:74] worker 26 stopped. I0408 02:39:21.947553 1 tasks_processing.go:74] worker 13 stopped. I0408 02:39:21.947561 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 11.193051ms to process 0 records I0408 02:39:21.949506 1 tasks_processing.go:74] worker 58 stopped. I0408 02:39:21.949518 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 12.744887ms to process 0 records I0408 02:39:21.951656 1 tasks_processing.go:74] worker 21 stopped. I0408 02:39:21.951669 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 15.132586ms to process 0 records I0408 02:39:21.951683 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 14.542858ms to process 0 records I0408 02:39:21.951688 1 tasks_processing.go:74] worker 19 stopped. I0408 02:39:21.951991 1 tasks_processing.go:74] worker 25 stopped. I0408 02:39:21.952249 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=8d98c923f5876f60e5d9affdf4cd62be69dfeb2d7dae6def924956fa8459cc0e I0408 02:39:21.952267 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 15.470344ms to process 1 records I0408 02:39:21.952276 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 14.957385ms to process 0 records I0408 02:39:21.952282 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 15.119412ms to process 0 records I0408 02:39:21.952285 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 14.853434ms to process 0 records I0408 02:39:21.952290 1 tasks_processing.go:74] worker 59 stopped. I0408 02:39:21.952291 1 tasks_processing.go:74] worker 35 stopped. I0408 02:39:21.952294 1 tasks_processing.go:74] worker 50 stopped. I0408 02:39:21.952337 1 tasks_processing.go:74] worker 23 stopped. I0408 02:39:21.952353 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 15.908048ms to process 0 records I0408 02:39:21.953030 1 tasks_processing.go:74] worker 1 stopped. I0408 02:39:21.953469 1 recorder.go:75] Recording config/ingress with fingerprint=f1c131f6e9e23ef559c7d3c112534b36549cf40cff60fd0f33099ab6acafb8f7 I0408 02:39:21.953547 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 15.993719ms to process 1 records I0408 02:39:21.953666 1 tasks_processing.go:74] worker 36 stopped. I0408 02:39:21.953889 1 recorder.go:75] Recording config/apiserver with fingerprint=b640c2568fc0fdf534270602c0ec299e957fca3bac6fde83b3ea220d9296d207 I0408 02:39:21.953975 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 16.358172ms to process 1 records I0408 02:39:21.954452 1 tasks_processing.go:74] worker 10 stopped. I0408 02:39:21.954472 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 16.818608ms to process 0 records I0408 02:39:21.954822 1 tasks_processing.go:74] worker 48 stopped. I0408 02:39:21.954940 1 recorder.go:75] Recording config/featuregate with fingerprint=f55f64d68d3ba7a93d57537498e22ce29b447480ba460b97d261d7b36ff13c63 I0408 02:39:21.954955 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 17.910583ms to process 1 records I0408 02:39:21.955111 1 tasks_processing.go:74] worker 44 stopped. I0408 02:39:21.955139 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0408 02:39:21.955149 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 18.765081ms to process 1 records I0408 02:39:21.960535 1 tasks_processing.go:74] worker 41 stopped. I0408 02:39:21.960549 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 22.668447ms to process 0 records E0408 02:39:21.965873 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0408 02:39:21.965886 1 tasks_processing.go:74] worker 61 stopped. I0408 02:39:21.965894 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 27.826394ms to process 0 records I0408 02:39:21.965929 1 tasks_processing.go:74] worker 37 stopped. I0408 02:39:21.966432 1 recorder.go:75] Recording config/infrastructure with fingerprint=52fa7b664d64cb1db09789363a65e3d3061f8c741f4c710f1b47c6f26328fadd I0408 02:39:21.966449 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 28.602932ms to process 1 records E0408 02:39:21.966456 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0408 02:39:21.966462 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 28.200172ms to process 0 records I0408 02:39:21.966482 1 gather_logs.go:145] no pods in namespace were found I0408 02:39:21.966485 1 tasks_processing.go:74] worker 39 stopped. I0408 02:39:21.966559 1 tasks_processing.go:74] worker 46 stopped. I0408 02:39:21.966587 1 recorder.go:75] Recording config/authentication with fingerprint=699adbf668eb619594e365d67e27e93cf962532dfa34458e004b9c0197288883 I0408 02:39:21.966596 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 28.189145ms to process 1 records I0408 02:39:21.966693 1 recorder.go:75] Recording config/network with fingerprint=f1bef75d4d0b3391c6a4a9e3027797110ecf287bb35060daae6bc473fc7253e8 I0408 02:39:21.966699 1 gather.go:177] gatherer "clusterconfig" function "networks" took 28.649201ms to process 1 records I0408 02:39:21.966738 1 tasks_processing.go:74] worker 57 stopped. I0408 02:39:21.966757 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=2c581f00b1519e73a44ffd4fbcba0e47c075da25fa9991c294f346b5e6537181 I0408 02:39:21.966766 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 28.327719ms to process 1 records I0408 02:39:21.966814 1 tasks_processing.go:74] worker 32 stopped. I0408 02:39:21.966819 1 tasks_processing.go:74] worker 52 stopped. I0408 02:39:21.966814 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=51be9d6fb17ad176b51ad5ab6c3171da0315a4a91379fbc2d8b151e2feeb62d0 I0408 02:39:21.966849 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=de799ed9175f860f572597463ba589423662deff83a1bad28df6105fbd9f8a63 I0408 02:39:21.966859 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 29.075822ms to process 2 records I0408 02:39:21.966865 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 29.227543ms to process 0 records I0408 02:39:21.966883 1 tasks_processing.go:74] worker 5 stopped. I0408 02:39:21.966956 1 tasks_processing.go:74] worker 56 stopped. I0408 02:39:21.967179 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=c078c0141ffdb4b5b50c76fe8c3500178a00e1e898e098c057b103e9fb6ea5a4 I0408 02:39:21.967190 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 30.220836ms to process 1 records I0408 02:39:21.967245 1 recorder.go:75] Recording config/image with fingerprint=7531fe8a3cba5f32f478dda2c11cb34a0ab68cac93039eda439652953f55121f I0408 02:39:21.967254 1 gather.go:177] gatherer "clusterconfig" function "image" took 29.002151ms to process 1 records I0408 02:39:21.967286 1 tasks_processing.go:74] worker 9 stopped. I0408 02:39:21.967292 1 recorder.go:75] Recording config/proxy with fingerprint=c6615c614eab809e54175217b6d2ac7ecb69efc5a29a44ccd52f08e07196d279 I0408 02:39:21.967296 1 tasks_processing.go:74] worker 54 stopped. I0408 02:39:21.967305 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 29.222601ms to process 1 records I0408 02:39:21.967313 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 28.595107ms to process 0 records I0408 02:39:21.967350 1 tasks_processing.go:74] worker 60 stopped. I0408 02:39:21.967412 1 tasks_processing.go:74] worker 24 stopped. I0408 02:39:21.967509 1 recorder.go:75] Recording config/oauth with fingerprint=251314b2228c00888f42acf9804b04a78e565334a360bdd8fdcd61ab7967ad96 I0408 02:39:21.967526 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 29.033277ms to process 1 records I0408 02:39:21.967550 1 tasks_processing.go:74] worker 63 stopped. E0408 02:39:21.967558 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0408 02:39:21.967565 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 29.235984ms to process 0 records I0408 02:39:21.967787 1 tasks_processing.go:74] worker 30 stopped. I0408 02:39:21.967803 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 29.552723ms to process 0 records I0408 02:39:21.967953 1 tasks_processing.go:74] worker 8 stopped. I0408 02:39:21.968207 1 recorder.go:75] Recording config/node/ip-10-0-0-11.ec2.internal with fingerprint=410f0bcb5bd053869add5a9d3a8a802c87da39662fcd6086cf4c0cd4dac5a420 I0408 02:39:21.968264 1 recorder.go:75] Recording config/node/ip-10-0-1-44.ec2.internal with fingerprint=557825925bac5a6e3136d35c52e01163725b7afdc4c9f32b50dfb49ec37d0255 I0408 02:39:21.968443 1 recorder.go:75] Recording config/node/ip-10-0-2-217.ec2.internal with fingerprint=2e23ab8fb1f283724b3ecb04bc303c839f0ce8338ec3e26da55ed06f2851eb23 I0408 02:39:21.968462 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 30.636594ms to process 3 records E0408 02:39:21.968476 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0408 02:39:21.968482 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 29.959547ms to process 0 records I0408 02:39:21.968488 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 30.945067ms to process 0 records E0408 02:39:21.968493 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0408 02:39:21.968521 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0408 02:39:21.968536 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 31.278193ms to process 1 records I0408 02:39:21.968549 1 tasks_processing.go:74] worker 47 stopped. I0408 02:39:21.968572 1 tasks_processing.go:74] worker 6 stopped. I0408 02:39:21.968602 1 tasks_processing.go:74] worker 49 stopped. I0408 02:39:21.968621 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 31.685662ms to process 0 records I0408 02:39:21.968650 1 tasks_processing.go:74] worker 62 stopped. I0408 02:39:21.968665 1 tasks_processing.go:74] worker 22 stopped. I0408 02:39:21.968948 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=b488a5cb90274d9d777ae664053a75549d21f3078dd4b3cc59ee4f3fb794ae0a I0408 02:39:21.968989 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=2aa8a1a9ac7ef4a1aac4a0909bddbc292bbefe2ef0a6ebba15ffd19c0e7ae59b I0408 02:39:21.969023 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=52fc6d8e3a59f7d38a31b8aa7ba537bd9d73ddacd7eaf36ed42e8ac05f7a4a5b I0408 02:39:21.969039 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 31.270355ms to process 3 records I0408 02:39:21.969398 1 tasks_processing.go:74] worker 28 stopped. I0408 02:39:21.969698 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=a004f99184f0b1a81ca865aa5649c50e774d2dc9f65f236fd9b63435895fc141 I0408 02:39:21.969769 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=dfa69c8edb6d4a016fac07d9e14df61e193f8b3e45303f3746681ce05e29a399 I0408 02:39:21.969817 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=91a36c115f365bdb0b4192cb0a344cae4541ee6bf353f4d4e2334cb25b8c7ab6 I0408 02:39:21.969869 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 33.569864ms to process 3 records I0408 02:39:21.971528 1 tasks_processing.go:74] worker 51 stopped. I0408 02:39:21.971704 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=9eed6f9840cbc7f771370e6d122e78f5be7bc7427be8a039aabc7e5975342763 I0408 02:39:21.971863 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=f32ad63e0cf31e19756cd96d0ab4d7378e177087d565e41bfa99d2e9f8799e57 I0408 02:39:21.971897 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=6ee9d0c50ac1dc59ca9b8fdba6c1f871010b83fea3c37a79acb28b5662254a31 I0408 02:39:21.971937 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=e4583a3221b1b1585e04fe850cd9148285eaef96d64d7c09691752b8ed7dfa41 I0408 02:39:21.971985 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=b4396d9e88e676fe5e52f71c35f5fe99cb4c1a83782c210c8510b9554ddd3ee7 I0408 02:39:21.972026 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=a7bdbeb7734d1d1d271aa1b241fe160c9b3141419073183606e4c993a877fe4f I0408 02:39:21.972065 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=8eb8e360771ca6e225750b9cdd84b725c2fb243907026882491d96db4feab1e3 I0408 02:39:21.972118 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=db9b0b7bfe7b69b67cf254d98f2626996d1fc7a0f3a084cb6f55c24750d0c17a I0408 02:39:21.972157 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=974a9994d8724928ebbc731cb5f7f898a1a4add48b617461544139f89c74117a I0408 02:39:21.972196 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=dd815398000c20a868a43d78d5049fd09aeed5a036135ea9d3845ffca6d77b88 I0408 02:39:21.972235 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=a090608227e4610f7b3e2c03fc4e7bc2190c91bc01321ac5a4827c20cc53b93e I0408 02:39:21.972247 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 34.345755ms to process 11 records I0408 02:39:21.972263 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 34.912111ms to process 0 records I0408 02:39:21.972275 1 tasks_processing.go:74] worker 0 stopped. W0408 02:39:21.974141 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0408 02:39:21.980830 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0408 02:39:21.980847 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0408 02:39:21.980904 1 tasks_processing.go:74] worker 34 stopped. W0408 02:39:21.980911 1 operator.go:328] started I0408 02:39:21.980921 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0408 02:39:21.982209 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=0d20039e1ec3a6d6d2b5e0964685a1d84792066ee7b176eee99ab05450291b85 I0408 02:39:21.982902 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=23c952e49610a5cc80b467b930707993b29843cf913b9188bd08b2a9b19ebe3a I0408 02:39:21.982924 1 gather.go:177] gatherer "clusterconfig" function "crds" took 42.855712ms to process 2 records I0408 02:39:21.982939 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 44.310128ms to process 0 records I0408 02:39:21.982991 1 recorder.go:75] Recording config/olm_operators with fingerprint=8d88d63c133bd76ee1a4b1eefedaded9cf8977cc87d06ceb3397a79a956dedfe I0408 02:39:21.983004 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 44.192761ms to process 1 records I0408 02:39:21.983012 1 tasks_processing.go:74] worker 15 stopped. I0408 02:39:21.983015 1 tasks_processing.go:74] worker 18 stopped. I0408 02:39:21.986492 1 tasks_processing.go:74] worker 14 stopped. I0408 02:39:21.986658 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=f0fc1eea8f1f556b8e49e0f7ce560dd9fee2b85d4311cfd8e176e6eb12c506b4 I0408 02:39:21.986761 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=c9892bf61aaf272644bfc723265588f7ae85bd59e28f06833a7ffb0730a415be I0408 02:39:21.986770 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 48.826326ms to process 2 records I0408 02:39:21.987867 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0408 02:39:21.987987 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0408 02:39:21.988062 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0408 02:39:21.989320 1 tasks_processing.go:74] worker 4 stopped. I0408 02:39:21.989706 1 recorder.go:75] Recording config/running_containers with fingerprint=57607779788bab7c33b7f44ffedac55b8a1716ae86aab9cf84a4ac6e53e0731f I0408 02:39:21.989746 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 52.79855ms to process 1 records I0408 02:39:21.989820 1 tasks_processing.go:74] worker 7 stopped. I0408 02:39:21.989828 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 51.940137ms to process 0 records I0408 02:39:22.004250 1 prometheus_rules.go:88] Prometheus rules successfully created I0408 02:39:22.007109 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0408 02:39:22.007117 1 base_controller.go:82] Caches are synced for ConfigController I0408 02:39:22.007122 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0408 02:39:22.007128 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0408 02:39:22.007130 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0408 02:39:22.007135 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0408 02:39:22.007140 1 controller.go:254] Source scaController *sca.Controller is not ready I0408 02:39:22.007160 1 controller.go:531] The operator is still being initialized I0408 02:39:22.007166 1 controller.go:554] The operator is healthy I0408 02:39:22.012048 1 configmapobserver.go:84] configmaps "insights-config" not found E0408 02:39:22.013909 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2743124df1-27dd-4bdf-8c94-c6a512c55f9e%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:44688->172.30.0.10:53: read: connection refused I0408 02:39:22.013923 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2743124df1-27dd-4bdf-8c94-c6a512c55f9e%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:44688->172.30.0.10:53: read: connection refused I0408 02:39:22.015557 1 tasks_processing.go:74] worker 12 stopped. E0408 02:39:22.015569 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0408 02:39:22.015575 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0408 02:39:22.015579 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0408 02:39:22.015587 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=d6cdef0bc443452d8c3614a2b80a95b81c762e2cc791eba8d6dc6c490fe443be I0408 02:39:22.015619 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0408 02:39:22.015626 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0408 02:39:22.015631 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=38de253d99fc91c21ec0830eaa3643933091a8a87ea8e88c8c639b11fcb856c6 I0408 02:39:22.015635 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0408 02:39:22.015672 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0408 02:39:22.015679 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0408 02:39:22.015685 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 77.97444ms to process 7 records I0408 02:39:22.049575 1 tasks_processing.go:74] worker 40 stopped. I0408 02:39:22.049817 1 recorder.go:75] Recording config/version with fingerprint=2bf2f3a6cb2071dae294ea537cdabae44b6bdd8e5424f8cb18aab29a6918d476 I0408 02:39:22.049834 1 recorder.go:75] Recording config/id with fingerprint=838c7a5a6e36347086b6eecc2d6d739c28fbf40e895c3d433e849a481f30cb7a I0408 02:39:22.049843 1 gather.go:177] gatherer "clusterconfig" function "version" took 111.817291ms to process 2 records I0408 02:39:22.062357 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0408 02:39:22.065848 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:36782->172.30.0.10:53: read: connection refused I0408 02:39:22.065861 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:36782->172.30.0.10:53: read: connection refused I0408 02:39:22.077538 1 tasks_processing.go:74] worker 27 stopped. E0408 02:39:22.077558 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0408 02:39:22.077568 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2phms2giigvfvsds2o6sgo9pgqaup61d-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2phms2giigvfvsds2o6sgo9pgqaup61d-primary-cert-bundle-secret" not found I0408 02:39:22.077656 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=188db2a655738c3eff0bf2793e42185f5b32f080611a56418a859445de01870f I0408 02:39:22.077668 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 140.857709ms to process 1 records I0408 02:39:22.081545 1 base_controller.go:82] Caches are synced for LoggingSyncer I0408 02:39:22.081557 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0408 02:39:22.363082 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0408 02:39:22.363099 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0408 02:39:22.363861 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-88c4k pod in namespace openshift-dns (previous: false). I0408 02:39:22.594382 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-88c4k pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-88c4k\" is waiting to start: ContainerCreating" I0408 02:39:22.594400 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-88c4k\" is waiting to start: ContainerCreating" I0408 02:39:22.594407 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-88c4k pod in namespace openshift-dns (previous: false). I0408 02:39:22.776017 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-88c4k pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-88c4k\" is waiting to start: ContainerCreating" I0408 02:39:22.776034 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-88c4k\" is waiting to start: ContainerCreating" I0408 02:39:22.776047 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-bqttj pod in namespace openshift-dns (previous: false). W0408 02:39:22.972209 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0408 02:39:22.987126 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bqttj pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-bqttj\" is waiting to start: ContainerCreating" I0408 02:39:22.987139 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-bqttj\" is waiting to start: ContainerCreating" I0408 02:39:22.987150 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-bqttj pod in namespace openshift-dns (previous: false). I0408 02:39:23.167579 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bqttj pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-bqttj\" is waiting to start: ContainerCreating" I0408 02:39:23.167595 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-bqttj\" is waiting to start: ContainerCreating" I0408 02:39:23.167609 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-jqwn7 pod in namespace openshift-dns (previous: false). I0408 02:39:23.397080 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0408 02:39:23.419915 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jqwn7 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-jqwn7\" is waiting to start: ContainerCreating" I0408 02:39:23.419929 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-jqwn7\" is waiting to start: ContainerCreating" I0408 02:39:23.419936 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-jqwn7 pod in namespace openshift-dns (previous: false). I0408 02:39:23.570401 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jqwn7 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-jqwn7\" is waiting to start: ContainerCreating" I0408 02:39:23.570415 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-jqwn7\" is waiting to start: ContainerCreating" I0408 02:39:23.570424 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-2mrsq pod in namespace openshift-dns (previous: false). I0408 02:39:23.767734 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0408 02:39:23.767751 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-5dh7m pod in namespace openshift-dns (previous: false). I0408 02:39:23.801824 1 tasks_processing.go:74] worker 55 stopped. I0408 02:39:23.801901 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=f4c5827629996ee138a695881300236b4fdf5e11ff13db9719f809a5a829b624 I0408 02:39:23.801964 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=ef2317ccaf5e69ac4a624b6799a2f7c4c53846ebbff20f953a4ca8d0e6768aae I0408 02:39:23.802001 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0408 02:39:23.802039 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=13726a014e877df93dd4d1891ec0f2c52b40de61f0e509e678d310e934578506 I0408 02:39:23.802059 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0408 02:39:23.802105 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=10722eb1dd89494a937951c0097061850fdb7e111af4ad3dcaf9b7ef1ca89161 I0408 02:39:23.802142 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=3cdbc93d4fdf18eb52eab64d8ac24df9fa7304f65eed78fdd4eb43136964f2da I0408 02:39:23.802169 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=66dc048f9d2deb7ad73c8183690d3542b2c5e5d610e4a49a159cf39171dd3983 I0408 02:39:23.802193 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=f2fc3c4267b2e8d8ccb90fe7b41b2ec6ab07fe5a01507279b0529dca8b8eda22 I0408 02:39:23.802215 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=04f8b1dff1a4379420b0f375726de7b6d4db8d93d25976733ada3a311b93a0a0 I0408 02:39:23.802226 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0408 02:39:23.802243 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=abf1cb4dab3cb9553392e864ff82e68ccd6323feba815a9730c5cc2ec02908c9 I0408 02:39:23.802255 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0408 02:39:23.802280 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=00e082a023d3b58276b7a935eb21c26e60f4f5ff46e87f54d5c0688fad67403e I0408 02:39:23.802292 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0408 02:39:23.802305 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=776c21ce6fd425a755bd66068a7e8aff5fe79ff42b8c826f4b1312fbda929eb2 I0408 02:39:23.802313 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0408 02:39:23.802366 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=1090a77e2b39dbc9248b1b14711a582a5394e7529ca4152668ac76b3d7da29ff I0408 02:39:23.802511 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=36a43d5c48f826eed9dbd1e6d7e9a1ddf1c64fd870b4de9572ca52bbdfab1f0e I0408 02:39:23.802526 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0408 02:39:23.802535 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0408 02:39:23.802558 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0408 02:39:23.802584 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=b784833d2106b5c4050d5aeb7498c74879208a5eb0a35aedb0c4e923c52c8053 I0408 02:39:23.802616 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=3be747d31f9b68b88ca960a48a5dc02f09678df5f815f0852f93b55792682bbe I0408 02:39:23.802643 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0408 02:39:23.802663 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=09cdd149b86904afba8bfabec64a4070bfc94e4224baa4a2e0eff872dcc0e944 I0408 02:39:23.802678 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0408 02:39:23.802695 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=a4ef57f9fc7037e6dbc2c9c8c5975ef71c1f114ab62755f1ffd644625976a6c9 I0408 02:39:23.802730 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=de625101532248d442ff97960b0370fa846d6beb18a2f1ac2c6630df702d4b73 I0408 02:39:23.802745 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=8b6161985cf307fccf6072bcebd5e5538e26c10f6128dbc86eb5ae78bec1221c I0408 02:39:23.802769 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=46446d3dbeab9e50b1cc90371c5ba494dcd12edc00fc08a3fa2204a8546face5 I0408 02:39:23.802786 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=e049cef7d7bd3eb27127b005c7887e739e1c82f27a3562f5f0c004156f764461 I0408 02:39:23.802811 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=c0e9b214eb2b527f0a78ba61a7fbbc1a8ad51ede0f1c40e91b72d7e3cbe82545 I0408 02:39:23.802828 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0408 02:39:23.802842 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0408 02:39:23.802853 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.864106001s to process 35 records I0408 02:39:23.967588 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0408 02:39:23.967606 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-xtnxn pod in namespace openshift-dns (previous: false). W0408 02:39:23.971945 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0408 02:39:24.169297 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0408 02:39:24.169349 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-594bcfd95d-7krct pod in namespace openshift-image-registry (previous: false). I0408 02:39:24.369478 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-594bcfd95d-7krct pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-594bcfd95d-7krct\" is waiting to start: ContainerCreating" I0408 02:39:24.369493 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-594bcfd95d-7krct\" is waiting to start: ContainerCreating" I0408 02:39:24.369542 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-594bcfd95d-p7wtr pod in namespace openshift-image-registry (previous: false). I0408 02:39:24.572783 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-594bcfd95d-p7wtr pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-594bcfd95d-p7wtr\" is waiting to start: ContainerCreating" I0408 02:39:24.572799 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-594bcfd95d-p7wtr\" is waiting to start: ContainerCreating" I0408 02:39:24.572835 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7876796689-s4vvt pod in namespace openshift-image-registry (previous: false). I0408 02:39:24.772551 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7876796689-s4vvt pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7876796689-s4vvt\" is waiting to start: ContainerCreating" I0408 02:39:24.772569 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7876796689-s4vvt\" is waiting to start: ContainerCreating" I0408 02:39:24.772578 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-2jssg pod in namespace openshift-image-registry (previous: false). I0408 02:39:24.969733 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0408 02:39:24.969748 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-hqw9x pod in namespace openshift-image-registry (previous: false). W0408 02:39:24.972475 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0408 02:39:25.169567 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0408 02:39:25.169581 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-kl8xp pod in namespace openshift-image-registry (previous: false). I0408 02:39:25.368742 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0408 02:39:25.368757 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-587ff98f7b-zgxm5 pod in namespace openshift-ingress (previous: false). I0408 02:39:25.567770 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-587ff98f7b-zgxm5 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-587ff98f7b-zgxm5\" is waiting to start: ContainerCreating" I0408 02:39:25.567784 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-587ff98f7b-zgxm5\" is waiting to start: ContainerCreating" I0408 02:39:25.567795 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-75b5c65956-dvpwk pod in namespace openshift-ingress (previous: false). I0408 02:39:25.767464 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-75b5c65956-dvpwk pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-75b5c65956-dvpwk\" is waiting to start: ContainerCreating" I0408 02:39:25.767478 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-75b5c65956-dvpwk\" is waiting to start: ContainerCreating" I0408 02:39:25.767488 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-75b5c65956-hvzxh pod in namespace openshift-ingress (previous: false). I0408 02:39:25.968470 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-75b5c65956-hvzxh pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-75b5c65956-hvzxh\" is waiting to start: ContainerCreating" I0408 02:39:25.968486 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-75b5c65956-hvzxh\" is waiting to start: ContainerCreating" I0408 02:39:25.968498 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5ktld pod in namespace openshift-ingress-canary (previous: false). W0408 02:39:25.972948 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0408 02:39:26.171534 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-tc49x pod in namespace openshift-ingress-canary (previous: false). I0408 02:39:26.367558 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-tgkxz pod in namespace openshift-ingress-canary (previous: false). I0408 02:39:26.569166 1 tasks_processing.go:74] worker 45 stopped. I0408 02:39:26.569283 1 recorder.go:75] Recording events/openshift-dns with fingerprint=040df2767b27ed9a083517f2cb43a368114f039399b8ade87f1c8612f3596347 I0408 02:39:26.569377 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=49815c06aba343f06e0c5bf7e31522e01b75117fccafa870084aeb5642dddd8f I0408 02:39:26.569406 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=98916ef221a3f55473d346856ae9168b4fb68cb8bfe482818acb35280fa61ed7 I0408 02:39:26.569454 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=86e649c2f913fb9d7a7798331163e413198fdeff6e31a7e0494815ce93d0eba6 I0408 02:39:26.569491 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=75c717ce1b278906f78a95d4c14d6c86d61cc39090b21584118a3f2e301d6161 I0408 02:39:26.570855 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-594bcfd95d-7krct with fingerprint=83aa545b539f9a29845f241311470abaf3ad08fae499fe06e22ba5cb10ba46f8 I0408 02:39:26.570972 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-594bcfd95d-p7wtr with fingerprint=d7785fb436b9bb32c48752f185fc4115289bc92423fe4275353f9fcca49adc4f I0408 02:39:26.571062 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7876796689-s4vvt with fingerprint=ee474debfe46612f5e5a30e9d2ff8f2cc9463e4e7de3c701da7680ffc22893fb I0408 02:39:26.571070 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-5ktld/serve-healthcheck-canary_current.log with fingerprint=0c51c17597d78715891053af4bd761171805eed2271449ce86d2db21ecf1e82c I0408 02:39:26.571075 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-tc49x/serve-healthcheck-canary_current.log with fingerprint=3193c00742c89af33d5ddb8f8ac60f2e70ea3a42661e158c6c184debfc720a56 I0408 02:39:26.571080 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-tgkxz/serve-healthcheck-canary_current.log with fingerprint=697298ae8fcd94c53ac04c9b4b1f5314c748e166db6abb32f99c92ae5576a473 I0408 02:39:26.571086 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.632876377s to process 11 records W0408 02:39:26.969472 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0408 02:39:26.969494 1 tasks_processing.go:74] worker 3 stopped. E0408 02:39:26.969512 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0408 02:39:26.969529 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0408 02:39:26.969545 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0408 02:39:26.969558 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.03252948s to process 1 records I0408 02:39:34.378144 1 tasks_processing.go:74] worker 33 stopped. I0408 02:39:34.378190 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0408 02:39:34.378206 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.440009114s to process 1 records I0408 02:39:34.948681 1 configmapobserver.go:84] configmaps "insights-config" not found I0408 02:39:35.154534 1 tasks_processing.go:74] worker 43 stopped. I0408 02:39:35.154823 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=4ce39b12c057291c1cbb2425e1f57ef4a8cb96c61f6227345caf83b89c351d65 I0408 02:39:35.154841 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.218178042s to process 1 records E0408 02:39:35.154909 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.219s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0408 02:39:35.156008 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0408 02:39:35.156025 1 periodic.go:216] Running workloads gatherer I0408 02:39:35.156043 1 tasks_processing.go:45] number of workers: 2 I0408 02:39:35.156052 1 tasks_processing.go:69] worker 1 listening for tasks. I0408 02:39:35.156058 1 tasks_processing.go:71] worker 1 working on workload_info task. I0408 02:39:35.156059 1 tasks_processing.go:69] worker 0 listening for tasks. I0408 02:39:35.156136 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0408 02:39:35.182850 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0408 02:39:35.186345 1 tasks_processing.go:74] worker 0 stopped. I0408 02:39:35.186360 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 30.189567ms to process 0 records I0408 02:39:35.191975 1 gather_workloads_info.go:387] No image sha256:5e7db48dd4a7ff84ca21a35498799f35a001334e74e8a66bbd11244daab6d533 (10ms) I0408 02:39:35.200935 1 gather_workloads_info.go:387] No image sha256:88be57daafab16ef117d2aa5dac938da96665b55319dcf01d0f2edc023c728b6 (9ms) I0408 02:39:35.210095 1 gather_workloads_info.go:387] No image sha256:d7767202aecccd0af8251c5d40e16a93d2d6867ef7ab7f31314266cc5404dbba (9ms) I0408 02:39:35.218615 1 gather_workloads_info.go:387] No image sha256:2ce799af9d720d44b8bcf3eb5a0d27219b3bdab944d2ea12eb36e5f5f400e001 (8ms) I0408 02:39:35.226803 1 gather_workloads_info.go:387] No image sha256:17f7dc8737ce5e65f3bd9647c71537357250a2eaa1feef6621cc4ffb0ccc1994 (8ms) I0408 02:39:35.234886 1 gather_workloads_info.go:387] No image sha256:dced609167193c2d9555bb0599ab7e406e0f5287809fa300eb927feaeabf5712 (8ms) I0408 02:39:35.243914 1 gather_workloads_info.go:387] No image sha256:0277b18d2c5c3b367751a8f18edaa69717d74b1b61eea20a31ddf43b0c06aeac (9ms) I0408 02:39:35.252385 1 gather_workloads_info.go:387] No image sha256:d54782e70dfc06f37e62e165fc257270bab0cb9ebde517449e237e99d50ebc66 (8ms) I0408 02:39:35.260595 1 gather_workloads_info.go:387] No image sha256:5084d257ac981d93acba8f5c6b61cdfca2087d1c144ba278e2ce549ad9f0651a (8ms) I0408 02:39:35.269243 1 gather_workloads_info.go:387] No image sha256:9df8b58d8a1909593488b3388adce14fbe1275bde2b73ba9290aad53e8d16460 (9ms) I0408 02:39:35.292537 1 gather_workloads_info.go:387] No image sha256:26a2580cdf01df7e6430eac9b36bbfe79e5223ec14d2a4dfe61a6e075c21832c (23ms) I0408 02:39:35.392353 1 gather_workloads_info.go:387] No image sha256:437f1b1ab57ee9db467c2d04133da4f0ac96b8ac33ab501536e6450368bc9a82 (100ms) I0408 02:39:35.500037 1 gather_workloads_info.go:387] No image sha256:418fc884217cf60159ae406316322e717308ebf70cc87d4f7cd8409d2f4487ff (108ms) I0408 02:39:35.592262 1 gather_workloads_info.go:387] No image sha256:f13b59866d3c28fafc1b74c1915af5872b97af6ee9caeed6db4ef0b813b6759b (92ms) I0408 02:39:35.691869 1 gather_workloads_info.go:387] No image sha256:49cbd2fe2f0fffdbf57623172b044a444ad219dad2b77997060d28ff6ebe2e22 (100ms) I0408 02:39:35.792540 1 gather_workloads_info.go:387] No image sha256:0f8dbfb8a31773a05e84a98aa16bf781424c21fa0706b6864b175d490176732a (101ms) I0408 02:39:35.893523 1 gather_workloads_info.go:387] No image sha256:0cbbf132a30f0d4015b8a3998cfc628705b4250c68385d842a2fbedd977338aa (101ms) I0408 02:39:35.991961 1 gather_workloads_info.go:387] No image sha256:2573000c2cdc8025b95a355005633ad6e63548eda496705626ae574181ae958f (98ms) I0408 02:39:36.093524 1 gather_workloads_info.go:387] No image sha256:067fd85a0ea0622338fee711e142545ec5af90675680ff03a8510f91b009c3c8 (102ms) I0408 02:39:36.193363 1 gather_workloads_info.go:387] No image sha256:fdf562bb59edeec873134a63787552617cf0ed949fc9193455393035f0f6d5a2 (100ms) I0408 02:39:36.292066 1 gather_workloads_info.go:387] No image sha256:0c00070db090265c8efb666505fb6ebcde93da427961e5a00d2fab3fb3668868 (99ms) I0408 02:39:36.391838 1 gather_workloads_info.go:387] No image sha256:619578ee4bc5fe42dc3fd908b03e0adce028318231d8aa3fd0542f09fd728ac2 (100ms) I0408 02:39:36.492214 1 gather_workloads_info.go:387] No image sha256:658016cc7c947fda5f092fd8caece619163d22b3b6b508b11e527b9bb2a0057f (100ms) I0408 02:39:36.591743 1 gather_workloads_info.go:387] No image sha256:6e9a97136562e4cbba3ef92f2f0d21ceb80e49db7051395994d726c23d41ec8e (100ms) I0408 02:39:36.706668 1 gather_workloads_info.go:387] No image sha256:47049c087e791c86ad7f4bb21562a9b01565dfcbe374674016d27e23d8bb9c9e (115ms) I0408 02:39:36.804458 1 gather_workloads_info.go:387] No image sha256:2740036c4476448a58a6382e366fc11ab6de358cf7fdbc3eca9d130947d1eb12 (98ms) I0408 02:39:36.893293 1 gather_workloads_info.go:387] No image sha256:32c74f9352fbba501782cd251f73df8c35ea891fed7b8f1f23c12560dc1d85b6 (89ms) I0408 02:39:36.995420 1 gather_workloads_info.go:387] No image sha256:200e66ede804ee5d9eedd6a5b13385ac0d1066bd127420aeef19c58d44c3e124 (102ms) I0408 02:39:37.092062 1 gather_workloads_info.go:387] No image sha256:255c506fb0b20a8afbd64f138e5cf0c695dfd039594560d91087647527e9501f (97ms) I0408 02:39:37.191632 1 gather_workloads_info.go:387] No image sha256:9014ddff98f9ac806dc8c6ffa0f2c6b7e8ae0ec816c9596f4604c909c2c43794 (100ms) I0408 02:39:37.293140 1 gather_workloads_info.go:387] No image sha256:02874ef814fc7ac6a608fba34b4659f3c9694b29841e6e4376706665817e2532 (101ms) I0408 02:39:37.391821 1 gather_workloads_info.go:387] No image sha256:80bb716e3db9615c2ee20bee50ba50d878be8af6b227879a9240e1cfbedd42c3 (99ms) I0408 02:39:37.491894 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms) I0408 02:39:37.491925 1 tasks_processing.go:74] worker 1 stopped. E0408 02:39:37.491936 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0408 02:39:37.492169 1 recorder.go:75] Recording config/workload_info with fingerprint=44e13096c3bc43dbe0b407501b5d5cd920acbe3af4b52fd222bfd3f8258a4838 I0408 02:39:37.492185 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.335857615s to process 1 records E0408 02:39:37.492211 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.336s with: function \"workload_info\" failed with an error" I0408 02:39:37.493315 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0408 02:39:37.493328 1 periodic.go:216] Running conditional gatherer I0408 02:39:37.504905 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.8/gathering_rules I0408 02:39:37.512019 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:41811->172.30.0.10:53: read: connection refused E0408 02:39:37.512319 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0408 02:39:37.512376 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0408 02:39:37.517633 1 conditional_gatherer.go:392] cluster version is '4.21.8' E0408 02:39:37.517645 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0408 02:39:37.517650 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0408 02:39:37.517653 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0408 02:39:37.517656 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0408 02:39:37.517659 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0408 02:39:37.517663 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0408 02:39:37.517666 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0408 02:39:37.517669 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0408 02:39:37.517672 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0408 02:39:37.517687 1 tasks_processing.go:45] number of workers: 3 I0408 02:39:37.517702 1 tasks_processing.go:69] worker 2 listening for tasks. I0408 02:39:37.517707 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0408 02:39:37.517710 1 tasks_processing.go:69] worker 0 listening for tasks. I0408 02:39:37.517742 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0408 02:39:37.517741 1 tasks_processing.go:69] worker 1 listening for tasks. I0408 02:39:37.517756 1 tasks_processing.go:74] worker 1 stopped. I0408 02:39:37.517758 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0408 02:39:37.517809 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0408 02:39:37.517822 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.16µs to process 1 records I0408 02:39:37.517853 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0408 02:39:37.517861 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 931ns to process 1 records I0408 02:39:37.517867 1 tasks_processing.go:74] worker 0 stopped. I0408 02:39:37.518004 1 tasks_processing.go:74] worker 2 stopped. I0408 02:39:37.518028 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 233.787µs to process 0 records I0408 02:39:37.518074 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:41811->172.30.0.10:53: read: connection refused I0408 02:39:37.518095 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0408 02:39:37.549551 1 configmapobserver.go:84] configmaps "insights-config" not found I0408 02:39:37.550569 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=c2de1139a665a68d571c82581b2882b239eadbfa835e529cf74b1a10d904dc3d I0408 02:39:37.550681 1 diskrecorder.go:70] Writing 105 records to /var/lib/insights-operator/insights-2026-04-08-023937.tar.gz I0408 02:39:37.557188 1 diskrecorder.go:51] Wrote 105 records to disk in 6ms I0408 02:39:37.557215 1 periodic.go:285] Gathering cluster info every 2h0m0s I0408 02:39:37.557229 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0408 02:39:37.742918 1 configmapobserver.go:84] configmaps "insights-config" not found I0408 02:39:45.215979 1 configmapobserver.go:84] configmaps "insights-config" not found I0408 02:40:46.401373 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="5e3576c3838995f10963d84781751ae20f291eed2fd071c1ed58aee5e3dd3be8") W0408 02:40:46.401413 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0408 02:40:46.401475 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="f7fa20dc109e89754dd691579fd3ae1c50aaab3a07e8f8e0ad18ed6dfb65bfdd")