W0403 00:43:00.046875 1 cmd.go:257] Using insecure, self-signed certificates I0403 00:43:01.263537 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0403 00:43:01.263876 1 observer_polling.go:159] Starting file observer I0403 00:43:02.801728 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0403 00:43:02.801943 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0403 00:43:02.802482 1 secure_serving.go:57] Forcing use of http/1.1 only W0403 00:43:02.802505 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0403 00:43:02.802510 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0403 00:43:02.802514 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0403 00:43:02.802517 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0403 00:43:02.802521 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0403 00:43:02.802524 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0403 00:43:02.802568 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0403 00:43:02.806258 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0403 00:43:02.806287 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"0ca3aefc-c9a5-4b16-9034-e58522ccdc22", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0403 00:43:02.807857 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0403 00:43:02.807882 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0403 00:43:02.807899 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0403 00:43:02.807904 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0403 00:43:02.807883 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0403 00:43:02.807920 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0403 00:43:02.808128 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3841798814/tls.crt::/tmp/serving-cert-3841798814/tls.key" I0403 00:43:02.808391 1 secure_serving.go:213] Serving securely on [::]:8443 I0403 00:43:02.808420 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0403 00:43:02.814679 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0403 00:43:02.814705 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0403 00:43:02.814808 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0403 00:43:02.819537 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0403 00:43:02.819561 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0403 00:43:02.824187 1 secretconfigobserver.go:119] support secret does not exist I0403 00:43:02.828638 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0403 00:43:02.832374 1 secretconfigobserver.go:119] support secret does not exist I0403 00:43:02.835395 1 recorder.go:176] Pruning old reports every 4h23m38s, max age is 288h0m0s I0403 00:43:02.839931 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0403 00:43:02.839945 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0403 00:43:02.839957 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0403 00:43:02.839970 1 insightsreport.go:296] Starting report retriever I0403 00:43:02.839976 1 periodic.go:216] Running clusterconfig gatherer I0403 00:43:02.839978 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0403 00:43:02.840016 1 tasks_processing.go:45] number of workers: 64 I0403 00:43:02.840039 1 tasks_processing.go:69] worker 3 listening for tasks. I0403 00:43:02.840049 1 tasks_processing.go:69] worker 1 listening for tasks. I0403 00:43:02.840051 1 tasks_processing.go:69] worker 2 listening for tasks. I0403 00:43:02.840060 1 tasks_processing.go:69] worker 29 listening for tasks. I0403 00:43:02.840062 1 tasks_processing.go:69] worker 0 listening for tasks. I0403 00:43:02.840063 1 tasks_processing.go:71] worker 2 working on machine_sets task. I0403 00:43:02.840068 1 tasks_processing.go:69] worker 30 listening for tasks. I0403 00:43:02.840071 1 tasks_processing.go:69] worker 45 listening for tasks. I0403 00:43:02.840075 1 tasks_processing.go:71] worker 30 working on image_registries task. I0403 00:43:02.840078 1 tasks_processing.go:69] worker 16 listening for tasks. I0403 00:43:02.840100 1 tasks_processing.go:69] worker 46 listening for tasks. I0403 00:43:02.840097 1 tasks_processing.go:69] worker 17 listening for tasks. I0403 00:43:02.840105 1 tasks_processing.go:69] worker 24 listening for tasks. I0403 00:43:02.840109 1 tasks_processing.go:69] worker 4 listening for tasks. I0403 00:43:02.840113 1 tasks_processing.go:69] worker 47 listening for tasks. I0403 00:43:02.840116 1 tasks_processing.go:69] worker 25 listening for tasks. I0403 00:43:02.840115 1 tasks_processing.go:69] worker 23 listening for tasks. I0403 00:43:02.840124 1 tasks_processing.go:69] worker 26 listening for tasks. I0403 00:43:02.840124 1 tasks_processing.go:69] worker 56 listening for tasks. I0403 00:43:02.840119 1 tasks_processing.go:69] worker 5 listening for tasks. I0403 00:43:02.840136 1 tasks_processing.go:69] worker 27 listening for tasks. I0403 00:43:02.840137 1 tasks_processing.go:69] worker 20 listening for tasks. I0403 00:43:02.840141 1 tasks_processing.go:69] worker 22 listening for tasks. I0403 00:43:02.840147 1 tasks_processing.go:69] worker 8 listening for tasks. I0403 00:43:02.840128 1 tasks_processing.go:69] worker 58 listening for tasks. I0403 00:43:02.840062 1 tasks_processing.go:69] worker 44 listening for tasks. I0403 00:43:02.840155 1 tasks_processing.go:69] worker 54 listening for tasks. I0403 00:43:02.840154 1 tasks_processing.go:69] worker 51 listening for tasks. I0403 00:43:02.840163 1 tasks_processing.go:69] worker 12 listening for tasks. I0403 00:43:02.840164 1 tasks_processing.go:71] worker 3 working on config_maps task. I0403 00:43:02.840168 1 tasks_processing.go:71] worker 1 working on cost_management_metrics_configs task. I0403 00:43:02.840172 1 tasks_processing.go:69] worker 10 listening for tasks. I0403 00:43:02.840172 1 tasks_processing.go:69] worker 11 listening for tasks. I0403 00:43:02.840174 1 tasks_processing.go:69] worker 15 listening for tasks. I0403 00:43:02.840172 1 tasks_processing.go:69] worker 62 listening for tasks. I0403 00:43:02.840181 1 tasks_processing.go:69] worker 33 listening for tasks. I0403 00:43:02.840175 1 tasks_processing.go:69] worker 50 listening for tasks. I0403 00:43:02.840185 1 tasks_processing.go:69] worker 35 listening for tasks. I0403 00:43:02.840175 1 tasks_processing.go:69] worker 55 listening for tasks. I0403 00:43:02.840189 1 tasks_processing.go:69] worker 34 listening for tasks. I0403 00:43:02.840187 1 tasks_processing.go:69] worker 31 listening for tasks. I0403 00:43:02.840143 1 tasks_processing.go:69] worker 52 listening for tasks. I0403 00:43:02.840198 1 tasks_processing.go:69] worker 39 listening for tasks. I0403 00:43:02.840203 1 tasks_processing.go:69] worker 40 listening for tasks. I0403 00:43:02.840148 1 tasks_processing.go:69] worker 53 listening for tasks. I0403 00:43:02.840193 1 tasks_processing.go:69] worker 49 listening for tasks. I0403 00:43:02.840211 1 tasks_processing.go:71] worker 46 working on networks task. I0403 00:43:02.840211 1 tasks_processing.go:71] worker 45 working on active_alerts task. I0403 00:43:02.840215 1 tasks_processing.go:71] worker 53 working on silenced_alerts task. I0403 00:43:02.840219 1 tasks_processing.go:71] worker 49 working on support_secret task. I0403 00:43:02.840218 1 tasks_processing.go:71] worker 4 working on qemu_kubevirt_launcher_logs task. I0403 00:43:02.840225 1 tasks_processing.go:71] worker 56 working on ingress task. I0403 00:43:02.840230 1 tasks_processing.go:71] worker 22 working on machine_healthchecks task. I0403 00:43:02.840233 1 tasks_processing.go:71] worker 50 working on ingress_certificates task. W0403 00:43:02.840241 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory W0403 00:43:02.840250 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0403 00:43:02.840211 1 tasks_processing.go:71] worker 5 working on ceph_cluster task. I0403 00:43:02.840262 1 tasks_processing.go:71] worker 35 working on sap_datahubs task. I0403 00:43:02.840258 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 31.803µs to process 0 records I0403 00:43:02.840272 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 37.626µs to process 0 records I0403 00:43:02.840281 1 tasks_processing.go:71] worker 34 working on crds task. I0403 00:43:02.840067 1 tasks_processing.go:71] worker 29 working on certificate_signing_requests task. I0403 00:43:02.840606 1 tasks_processing.go:71] worker 24 working on node_features task. I0403 00:43:02.840693 1 tasks_processing.go:71] worker 12 working on schedulers task. I0403 00:43:02.840876 1 tasks_processing.go:71] worker 10 working on image_pruners task. I0403 00:43:02.840879 1 tasks_processing.go:71] worker 47 working on node_logs task. I0403 00:43:02.840899 1 tasks_processing.go:71] worker 17 working on sap_config task. I0403 00:43:02.841227 1 tasks_processing.go:71] worker 55 working on storage_cluster task. I0403 00:43:02.841240 1 tasks_processing.go:71] worker 52 working on service_accounts task. I0403 00:43:02.841245 1 tasks_processing.go:71] worker 11 working on machine_config_pools task. I0403 00:43:02.840225 1 tasks_processing.go:71] worker 20 working on machines task. I0403 00:43:02.840133 1 tasks_processing.go:69] worker 21 listening for tasks. I0403 00:43:02.841262 1 tasks_processing.go:71] worker 15 working on proxies task. I0403 00:43:02.841267 1 tasks_processing.go:71] worker 21 working on pod_network_connectivity_checks task. I0403 00:43:02.841294 1 tasks_processing.go:71] worker 58 working on nodenetworkstates task. I0403 00:43:02.840157 1 tasks_processing.go:69] worker 9 listening for tasks. I0403 00:43:02.841308 1 tasks_processing.go:71] worker 31 working on metrics task. I0403 00:43:02.841313 1 tasks_processing.go:71] worker 9 working on sap_pods task. I0403 00:43:02.840152 1 tasks_processing.go:69] worker 28 listening for tasks. I0403 00:43:02.840122 1 tasks_processing.go:69] worker 57 listening for tasks. I0403 00:43:02.841326 1 tasks_processing.go:71] worker 40 working on nodes task. I0403 00:43:02.841330 1 tasks_processing.go:71] worker 28 working on openstack_version task. I0403 00:43:02.841229 1 tasks_processing.go:71] worker 53 working on infrastructures task. I0403 00:43:02.841392 1 tasks_processing.go:71] worker 57 working on tsdb_status task. I0403 00:43:02.840158 1 tasks_processing.go:69] worker 61 listening for tasks. I0403 00:43:02.841404 1 tasks_processing.go:71] worker 61 working on aggregated_monitoring_cr_names task. I0403 00:43:02.840220 1 tasks_processing.go:71] worker 27 working on container_images task. I0403 00:43:02.840156 1 tasks_processing.go:69] worker 19 listening for tasks. I0403 00:43:02.840164 1 tasks_processing.go:69] worker 63 listening for tasks. I0403 00:43:02.840163 1 tasks_processing.go:69] worker 13 listening for tasks. I0403 00:43:02.840165 1 tasks_processing.go:69] worker 14 listening for tasks. I0403 00:43:02.840182 1 tasks_processing.go:69] worker 37 listening for tasks. I0403 00:43:02.840126 1 tasks_processing.go:69] worker 6 listening for tasks. I0403 00:43:02.840188 1 tasks_processing.go:69] worker 36 listening for tasks. I0403 00:43:02.840196 1 tasks_processing.go:69] worker 41 listening for tasks. I0403 00:43:02.840143 1 tasks_processing.go:69] worker 59 listening for tasks. I0403 00:43:02.840197 1 tasks_processing.go:69] worker 43 listening for tasks. I0403 00:43:02.840204 1 tasks_processing.go:69] worker 38 listening for tasks. I0403 00:43:02.840206 1 tasks_processing.go:71] worker 16 working on mutating_webhook_configurations task. I0403 00:43:02.840170 1 tasks_processing.go:69] worker 48 listening for tasks. I0403 00:43:02.840140 1 tasks_processing.go:69] worker 7 listening for tasks. I0403 00:43:02.840214 1 tasks_processing.go:71] worker 25 working on validating_webhook_configurations task. I0403 00:43:02.840216 1 tasks_processing.go:71] worker 23 working on dvo_metrics task. I0403 00:43:02.841501 1 tasks_processing.go:71] worker 7 working on storage_classes task. I0403 00:43:02.840214 1 tasks_processing.go:71] worker 51 working on oauths task. I0403 00:43:02.841535 1 tasks_processing.go:71] worker 41 working on operators_pods_and_events task. I0403 00:43:02.841539 1 tasks_processing.go:71] worker 37 working on monitoring_persistent_volumes task. I0403 00:43:02.841543 1 tasks_processing.go:71] worker 63 working on machine_configs task. I0403 00:43:02.841553 1 tasks_processing.go:71] worker 43 working on version task. I0403 00:43:02.840072 1 tasks_processing.go:71] worker 0 working on cluster_apiserver task. I0403 00:43:02.841570 1 tasks_processing.go:71] worker 39 working on clusterroles task. I0403 00:43:02.840221 1 tasks_processing.go:71] worker 26 working on openstack_dataplanedeployments task. I0403 00:43:02.841234 1 tasks_processing.go:71] worker 45 working on authentication task. I0403 00:43:02.841301 1 tasks_processing.go:71] worker 44 working on overlapping_namespace_uids task. I0403 00:43:02.842440 1 tasks_processing.go:71] worker 38 working on install_plans task. I0403 00:43:02.841537 1 tasks_processing.go:71] worker 13 working on feature_gates task. I0403 00:43:02.841536 1 tasks_processing.go:71] worker 14 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0403 00:43:02.840151 1 tasks_processing.go:69] worker 60 listening for tasks. I0403 00:43:02.841312 1 tasks_processing.go:71] worker 33 working on pdbs task. I0403 00:43:02.840205 1 tasks_processing.go:69] worker 42 listening for tasks. I0403 00:43:02.841321 1 tasks_processing.go:71] worker 8 working on openshift_machine_api_events task. I0403 00:43:02.840150 1 tasks_processing.go:69] worker 18 listening for tasks. I0403 00:43:02.841529 1 tasks_processing.go:71] worker 6 working on operators task. I0403 00:43:02.841533 1 tasks_processing.go:71] worker 19 working on lokistack task. I0403 00:43:02.840207 1 tasks_processing.go:69] worker 32 listening for tasks. I0403 00:43:02.842317 1 tasks_processing.go:71] worker 59 working on olm_operators task. I0403 00:43:02.841305 1 tasks_processing.go:71] worker 54 working on openshift_logging task. I0403 00:43:02.841306 1 tasks_processing.go:71] worker 62 working on nodenetworkconfigurationpolicies task. I0403 00:43:02.842826 1 tasks_processing.go:71] worker 60 working on image task. I0403 00:43:02.841532 1 tasks_processing.go:71] worker 36 working on openstack_dataplanenodesets task. W0403 00:43:02.841323 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0403 00:43:02.843290 1 tasks_processing.go:74] worker 31 stopped. I0403 00:43:02.843302 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.972377ms to process 0 records I0403 00:43:02.843303 1 tasks_processing.go:71] worker 32 working on container_runtime_configs task. I0403 00:43:02.843714 1 tasks_processing.go:71] worker 18 working on machine_autoscalers task. I0403 00:43:02.843775 1 tasks_processing.go:71] worker 48 working on openstack_controlplanes task. I0403 00:43:02.843848 1 tasks_processing.go:74] worker 2 stopped. I0403 00:43:02.843867 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 3.772735ms to process 0 records I0403 00:43:02.843744 1 tasks_processing.go:71] worker 42 working on jaegers task. W0403 00:43:02.841406 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0403 00:43:02.844037 1 tasks_processing.go:74] worker 57 stopped. I0403 00:43:02.844052 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 2.635029ms to process 0 records I0403 00:43:02.844562 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0403 00:43:02.844583 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0403 00:43:02.844590 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0403 00:43:02.844593 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0403 00:43:02.844613 1 controller.go:531] The operator is still being initialized I0403 00:43:02.844622 1 controller.go:554] The operator is healthy I0403 00:43:02.846147 1 tasks_processing.go:74] worker 1 stopped. E0403 00:43:02.846157 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0403 00:43:02.846159 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 5.969122ms to process 0 records I0403 00:43:02.846169 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 5.546734ms to process 0 records I0403 00:43:02.846173 1 tasks_processing.go:74] worker 24 stopped. I0403 00:43:02.846346 1 tasks_processing.go:74] worker 12 stopped. I0403 00:43:02.846422 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=3a1123ffd0c4c58fe26aac7e778f1de66dd3df82ba152181fcfae3b43352d99f I0403 00:43:02.846435 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 5.63773ms to process 1 records I0403 00:43:02.849299 1 tasks_processing.go:74] worker 46 stopped. I0403 00:43:02.849439 1 recorder.go:75] Recording config/network with fingerprint=48646e3a1651087e632b2216dbcd62b69a2c1cba4d20f9aca0d4a12d60e99ce7 I0403 00:43:02.849450 1 gather.go:177] gatherer "clusterconfig" function "networks" took 9.075402ms to process 1 records I0403 00:43:02.869133 1 tasks_processing.go:74] worker 35 stopped. I0403 00:43:02.869150 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 28.862435ms to process 0 records I0403 00:43:02.869160 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 26.260153ms to process 0 records I0403 00:43:02.869166 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 26.247304ms to process 0 records I0403 00:43:02.869172 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 27.840102ms to process 0 records I0403 00:43:02.869176 1 tasks_processing.go:74] worker 54 stopped. I0403 00:43:02.869179 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 27.905898ms to process 0 records I0403 00:43:02.869182 1 tasks_processing.go:74] worker 58 stopped. I0403 00:43:02.869186 1 tasks_processing.go:74] worker 11 stopped. I0403 00:43:02.869185 1 tasks_processing.go:74] worker 36 stopped. I0403 00:43:02.869190 1 tasks_processing.go:74] worker 18 stopped. I0403 00:43:02.869185 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 25.4073ms to process 0 records I0403 00:43:02.869205 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 27.833593ms to process 0 records I0403 00:43:02.869213 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 26.321334ms to process 0 records I0403 00:43:02.869219 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 25.869698ms to process 0 records I0403 00:43:02.869225 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 28.935483ms to process 0 records I0403 00:43:02.869234 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 26.607374ms to process 0 records I0403 00:43:02.869241 1 tasks_processing.go:74] worker 26 stopped. I0403 00:43:02.869247 1 tasks_processing.go:74] worker 28 stopped. I0403 00:43:02.869251 1 tasks_processing.go:74] worker 19 stopped. I0403 00:43:02.869256 1 tasks_processing.go:74] worker 32 stopped. I0403 00:43:02.869255 1 tasks_processing.go:74] worker 22 stopped. I0403 00:43:02.869265 1 tasks_processing.go:74] worker 5 stopped. E0403 00:43:02.869263 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0403 00:43:02.869278 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 29.015042ms to process 0 records E0403 00:43:02.869289 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0403 00:43:02.869296 1 gather.go:177] gatherer "clusterconfig" function "machines" took 28.000468ms to process 0 records I0403 00:43:02.869301 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 27.961078ms to process 0 records I0403 00:43:02.869357 1 tasks_processing.go:74] worker 20 stopped. I0403 00:43:02.869362 1 tasks_processing.go:74] worker 9 stopped. I0403 00:43:02.869439 1 tasks_processing.go:74] worker 56 stopped. I0403 00:43:02.869456 1 recorder.go:75] Recording config/ingress with fingerprint=853b66e0b401c2d34e9c9b6f73cbb7122eca6734ba919dd73b43c95e14a06a41 I0403 00:43:02.869469 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 29.060412ms to process 1 records I0403 00:43:02.869478 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 25.546573ms to process 0 records I0403 00:43:02.869484 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 26.490101ms to process 0 records I0403 00:43:02.869489 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 27.86025ms to process 0 records I0403 00:43:02.869491 1 tasks_processing.go:74] worker 48 stopped. I0403 00:43:02.869498 1 tasks_processing.go:74] worker 47 stopped. I0403 00:43:02.869494 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 28.561195ms to process 0 records I0403 00:43:02.869506 1 tasks_processing.go:74] worker 37 stopped. I0403 00:43:02.869503 1 tasks_processing.go:74] worker 62 stopped. I0403 00:43:02.869629 1 tasks_processing.go:74] worker 0 stopped. I0403 00:43:02.870032 1 recorder.go:75] Recording config/apiserver with fingerprint=50415a8347430a40195040646315269aa46097fd8174feb7b43440b94a0c1df2 I0403 00:43:02.870056 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 28.061686ms to process 1 records I0403 00:43:02.870154 1 tasks_processing.go:74] worker 33 stopped. I0403 00:43:02.870495 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=ef4bcdc3c4b3d5c6dc11085cd3c1dd3a3034bacbf23871fc05b0dec2b5106195 I0403 00:43:02.870529 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=dc15bf71cc4a6715eb5cfe01122ad5ac62a9116238781f95ccb994e53eb77dae I0403 00:43:02.870571 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=bf470885d76fdf18ccf4b8d1c44dfcdaecd20a6967722dfc9378f55b673c5749 I0403 00:43:02.870590 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 26.906819ms to process 3 records I0403 00:43:02.870601 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 25.790186ms to process 0 records I0403 00:43:02.870632 1 tasks_processing.go:74] worker 42 stopped. I0403 00:43:02.870733 1 tasks_processing.go:74] worker 10 stopped. I0403 00:43:02.871012 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=c0eee12e1bbb7048415c5fde63333d8c7a73226aa40b15b77d63210e7e311ac2 I0403 00:43:02.871072 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 28.853825ms to process 1 records I0403 00:43:02.871209 1 tasks_processing.go:74] worker 60 stopped. I0403 00:43:02.871191 1 gather_logs.go:145] no pods in namespace were found I0403 00:43:02.871272 1 recorder.go:75] Recording config/image with fingerprint=9b1eadef8c5b10727d5c58d65da954fffd35b079974b13eaa3dca647c5ad9e1d I0403 00:43:02.871297 1 gather.go:177] gatherer "clusterconfig" function "image" took 27.208922ms to process 1 records I0403 00:43:02.871368 1 tasks_processing.go:74] worker 7 stopped. I0403 00:43:02.871466 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=718ec18170c004157c0538a79582e865d9d87779e7eda074784eeb973c55e428 I0403 00:43:02.871489 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=5cc8bec35669da517b09f390d5507875e344d4fcf4091b33534c9ab4f41a391b I0403 00:43:02.871496 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 28.652118ms to process 2 records E0403 00:43:02.871504 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0403 00:43:02.871517 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 30.072923ms to process 0 records I0403 00:43:02.871525 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 29.572883ms to process 0 records I0403 00:43:02.871531 1 tasks_processing.go:74] worker 49 stopped. I0403 00:43:02.871536 1 tasks_processing.go:74] worker 17 stopped. I0403 00:43:02.871592 1 tasks_processing.go:74] worker 13 stopped. I0403 00:43:02.871756 1 recorder.go:75] Recording config/featuregate with fingerprint=7c45b625e971e45a520e4e18486921dcd8fd5ddfcf8a33cd9cd7dac9f0d885a1 I0403 00:43:02.872252 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 28.216566ms to process 1 records I0403 00:43:02.872268 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 31.001948ms to process 0 records I0403 00:43:02.872342 1 tasks_processing.go:74] worker 4 stopped. I0403 00:43:02.872416 1 tasks_processing.go:74] worker 53 stopped. I0403 00:43:02.872834 1 recorder.go:75] Recording config/infrastructure with fingerprint=be51292c8dac8e2f17f48ebf92e916bcc81c8ca8987e4b8b243d04728981e873 I0403 00:43:02.872851 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 29.960462ms to process 1 records I0403 00:43:02.872861 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 30.128526ms to process 0 records I0403 00:43:02.872914 1 tasks_processing.go:74] worker 55 stopped. I0403 00:43:02.872977 1 tasks_processing.go:74] worker 51 stopped. I0403 00:43:02.873099 1 recorder.go:75] Recording config/oauth with fingerprint=ff13a97778b4e4efa084087b4a2f3d446deb93b5cdc2c568d1f488d1e24ba114 I0403 00:43:02.873116 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 30.790199ms to process 1 records I0403 00:43:02.873287 1 tasks_processing.go:74] worker 45 stopped. I0403 00:43:02.873332 1 recorder.go:75] Recording config/authentication with fingerprint=df9e3eba921c549286f47a4c38e2f941b1c7ccdcfc18fa8446c99b4c8dc765fd I0403 00:43:02.873373 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 30.562587ms to process 1 records I0403 00:43:02.873446 1 tasks_processing.go:74] worker 16 stopped. I0403 00:43:02.873563 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=14058ff212866bc8404d6acdf1dc8dc1fc74c9989e9fd00edb185ed8adf5a199 I0403 00:43:02.873602 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=c6a34b480a4e16b3568a304b57c4530322adbed698bd7e73b4758c5e1543ec77 I0403 00:43:02.873637 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=77d2091b41e6fc9a6cd405d1bf6e66f664df8b2d83273f599e0869cfeaa7f20b I0403 00:43:02.873647 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 31.192967ms to process 3 records I0403 00:43:02.873744 1 tasks_processing.go:74] worker 40 stopped. I0403 00:43:02.873948 1 recorder.go:75] Recording config/node/ip-10-0-0-96.ec2.internal with fingerprint=335b3978395a33632c2ab53a0c84133301eb2754103c3b780c7c87dfe170b9e1 I0403 00:43:02.874027 1 recorder.go:75] Recording config/node/ip-10-0-1-98.ec2.internal with fingerprint=01f7b4950943f1e0abdd05693a4154a72ed58a7bdd10c7f76ac28415940e5b3f I0403 00:43:02.874143 1 recorder.go:75] Recording config/node/ip-10-0-2-61.ec2.internal with fingerprint=b1b95f77e4f029112708f914a03bc2de20ea87c55a4ba0ea1b61008fa114b313 I0403 00:43:02.874159 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 32.034489ms to process 3 records I0403 00:43:02.874174 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 30.577582ms to process 0 records E0403 00:43:02.874182 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0403 00:43:02.874189 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 32.416513ms to process 0 records I0403 00:43:02.874189 1 tasks_processing.go:74] worker 8 stopped. I0403 00:43:02.874200 1 tasks_processing.go:74] worker 21 stopped. I0403 00:43:02.874269 1 tasks_processing.go:74] worker 30 stopped. I0403 00:43:02.874625 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=3dcc06cc433d1067f1f081f66f669276f24b7141fb5b9d7d95934a1d9a73b840 I0403 00:43:02.874643 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 33.849524ms to process 1 records I0403 00:43:02.874692 1 tasks_processing.go:74] worker 25 stopped. I0403 00:43:02.875045 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=c2c5e05e5846e9aef52f5a356d3d6ce29474f7f1176af5baaa05182dfefc6731 I0403 00:43:02.875378 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=8c17e007b9d112f9c1c60012a38b87ff8f62fdb036e55b769bdef6ea5b5a8b0e I0403 00:43:02.875442 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=10172ffdde924a0ef4b0439b814091cfc3ff76b19a7d2dfd745226b2b2ceb4b1 I0403 00:43:02.875488 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=542617dc7590565db4f645217e0eabc638424065738a8add34079db69a6f9c58 I0403 00:43:02.875541 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=de82659d568d2febb8cd929f3ab1293d93d0c93ce45d22603b24ccc0ddd537c3 I0403 00:43:02.875583 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=3598e6c001ac85eb32828d7b226d4df6285a1b9637495f8fbfbadd9ece30312b I0403 00:43:02.875633 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=632976643e89dff062ad6276605658a69304fdc782d9268e90e97b304d2bde26 I0403 00:43:02.875714 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=75ecd69723596051fa5ab875764d9a781a29b393c26885da4ae96cee3b98c1ca I0403 00:43:02.875805 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=caf41920a7ed8d84674e374bdc9725a83f0f66d075aba96251bb53316a34355f I0403 00:43:02.875878 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=6df44f12069d45b2de7dfb988a9441f0a1c3541280a3076a902e102483c54802 I0403 00:43:02.875949 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=386a34a5e41f9a3f2dd1496d64ffccfa791d651d842a985689fb6fbe3538864b I0403 00:43:02.875992 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 32.496088ms to process 11 records I0403 00:43:02.876166 1 recorder.go:75] Recording config/proxy with fingerprint=5d290964319f5e0301fe731d74360e47986b09dc708bd706a3a1b6f8c8374af5 I0403 00:43:02.876220 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 33.097832ms to process 1 records I0403 00:43:02.876267 1 tasks_processing.go:74] worker 15 stopped. I0403 00:43:02.876899 1 tasks_processing.go:74] worker 63 stopped. E0403 00:43:02.876919 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0403 00:43:02.876956 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0403 00:43:02.876970 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 35.344815ms to process 1 records W0403 00:43:02.877608 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0403 00:43:02.879709 1 tasks_processing.go:74] worker 44 stopped. I0403 00:43:02.879744 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0403 00:43:02.879760 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 37.350944ms to process 1 records I0403 00:43:02.880500 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0403 00:43:02.880571 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0403 00:43:02.880626 1 operator.go:328] started I0403 00:43:02.880642 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0403 00:43:02.881133 1 tasks_processing.go:74] worker 29 stopped. I0403 00:43:02.881151 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 40.752838ms to process 0 records I0403 00:43:02.883503 1 tasks_processing.go:74] worker 61 stopped. I0403 00:43:02.883517 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 42.08542ms to process 0 records I0403 00:43:02.885880 1 tasks_processing.go:74] worker 34 stopped. I0403 00:43:02.886866 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=2c3ec093c899ed982f23cfffbf5d2f3481a82f8b1d341e0087940bfc9e78e780 I0403 00:43:02.887068 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=25696386cf7f5876819888ff5cc46db435ae09e26f19a56245818d9b71007333 I0403 00:43:02.887077 1 gather.go:177] gatherer "clusterconfig" function "crds" took 45.589934ms to process 2 records I0403 00:43:02.888230 1 tasks_processing.go:74] worker 27 stopped. I0403 00:43:02.889409 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-57d9b95648-xphw4 with fingerprint=08e2fd8e2857eb8c3514ec252a2d399b66ff909af4ffff6184b5f003831b8181 I0403 00:43:02.889476 1 recorder.go:75] Recording config/running_containers with fingerprint=1cdaeaa0567545e02a79d552dd03dc39258f09d4669a1b5a285f6a6e312ddd78 I0403 00:43:02.889486 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 46.808662ms to process 2 records I0403 00:43:02.889662 1 tasks_processing.go:74] worker 39 stopped. I0403 00:43:02.889817 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=cfd8b300a65d9a61cf9177c876b0f292ecd3f9214d58eb44f525c099d6cb99cd I0403 00:43:02.889898 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=7ef3966eaeb3b839e016220f2e7d66516d3d4826b8372b2c9e71ee42ba66931e I0403 00:43:02.889907 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 47.375336ms to process 2 records I0403 00:43:02.889932 1 tasks_processing.go:74] worker 59 stopped. I0403 00:43:02.889989 1 recorder.go:75] Recording config/olm_operators with fingerprint=524a464af2936550d1c6a75e94646caf7aa721037e8977f1f11a068c4dd39496 I0403 00:43:02.890002 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 47.067535ms to process 1 records I0403 00:43:02.890601 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0403 00:43:02.890613 1 controller.go:254] Source scaController *sca.Controller is not ready I0403 00:43:02.890618 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0403 00:43:02.890622 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0403 00:43:02.890625 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0403 00:43:02.890648 1 controller.go:531] The operator is still being initialized I0403 00:43:02.890659 1 controller.go:554] The operator is healthy I0403 00:43:02.890840 1 tasks_processing.go:74] worker 14 stopped. I0403 00:43:02.890856 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 48.094957ms to process 0 records E0403 00:43:02.897068 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27590fbf1d-a1ab-4a6c-a510-73924b367cfa%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.131.0.12:37345->172.30.0.10:53: read: connection refused I0403 00:43:02.897075 1 prometheus_rules.go:88] Prometheus rules successfully created I0403 00:43:02.897098 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27590fbf1d-a1ab-4a6c-a510-73924b367cfa%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.131.0.12:37345->172.30.0.10:53: read: connection refused I0403 00:43:02.907500 1 tasks_processing.go:74] worker 3 stopped. E0403 00:43:02.907513 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0403 00:43:02.907519 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0403 00:43:02.907523 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0403 00:43:02.907531 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=20ed6d7fdef919e1dbf14043d15a28454160f2e604706803e55a38d1623c3158 I0403 00:43:02.907564 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0403 00:43:02.907568 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0403 00:43:02.907572 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=0bcb269fd90b6e8af4a57174ee20ae48ebee01bb0a0c651000e372609b4ee122 I0403 00:43:02.907576 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0403 00:43:02.907613 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0403 00:43:02.907621 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0403 00:43:02.907626 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 67.319807ms to process 7 records I0403 00:43:02.907984 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0403 00:43:02.907993 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0403 00:43:02.908031 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0403 00:43:02.915757 1 base_controller.go:82] Caches are synced for ConfigController I0403 00:43:02.915768 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0403 00:43:02.919770 1 configmapobserver.go:84] configmaps "insights-config" not found I0403 00:43:02.953467 1 tasks_processing.go:74] worker 43 stopped. I0403 00:43:02.953676 1 recorder.go:75] Recording config/version with fingerprint=a2bbb441b6dc427516deeb89ed9c87c6d00adaf46deb8924da33f9883197ff93 I0403 00:43:02.953693 1 recorder.go:75] Recording config/id with fingerprint=10117784fa643e1eecad6fa55dfe2fc18dd1b7048e5b8ea6aa0e57d464ff23a3 I0403 00:43:02.953702 1 gather.go:177] gatherer "clusterconfig" function "version" took 111.899118ms to process 2 records I0403 00:43:02.966102 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0403 00:43:02.969309 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.131.0.12:58654->172.30.0.10:53: read: connection refused I0403 00:43:02.969323 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.131.0.12:58654->172.30.0.10:53: read: connection refused I0403 00:43:02.980923 1 base_controller.go:82] Caches are synced for LoggingSyncer I0403 00:43:02.980937 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0403 00:43:02.984216 1 tasks_processing.go:74] worker 50 stopped. E0403 00:43:02.984228 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0403 00:43:02.984234 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2peb9ob26umtfq43icvb8p97pncv0c79-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2peb9ob26umtfq43icvb8p97pncv0c79-primary-cert-bundle-secret" not found I0403 00:43:02.984287 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=6d07da71ee7cbf405e696a22d19fc8500928b083b9d647e7011fb342e5753eec I0403 00:43:02.984299 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 143.969072ms to process 1 records W0403 00:43:03.873630 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0403 00:43:04.084753 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0403 00:43:04.084769 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0403 00:43:04.085767 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-7j6d8 pod in namespace openshift-dns (previous: false). I0403 00:43:04.289633 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7j6d8 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-7j6d8\" is waiting to start: ContainerCreating" I0403 00:43:04.289653 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-7j6d8\" is waiting to start: ContainerCreating" I0403 00:43:04.289665 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-7j6d8 pod in namespace openshift-dns (previous: false). I0403 00:43:04.296630 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0403 00:43:04.494443 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7j6d8 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-7j6d8\" is waiting to start: ContainerCreating" I0403 00:43:04.494461 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-7j6d8\" is waiting to start: ContainerCreating" I0403 00:43:04.494472 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-jmclr pod in namespace openshift-dns (previous: false). I0403 00:43:04.688663 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jmclr pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-jmclr\" is waiting to start: ContainerCreating" I0403 00:43:04.688683 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-jmclr\" is waiting to start: ContainerCreating" I0403 00:43:04.688694 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-jmclr pod in namespace openshift-dns (previous: false). W0403 00:43:04.874283 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0403 00:43:04.889381 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jmclr pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-jmclr\" is waiting to start: ContainerCreating" I0403 00:43:04.889400 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-jmclr\" is waiting to start: ContainerCreating" I0403 00:43:04.889414 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-kg72g pod in namespace openshift-dns (previous: false). I0403 00:43:04.900345 1 tasks_processing.go:74] worker 6 stopped. I0403 00:43:04.900395 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=12bfc10180265c5adfba5da9b295b7830a9a18f91fccfccee4a48c701403056a I0403 00:43:04.900443 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=6f4b65c50c9ee83f19ca2ef055b9204ea5815daea2ccc553d63012c1da6e7fc8 I0403 00:43:04.900471 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0403 00:43:04.900496 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=fcc604fb83f8ebf4498855d678f9917653e64cfaf95dc58fe375dfe79a71bc99 I0403 00:43:04.900526 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0403 00:43:04.900549 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=0343ba7498c563d9b1f9091f9afd4c30462f43ff3baaf04d8b2ae1accde65bc1 I0403 00:43:04.900580 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=16991546fda25e32a51ede2984a92d0ce87c9f4d1a8b77d848da35d9f78c660f I0403 00:43:04.900605 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=563a4aca033848681e623519275b2b6728ed288bfd37643e2331f6fc2a845306 I0403 00:43:04.900619 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=bcb399c9b114068a7346ff0953b22935d4d4f7437095f20062730dd78b59a5e1 I0403 00:43:04.900636 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=c3b0354c98434f2533dfaaee40202b0c8d6d6b71fc186611d974092368ab833b I0403 00:43:04.900646 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0403 00:43:04.900662 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=65e7885ccade2d43cea841a41b19ee3aae99fb2879ee05359d4e0c8f9278a53d I0403 00:43:04.900674 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0403 00:43:04.900689 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=a2955480b874cdb40d97ca7820fdc08cd098ffbc6bfa6031f6896a0eea3b8ff6 I0403 00:43:04.900696 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0403 00:43:04.900716 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=9fc093edc017d29dc60739be141057ae3878db8b6b65c0eaeb7cedc091453a0e I0403 00:43:04.900725 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0403 00:43:04.900740 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=07b037d901852469cc0312e615cba8438d5429a264c34f9cc0567aa06c2c8c7b I0403 00:43:04.900866 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=6f9d8d219170f29aae8991b14af6ba3ce58d9de093412b4e906078417eb253f0 I0403 00:43:04.900875 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0403 00:43:04.900882 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0403 00:43:04.900903 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0403 00:43:04.900926 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=6c65e2ca958698c5002ad26e877c1b30d2937203a9925bd35954c7da7776a6ee I0403 00:43:04.900951 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=da89901772af5db20f9e397eab12cf6152cfc0c7be54b98cec139812845bb3cb I0403 00:43:04.900960 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0403 00:43:04.900977 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=b4f6c85861c784d4587515b091fdea832c2335b6c5cd468b980ab359fed8da96 I0403 00:43:04.900986 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0403 00:43:04.900999 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=9e0f40af1b9b2ac679e652329bf10fbff264aa5a54c0bed5048b1aca91547201 I0403 00:43:04.901014 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=bd57baa8c99a1f22f8366ed67626298286b4f80283beaf83d9d08fecf40b5dca I0403 00:43:04.901028 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=d112913c34d6d5a976972f339390b263b3b2a65a76cf70e6370d63087bf6042c I0403 00:43:04.901043 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=c10aa9f0c126acb3026e86b56280532499eab7345af688a866b8703beb15b6e0 I0403 00:43:04.901063 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=d989891d7f5104fc11444d83731efc57b903a3d104227125280f86a4f05567a4 I0403 00:43:04.901072 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0403 00:43:04.901110 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=434acaa87397f5e782ade1bb1589e325bfaa59e107d8a3633f1eb9f7d31bcc7b I0403 00:43:04.901127 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0403 00:43:04.901133 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0403 00:43:04.901140 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.057488673s to process 36 records I0403 00:43:05.136033 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-kg72g pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-kg72g\" is waiting to start: ContainerCreating" I0403 00:43:05.136050 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-kg72g\" is waiting to start: ContainerCreating" I0403 00:43:05.136059 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-kg72g pod in namespace openshift-dns (previous: false). I0403 00:43:05.296215 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-kg72g pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-kg72g\" is waiting to start: ContainerCreating" I0403 00:43:05.296239 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-kg72g\" is waiting to start: ContainerCreating" I0403 00:43:05.296249 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-fpx9x pod in namespace openshift-dns (previous: false). I0403 00:43:05.489525 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:43:05.489545 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-hqct8 pod in namespace openshift-dns (previous: false). I0403 00:43:05.690306 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:43:05.690325 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-rl5tf pod in namespace openshift-dns (previous: false). W0403 00:43:05.874247 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0403 00:43:05.905798 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:43:05.905866 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-54ff97fc46-kngvd pod in namespace openshift-image-registry (previous: false). I0403 00:43:06.092202 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-54ff97fc46-kngvd pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-54ff97fc46-kngvd\" is waiting to start: ContainerCreating" I0403 00:43:06.092219 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-54ff97fc46-kngvd\" is waiting to start: ContainerCreating" I0403 00:43:06.092278 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7f6f7df889-6rm24 pod in namespace openshift-image-registry (previous: false). I0403 00:43:06.290746 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7f6f7df889-6rm24 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7f6f7df889-6rm24\" is waiting to start: ContainerCreating" I0403 00:43:06.290764 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7f6f7df889-6rm24\" is waiting to start: ContainerCreating" I0403 00:43:06.290798 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7f6f7df889-vr9sm pod in namespace openshift-image-registry (previous: false). I0403 00:43:06.492953 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7f6f7df889-vr9sm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7f6f7df889-vr9sm\" is waiting to start: ContainerCreating" I0403 00:43:06.492978 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7f6f7df889-vr9sm\" is waiting to start: ContainerCreating" I0403 00:43:06.492990 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-5c8zr pod in namespace openshift-image-registry (previous: false). I0403 00:43:06.701224 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:43:06.701243 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-dpgg6 pod in namespace openshift-image-registry (previous: false). W0403 00:43:06.874112 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0403 00:43:06.889914 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:43:06.889928 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-sjq2p pod in namespace openshift-image-registry (previous: false). I0403 00:43:07.087979 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0403 00:43:07.087994 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5965f78f96-jrdps pod in namespace openshift-ingress (previous: false). I0403 00:43:07.289100 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5965f78f96-jrdps pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5965f78f96-jrdps\" is waiting to start: ContainerCreating" I0403 00:43:07.289117 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5965f78f96-jrdps\" is waiting to start: ContainerCreating" I0403 00:43:07.289129 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5965f78f96-shgl4 pod in namespace openshift-ingress (previous: false). I0403 00:43:07.488543 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5965f78f96-shgl4 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5965f78f96-shgl4\" is waiting to start: ContainerCreating" I0403 00:43:07.488567 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5965f78f96-shgl4\" is waiting to start: ContainerCreating" I0403 00:43:07.488577 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5cf556f5bc-qkqjp pod in namespace openshift-ingress (previous: false). I0403 00:43:07.688120 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5cf556f5bc-qkqjp pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5cf556f5bc-qkqjp\" is waiting to start: ContainerCreating" I0403 00:43:07.688139 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5cf556f5bc-qkqjp\" is waiting to start: ContainerCreating" I0403 00:43:07.688151 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-b5xz5 pod in namespace openshift-ingress-canary (previous: false). W0403 00:43:07.870322 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0403 00:43:07.870346 1 tasks_processing.go:74] worker 23 stopped. E0403 00:43:07.870357 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0403 00:43:07.870377 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0403 00:43:07.870390 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0403 00:43:07.870399 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.028836503s to process 1 records I0403 00:43:07.888792 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-f4jqk pod in namespace openshift-ingress-canary (previous: false). I0403 00:43:08.089855 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-ncpnk pod in namespace openshift-ingress-canary (previous: false). I0403 00:43:08.288411 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-848b55fff-b7kgv pod in namespace openshift-kube-storage-version-migrator (previous: false). I0403 00:43:08.489198 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-848b55fff-b7kgv pod in namespace openshift-kube-storage-version-migrator (previous: false). I0403 00:43:08.690612 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-d4cbcbb94-vkxsq pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0403 00:43:08.889536 1 tasks_processing.go:74] worker 41 stopped. I0403 00:43:08.889688 1 recorder.go:75] Recording events/openshift-dns with fingerprint=75c11bfa62abd4a64e7f32babbf26d5bd904623fe5abac8c641eef05bca41bc6 I0403 00:43:08.889824 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=0e5ce075ee3a417e323b917b19422af048e920b3addceb16d9169c044d35e248 I0403 00:43:08.889854 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=8a7e28c776ee623c96f1f406457401cb4a08604cece32209db800cba4a0b93f5 I0403 00:43:08.889898 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=ee261559395589c0e287cd0d9ccb0899992939f05f29a60ef32b9718e9ff7232 I0403 00:43:08.889982 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=9ec3b78877d4ac9d73118f5b177a530afc45c55a2b7a004bba28e2b10fec1033 I0403 00:43:08.890005 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=f0fa8aa52b5ca54f46aff55cc69dcf1a2045d41ce355bef092a2c0d7f63e0dce I0403 00:43:08.890051 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=8b47888afebeb885ac9d127fb1744a401031105da08a594e120e256a6e4881bd I0403 00:43:08.890230 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-54ff97fc46-kngvd with fingerprint=c2615f8f87febcde1d9b1512e49fcd098d44b2a57cf8bab077eb6151bd8e1137 I0403 00:43:08.890333 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7f6f7df889-6rm24 with fingerprint=e017b911509b3be3635ff6526526882f79590d87c6401cf58c8e9ae50bb5eade I0403 00:43:08.890423 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7f6f7df889-vr9sm with fingerprint=b32c4425d941d233e86ae97a090e0797edd15a5ed49e216402e23cad8b7be0a2 I0403 00:43:08.890430 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-b5xz5/serve-healthcheck-canary_current.log with fingerprint=5b6c0aaad175f0d8e74b47a4083a00e0aff1f4396a1c71df23f1f043716dbfca I0403 00:43:08.890435 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-f4jqk/serve-healthcheck-canary_current.log with fingerprint=821f4805cde4e9e36adb4fbda6ef6b75dcb2345d4b4ad9797e46e98034a2ca23 I0403 00:43:08.890439 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-ncpnk/serve-healthcheck-canary_current.log with fingerprint=2dee94506fe63aa1d860e8778bcd622afbca813152ebaff8ce4cca84e222a1a3 I0403 00:43:08.890451 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-848b55fff-b7kgv/migrator_current.log with fingerprint=85bc376877270a1cd4a8395ae3a48342dfd93e73e11b465fb0f238e4a681b015 I0403 00:43:08.890457 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-848b55fff-b7kgv/graceful-termination_current.log with fingerprint=b4b631c539e70393a6fb468b69af5b5c8eeea01f4374f8bc4762795e347d67ca I0403 00:43:08.890522 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-d4cbcbb94-vkxsq/kube-storage-version-migrator-operator_current.log with fingerprint=58b1d6544f9dee8f12c703e3076a546fb92de3989e3b6e3b8c197f2fa17bb39a I0403 00:43:08.890531 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.047984857s to process 16 records I0403 00:43:12.682503 1 configmapobserver.go:84] configmaps "insights-config" not found I0403 00:43:14.992314 1 configmapobserver.go:84] configmaps "insights-config" not found I0403 00:43:15.188492 1 configmapobserver.go:84] configmaps "insights-config" not found I0403 00:43:15.686735 1 tasks_processing.go:74] worker 38 stopped. I0403 00:43:15.686775 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0403 00:43:15.686788 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.844229745s to process 1 records I0403 00:43:16.449603 1 tasks_processing.go:74] worker 52 stopped. I0403 00:43:16.449869 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=3b97e77b4f0d620410c8a18ccde8c9de6caf824ed04e5950eec4a1131a51426f I0403 00:43:16.449886 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.608345772s to process 1 records E0403 00:43:16.449946 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.609s with: function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0403 00:43:16.451050 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0403 00:43:16.451066 1 periodic.go:216] Running workloads gatherer I0403 00:43:16.451095 1 tasks_processing.go:45] number of workers: 2 I0403 00:43:16.451107 1 tasks_processing.go:69] worker 1 listening for tasks. I0403 00:43:16.451111 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I0403 00:43:16.451120 1 tasks_processing.go:69] worker 0 listening for tasks. I0403 00:43:16.451193 1 tasks_processing.go:71] worker 0 working on workload_info task. I0403 00:43:16.473931 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0403 00:43:16.477523 1 tasks_processing.go:74] worker 1 stopped. I0403 00:43:16.477537 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 26.400422ms to process 0 records I0403 00:43:16.481899 1 gather_workloads_info.go:387] No image sha256:8c9c050549f490f6b96eca68bb61a32f164b2152cae31b4ffb7d7ecc4bd678b1 (9ms) I0403 00:43:16.491230 1 gather_workloads_info.go:387] No image sha256:524c4410d51b126c6097fae3b2ad88ec67900e7b786a9131b7a8e96a194e4847 (9ms) I0403 00:43:16.500008 1 gather_workloads_info.go:387] No image sha256:6552b42b5cec3ef82f4b7b30214f2b4e4561f83599f1a77341fe77b9a6171bc2 (9ms) I0403 00:43:16.508794 1 gather_workloads_info.go:387] No image sha256:0b449cd4c58e81397bc99ba2d0970585d2a3cc1472a8134b46cf20e8c488b8c5 (9ms) I0403 00:43:16.518235 1 gather_workloads_info.go:387] No image sha256:4def742b6a5ef27c09ac9540e132622ec7178284d8900b9a844cb425e8be0c94 (9ms) I0403 00:43:16.526529 1 gather_workloads_info.go:387] No image sha256:0644c26b6a8f4aa4435145653370dd3f8438c6e299523ff8570eb2858ac65d09 (8ms) I0403 00:43:16.534980 1 gather_workloads_info.go:387] No image sha256:326a8b5302b495cb059364ab96dfdd38425252613cfa3abb7e1dacaecda4fb1e (8ms) I0403 00:43:16.543221 1 gather_workloads_info.go:387] No image sha256:1647489821e206e3ac1d3f1fbecdff3621ef87a7064f492906334c16f072a3e3 (8ms) I0403 00:43:16.552653 1 gather_workloads_info.go:387] No image sha256:07c82fce5e470c7ee9c3c1fdc6c953c962ed119411c88bf5fd4f0a08e3a0b9b7 (9ms) I0403 00:43:16.561077 1 gather_workloads_info.go:387] No image sha256:595b03c50302148c33de51825571a2b59a1930591d461a717315be05c6efdbb1 (8ms) I0403 00:43:16.586368 1 gather_workloads_info.go:387] No image sha256:1c6f9f9f726be814274f19e66bd04d069236460a312faa274eebe757d33f889c (25ms) I0403 00:43:16.682953 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (97ms) I0403 00:43:16.784248 1 gather_workloads_info.go:387] No image sha256:7958abc201949f9faed6fe6cd4f8e2f8dab06dde35f09779cec19e9286f3983d (101ms) I0403 00:43:16.883361 1 gather_workloads_info.go:387] No image sha256:5fd3dcbd54108018a438b849eb89f35b4c34343cb5319fbfb30cf252e2a58a8f (99ms) I0403 00:43:16.983697 1 gather_workloads_info.go:387] No image sha256:3b313209f88d2df827ff378cf0af36bd18908f1cab0e7ace14df1e8ffa5f1c00 (100ms) I0403 00:43:17.083644 1 gather_workloads_info.go:387] No image sha256:5ae6198359a92af6c4b317806ec8a33ff53d44189d14561a8f8a3153d7afdb81 (100ms) I0403 00:43:17.184789 1 gather_workloads_info.go:387] No image sha256:215264f061f8b0eeba17dc442cf5a6a3a754f67104bf271f61d2ccee30b7e663 (101ms) I0403 00:43:17.283716 1 gather_workloads_info.go:387] No image sha256:e468e359bdc654b85aa2e26fe6d9ff065bc85650d57be4cfd6879d5666cd08cd (99ms) I0403 00:43:17.394264 1 gather_workloads_info.go:387] No image sha256:55cb1bfa110d67c2452259e6b4a2158b8f6e7c4bba9e7dfd661e0dea37ff2e25 (111ms) I0403 00:43:17.485265 1 gather_workloads_info.go:387] No image sha256:5589d0d744b2f935e7f1bb3e094e813685092910a00e1853891b31fe9e330d23 (91ms) I0403 00:43:17.584875 1 gather_workloads_info.go:387] No image sha256:645ce33140c6bccfc5926a1d19a02f60d9b48c8d116dba2a300cdb43a0fd0220 (100ms) I0403 00:43:17.683138 1 gather_workloads_info.go:387] No image sha256:8d824fc165afff23fffc5b291acfa0c1a98f01a96f86ad547eadaa7c98efd35f (98ms) I0403 00:43:17.784078 1 gather_workloads_info.go:387] No image sha256:543891894646911f3714c3ebb7dd08f28cb0f0ea0d51045d058f7d2e9d475481 (101ms) I0403 00:43:17.883738 1 gather_workloads_info.go:387] No image sha256:2f4b0241dc0818547ffbaf42f8f17cac3ea8cde598a6c0bd3896872f53f7a3ff (100ms) I0403 00:43:17.983787 1 gather_workloads_info.go:387] No image sha256:9fed4b776332f3e8ce9c8454beabcb0c940b0e09c0c973eeafcf653b27a79043 (100ms) I0403 00:43:18.083658 1 gather_workloads_info.go:387] No image sha256:62075f81a8bc4ce5a7192023a80f2e27c2bc4fae547193776513d67fbddad601 (100ms) I0403 00:43:18.188992 1 gather_workloads_info.go:387] No image sha256:5e61f9895dd3c359917209aaa56cb9a1fba5e7b7946348f44ff1301045f0d1f0 (105ms) I0403 00:43:18.283706 1 gather_workloads_info.go:387] No image sha256:e251b56f79899ba2f5ece5dc68375ebba0157b35541861a0c8e31bc21d6adc52 (95ms) I0403 00:43:18.384523 1 gather_workloads_info.go:387] No image sha256:17eab4abb2d95e2fe5dead3b0ccd144401f0f4467fc5f1dec8e19d5cb9bfd315 (101ms) I0403 00:43:18.483854 1 gather_workloads_info.go:387] No image sha256:014e2427899021034589f5602bb55916492eba8531030bd8a07bf1501c99f374 (99ms) I0403 00:43:18.584311 1 gather_workloads_info.go:387] No image sha256:9ac7550a7edd59fdbc0e5b3d336defbd6fe0510087272b78d364a4580fd3d020 (100ms) I0403 00:43:18.686815 1 gather_workloads_info.go:387] No image sha256:3d02603962035bdee1a13b1b0d17740cc9c5bcdc89f2372652e5a7dd907ca313 (102ms) I0403 00:43:18.784486 1 gather_workloads_info.go:387] No image sha256:2973ce1c3d9df0e94568fdc45b90f86d6d7c65fa3bf6c319219b9e213a684101 (98ms) I0403 00:43:18.784515 1 tasks_processing.go:74] worker 0 stopped. E0403 00:43:18.784525 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0403 00:43:18.784772 1 recorder.go:75] Recording config/workload_info with fingerprint=f6e8f05684dc85b28a4569552e18d0e2e18fee98f3972ee9c01f44a35cb37e22 I0403 00:43:18.784787 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.333312258s to process 1 records E0403 00:43:18.784810 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.333s with: function \"workload_info\" failed with an error" I0403 00:43:18.785908 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0403 00:43:18.785921 1 periodic.go:216] Running conditional gatherer I0403 00:43:18.791412 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.7/gathering_rules I0403 00:43:18.798204 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.7/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.131.0.12:39204->172.30.0.10:53: read: connection refused E0403 00:43:18.798504 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0403 00:43:18.798563 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0403 00:43:18.804131 1 conditional_gatherer.go:392] cluster version is '4.21.7' E0403 00:43:18.804147 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:43:18.804153 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:43:18.804156 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:43:18.804159 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:43:18.804162 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:43:18.804165 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:43:18.804168 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:43:18.804171 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0403 00:43:18.804173 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0403 00:43:18.804186 1 tasks_processing.go:45] number of workers: 3 I0403 00:43:18.804193 1 tasks_processing.go:69] worker 2 listening for tasks. I0403 00:43:18.804197 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0403 00:43:18.804208 1 tasks_processing.go:69] worker 0 listening for tasks. I0403 00:43:18.804212 1 tasks_processing.go:69] worker 1 listening for tasks. I0403 00:43:18.804223 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0403 00:43:18.804235 1 tasks_processing.go:74] worker 1 stopped. I0403 00:43:18.804227 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0403 00:43:18.804270 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0403 00:43:18.804283 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.166µs to process 1 records I0403 00:43:18.804308 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0403 00:43:18.804315 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.751µs to process 1 records I0403 00:43:18.804320 1 tasks_processing.go:74] worker 0 stopped. I0403 00:43:18.804459 1 tasks_processing.go:74] worker 2 stopped. I0403 00:43:18.804471 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 222.918µs to process 0 records I0403 00:43:18.804498 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.7/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.131.0.12:39204->172.30.0.10:53: read: connection refused I0403 00:43:18.804515 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0403 00:43:18.826043 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=bd72a71e0f2576a0e5bbf641116cc8ade9783523d377ea9d03d5b2ebef301a29 I0403 00:43:18.826215 1 diskrecorder.go:70] Writing 112 records to /var/lib/insights-operator/insights-2026-04-03-004318.tar.gz I0403 00:43:18.833934 1 diskrecorder.go:51] Wrote 112 records to disk in 7ms I0403 00:43:18.833961 1 periodic.go:285] Gathering cluster info every 2h0m0s I0403 00:43:18.833975 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0403 00:43:24.051708 1 configmapobserver.go:84] configmaps "insights-config" not found I0403 00:44:06.266029 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="72a62235711ce033e49db2cd811704073443d1754d8ba05755f276c451b47e7c") W0403 00:44:06.266062 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created