W0418 14:55:01.044832 1 cmd.go:257] Using insecure, self-signed certificates I0418 14:55:01.386114 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 14:55:01.386445 1 observer_polling.go:159] Starting file observer I0418 14:55:01.866261 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0418 14:55:01.866454 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0418 14:55:01.867013 1 secure_serving.go:57] Forcing use of http/1.1 only W0418 14:55:01.867034 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0418 14:55:01.867038 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0418 14:55:01.867042 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0418 14:55:01.867045 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0418 14:55:01.867047 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0418 14:55:01.867050 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0418 14:55:01.867079 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0418 14:55:01.871757 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0418 14:55:01.871824 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"45680a2e-348f-44cc-8754-fa6d4a63d2c0", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0418 14:55:01.872981 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0418 14:55:01.872995 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0418 14:55:01.873009 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0418 14:55:01.873044 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0418 14:55:01.873008 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0418 14:55:01.873084 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0418 14:55:01.873387 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2701763361/tls.crt::/tmp/serving-cert-2701763361/tls.key" I0418 14:55:01.873714 1 secure_serving.go:213] Serving securely on [::]:8443 I0418 14:55:01.873741 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0418 14:55:01.877825 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0418 14:55:01.877848 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0418 14:55:01.877953 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0418 14:55:01.884423 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0418 14:55:01.884448 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0418 14:55:01.890838 1 secretconfigobserver.go:119] support secret does not exist I0418 14:55:01.895801 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0418 14:55:01.900696 1 secretconfigobserver.go:119] support secret does not exist I0418 14:55:01.904154 1 recorder.go:161] Pruning old reports every 4h36m44s, max age is 288h0m0s I0418 14:55:01.909491 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0418 14:55:01.909499 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0418 14:55:01.909509 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0418 14:55:01.909511 1 insightsreport.go:296] Starting report retriever I0418 14:55:01.909520 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0418 14:55:01.909533 1 periodic.go:209] Running clusterconfig gatherer I0418 14:55:01.909582 1 tasks_processing.go:45] number of workers: 64 I0418 14:55:01.909616 1 tasks_processing.go:69] worker 3 listening for tasks. I0418 14:55:01.909628 1 tasks_processing.go:69] worker 1 listening for tasks. I0418 14:55:01.909629 1 tasks_processing.go:69] worker 63 listening for tasks. I0418 14:55:01.909635 1 tasks_processing.go:69] worker 19 listening for tasks. I0418 14:55:01.909629 1 tasks_processing.go:69] worker 4 listening for tasks. I0418 14:55:01.909632 1 tasks_processing.go:71] worker 3 working on support_secret task. I0418 14:55:01.909643 1 tasks_processing.go:71] worker 4 working on operators task. I0418 14:55:01.909643 1 tasks_processing.go:69] worker 0 listening for tasks. I0418 14:55:01.909647 1 tasks_processing.go:69] worker 2 listening for tasks. I0418 14:55:01.909620 1 tasks_processing.go:69] worker 18 listening for tasks. I0418 14:55:01.909654 1 tasks_processing.go:69] worker 7 listening for tasks. I0418 14:55:01.909646 1 tasks_processing.go:69] worker 6 listening for tasks. I0418 14:55:01.909659 1 tasks_processing.go:71] worker 18 working on silenced_alerts task. I0418 14:55:01.909656 1 tasks_processing.go:71] worker 2 working on image_pruners task. I0418 14:55:01.909664 1 tasks_processing.go:69] worker 8 listening for tasks. I0418 14:55:01.909672 1 tasks_processing.go:69] worker 9 listening for tasks. I0418 14:55:01.909673 1 tasks_processing.go:71] worker 1 working on service_accounts task. I0418 14:55:01.909690 1 tasks_processing.go:69] worker 11 listening for tasks. I0418 14:55:01.909700 1 tasks_processing.go:69] worker 12 listening for tasks. W0418 14:55:01.909697 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 14:55:01.909707 1 tasks_processing.go:69] worker 13 listening for tasks. I0418 14:55:01.909652 1 tasks_processing.go:71] worker 0 working on machine_configs task. I0418 14:55:01.909719 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 46.51µs to process 0 records I0418 14:55:01.909721 1 tasks_processing.go:69] worker 31 listening for tasks. I0418 14:55:01.909719 1 tasks_processing.go:69] worker 52 listening for tasks. I0418 14:55:01.909735 1 tasks_processing.go:71] worker 31 working on sap_datahubs task. I0418 14:55:01.909741 1 tasks_processing.go:69] worker 21 listening for tasks. I0418 14:55:01.909743 1 tasks_processing.go:69] worker 43 listening for tasks. I0418 14:55:01.909730 1 tasks_processing.go:69] worker 20 listening for tasks. I0418 14:55:01.909749 1 tasks_processing.go:69] worker 36 listening for tasks. I0418 14:55:01.909758 1 tasks_processing.go:69] worker 37 listening for tasks. I0418 14:55:01.909762 1 tasks_processing.go:69] worker 23 listening for tasks. I0418 14:55:01.909765 1 tasks_processing.go:71] worker 36 working on node_logs task. I0418 14:55:01.909765 1 tasks_processing.go:69] worker 57 listening for tasks. I0418 14:55:01.909770 1 tasks_processing.go:71] worker 21 working on sap_pods task. I0418 14:55:01.909779 1 tasks_processing.go:69] worker 46 listening for tasks. I0418 14:55:01.909779 1 tasks_processing.go:69] worker 25 listening for tasks. I0418 14:55:01.909706 1 tasks_processing.go:69] worker 30 listening for tasks. I0418 14:55:01.909787 1 tasks_processing.go:69] worker 26 listening for tasks. I0418 14:55:01.909788 1 tasks_processing.go:69] worker 40 listening for tasks. I0418 14:55:01.909763 1 tasks_processing.go:71] worker 20 working on sap_config task. I0418 14:55:01.909796 1 tasks_processing.go:69] worker 47 listening for tasks. I0418 14:55:01.909796 1 tasks_processing.go:69] worker 27 listening for tasks. I0418 14:55:01.909799 1 tasks_processing.go:69] worker 32 listening for tasks. I0418 14:55:01.909804 1 tasks_processing.go:69] worker 34 listening for tasks. I0418 14:55:01.909808 1 tasks_processing.go:69] worker 48 listening for tasks. I0418 14:55:01.909799 1 tasks_processing.go:69] worker 15 listening for tasks. I0418 14:55:01.909811 1 tasks_processing.go:69] worker 29 listening for tasks. I0418 14:55:01.909816 1 tasks_processing.go:69] worker 16 listening for tasks. I0418 14:55:01.909812 1 tasks_processing.go:69] worker 54 listening for tasks. I0418 14:55:01.909820 1 tasks_processing.go:69] worker 56 listening for tasks. I0418 14:55:01.909640 1 tasks_processing.go:71] worker 19 working on openstack_controlplanes task. I0418 14:55:01.909825 1 tasks_processing.go:69] worker 14 listening for tasks. I0418 14:55:01.909827 1 tasks_processing.go:69] worker 17 listening for tasks. I0418 14:55:01.909829 1 tasks_processing.go:71] worker 8 working on image_registries task. I0418 14:55:01.909832 1 tasks_processing.go:71] worker 7 working on crds task. I0418 14:55:01.909836 1 tasks_processing.go:71] worker 18 working on nodes task. I0418 14:55:01.909839 1 tasks_processing.go:71] worker 11 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0418 14:55:01.909843 1 tasks_processing.go:71] worker 27 working on openshift_logging task. I0418 14:55:01.909842 1 tasks_processing.go:71] worker 17 working on install_plans task. I0418 14:55:01.909899 1 tasks_processing.go:71] worker 29 working on openstack_version task. I0418 14:55:01.909973 1 tasks_processing.go:71] worker 30 working on feature_gates task. I0418 14:55:01.909977 1 tasks_processing.go:71] worker 40 working on proxies task. I0418 14:55:01.910008 1 tasks_processing.go:71] worker 47 working on container_images task. I0418 14:55:01.909637 1 tasks_processing.go:69] worker 5 listening for tasks. I0418 14:55:01.910030 1 tasks_processing.go:71] worker 5 working on authentication task. I0418 14:55:01.909699 1 tasks_processing.go:69] worker 41 listening for tasks. I0418 14:55:01.909756 1 tasks_processing.go:69] worker 58 listening for tasks. I0418 14:55:01.909754 1 tasks_processing.go:71] worker 52 working on schedulers task. I0418 14:55:01.909681 1 tasks_processing.go:69] worker 10 listening for tasks. I0418 14:55:01.910484 1 tasks_processing.go:71] worker 10 working on lokistack task. I0418 14:55:01.909735 1 tasks_processing.go:69] worker 42 listening for tasks. I0418 14:55:01.909763 1 tasks_processing.go:69] worker 44 listening for tasks. I0418 14:55:01.909763 1 tasks_processing.go:69] worker 59 listening for tasks. I0418 14:55:01.909772 1 tasks_processing.go:69] worker 38 listening for tasks. I0418 14:55:01.909771 1 tasks_processing.go:69] worker 45 listening for tasks. I0418 14:55:01.909772 1 tasks_processing.go:69] worker 60 listening for tasks. I0418 14:55:01.909774 1 tasks_processing.go:69] worker 24 listening for tasks. I0418 14:55:01.909776 1 tasks_processing.go:71] worker 43 working on image task. I0418 14:55:01.910560 1 tasks_processing.go:71] worker 24 working on machine_sets task. I0418 14:55:01.910568 1 tasks_processing.go:71] worker 59 working on version task. I0418 14:55:01.910580 1 tasks_processing.go:71] worker 42 working on metrics task. W0418 14:55:01.910610 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 14:55:01.910615 1 tasks_processing.go:71] worker 44 working on pod_network_connectivity_checks task. I0418 14:55:01.910619 1 tasks_processing.go:71] worker 42 working on oauths task. I0418 14:55:01.910681 1 tasks_processing.go:71] worker 45 working on mutating_webhook_configurations task. I0418 14:55:01.910708 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 23.592µs to process 0 records I0418 14:55:01.910721 1 tasks_processing.go:71] worker 60 working on dvo_metrics task. I0418 14:55:01.910726 1 tasks_processing.go:71] worker 38 working on aggregated_monitoring_cr_names task. I0418 14:55:01.909779 1 tasks_processing.go:69] worker 39 listening for tasks. I0418 14:55:01.909781 1 tasks_processing.go:69] worker 61 listening for tasks. I0418 14:55:01.909787 1 tasks_processing.go:69] worker 49 listening for tasks. I0418 14:55:01.909782 1 tasks_processing.go:69] worker 33 listening for tasks. I0418 14:55:01.909788 1 tasks_processing.go:69] worker 62 listening for tasks. I0418 14:55:01.909794 1 tasks_processing.go:69] worker 50 listening for tasks. I0418 14:55:01.909798 1 tasks_processing.go:69] worker 35 listening for tasks. I0418 14:55:01.909804 1 tasks_processing.go:69] worker 28 listening for tasks. I0418 14:55:01.909802 1 tasks_processing.go:69] worker 51 listening for tasks. I0418 14:55:01.909640 1 tasks_processing.go:71] worker 63 working on ceph_cluster task. I0418 14:55:01.910764 1 tasks_processing.go:71] worker 51 working on openstack_dataplanenodesets task. I0418 14:55:01.910778 1 tasks_processing.go:71] worker 33 working on networks task. I0418 14:55:01.910785 1 tasks_processing.go:71] worker 61 working on machine_config_pools task. I0418 14:55:01.910865 1 tasks_processing.go:71] worker 39 working on container_runtime_configs task. I0418 14:55:01.910927 1 tasks_processing.go:71] worker 28 working on nodenetworkstates task. I0418 14:55:01.910908 1 tasks_processing.go:71] worker 50 working on qemu_kubevirt_launcher_logs task. I0418 14:55:01.909828 1 tasks_processing.go:71] worker 6 working on operators_pods_and_events task. I0418 14:55:01.909823 1 tasks_processing.go:71] worker 9 working on olm_operators task. I0418 14:55:01.909835 1 tasks_processing.go:71] worker 12 working on jaegers task. I0418 14:55:01.909834 1 tasks_processing.go:69] worker 55 listening for tasks. I0418 14:55:01.911248 1 tasks_processing.go:71] worker 55 working on storage_cluster task. I0418 14:55:01.909919 1 tasks_processing.go:71] worker 34 working on storage_classes task. I0418 14:55:01.909924 1 tasks_processing.go:71] worker 32 working on machine_autoscalers task. I0418 14:55:01.909931 1 tasks_processing.go:71] worker 54 working on certificate_signing_requests task. I0418 14:55:01.909936 1 tasks_processing.go:71] worker 16 working on openstack_dataplanedeployments task. I0418 14:55:01.909942 1 tasks_processing.go:71] worker 13 working on cluster_apiserver task. I0418 14:55:01.909943 1 tasks_processing.go:71] worker 48 working on ingress task. I0418 14:55:01.909949 1 tasks_processing.go:71] worker 25 working on machine_healthchecks task. I0418 14:55:01.909950 1 tasks_processing.go:71] worker 23 working on overlapping_namespace_uids task. I0418 14:55:01.909953 1 tasks_processing.go:71] worker 57 working on active_alerts task. W0418 14:55:01.912119 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 14:55:01.909956 1 tasks_processing.go:71] worker 37 working on tsdb_status task. W0418 14:55:01.912185 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 14:55:01.909957 1 tasks_processing.go:71] worker 46 working on infrastructures task. I0418 14:55:01.912159 1 tasks_processing.go:71] worker 57 working on openshift_machine_api_events task. I0418 14:55:01.912287 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 54.7µs to process 0 records I0418 14:55:01.912306 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 30.156µs to process 0 records I0418 14:55:01.912315 1 tasks_processing.go:74] worker 37 stopped. I0418 14:55:01.909963 1 tasks_processing.go:71] worker 15 working on machines task. I0418 14:55:01.909963 1 tasks_processing.go:71] worker 56 working on monitoring_persistent_volumes task. I0418 14:55:01.909969 1 tasks_processing.go:71] worker 26 working on nodenetworkconfigurationpolicies task. I0418 14:55:01.909969 1 tasks_processing.go:71] worker 14 working on validating_webhook_configurations task. I0418 14:55:01.909754 1 tasks_processing.go:69] worker 22 listening for tasks. I0418 14:55:01.912855 1 tasks_processing.go:74] worker 22 stopped. I0418 14:55:01.910236 1 tasks_processing.go:71] worker 41 working on cost_management_metrics_configs task. I0418 14:55:01.910456 1 tasks_processing.go:71] worker 58 working on pdbs task. I0418 14:55:01.910915 1 tasks_processing.go:71] worker 62 working on ingress_certificates task. I0418 14:55:01.913177 1 tasks_processing.go:74] worker 31 stopped. I0418 14:55:01.909820 1 tasks_processing.go:69] worker 53 listening for tasks. I0418 14:55:01.913214 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 3.380156ms to process 0 records I0418 14:55:01.913230 1 tasks_processing.go:74] worker 53 stopped. I0418 14:55:01.913231 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 3.299997ms to process 0 records I0418 14:55:01.913237 1 tasks_processing.go:74] worker 27 stopped. I0418 14:55:01.910923 1 tasks_processing.go:71] worker 35 working on config_maps task. I0418 14:55:01.910915 1 tasks_processing.go:71] worker 49 working on clusterroles task. I0418 14:55:01.916508 1 tasks_processing.go:74] worker 20 stopped. I0418 14:55:01.916522 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 6.704479ms to process 0 records I0418 14:55:01.916535 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 6.73115ms to process 0 records I0418 14:55:01.916540 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 5.960013ms to process 0 records I0418 14:55:01.916544 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 6.710402ms to process 0 records I0418 14:55:01.916544 1 tasks_processing.go:74] worker 21 stopped. E0418 14:55:01.916550 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0418 14:55:01.916546 1 tasks_processing.go:74] worker 24 stopped. I0418 14:55:01.916553 1 tasks_processing.go:74] worker 19 stopped. I0418 14:55:01.916557 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 5.921695ms to process 0 records I0418 14:55:01.916561 1 tasks_processing.go:74] worker 44 stopped. I0418 14:55:01.916569 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 6.054736ms to process 0 records I0418 14:55:01.916579 1 tasks_processing.go:74] worker 10 stopped. I0418 14:55:01.934327 1 tasks_processing.go:74] worker 28 stopped. I0418 14:55:01.934344 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 23.344832ms to process 0 records I0418 14:55:01.934372 1 tasks_processing.go:74] worker 39 stopped. I0418 14:55:01.934378 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 23.439651ms to process 0 records I0418 14:55:01.934385 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 23.217726ms to process 0 records I0418 14:55:01.934391 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 23.615692ms to process 0 records I0418 14:55:01.934394 1 tasks_processing.go:74] worker 12 stopped. I0418 14:55:01.934396 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 23.627619ms to process 0 records I0418 14:55:01.934401 1 tasks_processing.go:74] worker 63 stopped. I0418 14:55:01.934407 1 tasks_processing.go:74] worker 51 stopped. I0418 14:55:01.934409 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0418 14:55:01.934428 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0418 14:55:01.934436 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0418 14:55:01.934437 1 tasks_processing.go:74] worker 29 stopped. I0418 14:55:01.934440 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0418 14:55:01.934448 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 24.455648ms to process 0 records I0418 14:55:01.934456 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 21.529054ms to process 0 records I0418 14:55:01.934460 1 controller.go:489] The operator is still being initialized I0418 14:55:01.934467 1 tasks_processing.go:74] worker 41 stopped. I0418 14:55:01.934468 1 controller.go:512] The operator is healthy I0418 14:55:01.934559 1 tasks_processing.go:74] worker 55 stopped. I0418 14:55:01.934575 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 23.298233ms to process 0 records I0418 14:55:01.934622 1 tasks_processing.go:74] worker 26 stopped. I0418 14:55:01.934631 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 22.087506ms to process 0 records I0418 14:55:01.934640 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 23.170124ms to process 0 records I0418 14:55:01.934645 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 23.228526ms to process 0 records I0418 14:55:01.934652 1 tasks_processing.go:74] worker 32 stopped. I0418 14:55:01.934651 1 tasks_processing.go:74] worker 16 stopped. I0418 14:55:01.934658 1 tasks_processing.go:74] worker 43 stopped. I0418 14:55:01.934773 1 recorder.go:75] Recording config/image with fingerprint=1a331aa1658b287c04def02632c407dfdea67550711b364d3bdafb4460cd95fa I0418 14:55:01.934788 1 gather.go:177] gatherer "clusterconfig" function "image" took 24.14694ms to process 1 records I0418 14:55:01.934862 1 tasks_processing.go:74] worker 2 stopped. I0418 14:55:01.935027 1 gather_logs.go:145] no pods in namespace were found I0418 14:55:01.935064 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=56fcb79741a6b57e46168adbe612486238daa324b9ae832721e7548ffb5fb2de I0418 14:55:01.935074 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 25.089374ms to process 1 records I0418 14:55:01.935079 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 25.004783ms to process 0 records E0418 14:55:01.935084 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0418 14:55:01.935088 1 tasks_processing.go:74] worker 36 stopped. I0418 14:55:01.935089 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 22.902408ms to process 0 records I0418 14:55:01.935094 1 tasks_processing.go:74] worker 25 stopped. I0418 14:55:01.935144 1 tasks_processing.go:74] worker 42 stopped. I0418 14:55:01.935415 1 recorder.go:75] Recording config/oauth with fingerprint=d8ad10cd8161b3611647e54964759760285a179aa8946c39f30408be91ca5edc I0418 14:55:01.935433 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 24.236733ms to process 1 records E0418 14:55:01.935448 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0418 14:55:01.935460 1 gather.go:177] gatherer "clusterconfig" function "machines" took 22.550937ms to process 0 records I0418 14:55:01.935469 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 24.021136ms to process 0 records I0418 14:55:01.935516 1 tasks_processing.go:74] worker 15 stopped. I0418 14:55:01.935519 1 tasks_processing.go:74] worker 50 stopped. I0418 14:55:01.935539 1 recorder.go:75] Recording config/proxy with fingerprint=27369230307487b6049baa1ad6f16dad8aac90127c47aa6fd89aa3acee94f9c5 I0418 14:55:01.935549 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 25.092855ms to process 1 records I0418 14:55:01.935585 1 tasks_processing.go:74] worker 40 stopped. I0418 14:55:01.935651 1 tasks_processing.go:74] worker 46 stopped. I0418 14:55:01.936144 1 recorder.go:75] Recording config/infrastructure with fingerprint=49d857ddf800e06570dc363912169103e3b4f1eb84efe01effb7aa041ea9b3a6 I0418 14:55:01.936160 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 22.916454ms to process 1 records E0418 14:55:01.936170 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0418 14:55:01.936178 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 25.51248ms to process 0 records I0418 14:55:01.936244 1 tasks_processing.go:74] worker 3 stopped. I0418 14:55:01.936311 1 tasks_processing.go:74] worker 33 stopped. I0418 14:55:01.936367 1 recorder.go:75] Recording config/network with fingerprint=b2b8d6031f2a25c8040b87edb19dd3ac43c8f3563d5136482add247dcbcc8f50 I0418 14:55:01.936383 1 gather.go:177] gatherer "clusterconfig" function "networks" took 24.728069ms to process 1 records I0418 14:55:01.936395 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 23.406684ms to process 0 records I0418 14:55:01.936463 1 tasks_processing.go:74] worker 57 stopped. I0418 14:55:01.936519 1 recorder.go:75] Recording config/featuregate with fingerprint=79ccffec56933b8c70ec9465233348c609ee24f52b88ef23627ce283257248ff I0418 14:55:01.936529 1 tasks_processing.go:74] worker 30 stopped. I0418 14:55:01.936533 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 26.008958ms to process 1 records I0418 14:55:01.936635 1 tasks_processing.go:74] worker 8 stopped. I0418 14:55:01.936997 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=a22fe572f3f6e63fce4e0a73a577252127c9f46bd967ec63c82b9fe3b2a97847 I0418 14:55:01.937013 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 26.335904ms to process 1 records I0418 14:55:01.939477 1 tasks_processing.go:74] worker 48 stopped. I0418 14:55:01.939627 1 recorder.go:75] Recording config/ingress with fingerprint=db12a145d50981681a029586ca4b00e97cac2617d242756d3379a996fd5a67ec I0418 14:55:01.939647 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 27.698142ms to process 1 records I0418 14:55:01.940069 1 tasks_processing.go:74] worker 52 stopped. I0418 14:55:01.940147 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=11ae9e76939350c9c8564331a30a15d3d56d1bd2dff09aec9ec9f4e8cd8e435a I0418 14:55:01.940159 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 29.595402ms to process 1 records I0418 14:55:01.940427 1 tasks_processing.go:74] worker 18 stopped. I0418 14:55:01.940694 1 recorder.go:75] Recording config/node/ip-10-0-0-28.ec2.internal with fingerprint=c383f8f61f2c6ff3035130752c497fd75bd51e1e497e0aeaa55147e0f16cdffd I0418 14:55:01.940750 1 recorder.go:75] Recording config/node/ip-10-0-1-68.ec2.internal with fingerprint=38da2ca4913b3e55d9a7e319882312435e6af56e858be810220e538d2f4eabcf I0418 14:55:01.940800 1 recorder.go:75] Recording config/node/ip-10-0-2-198.ec2.internal with fingerprint=863bc95adaebe2a6f6123a31de36119a2149950629e6e078a7e8e42d0d77f2f2 I0418 14:55:01.940808 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 30.576338ms to process 3 records I0418 14:55:01.941822 1 tasks_processing.go:74] worker 5 stopped. I0418 14:55:01.942016 1 recorder.go:75] Recording config/authentication with fingerprint=8fccab2a761479843e48ba60ccfabd00a3eb554e6a877030bb4e88d44a17384b I0418 14:55:01.942030 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 31.783264ms to process 1 records I0418 14:55:01.942361 1 tasks_processing.go:74] worker 56 stopped. I0418 14:55:01.942378 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 29.889268ms to process 0 records I0418 14:55:01.942530 1 tasks_processing.go:74] worker 61 stopped. I0418 14:55:01.942544 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 31.733823ms to process 0 records I0418 14:55:01.942683 1 tasks_processing.go:74] worker 58 stopped. I0418 14:55:01.942779 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=65db0aeee55f61d1555ccef18d865a3e3d1f155056a20c4e2102aaa743b17f20 I0418 14:55:01.942807 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=86f46a1bea47b171360ea036da569e2f972860875e77e5d029ce8e74fd19d2b5 I0418 14:55:01.942831 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=7cc4290ace65b93b7324fc90f208eb3b6c50250707fdf77ede71c6dbc92e6305 I0418 14:55:01.942841 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 29.635174ms to process 3 records I0418 14:55:01.942901 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=ebcdbb9f4677217640bf3c5e8c2cb9efc545e5eb8046ab77037cc167275a121f I0418 14:55:01.942916 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=ea04a144c01d1492afa63f16c85b6d7a44605a2ed91436b841156e0d5b724069 I0418 14:55:01.942922 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 31.395964ms to process 2 records I0418 14:55:01.942930 1 tasks_processing.go:74] worker 34 stopped. I0418 14:55:01.943004 1 tasks_processing.go:74] worker 13 stopped. I0418 14:55:01.943112 1 recorder.go:75] Recording config/apiserver with fingerprint=6af38e2c6ad5555e976970c16db0b931da77c4f8d6aa92565a1a0d9538539a49 I0418 14:55:01.943142 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 31.337109ms to process 1 records I0418 14:55:01.944364 1 tasks_processing.go:74] worker 23 stopped. I0418 14:55:01.944455 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0418 14:55:01.944491 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 32.311877ms to process 1 records I0418 14:55:01.944576 1 tasks_processing.go:74] worker 54 stopped. I0418 14:55:01.944638 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 33.133701ms to process 0 records W0418 14:55:01.948245 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 14:55:01.948363 1 tasks_processing.go:74] worker 59 stopped. I0418 14:55:01.948632 1 recorder.go:75] Recording config/version with fingerprint=924287301624286bae4c7d518772c8a6e4fc61c27e452a79b1038e6def96743a I0418 14:55:01.948646 1 recorder.go:75] Recording config/id with fingerprint=b952522e091996672f6f16c96ed1a0157c75386a4f08caf11bca48f993686d8f I0418 14:55:01.948652 1 gather.go:177] gatherer "clusterconfig" function "version" took 37.783292ms to process 2 records I0418 14:55:01.948748 1 tasks_processing.go:74] worker 7 stopped. I0418 14:55:01.949107 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=bcdf31d57807a98c76a372494ed9b94829f17d49b9ed65e74e2e81970d78ae43 I0418 14:55:01.949337 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=3e8c1382c0f013f88931b65a2d1ffcb5cdbe66ab168fc8f817a98742a490f4cc I0418 14:55:01.949348 1 gather.go:177] gatherer "clusterconfig" function "crds" took 38.6334ms to process 2 records I0418 14:55:01.950946 1 tasks_processing.go:74] worker 49 stopped. I0418 14:55:01.951207 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=1eddb44928589d24fdbce992b132db9fbaddde11d0c77bba442883110b2e8836 I0418 14:55:01.951351 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=ec094093a0263df55ef424958b17f667d1139f41e150cd40b543a47c08f29ac6 I0418 14:55:01.951366 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 37.665372ms to process 2 records I0418 14:55:01.951380 1 tasks_processing.go:74] worker 47 stopped. I0418 14:55:01.951695 1 recorder.go:75] Recording config/running_containers with fingerprint=305774c56b4b63149bbac067ef3b9ba58c899a3f9f7df42ad1d979725962998c I0418 14:55:01.951767 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 41.362312ms to process 1 records I0418 14:55:01.951988 1 tasks_processing.go:74] worker 14 stopped. I0418 14:55:01.952679 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=434fdb77b25f59d247c0fd92dd0eb67e9b3ea975a2baff94a33f1d1cceb42667 I0418 14:55:01.953081 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=8994b4fa6f4d5fc8a2287d07307d41be9131c31c5bc2efca3debdba65a96afce I0418 14:55:01.953185 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=aaa11dbf80915e19b1c7d5f1c916010c06949c4ca219ecbaa95f6bcc09a03d21 I0418 14:55:01.953258 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=72795b5b8f796c3d7c847111bccaa381f7e118554288e9acc96794d00094df3d I0418 14:55:01.953321 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=edcc07ce33c60fbd842298faed7ed76e7131fb6fb680f25159c336f7bb5d3aa9 I0418 14:55:01.953703 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=587d48fc9e78ebaa22a5c883c1e82a2620a304969cd87e59740dd9e794fd6d81 I0418 14:55:01.953761 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=8fe1a80a7f218ab99c7672815363ac04c91c0f39a945ed22df9a9c53489b5fc7 I0418 14:55:01.953801 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=b2ad2215a175fd77f7a807a08d87226f29618409ee2738d143c59c836a86390d I0418 14:55:01.953825 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=6e61d2543419a10dbd8f5e0981923bbce26ca04cc167a06fd49ca7e573d57dbc I0418 14:55:01.953851 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=f80c0000f056fd752e2fac499ca638a9e6bdd707a757b654d4e160b5a05bf459 I0418 14:55:01.953874 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=32729e9594f5ea0171f3c13f2a24f8d9008224674c2fabf48d540d2eab8250f4 I0418 14:55:01.953884 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 39.304667ms to process 11 records I0418 14:55:01.953895 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 41.632666ms to process 0 records I0418 14:55:01.953908 1 tasks_processing.go:74] worker 38 stopped. I0418 14:55:01.953940 1 recorder.go:75] Recording config/olm_operators with fingerprint=399da30fb9eee764a94b9976980d81fb7f4244735970beb6f8bdbc0ab30fe1ff I0418 14:55:01.953948 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 41.373702ms to process 1 records I0418 14:55:01.953952 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 43.480788ms to process 0 records I0418 14:55:01.953977 1 tasks_processing.go:74] worker 9 stopped. I0418 14:55:01.953985 1 tasks_processing.go:74] worker 11 stopped. I0418 14:55:01.954033 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=f8e6c89662d50cde213f9076df4fa8f40015dc17beca084f91b2ee0cf0326baf I0418 14:55:01.954057 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=b7406ec23ddca1e097c1d235f5054a6659482057fe48b96b026bc806a68c2796 I0418 14:55:01.954059 1 tasks_processing.go:74] worker 45 stopped. I0418 14:55:01.954079 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=ef5a8c8a77c00e29ccbb2aef292dd7c0746ecdd11d4d16caa318a6dd27026087 I0418 14:55:01.954084 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 43.064724ms to process 3 records I0418 14:55:01.957383 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0418 14:55:01.957453 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0418 14:55:01.957543 1 operator.go:288] started I0418 14:55:01.957562 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0418 14:55:01.958608 1 tasks_processing.go:74] worker 0 stopped. I0418 14:55:01.958632 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0418 14:55:01.958641 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 48.883723ms to process 1 records I0418 14:55:01.970298 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0418 14:55:01.970310 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0418 14:55:01.970314 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0418 14:55:01.970319 1 controller.go:212] Source scaController *sca.Controller is not ready I0418 14:55:01.970324 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0418 14:55:01.970344 1 controller.go:489] The operator is still being initialized I0418 14:55:01.970352 1 controller.go:512] The operator is healthy I0418 14:55:01.973465 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0418 14:55:01.973474 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0418 14:55:01.973527 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0418 14:55:01.977831 1 prometheus_rules.go:88] Prometheus rules successfully created E0418 14:55:01.977837 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2785f32514-3f1e-459e-97c7-d61cee665362%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:52921->172.30.0.10:53: read: connection refused I0418 14:55:01.977851 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%2785f32514-3f1e-459e-97c7-d61cee665362%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:52921->172.30.0.10:53: read: connection refused I0418 14:55:01.978867 1 base_controller.go:82] Caches are synced for ConfigController I0418 14:55:01.978881 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0418 14:55:02.010995 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 14:55:02.011678 1 tasks_processing.go:74] worker 35 stopped. E0418 14:55:02.011692 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0418 14:55:02.011699 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0418 14:55:02.011703 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0418 14:55:02.011714 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0418 14:55:02.011742 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0418 14:55:02.011749 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0418 14:55:02.011753 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0418 14:55:02.011757 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0418 14:55:02.011795 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0418 14:55:02.011802 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0418 14:55:02.011808 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 98.419919ms to process 7 records I0418 14:55:02.053087 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0418 14:55:02.056469 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:49853->172.30.0.10:53: read: connection refused I0418 14:55:02.056485 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.13:49853->172.30.0.10:53: read: connection refused I0418 14:55:02.058013 1 base_controller.go:82] Caches are synced for LoggingSyncer I0418 14:55:02.058022 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0418 14:55:02.060284 1 tasks_processing.go:74] worker 62 stopped. E0418 14:55:02.060302 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0418 14:55:02.060309 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pokgojp8lbl9musjri2502dflis12lj-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pokgojp8lbl9musjri2502dflis12lj-primary-cert-bundle-secret" not found I0418 14:55:02.060366 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=35c2fe9e53449df3361b2d28806c155981ea16899ece63feb2351d4fc2804829 I0418 14:55:02.060380 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 147.128776ms to process 1 records I0418 14:55:02.082649 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0418 14:55:02.102743 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0418 14:55:02.353497 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0418 14:55:02.353513 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0418 14:55:02.354140 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-59l4s pod in namespace openshift-dns (previous: false). I0418 14:55:02.583367 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-59l4s pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-59l4s\" is waiting to start: ContainerCreating" I0418 14:55:02.583390 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-59l4s\" is waiting to start: ContainerCreating" I0418 14:55:02.583400 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-59l4s pod in namespace openshift-dns (previous: false). I0418 14:55:02.759571 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-59l4s pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-59l4s\" is waiting to start: ContainerCreating" I0418 14:55:02.759591 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-59l4s\" is waiting to start: ContainerCreating" I0418 14:55:02.759619 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-bzqm2 pod in namespace openshift-dns (previous: false). W0418 14:55:02.946364 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 14:55:02.980892 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bzqm2 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-bzqm2\" is waiting to start: ContainerCreating" I0418 14:55:02.980909 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-bzqm2\" is waiting to start: ContainerCreating" I0418 14:55:02.980917 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-bzqm2 pod in namespace openshift-dns (previous: false). I0418 14:55:03.169765 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bzqm2 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-bzqm2\" is waiting to start: ContainerCreating" I0418 14:55:03.169784 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-bzqm2\" is waiting to start: ContainerCreating" I0418 14:55:03.169797 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-qh77g pod in namespace openshift-dns (previous: false). I0418 14:55:03.371064 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0418 14:55:03.388451 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qh77g pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-qh77g\" is waiting to start: ContainerCreating" I0418 14:55:03.388467 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-qh77g\" is waiting to start: ContainerCreating" I0418 14:55:03.388475 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-qh77g pod in namespace openshift-dns (previous: false). I0418 14:55:03.559947 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qh77g pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-qh77g\" is waiting to start: ContainerCreating" I0418 14:55:03.559964 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-qh77g\" is waiting to start: ContainerCreating" I0418 14:55:03.559974 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-7l4fz pod in namespace openshift-dns (previous: false). I0418 14:55:03.759808 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 14:55:03.759827 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-mmnst pod in namespace openshift-dns (previous: false). W0418 14:55:03.946865 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 14:55:03.959956 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 14:55:03.959974 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-t9pld pod in namespace openshift-dns (previous: false). I0418 14:55:03.972618 1 tasks_processing.go:74] worker 4 stopped. I0418 14:55:03.972669 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=657ec4fce6e97d56ca7c3caa4f6a22898224febfb38bf1ff9d4699ef1abb2053 I0418 14:55:03.972702 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=e3b4422f97aea5284fdf8a62be5026f88114ec618923b356f1273f9652f0eb93 I0418 14:55:03.972732 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0418 14:55:03.972758 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=3d08c6fe5fc9eb1cbb093348b994efc570d5e3c6a90635c74ac7608add2fe3e7 I0418 14:55:03.972776 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0418 14:55:03.972814 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=06f9e5af65801e29bceab2a72c2e0b630edb915756d1aeb359c2b30c25fa6e43 I0418 14:55:03.972845 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=6baccd6adfdc7ece99a1b1b3351eb51f7242326a373e4f59a573fc3fc1afb4cc I0418 14:55:03.972868 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=cab6b938a9cb799524320ecb14c78ba2cf25b84cd22f6092f9f80ae138e92016 I0418 14:55:03.972882 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=9e17185b34ea0b6ed3349ae633cce89669d8fac90278f64db3f66117e62293a2 I0418 14:55:03.972898 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=8a242cad70468f33107fac05738da3c3ba16e5e2e710d810f16fef10ff578fa3 I0418 14:55:03.972907 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0418 14:55:03.972923 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=d174bd697b69a2d223f14a268c0ba3556a99e43a0be4805e7df8d91dfca4318f I0418 14:55:03.972934 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0418 14:55:03.972950 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=6e5474afbfa4f0b73b298a94ba0d135e035bcb170ec708c283f34e294964e3e9 I0418 14:55:03.972959 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0418 14:55:03.972972 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=453c0523662f79d135fbbf9398bf0e411657502c8a657ae4e5760866ca2a5682 I0418 14:55:03.972979 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0418 14:55:03.972994 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=5dc610fc16a8c0cf777c7d18edc004af1cf9f2dd90bb4b1d13187c461e453377 I0418 14:55:03.973112 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=5d94c638db13f3e38efe028acba476f829ec6bc94993186250016b0bba89c13e I0418 14:55:03.973121 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0418 14:55:03.973148 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0418 14:55:03.973186 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0418 14:55:03.973220 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=b116972b67c2a7824f282c7aca16966cfe96e45237ef114f7e2c62e019f57092 I0418 14:55:03.973246 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=173afd65ce3e572b7ac1d98e9fb085fe68361670daa655a64959a3d08cf9bdcb I0418 14:55:03.973255 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0418 14:55:03.973270 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=c0357b8ee5a44ce12b2b5572135659713c34c3831a22c2258a49fb99d8dda4ca I0418 14:55:03.973305 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0418 14:55:03.973321 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=a4bc8c41ccd23b985dcd998f8d6d17f114eaa2c3d1234911bdc40fdbba81a158 I0418 14:55:03.973335 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=62cd1319b9b66478609c65de01a381038571c573a2c9b83f4c824198a3eca891 I0418 14:55:03.973348 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=cc6e82ea8a7f8797c41d32dedb90c94201b03e43f8d79b9faffc35af0b405c0d I0418 14:55:03.973363 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=1f386bf9e3033c786f2098979141e35082aa389500245ee7663f51e49bf84c83 I0418 14:55:03.973385 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=6cf3f1a5354a543413424ce3edd86dbfa29e78ff6f6415141685e1b802ec979b I0418 14:55:03.973395 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0418 14:55:03.973417 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=e5222b747875a8446c110d3448f0dc596ea03ab2cb822b0d6ef13af5ad62ec53 I0418 14:55:03.973433 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0418 14:55:03.973442 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0418 14:55:03.973450 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.062960349s to process 36 records I0418 14:55:04.171161 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 14:55:04.171217 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-599458bf9d-rkrkr pod in namespace openshift-image-registry (previous: false). I0418 14:55:04.358305 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-599458bf9d-rkrkr pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-599458bf9d-rkrkr\" is waiting to start: ContainerCreating" I0418 14:55:04.358325 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-599458bf9d-rkrkr\" is waiting to start: ContainerCreating" I0418 14:55:04.358371 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7d9669c977-hhswg pod in namespace openshift-image-registry (previous: false). I0418 14:55:04.559101 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7d9669c977-hhswg pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7d9669c977-hhswg\" is waiting to start: ContainerCreating" I0418 14:55:04.559123 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7d9669c977-hhswg\" is waiting to start: ContainerCreating" I0418 14:55:04.559181 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7d9669c977-m8pdx pod in namespace openshift-image-registry (previous: false). I0418 14:55:04.759279 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7d9669c977-m8pdx pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7d9669c977-m8pdx\" is waiting to start: ContainerCreating" I0418 14:55:04.759301 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7d9669c977-m8pdx\" is waiting to start: ContainerCreating" I0418 14:55:04.759311 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-8xncw pod in namespace openshift-image-registry (previous: false). W0418 14:55:04.946623 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 14:55:04.961584 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 14:55:04.961600 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-z6l9b pod in namespace openshift-image-registry (previous: false). I0418 14:55:05.160204 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 14:55:05.160223 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-z8lcs pod in namespace openshift-image-registry (previous: false). I0418 14:55:05.359720 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0418 14:55:05.359741 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6bc954d75c-qlblq pod in namespace openshift-ingress (previous: false). I0418 14:55:05.558714 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6bc954d75c-qlblq pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6bc954d75c-qlblq\" is waiting to start: ContainerCreating" I0418 14:55:05.558732 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6bc954d75c-qlblq\" is waiting to start: ContainerCreating" I0418 14:55:05.558744 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-cc8574954-7pqsj pod in namespace openshift-ingress (previous: false). I0418 14:55:05.758751 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-cc8574954-7pqsj pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-cc8574954-7pqsj\" is waiting to start: ContainerCreating" I0418 14:55:05.758766 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-cc8574954-7pqsj\" is waiting to start: ContainerCreating" I0418 14:55:05.758777 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-cc8574954-snvmf pod in namespace openshift-ingress (previous: false). W0418 14:55:05.948538 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0418 14:55:05.961162 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-cc8574954-snvmf pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-cc8574954-snvmf\" is waiting to start: ContainerCreating" I0418 14:55:05.961179 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-cc8574954-snvmf\" is waiting to start: ContainerCreating" I0418 14:55:05.961208 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-kxfrs pod in namespace openshift-ingress-canary (previous: false). I0418 14:55:06.163973 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-kxfrs pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-kxfrs\" is waiting to start: ContainerCreating" I0418 14:55:06.163998 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-kxfrs\" is waiting to start: ContainerCreating" I0418 14:55:06.164009 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-m2nv8 pod in namespace openshift-ingress-canary (previous: false). I0418 14:55:06.357906 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-m2nv8 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-m2nv8\" is waiting to start: ContainerCreating" I0418 14:55:06.357925 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-m2nv8\" is waiting to start: ContainerCreating" I0418 14:55:06.357936 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-xw4n2 pod in namespace openshift-ingress-canary (previous: false). I0418 14:55:06.558579 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-xw4n2 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-xw4n2\" is waiting to start: ContainerCreating" I0418 14:55:06.558595 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-xw4n2\" is waiting to start: ContainerCreating" I0418 14:55:06.558615 1 tasks_processing.go:74] worker 6 stopped. I0418 14:55:06.558715 1 recorder.go:75] Recording events/openshift-dns with fingerprint=f7491f7d4df750be14683419995d41db2c256e97f9e53bc38efb8b48d23af92a I0418 14:55:06.558815 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=c115b5bf84bc4cb8aafe8d944afef09215d7fefbb2072d315cf45eeeffc91ba7 I0418 14:55:06.558843 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=d5dc5989d6503a5442d21d485ab2fec4c446877dd3ce4c8d46e758503acb9cca I0418 14:55:06.558888 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=55c9c0c80989cd6548391d4d31ab0beb11b76afe1505751cffb1019b853b520e I0418 14:55:06.558905 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=5809111278e1dc0fbd006fb337fdfc6fdc1544ee90ceeafb818dd28639f65760 I0418 14:55:06.560221 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-bzqm2 with fingerprint=aece366fc0efb83b59955c8aaef7579aead2863c62ff8ccb1196630ca69e90ef I0418 14:55:06.560341 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-599458bf9d-rkrkr with fingerprint=e16cc92958bfc9529d7b6b6b48f7e2fc22d7756569ef64b9f2d7d63df4ba6b09 I0418 14:55:06.560432 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7d9669c977-hhswg with fingerprint=668be509556848ffc5d85db30887d794a09a2cc103d896c1c72ecd5d45c385a9 I0418 14:55:06.560518 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7d9669c977-m8pdx with fingerprint=9832ac067c6517ae9ff798fad2563862f0c62112422fc91db8513fd9436674c3 I0418 14:55:06.560575 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-kxfrs with fingerprint=bcc7cff4ce1af49a30606d860a6dbbeb0f7794dcf52a6a04b3ed7166bd25630f I0418 14:55:06.560584 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.647561829s to process 10 records W0418 14:55:06.946684 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0418 14:55:06.946711 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0418 14:55:06.946723 1 tasks_processing.go:74] worker 60 stopped. E0418 14:55:06.946732 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0418 14:55:06.946744 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0418 14:55:06.946760 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0418 14:55:06.946772 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.035993113s to process 1 records I0418 14:55:14.353568 1 tasks_processing.go:74] worker 17 stopped. I0418 14:55:14.353606 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0418 14:55:14.353618 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.443701921s to process 1 records I0418 14:55:14.677549 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 14:55:14.777069 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 14:55:14.880119 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 14:55:15.099187 1 configmapobserver.go:84] configmaps "insights-config" not found I0418 14:55:15.117292 1 tasks_processing.go:74] worker 1 stopped. I0418 14:55:15.117731 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=751aa8b7d1208af5fd734152a53c8f2354708612b0cd50cfd9c595651a5cc8c8 I0418 14:55:15.117751 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.207587497s to process 1 records E0418 14:55:15.117829 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.208s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0418 14:55:15.118944 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0418 14:55:15.118961 1 periodic.go:209] Running workloads gatherer I0418 14:55:15.118978 1 tasks_processing.go:45] number of workers: 2 I0418 14:55:15.118988 1 tasks_processing.go:69] worker 1 listening for tasks. I0418 14:55:15.118992 1 tasks_processing.go:71] worker 1 working on workload_info task. I0418 14:55:15.119003 1 tasks_processing.go:69] worker 0 listening for tasks. I0418 14:55:15.119021 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0418 14:55:15.148926 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0418 14:55:15.151243 1 tasks_processing.go:74] worker 0 stopped. I0418 14:55:15.151268 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 32.204694ms to process 0 records I0418 14:55:15.158531 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (11ms) I0418 14:55:15.168218 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (10ms) I0418 14:55:15.177471 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (9ms) I0418 14:55:15.186781 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (9ms) I0418 14:55:15.196437 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (10ms) I0418 14:55:15.205939 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (9ms) I0418 14:55:15.215314 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (9ms) I0418 14:55:15.229284 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (14ms) I0418 14:55:15.240192 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (11ms) I0418 14:55:15.251739 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (12ms) I0418 14:55:15.265695 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (14ms) I0418 14:55:15.359646 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (94ms) I0418 14:55:15.458112 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (98ms) I0418 14:55:15.560999 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (103ms) I0418 14:55:15.660701 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0418 14:55:15.758753 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (98ms) I0418 14:55:15.860152 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (101ms) I0418 14:55:15.959552 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (99ms) I0418 14:55:16.059380 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (100ms) I0418 14:55:16.159397 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (100ms) I0418 14:55:16.260029 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (101ms) I0418 14:55:16.359772 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0418 14:55:16.458953 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (99ms) I0418 14:55:16.560943 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (102ms) I0418 14:55:16.659685 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (99ms) I0418 14:55:16.759468 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0418 14:55:16.868691 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (109ms) I0418 14:55:16.978712 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (110ms) I0418 14:55:17.066163 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (87ms) I0418 14:55:17.166366 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (100ms) I0418 14:55:17.261215 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (95ms) I0418 14:55:17.366928 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (106ms) I0418 14:55:17.366961 1 tasks_processing.go:74] worker 1 stopped. E0418 14:55:17.366971 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0418 14:55:17.367248 1 recorder.go:75] Recording config/workload_info with fingerprint=2fbc5fe100eeab318cab14f4873fa1c9d1d1bb954ca04eb2c8946fa9d0c73789 I0418 14:55:17.367266 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.247961634s to process 1 records E0418 14:55:17.367293 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.248s with: function \"workload_info\" failed with an error" I0418 14:55:17.369046 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0418 14:55:17.369070 1 periodic.go:209] Running conditional gatherer I0418 14:55:17.376768 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0418 14:55:17.382922 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.13:37682->172.30.0.10:53: read: connection refused E0418 14:55:17.383196 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0418 14:55:17.383254 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0418 14:55:17.391276 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0418 14:55:17.391290 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 14:55:17.391295 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 14:55:17.391299 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 14:55:17.391302 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 14:55:17.391305 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 14:55:17.391308 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 14:55:17.391311 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 14:55:17.391313 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0418 14:55:17.391316 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0418 14:55:17.391331 1 tasks_processing.go:45] number of workers: 3 I0418 14:55:17.391340 1 tasks_processing.go:69] worker 2 listening for tasks. I0418 14:55:17.391345 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0418 14:55:17.391350 1 tasks_processing.go:69] worker 0 listening for tasks. I0418 14:55:17.391362 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0418 14:55:17.391367 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0418 14:55:17.391375 1 tasks_processing.go:69] worker 1 listening for tasks. I0418 14:55:17.391391 1 tasks_processing.go:74] worker 1 stopped. I0418 14:55:17.391423 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0418 14:55:17.391435 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 948ns to process 1 records I0418 14:55:17.391467 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0418 14:55:17.391476 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.078µs to process 1 records I0418 14:55:17.391481 1 tasks_processing.go:74] worker 0 stopped. I0418 14:55:17.391626 1 tasks_processing.go:74] worker 2 stopped. I0418 14:55:17.391643 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 249.64µs to process 0 records I0418 14:55:17.391675 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.13:37682->172.30.0.10:53: read: connection refused I0418 14:55:17.391700 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0418 14:55:17.435006 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=b25ea4148fd31763e288675b920cc7106d6472e2fe39cb149076e37bab31de02 I0418 14:55:17.435121 1 diskrecorder.go:70] Writing 105 records to /var/lib/insights-operator/insights-2026-04-18-145517.tar.gz I0418 14:55:17.442146 1 diskrecorder.go:51] Wrote 105 records to disk in 7ms I0418 14:55:17.442193 1 periodic.go:278] Gathering cluster info every 2h0m0s I0418 14:55:17.442212 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0418 14:56:16.387258 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="898fa65b54c75e91c5c13170ba89bf6a64b36038ebd076436223d7c517f2164a") W0418 14:56:16.387293 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0418 14:56:16.387339 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="b3d6e45a48650e905bc497c72b473e0681fbfe98a5c470076ce7045e91f693c3") I0418 14:56:16.387344 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0418 14:56:16.387369 1 base_controller.go:181] Shutting down ConfigController ... I0418 14:56:16.387418 1 periodic.go:170] Shutting down I0418 14:56:16.387418 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="f584716327539469cc2e72b8598a53302c91db0a26a09cfeec38cc6db276db28") I0418 14:56:16.387420 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0418 14:56:16.387446 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I0418 14:56:16.387463 1 base_controller.go:113] All ConfigController workers have been terminated I0418 14:56:16.387466 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0418 14:56:16.387470 1 base_controller.go:181] Shutting down LoggingSyncer ... I0418 14:56:16.387475 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0418 14:56:16.387481 1 base_controller.go:113] All LoggingSyncer workers have been terminated