W0521 19:42:54.064257 1 cmd.go:257] Using insecure, self-signed certificates I0521 19:42:54.182323 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0521 19:42:54.182628 1 observer_polling.go:159] Starting file observer I0521 19:42:54.732919 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0521 19:42:54.733157 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0521 19:42:54.733692 1 secure_serving.go:57] Forcing use of http/1.1 only W0521 19:42:54.733713 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0521 19:42:54.733718 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0521 19:42:54.733722 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0521 19:42:54.733725 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0521 19:42:54.733727 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0521 19:42:54.733729 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0521 19:42:54.733798 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0521 19:42:54.738484 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0521 19:42:54.738499 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"c6385180-7a7c-42cb-ad45-9204b7adb6bc", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0521 19:42:54.739092 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0521 19:42:54.739094 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0521 19:42:54.739103 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0521 19:42:54.739115 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0521 19:42:54.739116 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0521 19:42:54.739116 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0521 19:42:54.739324 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-4288365481/tls.crt::/tmp/serving-cert-4288365481/tls.key" I0521 19:42:54.739557 1 secure_serving.go:213] Serving securely on [::]:8443 I0521 19:42:54.739586 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0521 19:42:54.743027 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0521 19:42:54.743053 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0521 19:42:54.743160 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0521 19:42:54.749001 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0521 19:42:54.749024 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0521 19:42:54.753750 1 secretconfigobserver.go:119] support secret does not exist I0521 19:42:54.761809 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0521 19:42:54.772098 1 secretconfigobserver.go:119] support secret does not exist I0521 19:42:54.778459 1 recorder.go:161] Pruning old reports every 8h12m25s, max age is 288h0m0s I0521 19:42:54.783498 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0521 19:42:54.783499 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0521 19:42:54.783516 1 insightsreport.go:296] Starting report retriever I0521 19:42:54.783524 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0521 19:42:54.783524 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0521 19:42:54.783555 1 periodic.go:209] Running clusterconfig gatherer I0521 19:42:54.783619 1 tasks_processing.go:45] number of workers: 64 I0521 19:42:54.783710 1 tasks_processing.go:69] worker 63 listening for tasks. I0521 19:42:54.783717 1 tasks_processing.go:69] worker 47 listening for tasks. I0521 19:42:54.783721 1 tasks_processing.go:71] worker 63 working on sap_pods task. I0521 19:42:54.783722 1 tasks_processing.go:69] worker 0 listening for tasks. I0521 19:42:54.783725 1 tasks_processing.go:69] worker 40 listening for tasks. I0521 19:42:54.783733 1 tasks_processing.go:69] worker 41 listening for tasks. I0521 19:42:54.783732 1 tasks_processing.go:69] worker 39 listening for tasks. I0521 19:42:54.783741 1 tasks_processing.go:69] worker 42 listening for tasks. I0521 19:42:54.783742 1 tasks_processing.go:69] worker 16 listening for tasks. I0521 19:42:54.783748 1 tasks_processing.go:69] worker 36 listening for tasks. I0521 19:42:54.783750 1 tasks_processing.go:69] worker 43 listening for tasks. I0521 19:42:54.783752 1 tasks_processing.go:69] worker 17 listening for tasks. I0521 19:42:54.783758 1 tasks_processing.go:69] worker 44 listening for tasks. I0521 19:42:54.783757 1 tasks_processing.go:69] worker 15 listening for tasks. I0521 19:42:54.783761 1 tasks_processing.go:69] worker 35 listening for tasks. I0521 19:42:54.783769 1 tasks_processing.go:69] worker 19 listening for tasks. I0521 19:42:54.783766 1 tasks_processing.go:69] worker 38 listening for tasks. I0521 19:42:54.783776 1 tasks_processing.go:69] worker 1 listening for tasks. I0521 19:42:54.783776 1 tasks_processing.go:69] worker 46 listening for tasks. I0521 19:42:54.783780 1 tasks_processing.go:69] worker 20 listening for tasks. I0521 19:42:54.783776 1 tasks_processing.go:69] worker 34 listening for tasks. I0521 19:42:54.783772 1 tasks_processing.go:69] worker 33 listening for tasks. I0521 19:42:54.783789 1 tasks_processing.go:69] worker 26 listening for tasks. I0521 19:42:54.783786 1 tasks_processing.go:69] worker 32 listening for tasks. I0521 19:42:54.783762 1 tasks_processing.go:69] worker 18 listening for tasks. I0521 19:42:54.783799 1 tasks_processing.go:69] worker 53 listening for tasks. I0521 19:42:54.783802 1 tasks_processing.go:69] worker 54 listening for tasks. I0521 19:42:54.783805 1 tasks_processing.go:69] worker 49 listening for tasks. I0521 19:42:54.783805 1 tasks_processing.go:69] worker 30 listening for tasks. I0521 19:42:54.783810 1 tasks_processing.go:69] worker 59 listening for tasks. I0521 19:42:54.783807 1 tasks_processing.go:69] worker 50 listening for tasks. I0521 19:42:54.783812 1 tasks_processing.go:69] worker 22 listening for tasks. I0521 19:42:54.783817 1 tasks_processing.go:69] worker 57 listening for tasks. I0521 19:42:54.783818 1 tasks_processing.go:69] worker 23 listening for tasks. I0521 19:42:54.783821 1 tasks_processing.go:69] worker 11 listening for tasks. I0521 19:42:54.783824 1 tasks_processing.go:69] worker 21 listening for tasks. I0521 19:42:54.783826 1 tasks_processing.go:69] worker 60 listening for tasks. I0521 19:42:54.783823 1 tasks_processing.go:69] worker 9 listening for tasks. I0521 19:42:54.783759 1 tasks_processing.go:69] worker 37 listening for tasks. I0521 19:42:54.783831 1 tasks_processing.go:69] worker 62 listening for tasks. I0521 19:42:54.783834 1 tasks_processing.go:69] worker 8 listening for tasks. I0521 19:42:54.783768 1 tasks_processing.go:69] worker 45 listening for tasks. I0521 19:42:54.783844 1 tasks_processing.go:71] worker 47 working on version task. I0521 19:42:54.783843 1 tasks_processing.go:71] worker 0 working on crds task. I0521 19:42:54.783842 1 tasks_processing.go:71] worker 40 working on support_secret task. I0521 19:42:54.783847 1 tasks_processing.go:71] worker 16 working on lokistack task. I0521 19:42:54.783849 1 tasks_processing.go:71] worker 39 working on certificate_signing_requests task. I0521 19:42:54.783856 1 tasks_processing.go:71] worker 45 working on openstack_version task. I0521 19:42:54.783855 1 tasks_processing.go:71] worker 23 working on sap_datahubs task. I0521 19:42:54.783859 1 tasks_processing.go:71] worker 38 working on validating_webhook_configurations task. I0521 19:42:54.783864 1 tasks_processing.go:71] worker 17 working on storage_classes task. I0521 19:42:54.783878 1 tasks_processing.go:69] worker 61 listening for tasks. I0521 19:42:54.783893 1 tasks_processing.go:71] worker 61 working on pod_network_connectivity_checks task. I0521 19:42:54.783916 1 tasks_processing.go:71] worker 9 working on qemu_kubevirt_launcher_logs task. I0521 19:42:54.783854 1 tasks_processing.go:71] worker 54 working on container_runtime_configs task. I0521 19:42:54.783943 1 tasks_processing.go:71] worker 37 working on networks task. I0521 19:42:54.784066 1 tasks_processing.go:71] worker 49 working on aggregated_monitoring_cr_names task. I0521 19:42:54.784115 1 tasks_processing.go:71] worker 30 working on machine_sets task. I0521 19:42:54.784126 1 tasks_processing.go:71] worker 20 working on image task. I0521 19:42:54.784134 1 tasks_processing.go:71] worker 18 working on jaegers task. I0521 19:42:54.783855 1 tasks_processing.go:71] worker 36 working on operators_pods_and_events task. I0521 19:42:54.784207 1 tasks_processing.go:71] worker 34 working on cluster_apiserver task. I0521 19:42:54.784211 1 tasks_processing.go:71] worker 35 working on tsdb_status task. W0521 19:42:54.784239 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0521 19:42:54.784256 1 tasks_processing.go:71] worker 35 working on container_images task. I0521 19:42:54.784262 1 tasks_processing.go:71] worker 53 working on openshift_machine_api_events task. I0521 19:42:54.784271 1 tasks_processing.go:71] worker 22 working on metrics task. I0521 19:42:54.784283 1 tasks_processing.go:71] worker 59 working on dvo_metrics task. W0521 19:42:54.784292 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0521 19:42:54.784295 1 tasks_processing.go:71] worker 11 working on authentication task. I0521 19:42:54.784300 1 tasks_processing.go:71] worker 21 working on ingress task. I0521 19:42:54.784311 1 tasks_processing.go:71] worker 26 working on machine_configs task. I0521 19:42:54.783786 1 tasks_processing.go:69] worker 2 listening for tasks. I0521 19:42:54.784117 1 tasks_processing.go:71] worker 1 working on olm_operators task. I0521 19:42:54.783792 1 tasks_processing.go:69] worker 52 listening for tasks. I0521 19:42:54.783859 1 tasks_processing.go:71] worker 43 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0521 19:42:54.784491 1 tasks_processing.go:71] worker 52 working on silenced_alerts task. I0521 19:42:54.784514 1 tasks_processing.go:71] worker 2 working on machine_autoscalers task. W0521 19:42:54.784516 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0521 19:42:54.783793 1 tasks_processing.go:69] worker 3 listening for tasks. I0521 19:42:54.784551 1 tasks_processing.go:71] worker 3 working on cost_management_metrics_configs task. I0521 19:42:54.783799 1 tasks_processing.go:69] worker 29 listening for tasks. I0521 19:42:54.783790 1 tasks_processing.go:69] worker 28 listening for tasks. I0521 19:42:54.783798 1 tasks_processing.go:69] worker 48 listening for tasks. I0521 19:42:54.783804 1 tasks_processing.go:69] worker 4 listening for tasks. I0521 19:42:54.783804 1 tasks_processing.go:69] worker 25 listening for tasks. I0521 19:42:54.783786 1 tasks_processing.go:69] worker 55 listening for tasks. I0521 19:42:54.783811 1 tasks_processing.go:69] worker 10 listening for tasks. I0521 19:42:54.784618 1 tasks_processing.go:71] worker 48 working on overlapping_namespace_uids task. I0521 19:42:54.783820 1 tasks_processing.go:69] worker 13 listening for tasks. I0521 19:42:54.783822 1 tasks_processing.go:69] worker 6 listening for tasks. I0521 19:42:54.784630 1 tasks_processing.go:71] worker 6 working on openshift_logging task. I0521 19:42:54.784635 1 tasks_processing.go:71] worker 10 working on node_logs task. I0521 19:42:54.783818 1 tasks_processing.go:69] worker 58 listening for tasks. I0521 19:42:54.783820 1 tasks_processing.go:69] worker 56 listening for tasks. I0521 19:42:54.783713 1 tasks_processing.go:69] worker 31 listening for tasks. I0521 19:42:54.783828 1 tasks_processing.go:69] worker 5 listening for tasks. I0521 19:42:54.783829 1 tasks_processing.go:69] worker 24 listening for tasks. I0521 19:42:54.783828 1 tasks_processing.go:69] worker 14 listening for tasks. I0521 19:42:54.783831 1 tasks_processing.go:69] worker 7 listening for tasks. I0521 19:42:54.783843 1 tasks_processing.go:71] worker 41 working on machine_healthchecks task. I0521 19:42:54.784699 1 tasks_processing.go:71] worker 7 working on ingress_certificates task. I0521 19:42:54.784713 1 tasks_processing.go:71] worker 31 working on storage_cluster task. I0521 19:42:54.784729 1 tasks_processing.go:71] worker 58 working on openstack_dataplanenodesets task. I0521 19:42:54.784739 1 tasks_processing.go:71] worker 24 working on monitoring_persistent_volumes task. I0521 19:42:54.784749 1 tasks_processing.go:71] worker 5 working on image_pruners task. I0521 19:42:54.784758 1 tasks_processing.go:71] worker 56 working on operators task. I0521 19:42:54.784630 1 tasks_processing.go:71] worker 13 working on install_plans task. I0521 19:42:54.783844 1 tasks_processing.go:71] worker 42 working on pdbs task. I0521 19:42:54.784856 1 tasks_processing.go:71] worker 14 working on infrastructures task. I0521 19:42:54.784086 1 tasks_processing.go:71] worker 15 working on nodenetworkstates task. I0521 19:42:54.784090 1 tasks_processing.go:71] worker 44 working on nodes task. I0521 19:42:54.784098 1 tasks_processing.go:71] worker 62 working on openstack_dataplanedeployments task. I0521 19:42:54.784100 1 tasks_processing.go:71] worker 8 working on proxies task. I0521 19:42:54.784109 1 tasks_processing.go:71] worker 50 working on oauths task. I0521 19:42:54.784111 1 tasks_processing.go:71] worker 33 working on mutating_webhook_configurations task. I0521 19:42:54.784122 1 tasks_processing.go:71] worker 46 working on feature_gates task. I0521 19:42:54.783792 1 tasks_processing.go:69] worker 51 listening for tasks. I0521 19:42:54.785296 1 tasks_processing.go:71] worker 51 working on openstack_controlplanes task. I0521 19:42:54.784356 1 tasks_processing.go:71] worker 57 working on nodenetworkconfigurationpolicies task. I0521 19:42:54.784362 1 tasks_processing.go:71] worker 32 working on image_registries task. I0521 19:42:54.784376 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 30.267µs to process 0 records I0521 19:42:54.785440 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 22.79µs to process 0 records I0521 19:42:54.785449 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 22.465µs to process 0 records I0521 19:42:54.785456 1 tasks_processing.go:71] worker 52 working on config_maps task. I0521 19:42:54.784389 1 tasks_processing.go:71] worker 60 working on machine_config_pools task. I0521 19:42:54.785479 1 tasks_processing.go:71] worker 22 working on machines task. I0521 19:42:54.784599 1 tasks_processing.go:71] worker 29 working on sap_config task. I0521 19:42:54.784607 1 tasks_processing.go:71] worker 28 working on schedulers task. I0521 19:42:54.784614 1 tasks_processing.go:71] worker 4 working on service_accounts task. I0521 19:42:54.783797 1 tasks_processing.go:69] worker 27 listening for tasks. I0521 19:42:54.785689 1 tasks_processing.go:74] worker 27 stopped. I0521 19:42:54.784615 1 tasks_processing.go:71] worker 25 working on clusterroles task. I0521 19:42:54.784623 1 tasks_processing.go:71] worker 55 working on active_alerts task. W0521 19:42:54.785719 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0521 19:42:54.785734 1 tasks_processing.go:74] worker 55 stopped. I0521 19:42:54.785745 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 27.37µs to process 0 records I0521 19:42:54.783815 1 tasks_processing.go:69] worker 12 listening for tasks. I0521 19:42:54.785761 1 tasks_processing.go:74] worker 12 stopped. I0521 19:42:54.783851 1 tasks_processing.go:71] worker 19 working on ceph_cluster task. I0521 19:42:54.790439 1 tasks_processing.go:74] worker 45 stopped. I0521 19:42:54.790453 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 6.567992ms to process 0 records I0521 19:42:54.797806 1 tasks_processing.go:74] worker 30 stopped. I0521 19:42:54.797824 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 13.673664ms to process 0 records I0521 19:42:54.797837 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 13.662254ms to process 0 records I0521 19:42:54.797844 1 tasks_processing.go:74] worker 18 stopped. I0521 19:42:54.797856 1 tasks_processing.go:74] worker 23 stopped. I0521 19:42:54.797867 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 13.987357ms to process 0 records I0521 19:42:54.797873 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 13.999058ms to process 0 records I0521 19:42:54.797877 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 13.911555ms to process 0 records E0521 19:42:54.797884 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0521 19:42:54.797889 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 13.97482ms to process 0 records I0521 19:42:54.797894 1 tasks_processing.go:74] worker 61 stopped. I0521 19:42:54.797898 1 tasks_processing.go:74] worker 16 stopped. I0521 19:42:54.797901 1 tasks_processing.go:74] worker 54 stopped. I0521 19:42:54.798314 1 tasks_processing.go:74] worker 2 stopped. I0521 19:42:54.798329 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 13.791243ms to process 0 records I0521 19:42:54.798357 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 14.588264ms to process 0 records I0521 19:42:54.798365 1 tasks_processing.go:74] worker 63 stopped. I0521 19:42:54.798366 1 tasks_processing.go:74] worker 40 stopped. E0521 19:42:54.798374 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0521 19:42:54.798373 1 gather_logs.go:145] no pods in namespace were found I0521 19:42:54.798379 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 14.512256ms to process 0 records I0521 19:42:54.798384 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 14.453903ms to process 0 records I0521 19:42:54.798389 1 tasks_processing.go:74] worker 9 stopped. I0521 19:42:54.800463 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0521 19:42:54.800486 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0521 19:42:54.800492 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0521 19:42:54.800496 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0521 19:42:54.800518 1 controller.go:489] The operator is still being initialized I0521 19:42:54.800527 1 controller.go:512] The operator is healthy I0521 19:42:54.807402 1 tasks_processing.go:74] worker 3 stopped. I0521 19:42:54.807419 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 22.819407ms to process 0 records I0521 19:42:54.807427 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 22.768657ms to process 0 records I0521 19:42:54.807432 1 tasks_processing.go:74] worker 6 stopped. I0521 19:42:54.815963 1 tasks_processing.go:74] worker 31 stopped. I0521 19:42:54.815975 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 31.236176ms to process 0 records I0521 19:42:54.816085 1 tasks_processing.go:74] worker 41 stopped. E0521 19:42:54.816098 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0521 19:42:54.816108 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 31.395221ms to process 0 records I0521 19:42:54.820405 1 tasks_processing.go:74] worker 58 stopped. I0521 19:42:54.820418 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 35.662639ms to process 0 records I0521 19:42:54.828784 1 tasks_processing.go:74] worker 20 stopped. I0521 19:42:54.828884 1 recorder.go:75] Recording config/image with fingerprint=8bd3fdc37bb13d1b7701c10b0984da0c76efcadc04dbd176096925510a88b463 I0521 19:42:54.828896 1 gather.go:177] gatherer "clusterconfig" function "image" took 44.644571ms to process 1 records I0521 19:42:54.829516 1 tasks_processing.go:74] worker 53 stopped. I0521 19:42:54.829534 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 45.239762ms to process 0 records I0521 19:42:54.829697 1 tasks_processing.go:74] worker 34 stopped. I0521 19:42:54.829853 1 recorder.go:75] Recording config/apiserver with fingerprint=69cc677086791c23e138e780819dafa65757b3c56d8b8a6f09db7a2b91be714e I0521 19:42:54.829878 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 45.473715ms to process 1 records I0521 19:42:54.829890 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 44.809378ms to process 0 records I0521 19:42:54.829896 1 tasks_processing.go:74] worker 15 stopped. I0521 19:42:54.830016 1 tasks_processing.go:74] worker 21 stopped. I0521 19:42:54.830195 1 recorder.go:75] Recording config/ingress with fingerprint=80808da02a92b32edecc5e6bf6fae6afb77c279b6c2fce006d544190899c5fde I0521 19:42:54.830212 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 45.707233ms to process 1 records I0521 19:42:54.830301 1 tasks_processing.go:74] worker 11 stopped. I0521 19:42:54.830377 1 recorder.go:75] Recording config/authentication with fingerprint=b1b388c4ec5cd28eaa15b6bd8303fa2628d25cba1efe3aa7a85ba91f83d4a434 I0521 19:42:54.830387 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 45.794533ms to process 1 records I0521 19:42:54.830474 1 tasks_processing.go:74] worker 5 stopped. I0521 19:42:54.830665 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=9de19d5436b8e99a4b47c739bf89c60cf1ea1cad17aa3e09a388ceb8a56abcd5 I0521 19:42:54.830677 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 45.715369ms to process 1 records I0521 19:42:54.830766 1 tasks_processing.go:74] worker 37 stopped. I0521 19:42:54.830775 1 recorder.go:75] Recording config/network with fingerprint=bc893a545cbba1e4031232ca1e03161f96566e049fc075b11a4e1a93103bec02 I0521 19:42:54.830782 1 gather.go:177] gatherer "clusterconfig" function "networks" took 46.618505ms to process 1 records I0521 19:42:54.833089 1 tasks_processing.go:74] worker 8 stopped. I0521 19:42:54.833149 1 recorder.go:75] Recording config/proxy with fingerprint=6411dd38c140da76b2c49d60e69b5fd99e46b27a91ff13d8e35a103c8339b7c5 I0521 19:42:54.833160 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 47.889699ms to process 1 records I0521 19:42:54.833210 1 tasks_processing.go:74] worker 51 stopped. I0521 19:42:54.833224 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 47.904823ms to process 0 records I0521 19:42:54.833329 1 tasks_processing.go:74] worker 29 stopped. I0521 19:42:54.833363 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 47.775737ms to process 0 records I0521 19:42:54.833478 1 tasks_processing.go:74] worker 57 stopped. I0521 19:42:54.833501 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 48.166758ms to process 0 records W0521 19:42:54.833612 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0521 19:42:54.833895 1 tasks_processing.go:74] worker 22 stopped. E0521 19:42:54.833904 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0521 19:42:54.833912 1 gather.go:177] gatherer "clusterconfig" function "machines" took 48.402022ms to process 0 records I0521 19:42:54.834150 1 tasks_processing.go:74] worker 14 stopped. I0521 19:42:54.834680 1 recorder.go:75] Recording config/infrastructure with fingerprint=851d09fb39724268c864ea01ecd77e207de8478c4da636ed57771b7be99c56b5 I0521 19:42:54.834697 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 49.279929ms to process 1 records I0521 19:42:54.834761 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=3f34815ee837a8b8cacb4687887d325bdf1dc0c751dfe9b698c4b35f1a62309d I0521 19:42:54.834777 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=54479d9a7b00bf38ed13ac8bfc72d00c176fc4ce8643cc6820ac073ac401d1f9 I0521 19:42:54.834782 1 tasks_processing.go:74] worker 17 stopped. I0521 19:42:54.834787 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 50.305127ms to process 2 records I0521 19:42:54.834794 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 49.798772ms to process 0 records I0521 19:42:54.834798 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 49.350588ms to process 0 records I0521 19:42:54.834802 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 48.698808ms to process 0 records I0521 19:42:54.834806 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 49.737167ms to process 0 records I0521 19:42:54.834864 1 tasks_processing.go:74] worker 62 stopped. I0521 19:42:54.834870 1 tasks_processing.go:74] worker 19 stopped. I0521 19:42:54.834874 1 tasks_processing.go:74] worker 10 stopped. I0521 19:42:54.834882 1 tasks_processing.go:74] worker 24 stopped. I0521 19:42:54.834940 1 tasks_processing.go:74] worker 50 stopped. I0521 19:42:54.834973 1 recorder.go:75] Recording config/oauth with fingerprint=d4599d0194729da9a1460e3a70510cf2e3f4fcb6f834b2146062741bc2bec1ea I0521 19:42:54.834983 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 49.456437ms to process 1 records I0521 19:42:54.837719 1 tasks_processing.go:74] worker 46 stopped. I0521 19:42:54.837974 1 recorder.go:75] Recording config/featuregate with fingerprint=ea6335774ebd697d41ba0b7485279af0faca9898ce761c0d56ed769f5f4ef3bb I0521 19:42:54.837997 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 52.449708ms to process 1 records I0521 19:42:54.838859 1 tasks_processing.go:74] worker 38 stopped. I0521 19:42:54.839433 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0521 19:42:54.839449 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0521 19:42:54.839502 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0521 19:42:54.839563 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=c8bf489f2a8009b2e0cc736684527b0182d69b0c3aec2828a79f1047a503cc41 I0521 19:42:54.839701 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=fa369a94921010b605ef0857250a941a8a912ad14a333d97f18a977b85798f1d I0521 19:42:54.839737 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=5ec842b9c65dcb052b930bfa53b6c2247b6992aece4d769e044bd2df9116b7cc I0521 19:42:54.839788 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=c31b9fb936e4b380214c75886fc44c55d3f1049b2aee162d937d87ada7653aed I0521 19:42:54.839828 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=7fd5baa8270553cd4a149eb1a80f2c96279817d390b64aa7a1e471a3425b8fd8 I0521 19:42:54.839867 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=8b157050ab045eb63a7462b51edca433bd80552bc80d98dfccd5a5ea2530d75d I0521 19:42:54.839905 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=66bd47d610d5b4f52593818a023067ab587b4018baef075f897e4cd7ae13f8bd I0521 19:42:54.839965 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=f501b0f7074c834f3aec0d616e83c407e183973e59797ae756fe95348297d481 I0521 19:42:54.840006 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=97cf42a1de6caa01c80a7546b697d4fd41e2040964c0187a048b2a059864d38f I0521 19:42:54.840045 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=00ddbd27eb5a8067a0c08d834a8b0771b06c1f951fd5e016c375beb144a9b091 I0521 19:42:54.840084 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=937e9d0503055098bcdacedae938bedc8ffeaaada17e378f172ac643bd65ca9d I0521 19:42:54.840096 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 54.989394ms to process 11 records I0521 19:42:54.840116 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0521 19:42:54.840126 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 55.403913ms to process 1 records I0521 19:42:54.840139 1 tasks_processing.go:74] worker 48 stopped. I0521 19:42:54.840498 1 tasks_processing.go:74] worker 0 stopped. I0521 19:42:54.841252 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=210dd2e2585c541be7e91c4fb64368ca873935f8915192b6de187d537038329f I0521 19:42:54.841614 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=75e32d05ae43969e8a956d13289d3e8341398e86991cffdc0be25505212da048 I0521 19:42:54.841632 1 gather.go:177] gatherer "clusterconfig" function "crds" took 56.635378ms to process 2 records I0521 19:42:54.841759 1 tasks_processing.go:74] worker 32 stopped. I0521 19:42:54.841998 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=21afa9c7dfe9dd8631d4e421daba0b0ce65a582e1436ecf908366d114cac405c I0521 19:42:54.842009 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 55.170307ms to process 1 records I0521 19:42:54.842020 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 57.172743ms to process 0 records I0521 19:42:54.842034 1 tasks_processing.go:74] worker 39 stopped. I0521 19:42:54.842111 1 tasks_processing.go:74] worker 33 stopped. I0521 19:42:54.842129 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=c3b45b4496bec1cea1f476998994288375e98fa272273a89cf3d0ed3d444d251 I0521 19:42:54.842155 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=ea771990d3d11f55f304cc438ae63a7663a4d3a9e0be062f5aa2310b0f14f21a I0521 19:42:54.842186 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=a4da33b0f7714863f4029a89618fe0aad51b744b1e3847ba98be23c1d48fd17c I0521 19:42:54.842194 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 56.368064ms to process 3 records I0521 19:42:54.842244 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=dda5e9c12e85f8f6bc818d484b119233ca8e2a0852d72b601164c974261cdc54 I0521 19:42:54.842252 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 56.107804ms to process 1 records I0521 19:42:54.842258 1 tasks_processing.go:74] worker 28 stopped. I0521 19:42:54.843728 1 base_controller.go:82] Caches are synced for ConfigController I0521 19:42:54.843738 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0521 19:42:54.850645 1 tasks_processing.go:74] worker 60 stopped. I0521 19:42:54.850657 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 65.1712ms to process 0 records I0521 19:42:54.850866 1 tasks_processing.go:74] worker 49 stopped. I0521 19:42:54.850880 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 66.739872ms to process 0 records I0521 19:42:54.852437 1 tasks_processing.go:74] worker 42 stopped. I0521 19:42:54.852557 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=cd6cc222d828cd11961c9b04b5dc8b8cb31c7fa70ff069b2780fdbf6edfdac5c I0521 19:42:54.852588 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=33491904b72a5b5a4cd5280c2b34c4cdd9042c0afd948ecb40c790699c264c5d I0521 19:42:54.852616 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=f5951a0e1531eff33625f345070c9148f8588920780f108470f316a6dc64e275 I0521 19:42:54.852628 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 67.596372ms to process 3 records I0521 19:42:54.858121 1 tasks_processing.go:74] worker 25 stopped. I0521 19:42:54.858140 1 configmapobserver.go:84] configmaps "insights-config" not found I0521 19:42:54.858388 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=795fae2952194391e87e7b502ea3e914bc72ad7328dbc975e98bd5416d0668de I0521 19:42:54.858551 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=6c2fc96833fabc320bbc1f89e97b3f652fcbe7481031ab335a90e696ece73cfd I0521 19:42:54.858567 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 72.421392ms to process 2 records I0521 19:42:54.858639 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0521 19:42:54.858645 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0521 19:42:54.858823 1 operator.go:288] started I0521 19:42:54.858849 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0521 19:42:54.869975 1 tasks_processing.go:74] worker 1 stopped. I0521 19:42:54.870029 1 recorder.go:75] Recording config/olm_operators with fingerprint=2f797def0c962623df54775527be1d8b6b76f6c8862f307498241e35a30af8c2 I0521 19:42:54.870044 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 85.541301ms to process 1 records I0521 19:42:54.872115 1 tasks_processing.go:74] worker 47 stopped. I0521 19:42:54.873261 1 recorder.go:75] Recording config/version with fingerprint=73cd4570b654a54bdbe803ff97d474ec24cdfca922c19d7f25467031b7574de0 I0521 19:42:54.873318 1 recorder.go:75] Recording config/id with fingerprint=7dcc7250af2a34c126d1f4e84c0342e5884fe44b2856deee1319bd204b78c039 I0521 19:42:54.873365 1 gather.go:177] gatherer "clusterconfig" function "version" took 88.257387ms to process 2 records I0521 19:42:54.886836 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0521 19:42:54.886849 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0521 19:42:54.886853 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0521 19:42:54.886858 1 controller.go:212] Source scaController *sca.Controller is not ready I0521 19:42:54.886861 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0521 19:42:54.886875 1 controller.go:489] The operator is still being initialized I0521 19:42:54.886881 1 controller.go:512] The operator is healthy I0521 19:42:54.887040 1 prometheus_rules.go:88] Prometheus rules successfully created I0521 19:42:54.893511 1 tasks_processing.go:74] worker 35 stopped. I0521 19:42:54.893573 1 recorder.go:75] Recording config/running_containers with fingerprint=569e19dbb9f383afc16232ab74320f4eae5b46b3ada57dbe63e0377c03934107 I0521 19:42:54.893586 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 109.242051ms to process 1 records E0521 19:42:54.894052 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27701b401c-0f18-4913-ad4c-066b87957d03%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:37608->172.30.0.10:53: read: connection refused I0521 19:42:54.894065 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27701b401c-0f18-4913-ad4c-066b87957d03%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:37608->172.30.0.10:53: read: connection refused I0521 19:42:54.895598 1 tasks_processing.go:74] worker 43 stopped. I0521 19:42:54.895610 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 111.137419ms to process 0 records I0521 19:42:54.942561 1 tasks_processing.go:74] worker 44 stopped. I0521 19:42:54.942839 1 recorder.go:75] Recording config/node/ip-10-0-0-127.ec2.internal with fingerprint=0b3b542b75a34fa755c9586209e9e4a3d1402326f1e8c6813e39643ae30439e9 I0521 19:42:54.942895 1 recorder.go:75] Recording config/node/ip-10-0-1-62.ec2.internal with fingerprint=3e2a8dcaf7baa1c4aca7ba646758d946e9690f6d87aab4c675207662db166cc4 I0521 19:42:54.942944 1 recorder.go:75] Recording config/node/ip-10-0-2-95.ec2.internal with fingerprint=643b5a33345abc62ace8e69d68c8829a9d3722ed83f5f8cdb7e77eeea8e39f67 I0521 19:42:54.942952 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 157.523507ms to process 3 records I0521 19:42:54.959094 1 base_controller.go:82] Caches are synced for LoggingSyncer I0521 19:42:54.959106 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0521 19:42:54.971035 1 tasks_processing.go:74] worker 7 stopped. E0521 19:42:54.971048 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0521 19:42:54.971054 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2qegoo3vnj953sjchii9ofsr5vsfv02i-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2qegoo3vnj953sjchii9ofsr5vsfv02i-primary-cert-bundle-secret" not found I0521 19:42:54.971109 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=ef272bc3aa65d34a1d4883c3c4a93cbf9928ee23d5496909aec7b5ce06b3f527 I0521 19:42:54.971121 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 186.317165ms to process 1 records I0521 19:42:54.971246 1 tasks_processing.go:74] worker 26 stopped. I0521 19:42:54.971280 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0521 19:42:54.971296 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 186.922332ms to process 1 records I0521 19:42:54.971865 1 tasks_processing.go:74] worker 52 stopped. E0521 19:42:54.971886 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0521 19:42:54.971895 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0521 19:42:54.971899 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0521 19:42:54.971907 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0521 19:42:54.971934 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0521 19:42:54.971943 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0521 19:42:54.971948 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0521 19:42:54.971952 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0521 19:42:54.971991 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0521 19:42:54.971998 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0521 19:42:54.972003 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 186.39417ms to process 7 records I0521 19:42:54.972890 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0521 19:42:54.976054 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:41852->172.30.0.10:53: read: connection refused I0521 19:42:54.976069 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:41852->172.30.0.10:53: read: connection refused I0521 19:42:55.022213 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0521 19:42:55.027214 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0521 19:42:55.247507 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0521 19:42:55.247519 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0521 19:42:55.247705 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-6s7cx pod in namespace openshift-dns (previous: false). I0521 19:42:55.496246 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-6s7cx pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-6s7cx\" is waiting to start: ContainerCreating" I0521 19:42:55.496264 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-6s7cx\" is waiting to start: ContainerCreating" I0521 19:42:55.496273 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-6s7cx pod in namespace openshift-dns (previous: false). I0521 19:42:55.666416 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-6s7cx pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-6s7cx\" is waiting to start: ContainerCreating" I0521 19:42:55.666432 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-6s7cx\" is waiting to start: ContainerCreating" I0521 19:42:55.666445 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-9f64q pod in namespace openshift-dns (previous: false). W0521 19:42:55.833455 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0521 19:42:55.872910 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-9f64q pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-9f64q\" is waiting to start: ContainerCreating" I0521 19:42:55.872924 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-9f64q\" is waiting to start: ContainerCreating" I0521 19:42:55.872931 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-9f64q pod in namespace openshift-dns (previous: false). I0521 19:42:56.052456 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-9f64q pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-9f64q\" is waiting to start: ContainerCreating" I0521 19:42:56.052473 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-9f64q\" is waiting to start: ContainerCreating" I0521 19:42:56.052483 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-gkmcv pod in namespace openshift-dns (previous: false). I0521 19:42:56.273489 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-gkmcv pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-gkmcv\" is waiting to start: ContainerCreating" I0521 19:42:56.273502 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-gkmcv\" is waiting to start: ContainerCreating" I0521 19:42:56.273509 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-gkmcv pod in namespace openshift-dns (previous: false). I0521 19:42:56.284726 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0521 19:42:56.452321 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-gkmcv pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-gkmcv\" is waiting to start: ContainerCreating" I0521 19:42:56.452354 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-gkmcv\" is waiting to start: ContainerCreating" I0521 19:42:56.452367 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-7qbtg pod in namespace openshift-dns (previous: false). I0521 19:42:56.652747 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0521 19:42:56.652758 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-ms48w pod in namespace openshift-dns (previous: false). W0521 19:42:56.833231 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0521 19:42:56.852999 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0521 19:42:56.853013 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-rsgh7 pod in namespace openshift-dns (previous: false). I0521 19:42:56.887994 1 tasks_processing.go:74] worker 56 stopped. I0521 19:42:56.888040 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=c3a15b3d1d2ecf6c48b275c8e9a55c0121c3fd091d4aceff3bff86d95e4efd1b I0521 19:42:56.888076 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=dc8aed552c738fe9ee8652087ea7ba8aedf8af0f7f05ad732e6a91b754ef931e I0521 19:42:56.888125 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0521 19:42:56.888162 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=2699827c1423d74a57fb70d2f3900d5fe8ad0d9f60bcca67cb9a93d2bb124504 I0521 19:42:56.888180 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0521 19:42:56.888225 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=1f666e0d0a758f481f83f352b25729478f787ab8765069081171c051006beabb I0521 19:42:56.888258 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=734ddf223aff2009b082ce0920612f80822df8c88f779150d0a959f1d4c2abd7 I0521 19:42:56.888283 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=b8e250a840b28e63fa612280f9c12fa4bcb17ffe5a61636302b1b33b54e7de00 I0521 19:42:56.888304 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=3cc039582b15ff3370c830a757d8a2b9299653400247d954f6b25870bcabe66d I0521 19:42:56.888325 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=5624ad5967503d37c6b4d263c26a1309915f4bbfbf2b7ce6bec3424bc702a8ec I0521 19:42:56.888361 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0521 19:42:56.888382 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=5e136bac633da702c1fc3a263f21ef5553cf9d01c2501de79a4903e3b4f10c3a I0521 19:42:56.888394 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0521 19:42:56.888410 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=b6059b544b268cdc4df3f359ac26b4b43f4c47df0df382ad6cef36890ab36083 I0521 19:42:56.888419 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0521 19:42:56.888440 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=b76721fce0482579ec509104bcea346cd88dcd0b7f22170dfc81590174963e7b I0521 19:42:56.888450 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0521 19:42:56.888467 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=68d4481137b6e62cf4ba3d47d9617dc52093e2fc22a3041ce871c775f10d17b7 I0521 19:42:56.888607 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=ea318ec70afc93959cf2151f37533c2f9b2df632eff28c1b7ff5f826f8a0c51d I0521 19:42:56.888618 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0521 19:42:56.888624 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0521 19:42:56.888643 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0521 19:42:56.888670 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=3a4cd1feaf8c8701792459ad9224edde8153307013a5627d9ca5c8134f7eb08f I0521 19:42:56.888698 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=9f8dd4967176484dba9f663c57e185ca5b97fa074f527daffcadd97446a6f259 I0521 19:42:56.888709 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0521 19:42:56.888724 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=7495c0b3c11567c3e499681ccd323e8f0a06cbb4ac33ffd4ecdb29254ceadd5e I0521 19:42:56.888734 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0521 19:42:56.888755 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=79d958d559b96f62191909f212eaf65f23f1e28cb311350d23ebaf56d5967115 I0521 19:42:56.888771 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=f13930a50631b36c7703f826ad5a87fde9cd7f795b963237d506aeb662c133a7 I0521 19:42:56.888789 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=6e8a8ad87bda5334b8bef50f4cd877e8b0bac9d646d21fafc11a98f59172c671 I0521 19:42:56.888805 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=1f167ff095668dadf55bafac4934bc3e86a7f964a1082508996e407a55fccd76 I0521 19:42:56.888834 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=d3f0260e529af51caee3436aa6d91e1fc20af4be98e323c44f77e286712ba759 I0521 19:42:56.888846 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0521 19:42:56.888869 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=fcc11f247edfda50b75ada93eb816068269bd69fa48b9623cffabeaaee5fda42 I0521 19:42:56.888886 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0521 19:42:56.888898 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0521 19:42:56.888909 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.103218776s to process 36 records I0521 19:42:57.052282 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0521 19:42:57.052359 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6f6c5d6c9-dsbnt pod in namespace openshift-image-registry (previous: false). I0521 19:42:57.251445 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6f6c5d6c9-dsbnt pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6f6c5d6c9-dsbnt\" is waiting to start: ContainerCreating" I0521 19:42:57.251460 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6f6c5d6c9-dsbnt\" is waiting to start: ContainerCreating" I0521 19:42:57.251529 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7d5849c64-4bsrx pod in namespace openshift-image-registry (previous: false). I0521 19:42:57.452681 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7d5849c64-4bsrx pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7d5849c64-4bsrx\" is waiting to start: ContainerCreating" I0521 19:42:57.452703 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7d5849c64-4bsrx\" is waiting to start: ContainerCreating" I0521 19:42:57.452751 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7d5849c64-8vhgg pod in namespace openshift-image-registry (previous: false). I0521 19:42:57.651551 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7d5849c64-8vhgg pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7d5849c64-8vhgg\" is waiting to start: ContainerCreating" I0521 19:42:57.651568 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7d5849c64-8vhgg\" is waiting to start: ContainerCreating" I0521 19:42:57.651578 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6hhts pod in namespace openshift-image-registry (previous: false). W0521 19:42:57.833925 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0521 19:42:57.851145 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0521 19:42:57.851162 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-gmr2k pod in namespace openshift-image-registry (previous: false). I0521 19:42:58.051896 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0521 19:42:58.051909 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-s92np pod in namespace openshift-image-registry (previous: false). I0521 19:42:58.251938 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0521 19:42:58.251956 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-57d996df88-lgx4w pod in namespace openshift-ingress (previous: false). I0521 19:42:58.453979 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-57d996df88-lgx4w pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-57d996df88-lgx4w\" is waiting to start: ContainerCreating" I0521 19:42:58.453996 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-57d996df88-lgx4w\" is waiting to start: ContainerCreating" I0521 19:42:58.454009 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-57d996df88-xkp94 pod in namespace openshift-ingress (previous: false). I0521 19:42:58.699927 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-57d996df88-xkp94 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-57d996df88-xkp94\" is waiting to start: ContainerCreating" I0521 19:42:58.699943 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-57d996df88-xkp94\" is waiting to start: ContainerCreating" I0521 19:42:58.699954 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-664cf878bf-kqkhl pod in namespace openshift-ingress (previous: false). W0521 19:42:58.833307 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0521 19:42:58.864068 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-664cf878bf-kqkhl pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-664cf878bf-kqkhl\" is waiting to start: ContainerCreating" I0521 19:42:58.864085 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-664cf878bf-kqkhl\" is waiting to start: ContainerCreating" I0521 19:42:58.864096 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-7gj4s pod in namespace openshift-ingress-canary (previous: false). I0521 19:42:59.051761 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-7gj4s pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-7gj4s\" is waiting to start: ContainerCreating" I0521 19:42:59.051781 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-7gj4s\" is waiting to start: ContainerCreating" I0521 19:42:59.051796 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-hkst2 pod in namespace openshift-ingress-canary (previous: false). I0521 19:42:59.252798 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-hkst2 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-hkst2\" is waiting to start: ContainerCreating" I0521 19:42:59.252814 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-hkst2\" is waiting to start: ContainerCreating" I0521 19:42:59.252825 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-p97n2 pod in namespace openshift-ingress-canary (previous: false). I0521 19:42:59.450985 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-p97n2 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-p97n2\" is waiting to start: ContainerCreating" I0521 19:42:59.451000 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-p97n2\" is waiting to start: ContainerCreating" I0521 19:42:59.451020 1 tasks_processing.go:74] worker 36 stopped. I0521 19:42:59.451119 1 recorder.go:75] Recording events/openshift-dns with fingerprint=da4cc28d0d5b856ef3982b26e6b93b8ae5a3649146ad00e5bbf0265017c39cc5 I0521 19:42:59.451217 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=1e6f020b1affb7fd430282100661f191a4960fb17b3c4c0d8e38d2847d774677 I0521 19:42:59.451256 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=371066cb7ba8ac4c4b4f462c8dab30e526969287d51573f026020b3beca081af I0521 19:42:59.451303 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=8b2187d8e02b177c1b4a8c5dea36c435f314d7dd5c17c31f5c691aa80989fbbc I0521 19:42:59.451319 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=a1f819c022b52917ef891588388c5ce4eefeae8944abfafb8063a751d5e8e5e6 I0521 19:42:59.452627 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6f6c5d6c9-dsbnt with fingerprint=a3b8bc44f8257c85541931770d429cdee6b79b2e4d3ba58155470e90e5b9c143 I0521 19:42:59.452751 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7d5849c64-4bsrx with fingerprint=4b8058dcdf192b934d428600b45b06930dda97963beb772947976f0afadd4dc2 I0521 19:42:59.452844 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7d5849c64-8vhgg with fingerprint=713e8c5a2c886323b992ff2d92660b6dca86fbdbaf517754b2505c7923944e27 I0521 19:42:59.452854 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.666859772s to process 8 records W0521 19:42:59.833318 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0521 19:42:59.833363 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0521 19:42:59.833383 1 tasks_processing.go:74] worker 59 stopped. E0521 19:42:59.833394 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0521 19:42:59.833406 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0521 19:42:59.833420 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0521 19:42:59.833432 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.049085623s to process 1 records I0521 19:43:07.445249 1 tasks_processing.go:74] worker 13 stopped. I0521 19:43:07.445298 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0521 19:43:07.445313 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.66043094s to process 1 records I0521 19:43:08.019576 1 configmapobserver.go:84] configmaps "insights-config" not found I0521 19:43:08.100120 1 configmapobserver.go:84] configmaps "insights-config" not found I0521 19:43:08.191205 1 tasks_processing.go:74] worker 4 stopped. I0521 19:43:08.191477 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=a7a4de02df1cc1abdf9107bf21a9d837b0f58083251a7f44b02bf3cc6249ecc3 I0521 19:43:08.191494 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.405514472s to process 1 records E0521 19:43:08.191546 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.407s with: function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error" I0521 19:43:08.192647 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error I0521 19:43:08.192661 1 periodic.go:209] Running workloads gatherer I0521 19:43:08.192675 1 tasks_processing.go:45] number of workers: 2 I0521 19:43:08.192680 1 tasks_processing.go:69] worker 1 listening for tasks. I0521 19:43:08.192684 1 tasks_processing.go:71] worker 1 working on workload_info task. I0521 19:43:08.192690 1 tasks_processing.go:69] worker 0 listening for tasks. I0521 19:43:08.192703 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0521 19:43:08.217204 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0521 19:43:08.219366 1 tasks_processing.go:74] worker 0 stopped. I0521 19:43:08.219380 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 26.650105ms to process 0 records I0521 19:43:08.225376 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (9ms) I0521 19:43:08.233576 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (8ms) I0521 19:43:08.241632 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (8ms) I0521 19:43:08.249694 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (8ms) I0521 19:43:08.257906 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (8ms) I0521 19:43:08.266831 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (9ms) I0521 19:43:08.274686 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (8ms) I0521 19:43:08.282588 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (8ms) I0521 19:43:08.290577 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (8ms) I0521 19:43:08.301365 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (11ms) I0521 19:43:08.303603 1 configmapobserver.go:84] configmaps "insights-config" not found I0521 19:43:08.324980 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (24ms) I0521 19:43:08.426656 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (102ms) I0521 19:43:08.525855 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (99ms) I0521 19:43:08.626872 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (101ms) I0521 19:43:08.725492 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (99ms) I0521 19:43:08.826144 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (101ms) I0521 19:43:08.925804 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms) I0521 19:43:09.025878 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (100ms) I0521 19:43:09.125999 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0521 19:43:09.225178 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (99ms) I0521 19:43:09.325289 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (100ms) I0521 19:43:09.426861 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (102ms) I0521 19:43:09.526372 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (99ms) I0521 19:43:09.626185 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (100ms) I0521 19:43:09.726229 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms) I0521 19:43:09.826599 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0521 19:43:09.926807 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0521 19:43:10.029268 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (102ms) I0521 19:43:10.126587 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (97ms) I0521 19:43:10.225679 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (99ms) I0521 19:43:10.326535 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (101ms) I0521 19:43:10.425324 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (99ms) I0521 19:43:10.526722 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (101ms) I0521 19:43:10.526752 1 tasks_processing.go:74] worker 1 stopped. E0521 19:43:10.526763 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0521 19:43:10.527104 1 recorder.go:75] Recording config/workload_info with fingerprint=fdcbeea8af897271aee15e007e7ef1df9b53a8e6dadb6cffb6f869010552885f I0521 19:43:10.527123 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.33406101s to process 1 records E0521 19:43:10.527151 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.334s with: function \"workload_info\" failed with an error" I0521 19:43:10.528262 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0521 19:43:10.528277 1 periodic.go:209] Running conditional gatherer I0521 19:43:10.534536 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0521 19:43:10.543504 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.10:56546->172.30.0.10:53: read: connection refused E0521 19:43:10.543764 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0521 19:43:10.543830 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0521 19:43:10.549557 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0521 19:43:10.549573 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0521 19:43:10.549579 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0521 19:43:10.549582 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0521 19:43:10.549586 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0521 19:43:10.549589 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0521 19:43:10.549592 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0521 19:43:10.549595 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0521 19:43:10.549598 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0521 19:43:10.549601 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0521 19:43:10.549617 1 tasks_processing.go:45] number of workers: 3 I0521 19:43:10.549630 1 tasks_processing.go:69] worker 2 listening for tasks. I0521 19:43:10.549635 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0521 19:43:10.549645 1 tasks_processing.go:69] worker 0 listening for tasks. I0521 19:43:10.549658 1 tasks_processing.go:69] worker 1 listening for tasks. I0521 19:43:10.549672 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0521 19:43:10.549679 1 tasks_processing.go:71] worker 1 working on conditional_gatherer_rules task. I0521 19:43:10.549681 1 tasks_processing.go:74] worker 0 stopped. I0521 19:43:10.549747 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0521 19:43:10.549765 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.63µs to process 1 records I0521 19:43:10.549840 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0521 19:43:10.549850 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.706µs to process 1 records I0521 19:43:10.549856 1 tasks_processing.go:74] worker 1 stopped. I0521 19:43:10.549885 1 tasks_processing.go:74] worker 2 stopped. I0521 19:43:10.549900 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 245.645µs to process 0 records I0521 19:43:10.549919 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.10:56546->172.30.0.10:53: read: connection refused I0521 19:43:10.549938 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0521 19:43:10.571916 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=1d80c559baeaa5e1fb602436185e7db3d8a91ac58cfb1cdda6865e883d9d6662 I0521 19:43:10.572052 1 diskrecorder.go:70] Writing 103 records to /var/lib/insights-operator/insights-2026-05-21-194310.tar.gz I0521 19:43:10.578439 1 diskrecorder.go:51] Wrote 103 records to disk in 6ms I0521 19:43:10.578473 1 periodic.go:278] Gathering cluster info every 2h0m0s I0521 19:43:10.578493 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0521 19:43:21.401795 1 configmapobserver.go:84] configmaps "insights-config" not found I0521 19:44:04.183730 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="3ae6dcbb42a610ca6b26fb95392795f8ad78316a0657ad91dce6e33e33807f48") W0521 19:44:04.183763 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0521 19:44:04.183836 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="59713afd60ebcff89e4b7492418746a474ee86a3e3c719f66f1bc21d8ecbfbe2") I0521 19:44:04.183895 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0521 19:44:04.183910 1 base_controller.go:181] Shutting down LoggingSyncer ... I0521 19:44:04.183922 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0521 19:44:04.183931 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="5a87030a708c09e9adf4ae5345b112055cd8f1e73fb646152bac85a75e94a9a7") I0521 19:44:04.183959 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0521 19:44:04.183977 1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController I0521 19:44:04.183979 1 periodic.go:170] Shutting down I0521 19:44:04.183987 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0521 19:44:04.183989 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0521 19:44:04.183997 1 base_controller.go:113] All LoggingSyncer workers have been terminated I0521 19:44:04.183987 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0521 19:44:04.184012 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" I0521 19:44:04.184044 1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController"