W0505 13:04:14.516657 1 cmd.go:257] Using insecure, self-signed certificates I0505 13:04:15.413212 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0505 13:04:15.413591 1 observer_polling.go:159] Starting file observer I0505 13:04:16.066721 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0505 13:04:16.066938 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0505 13:04:16.067454 1 secure_serving.go:57] Forcing use of http/1.1 only W0505 13:04:16.067473 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0505 13:04:16.067478 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0505 13:04:16.067482 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0505 13:04:16.067484 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0505 13:04:16.067487 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0505 13:04:16.067489 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0505 13:04:16.067550 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0505 13:04:16.079282 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0505 13:04:16.079333 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0505 13:04:16.079346 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0505 13:04:16.079335 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"2f5e888e-5b28-4d59-a27b-699af3bd236e", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0505 13:04:16.079350 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0505 13:04:16.079360 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0505 13:04:16.079393 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0505 13:04:16.079397 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0505 13:04:16.079568 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-643175228/tls.crt::/tmp/serving-cert-643175228/tls.key" I0505 13:04:16.079786 1 secure_serving.go:213] Serving securely on [::]:8443 I0505 13:04:16.079812 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0505 13:04:16.089193 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0505 13:04:16.089216 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0505 13:04:16.089316 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0505 13:04:16.095584 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0505 13:04:16.095603 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0505 13:04:16.101606 1 secretconfigobserver.go:119] support secret does not exist I0505 13:04:16.109582 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0505 13:04:16.115269 1 secretconfigobserver.go:119] support secret does not exist I0505 13:04:16.116941 1 recorder.go:161] Pruning old reports every 7h2m27s, max age is 288h0m0s I0505 13:04:16.124066 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0505 13:04:16.124093 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0505 13:04:16.124108 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0505 13:04:16.124116 1 insightsreport.go:296] Starting report retriever I0505 13:04:16.124122 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0505 13:04:16.124124 1 periodic.go:209] Running clusterconfig gatherer I0505 13:04:16.124163 1 tasks_processing.go:45] number of workers: 64 I0505 13:04:16.124185 1 tasks_processing.go:69] worker 4 listening for tasks. I0505 13:04:16.124195 1 tasks_processing.go:69] worker 2 listening for tasks. I0505 13:04:16.124200 1 tasks_processing.go:69] worker 3 listening for tasks. I0505 13:04:16.124202 1 tasks_processing.go:69] worker 1 listening for tasks. I0505 13:04:16.124204 1 tasks_processing.go:69] worker 0 listening for tasks. I0505 13:04:16.124212 1 tasks_processing.go:69] worker 20 listening for tasks. I0505 13:04:16.124213 1 tasks_processing.go:69] worker 15 listening for tasks. I0505 13:04:16.124216 1 tasks_processing.go:71] worker 20 working on openstack_dataplanedeployments task. I0505 13:04:16.124220 1 tasks_processing.go:69] worker 17 listening for tasks. I0505 13:04:16.124218 1 tasks_processing.go:69] worker 26 listening for tasks. I0505 13:04:16.124227 1 tasks_processing.go:69] worker 16 listening for tasks. I0505 13:04:16.124222 1 tasks_processing.go:69] worker 5 listening for tasks. I0505 13:04:16.124224 1 tasks_processing.go:69] worker 27 listening for tasks. I0505 13:04:16.124234 1 tasks_processing.go:69] worker 21 listening for tasks. I0505 13:04:16.124229 1 tasks_processing.go:69] worker 6 listening for tasks. I0505 13:04:16.124231 1 tasks_processing.go:69] worker 28 listening for tasks. I0505 13:04:16.124237 1 tasks_processing.go:69] worker 11 listening for tasks. I0505 13:04:16.124238 1 tasks_processing.go:69] worker 29 listening for tasks. I0505 13:04:16.124240 1 tasks_processing.go:69] worker 22 listening for tasks. I0505 13:04:16.124244 1 tasks_processing.go:69] worker 23 listening for tasks. I0505 13:04:16.124244 1 tasks_processing.go:69] worker 30 listening for tasks. I0505 13:04:16.124250 1 tasks_processing.go:69] worker 13 listening for tasks. I0505 13:04:16.124252 1 tasks_processing.go:69] worker 31 listening for tasks. I0505 13:04:16.124251 1 tasks_processing.go:69] worker 10 listening for tasks. I0505 13:04:16.124259 1 tasks_processing.go:69] worker 14 listening for tasks. I0505 13:04:16.124260 1 tasks_processing.go:69] worker 9 listening for tasks. I0505 13:04:16.124263 1 tasks_processing.go:69] worker 50 listening for tasks. I0505 13:04:16.124260 1 tasks_processing.go:69] worker 32 listening for tasks. I0505 13:04:16.124267 1 tasks_processing.go:69] worker 19 listening for tasks. I0505 13:04:16.124243 1 tasks_processing.go:69] worker 12 listening for tasks. I0505 13:04:16.124265 1 tasks_processing.go:69] worker 8 listening for tasks. I0505 13:04:16.124274 1 tasks_processing.go:69] worker 18 listening for tasks. I0505 13:04:16.124273 1 tasks_processing.go:69] worker 25 listening for tasks. I0505 13:04:16.124280 1 tasks_processing.go:71] worker 8 working on nodenetworkconfigurationpolicies task. I0505 13:04:16.124251 1 tasks_processing.go:69] worker 7 listening for tasks. I0505 13:04:16.124286 1 tasks_processing.go:71] worker 30 working on image task. I0505 13:04:16.124256 1 tasks_processing.go:69] worker 24 listening for tasks. I0505 13:04:16.124289 1 tasks_processing.go:71] worker 2 working on container_runtime_configs task. I0505 13:04:16.124292 1 tasks_processing.go:69] worker 54 listening for tasks. I0505 13:04:16.124294 1 tasks_processing.go:69] worker 63 listening for tasks. I0505 13:04:16.124297 1 tasks_processing.go:69] worker 38 listening for tasks. I0505 13:04:16.124296 1 tasks_processing.go:71] worker 14 working on pdbs task. I0505 13:04:16.124297 1 tasks_processing.go:71] worker 29 working on validating_webhook_configurations task. I0505 13:04:16.124309 1 tasks_processing.go:69] worker 56 listening for tasks. I0505 13:04:16.124312 1 tasks_processing.go:71] worker 10 working on infrastructures task. I0505 13:04:16.124317 1 tasks_processing.go:71] worker 56 working on install_plans task. I0505 13:04:16.124312 1 tasks_processing.go:71] worker 38 working on storage_cluster task. I0505 13:04:16.124327 1 tasks_processing.go:69] worker 42 listening for tasks. I0505 13:04:16.124337 1 tasks_processing.go:69] worker 43 listening for tasks. I0505 13:04:16.124331 1 tasks_processing.go:71] worker 50 working on operators_pods_and_events task. I0505 13:04:16.124345 1 tasks_processing.go:69] worker 44 listening for tasks. I0505 13:04:16.124352 1 tasks_processing.go:69] worker 45 listening for tasks. I0505 13:04:16.124346 1 tasks_processing.go:69] worker 58 listening for tasks. I0505 13:04:16.124359 1 tasks_processing.go:69] worker 46 listening for tasks. I0505 13:04:16.124274 1 tasks_processing.go:69] worker 34 listening for tasks. I0505 13:04:16.124274 1 tasks_processing.go:69] worker 60 listening for tasks. I0505 13:04:16.124278 1 tasks_processing.go:71] worker 12 working on dvo_metrics task. I0505 13:04:16.124373 1 tasks_processing.go:71] worker 6 working on machine_healthchecks task. I0505 13:04:16.124374 1 tasks_processing.go:71] worker 28 working on crds task. I0505 13:04:16.124374 1 tasks_processing.go:71] worker 5 working on openshift_logging task. I0505 13:04:16.124309 1 tasks_processing.go:71] worker 31 working on machine_autoscalers task. I0505 13:04:16.124388 1 tasks_processing.go:71] worker 7 working on storage_classes task. I0505 13:04:16.124392 1 tasks_processing.go:71] worker 60 working on container_images task. I0505 13:04:16.124426 1 tasks_processing.go:71] worker 42 working on machine_sets task. I0505 13:04:16.124270 1 tasks_processing.go:69] worker 33 listening for tasks. I0505 13:04:16.124436 1 tasks_processing.go:71] worker 45 working on qemu_kubevirt_launcher_logs task. I0505 13:04:16.124440 1 tasks_processing.go:71] worker 33 working on ceph_cluster task. I0505 13:04:16.124490 1 tasks_processing.go:71] worker 3 working on image_registries task. I0505 13:04:16.124280 1 tasks_processing.go:71] worker 22 working on machine_config_pools task. I0505 13:04:16.124537 1 tasks_processing.go:71] worker 24 working on support_secret task. I0505 13:04:16.124573 1 tasks_processing.go:71] worker 27 working on pod_network_connectivity_checks task. I0505 13:04:16.124314 1 tasks_processing.go:69] worker 40 listening for tasks. I0505 13:04:16.124284 1 tasks_processing.go:69] worker 53 listening for tasks. I0505 13:04:16.124284 1 tasks_processing.go:69] worker 61 listening for tasks. I0505 13:04:16.124591 1 tasks_processing.go:71] worker 26 working on openshift_machine_api_events task. I0505 13:04:16.124597 1 tasks_processing.go:71] worker 53 working on networks task. I0505 13:04:16.124286 1 tasks_processing.go:69] worker 62 listening for tasks. I0505 13:04:16.124606 1 tasks_processing.go:71] worker 62 working on nodes task. I0505 13:04:16.124607 1 tasks_processing.go:71] worker 58 working on proxies task. I0505 13:04:16.124715 1 tasks_processing.go:71] worker 21 working on openstack_dataplanenodesets task. I0505 13:04:16.124733 1 tasks_processing.go:71] worker 40 working on lokistack task. I0505 13:04:16.124746 1 tasks_processing.go:71] worker 11 working on sap_config task. I0505 13:04:16.124303 1 tasks_processing.go:69] worker 55 listening for tasks. I0505 13:04:16.124831 1 tasks_processing.go:71] worker 18 working on image_pruners task. I0505 13:04:16.124321 1 tasks_processing.go:69] worker 41 listening for tasks. I0505 13:04:16.124426 1 tasks_processing.go:71] worker 32 working on aggregated_monitoring_cr_names task. I0505 13:04:16.126097 1 tasks_processing.go:71] worker 41 working on overlapping_namespace_uids task. I0505 13:04:16.124291 1 tasks_processing.go:69] worker 37 listening for tasks. I0505 13:04:16.126425 1 tasks_processing.go:71] worker 37 working on operators task. I0505 13:04:16.124599 1 tasks_processing.go:71] worker 61 working on openstack_controlplanes task. I0505 13:04:16.124301 1 tasks_processing.go:71] worker 13 working on tsdb_status task. W0505 13:04:16.126611 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0505 13:04:16.124307 1 tasks_processing.go:69] worker 39 listening for tasks. I0505 13:04:16.124358 1 tasks_processing.go:69] worker 57 listening for tasks. I0505 13:04:16.124278 1 tasks_processing.go:69] worker 35 listening for tasks. I0505 13:04:16.124430 1 tasks_processing.go:71] worker 19 working on monitoring_persistent_volumes task. I0505 13:04:16.124582 1 tasks_processing.go:71] worker 15 working on active_alerts task. I0505 13:04:16.124588 1 tasks_processing.go:71] worker 17 working on feature_gates task. I0505 13:04:16.124284 1 tasks_processing.go:71] worker 23 working on node_logs task. I0505 13:04:16.124823 1 tasks_processing.go:71] worker 54 working on cluster_apiserver task. I0505 13:04:16.124827 1 tasks_processing.go:71] worker 63 working on olm_operators task. I0505 13:04:16.124270 1 tasks_processing.go:69] worker 59 listening for tasks. I0505 13:04:16.124875 1 tasks_processing.go:71] worker 34 working on certificate_signing_requests task. I0505 13:04:16.124882 1 tasks_processing.go:71] worker 1 working on version task. I0505 13:04:16.124881 1 tasks_processing.go:71] worker 46 working on schedulers task. I0505 13:04:16.124890 1 tasks_processing.go:71] worker 43 working on cost_management_metrics_configs task. I0505 13:04:16.124897 1 tasks_processing.go:71] worker 25 working on service_accounts task. I0505 13:04:16.124904 1 tasks_processing.go:71] worker 16 working on ingress_certificates task. I0505 13:04:16.124910 1 tasks_processing.go:71] worker 44 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0505 13:04:16.124281 1 tasks_processing.go:71] worker 4 working on config_maps task. I0505 13:04:16.124920 1 tasks_processing.go:69] worker 48 listening for tasks. I0505 13:04:16.124926 1 tasks_processing.go:69] worker 47 listening for tasks. I0505 13:04:16.124216 1 tasks_processing.go:71] worker 0 working on sap_pods task. I0505 13:04:16.124936 1 tasks_processing.go:69] worker 49 listening for tasks. I0505 13:04:16.124277 1 tasks_processing.go:69] worker 52 listening for tasks. I0505 13:04:16.124945 1 tasks_processing.go:71] worker 9 working on mutating_webhook_configurations task. I0505 13:04:16.124267 1 tasks_processing.go:69] worker 51 listening for tasks. I0505 13:04:16.125060 1 tasks_processing.go:71] worker 55 working on nodenetworkstates task. I0505 13:04:16.124284 1 tasks_processing.go:69] worker 36 listening for tasks. I0505 13:04:16.126633 1 tasks_processing.go:71] worker 13 working on machine_configs task. I0505 13:04:16.126776 1 tasks_processing.go:71] worker 47 working on authentication task. W0505 13:04:16.126782 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0505 13:04:16.126641 1 tasks_processing.go:71] worker 39 working on sap_datahubs task. I0505 13:04:16.126683 1 tasks_processing.go:71] worker 57 working on openstack_version task. I0505 13:04:16.127742 1 tasks_processing.go:71] worker 48 working on machines task. I0505 13:04:16.126654 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 107.335µs to process 0 records I0505 13:04:16.127783 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 137.631µs to process 0 records I0505 13:04:16.127793 1 tasks_processing.go:74] worker 15 stopped. I0505 13:04:16.128164 1 tasks_processing.go:71] worker 51 working on silenced_alerts task. I0505 13:04:16.128187 1 tasks_processing.go:71] worker 49 working on metrics task. W0505 13:04:16.128201 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0505 13:04:16.128212 1 tasks_processing.go:74] worker 51 stopped. W0505 13:04:16.128213 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0505 13:04:16.128215 1 tasks_processing.go:71] worker 36 working on jaegers task. I0505 13:04:16.128221 1 tasks_processing.go:71] worker 35 working on oauths task. I0505 13:04:16.128235 1 tasks_processing.go:71] worker 52 working on ingress task. I0505 13:04:16.128269 1 tasks_processing.go:71] worker 59 working on clusterroles task. I0505 13:04:16.128222 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 33.39µs to process 0 records I0505 13:04:16.128405 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 23.911µs to process 0 records I0505 13:04:16.128416 1 tasks_processing.go:74] worker 49 stopped. I0505 13:04:16.130498 1 tasks_processing.go:74] worker 2 stopped. I0505 13:04:16.130509 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 6.198371ms to process 0 records I0505 13:04:16.130518 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 6.211988ms to process 0 records I0505 13:04:16.130522 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 6.283318ms to process 0 records I0505 13:04:16.130526 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 6.181937ms to process 0 records I0505 13:04:16.130531 1 tasks_processing.go:74] worker 38 stopped. I0505 13:04:16.130535 1 tasks_processing.go:74] worker 8 stopped. I0505 13:04:16.130538 1 tasks_processing.go:74] worker 20 stopped. I0505 13:04:16.137677 1 tasks_processing.go:74] worker 31 stopped. I0505 13:04:16.137687 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 13.28694ms to process 0 records I0505 13:04:16.137693 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 13.298047ms to process 0 records I0505 13:04:16.137699 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 13.252697ms to process 0 records I0505 13:04:16.137699 1 tasks_processing.go:74] worker 5 stopped. I0505 13:04:16.137703 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 13.250124ms to process 0 records I0505 13:04:16.137706 1 tasks_processing.go:74] worker 33 stopped. I0505 13:04:16.137708 1 tasks_processing.go:74] worker 42 stopped. E0505 13:04:16.137712 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0505 13:04:16.137719 1 tasks_processing.go:74] worker 27 stopped. I0505 13:04:16.137719 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 13.110722ms to process 0 records I0505 13:04:16.137823 1 tasks_processing.go:74] worker 6 stopped. E0505 13:04:16.137835 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0505 13:04:16.137842 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 13.438165ms to process 0 records I0505 13:04:16.137849 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0505 13:04:16.137861 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0505 13:04:16.137865 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0505 13:04:16.137868 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0505 13:04:16.137881 1 controller.go:489] The operator is still being initialized I0505 13:04:16.137890 1 controller.go:512] The operator is healthy I0505 13:04:16.139014 1 tasks_processing.go:74] worker 14 stopped. I0505 13:04:16.139178 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=f614cfb53beb3e9d1de23af80689d388c53a7bd31af438fb106653abcbd27000 I0505 13:04:16.139199 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=be517c0f3e9f6a55e6eaf5912d439f7b9030e2f5cbeeba06a8e2836df1bed20f I0505 13:04:16.139215 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=ae3546b49a569514db09e2606fa9dcddf5300b71ed17007bf81787af4401c121 I0505 13:04:16.139224 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 14.703849ms to process 3 records I0505 13:04:16.139239 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 14.321273ms to process 0 records I0505 13:04:16.139249 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 14.314999ms to process 0 records I0505 13:04:16.139309 1 tasks_processing.go:74] worker 21 stopped. I0505 13:04:16.139323 1 tasks_processing.go:74] worker 40 stopped. I0505 13:04:16.139350 1 recorder.go:75] Recording config/image with fingerprint=57e9dfb36a41c00702aaf4b37db49a865b88764d6ee6105d26eb10f550dab2b4 I0505 13:04:16.139361 1 gather.go:177] gatherer "clusterconfig" function "image" took 14.8069ms to process 1 records I0505 13:04:16.139402 1 tasks_processing.go:74] worker 30 stopped. I0505 13:04:16.139463 1 tasks_processing.go:74] worker 53 stopped. I0505 13:04:16.139535 1 recorder.go:75] Recording config/network with fingerprint=aeefac480e4c5c738c68d1f191097d40b3a2e41ccebb7cc6e2cce308300543ff I0505 13:04:16.139549 1 gather.go:177] gatherer "clusterconfig" function "networks" took 14.603195ms to process 1 records I0505 13:04:16.140549 1 tasks_processing.go:74] worker 24 stopped. E0505 13:04:16.140560 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0505 13:04:16.140567 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 15.998123ms to process 0 records I0505 13:04:16.140774 1 tasks_processing.go:74] worker 10 stopped. I0505 13:04:16.141357 1 recorder.go:75] Recording config/infrastructure with fingerprint=f6aee3e71e6c70db5e5fc5e1e9913c1e0475b8c5a74fe464f1e594b78a4c17f9 I0505 13:04:16.141372 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 16.448835ms to process 1 records I0505 13:04:16.141383 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 14.673962ms to process 0 records I0505 13:04:16.141390 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 16.541334ms to process 0 records I0505 13:04:16.141398 1 tasks_processing.go:74] worker 61 stopped. I0505 13:04:16.141406 1 tasks_processing.go:74] worker 26 stopped. I0505 13:04:16.141455 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=1834be67e12b4c154d7b8510c065ec719a380ffbe4e554a42b34ff0d143e4cb7 I0505 13:04:16.141470 1 tasks_processing.go:74] worker 7 stopped. I0505 13:04:16.141475 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=f2c4f013e2ac0973fcb231091ed36925a5e8fba55339f643d36c95c8eeb7f1e7 I0505 13:04:16.141481 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 16.749682ms to process 2 records I0505 13:04:16.141490 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 16.466075ms to process 0 records I0505 13:04:16.141496 1 tasks_processing.go:74] worker 11 stopped. I0505 13:04:16.141830 1 tasks_processing.go:74] worker 29 stopped. I0505 13:04:16.141974 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=f420a03fe6c5cc15f9c21805f539c15522db5526d2ac8bf58a27e4e37cc34938 I0505 13:04:16.142053 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=d0fba24dc10e7fa833a0bfc649daa51c4782e70e4de6a4dfa78a19857129d776 I0505 13:04:16.142071 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=54e377139bc83e308154688d4696b66be16083d58f277747a87a20de925bc693 I0505 13:04:16.142118 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=0e699fe5add4441440e494db5df2a6595fd5ed5239a26c2da37bcdcea45c8a5e I0505 13:04:16.142142 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=1397f66db555359de07e3e471eff40ae8979472a21f7fbaf6162becab0511451 I0505 13:04:16.142164 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=40a2d974e48dae56ae50e2bdaf9662c78ecb4b52f1c4553a3b8100f06d3d8eb3 I0505 13:04:16.142186 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=24435d4531dfee4659c0cc49916a8e307ad4e9cca2f3db58aa0383de053855b9 I0505 13:04:16.142222 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=7a5ee7cc2425ec9e040ecae4b8c0c8a551c78eb35154ae265b403791ed59f86c I0505 13:04:16.142245 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=227f02e7eba8b110a21ac411c188155faf9182bd3acef5089370e7893e07a57a I0505 13:04:16.142268 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=298246c1f9f4bd815e94382ee7e9572153370fe32e08d321f19189def16391f3 I0505 13:04:16.142291 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=35972783adb33db28d8018fd3656cb45cf1ffaa16feee71c77da37db70542852 I0505 13:04:16.142299 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 17.513437ms to process 11 records I0505 13:04:16.142382 1 tasks_processing.go:74] worker 3 stopped. I0505 13:04:16.142677 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=65cf0f3b595dffb52e956be7ce8431b3339a9aa7a4170edd97dc94fb8f182371 I0505 13:04:16.142686 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 17.680212ms to process 1 records I0505 13:04:16.147971 1 tasks_processing.go:74] worker 39 stopped. I0505 13:04:16.147988 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 20.570772ms to process 0 records I0505 13:04:16.148067 1 recorder.go:75] Recording config/proxy with fingerprint=d7a895d28d76a0948a332e42442f0fee201ce1e79fff744e5fbadc13eaedbaed I0505 13:04:16.148089 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 23.368286ms to process 1 records I0505 13:04:16.148096 1 tasks_processing.go:74] worker 58 stopped. I0505 13:04:16.148106 1 tasks_processing.go:74] worker 54 stopped. I0505 13:04:16.148227 1 recorder.go:75] Recording config/apiserver with fingerprint=dd652dd928e4f2aa3a1618e24a4f32867e7d75f66b1c403d188048b4f4346a2a I0505 13:04:16.148240 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 21.436953ms to process 1 records I0505 13:04:16.148330 1 tasks_processing.go:74] worker 47 stopped. I0505 13:04:16.148421 1 recorder.go:75] Recording config/authentication with fingerprint=993c900568d483b598f72d8cbbbc39071f424cb41909063fd2cbeb6a8f8ef61b I0505 13:04:16.148432 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 21.341757ms to process 1 records I0505 13:04:16.154684 1 tasks_processing.go:74] worker 18 stopped. I0505 13:04:16.155004 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=71ac98a73f809f1af54cea1ac444e98eb735f3e1acf030016ae68f43d549cef1 I0505 13:04:16.155044 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 29.841405ms to process 1 records I0505 13:04:16.155054 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 27.408891ms to process 0 records I0505 13:04:16.155064 1 tasks_processing.go:74] worker 57 stopped. I0505 13:04:16.156627 1 tasks_processing.go:74] worker 62 stopped. I0505 13:04:16.156892 1 recorder.go:75] Recording config/node/ip-10-0-0-107.ec2.internal with fingerprint=d46239282983829422a161dd32a9e311254875ffe16df2802cad1f354cf608e7 I0505 13:04:16.156946 1 recorder.go:75] Recording config/node/ip-10-0-1-131.ec2.internal with fingerprint=961aea1ac6e587863003a164e958d60d221bdc6b9ba110fdb8af4df66bf5a516 I0505 13:04:16.157009 1 recorder.go:75] Recording config/node/ip-10-0-2-123.ec2.internal with fingerprint=0f94580145d1cb6d55c6d395d3a37af71dd79a7fbbbe18decac41f1a3e889220 I0505 13:04:16.157018 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 32.011681ms to process 3 records I0505 13:04:16.157090 1 tasks_processing.go:74] worker 17 stopped. I0505 13:04:16.157128 1 recorder.go:75] Recording config/featuregate with fingerprint=af119e5592c2d20a6fad5ce0bb49f4abc16935fa70bbe23111a3ce92b589721e I0505 13:04:16.157137 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 30.238803ms to process 1 records I0505 13:04:16.157154 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0505 13:04:16.157181 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=8fd73c9a4e3e429c47b838e668686713be69313cc21e411610e970f558feea77 I0505 13:04:16.157195 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 30.370192ms to process 1 records I0505 13:04:16.157198 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0505 13:04:16.157201 1 tasks_processing.go:74] worker 46 stopped. W0505 13:04:16.157297 1 operator.go:288] started I0505 13:04:16.157320 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0505 13:04:16.159592 1 gather_logs.go:145] no pods in namespace were found I0505 13:04:16.159611 1 tasks_processing.go:74] worker 45 stopped. I0505 13:04:16.159619 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 35.162104ms to process 0 records I0505 13:04:16.160795 1 tasks_processing.go:74] worker 43 stopped. I0505 13:04:16.160810 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 33.382708ms to process 0 records I0505 13:04:16.161032 1 tasks_processing.go:74] worker 19 stopped. I0505 13:04:16.161047 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 34.221574ms to process 0 records I0505 13:04:16.161320 1 tasks_processing.go:74] worker 34 stopped. I0505 13:04:16.161331 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 34.33972ms to process 0 records W0505 13:04:16.163167 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0505 13:04:16.170163 1 tasks_processing.go:74] worker 36 stopped. I0505 13:04:16.170178 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 41.9343ms to process 0 records I0505 13:04:16.170187 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 42.927674ms to process 0 records I0505 13:04:16.170194 1 tasks_processing.go:74] worker 0 stopped. I0505 13:04:16.170553 1 tasks_processing.go:74] worker 63 stopped. I0505 13:04:16.170598 1 recorder.go:75] Recording config/olm_operators with fingerprint=5db7374bf80262f7f7aae74f3ad95f08f8b840d3fd485c45dffe7419c8ee83b4 I0505 13:04:16.170609 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 43.612728ms to process 1 records I0505 13:04:16.171515 1 tasks_processing.go:74] worker 28 stopped. I0505 13:04:16.171833 1 controller.go:212] Source scaController *sca.Controller is not ready I0505 13:04:16.171845 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0505 13:04:16.171850 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0505 13:04:16.171855 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0505 13:04:16.171859 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0505 13:04:16.171880 1 controller.go:489] The operator is still being initialized I0505 13:04:16.171891 1 controller.go:512] The operator is healthy I0505 13:04:16.172162 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=87365ca4e0476ed3d0b7cd4923336213c74a2678d7e16948f8dfad80878c38f6 I0505 13:04:16.172384 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=61381132a5effca487563aec64778781da1e8545c2efcc8dfa9917cf6b040cd2 I0505 13:04:16.172394 1 gather.go:177] gatherer "clusterconfig" function "crds" took 47.12313ms to process 2 records I0505 13:04:16.175002 1 prometheus_rules.go:88] Prometheus rules successfully created I0505 13:04:16.175326 1 tasks_processing.go:74] worker 52 stopped. I0505 13:04:16.175522 1 recorder.go:75] Recording config/ingress with fingerprint=b17c23ca79f681791d6d27c7aa77c6fbcf86fe4eba8a9035defc38c2953adbfa I0505 13:04:16.175538 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 47.080544ms to process 1 records I0505 13:04:16.175934 1 tasks_processing.go:74] worker 55 stopped. I0505 13:04:16.175954 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 48.728594ms to process 0 records I0505 13:04:16.176207 1 tasks_processing.go:74] worker 48 stopped. E0505 13:04:16.176219 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0505 13:04:16.176229 1 gather.go:177] gatherer "clusterconfig" function "machines" took 48.444866ms to process 0 records I0505 13:04:16.176261 1 tasks_processing.go:74] worker 35 stopped. I0505 13:04:16.176466 1 recorder.go:75] Recording config/oauth with fingerprint=df553c74ab5f8711dae1b5bfb990f57a68e4dcdb879b74430ed12b0ae4216dc9 I0505 13:04:16.176487 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 48.027744ms to process 1 records I0505 13:04:16.178635 1 tasks_processing.go:74] worker 9 stopped. I0505 13:04:16.178753 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=7b142bc1b14b9ff945ae630d09e5d86f6a7bec029a9c80ed98153e21e9349171 I0505 13:04:16.178787 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=35b67948d5e26df07306cbdb274464325bf86b87df8bd28935864f70dcf0abe8 I0505 13:04:16.178810 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=692ae0ee1358eecef6645fd32f0e397570f97d7b808e53b6b4c979bf6e179771 I0505 13:04:16.178821 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 51.609296ms to process 3 records I0505 13:04:16.178837 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 52.586929ms to process 0 records I0505 13:04:16.178844 1 tasks_processing.go:74] worker 32 stopped. I0505 13:04:16.179380 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0505 13:04:16.179435 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0505 13:04:16.179438 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file E0505 13:04:16.180208 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27424018d0-c6b7-45bb-8289-e61ce177c8b8%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.9:49651->172.30.0.10:53: read: connection refused I0505 13:04:16.180270 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27424018d0-c6b7-45bb-8289-e61ce177c8b8%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.9:49651->172.30.0.10:53: read: connection refused I0505 13:04:16.182222 1 tasks_processing.go:74] worker 60 stopped. I0505 13:04:16.183425 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-w5p29 with fingerprint=0b0f01909f1c09eaed90489a369d84ed8dd554f2913eeb1e31ce3af78d8bab22 I0505 13:04:16.183478 1 recorder.go:75] Recording config/running_containers with fingerprint=4dcbc6a48e29828aac9a6a9bf6bb70190d49354e75631d7c010ecdfdc285f2aa I0505 13:04:16.183487 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 57.813654ms to process 2 records I0505 13:04:16.186711 1 tasks_processing.go:74] worker 59 stopped. I0505 13:04:16.186925 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=88bb5f83f29c6c944a3dd6296275c952ba2cbe70206c5b816d79aa6ade507cef I0505 13:04:16.187009 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=1a3a6e1de4d1f25fb5cc5016d5fb80f2aa2e5ca33327f0142b98ca9792ce655e I0505 13:04:16.187017 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 58.37429ms to process 2 records I0505 13:04:16.189414 1 base_controller.go:82] Caches are synced for ConfigController I0505 13:04:16.189424 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0505 13:04:16.195683 1 configmapobserver.go:84] configmaps "insights-config" not found I0505 13:04:16.197376 1 tasks_processing.go:74] worker 4 stopped. E0505 13:04:16.197391 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0505 13:04:16.197400 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0505 13:04:16.197404 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0505 13:04:16.197414 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0505 13:04:16.197442 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0505 13:04:16.197449 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0505 13:04:16.197454 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0505 13:04:16.197458 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0505 13:04:16.197515 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0505 13:04:16.197525 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0505 13:04:16.197530 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 69.84208ms to process 7 records I0505 13:04:16.239729 1 tasks_processing.go:74] worker 41 stopped. I0505 13:04:16.239752 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0505 13:04:16.239764 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 113.48151ms to process 1 records I0505 13:04:16.246434 1 tasks_processing.go:74] worker 23 stopped. I0505 13:04:16.246448 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 119.717927ms to process 0 records I0505 13:04:16.251601 1 tasks_processing.go:74] worker 1 stopped. I0505 13:04:16.251852 1 recorder.go:75] Recording config/version with fingerprint=08c86027e502e81ea8bcda73d174dda6cbb276a3c7396a6ef8ffd95c85529a79 I0505 13:04:16.251869 1 recorder.go:75] Recording config/id with fingerprint=b9dad54cb66a93ffd5ea8c79bd5b1cf624907b3291c732b19355d8cfc7699cd0 I0505 13:04:16.251879 1 gather.go:177] gatherer "clusterconfig" function "version" took 124.456233ms to process 2 records I0505 13:04:16.257364 1 base_controller.go:82] Caches are synced for LoggingSyncer I0505 13:04:16.257379 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0505 13:04:16.257460 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0505 13:04:16.262885 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.9:44349->172.30.0.10:53: read: connection refused I0505 13:04:16.262899 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.9:44349->172.30.0.10:53: read: connection refused I0505 13:04:16.268705 1 tasks_processing.go:74] worker 44 stopped. I0505 13:04:16.268719 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 141.707213ms to process 0 records I0505 13:04:16.291399 1 tasks_processing.go:74] worker 16 stopped. E0505 13:04:16.291417 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0505 13:04:16.291428 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q3pe17u55dtlb0jnobhvmj01dk6ubgf-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q3pe17u55dtlb0jnobhvmj01dk6ubgf-primary-cert-bundle-secret" not found I0505 13:04:16.291491 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=858f45e50fa2966eca15561332d970f6fa1fff673e81f23efcaaeb8f37c9f2bb I0505 13:04:16.291503 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 164.520763ms to process 1 records W0505 13:04:17.163488 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0505 13:04:17.183721 1 tasks_processing.go:74] worker 22 stopped. I0505 13:04:17.183795 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 1.0592112s to process 0 records I0505 13:04:17.194786 1 tasks_processing.go:74] worker 13 stopped. I0505 13:04:17.194820 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0505 13:04:17.194833 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 1.068061255s to process 1 records I0505 13:04:17.357547 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0505 13:04:17.357561 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0505 13:04:17.357747 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-27rkk pod in namespace openshift-dns (previous: false). I0505 13:04:17.585522 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0505 13:04:17.587246 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-27rkk pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-27rkk\" is waiting to start: ContainerCreating" I0505 13:04:17.587262 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-27rkk\" is waiting to start: ContainerCreating" I0505 13:04:17.587271 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-27rkk pod in namespace openshift-dns (previous: false). I0505 13:04:17.762354 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-27rkk pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-27rkk\" is waiting to start: ContainerCreating" I0505 13:04:17.762373 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-27rkk\" is waiting to start: ContainerCreating" I0505 13:04:17.762403 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-w922b pod in namespace openshift-dns (previous: false). I0505 13:04:17.982073 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-w922b pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-w922b\" is waiting to start: ContainerCreating" I0505 13:04:17.982110 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-w922b\" is waiting to start: ContainerCreating" I0505 13:04:17.982120 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-w922b pod in namespace openshift-dns (previous: false). W0505 13:04:18.162839 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0505 13:04:18.163276 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-w922b pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-w922b\" is waiting to start: ContainerCreating" I0505 13:04:18.163292 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-w922b\" is waiting to start: ContainerCreating" I0505 13:04:18.163303 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-z5k5d pod in namespace openshift-dns (previous: false). I0505 13:04:18.187881 1 tasks_processing.go:74] worker 37 stopped. I0505 13:04:18.187933 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=043e3b630f649303e5314399f1568cad4d52fa42b043860dff4180ebdb040f48 I0505 13:04:18.187962 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=cdb4ee9966301c01bc824e4378b569490ad3367724d6e63eaaec12381033052a I0505 13:04:18.187990 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0505 13:04:18.188027 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=3112e932bc68588f7d5ac6fb67365bf1a4a3cdb57783c9971283a611f9b6eae4 I0505 13:04:18.188059 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0505 13:04:18.188101 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=a2fd6605cc3d640879c519db18c3c9ec773101bf58067461a93f8a6bd1874a29 I0505 13:04:18.188132 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=47aeb88a901ad06ab2afa75781184a967a897f2fe6f0a9761a0ed2ee6604ea2a I0505 13:04:18.188157 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=fe479d697b141583fa1c4e1cbc6dd16844209b61b761daedc1ccfb50807fc81f I0505 13:04:18.188171 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=5e268eec388aeccc9b76f8c0148434217c24539fd79e604f6920635014ab371d I0505 13:04:18.188191 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=c1a5c5e0834c7dd8c206cca8a0a1bc5afed985c61f42f232d1ca2389835c2f2d I0505 13:04:18.188200 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0505 13:04:18.188217 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=1141d8d05db335dcfa235301a7caa20bced16fa60bbf85f23f3b61ef2e4f5d44 I0505 13:04:18.188228 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0505 13:04:18.188246 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=7e4aaa5534bb79dc9dc46e8a8ac4aeea445837ea594974a153a24ebe8796262c I0505 13:04:18.188256 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0505 13:04:18.188275 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=6a80e7c7cf7afc06c96d642deb2b50a5941bf9436e933f376aebc47171a4f238 I0505 13:04:18.188284 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0505 13:04:18.188299 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=dd9a1535cd12a9ab641095ae48ca7a0f1fb754fb0a9b4d29e34686805d148a08 I0505 13:04:18.188420 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=0c7be43d4352252636fad3eaf9db0bad23c3138338d65dc5221d4fab0c36ab4a I0505 13:04:18.188429 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0505 13:04:18.188436 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0505 13:04:18.188457 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0505 13:04:18.188478 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=9bd2ad91555da8d6a46889fe80a179611584877a63ac658c9acf3ee4c7c8586a I0505 13:04:18.188501 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=150874fd1a41f3b56ec9ab7883766e202c3e116628cc1b7b0b473dab61cca326 I0505 13:04:18.188511 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0505 13:04:18.188527 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=c522f72a004e3d667f695f6a70dec0b4d43ad4f3c8bcbc81a09470ddfa0d0e76 I0505 13:04:18.188536 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0505 13:04:18.188548 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=145290aa7dcc7898e658c4940ebaa9470998efcbd42418e1313c645ea40efd61 I0505 13:04:18.188561 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=0aef41a8422ae5d50b91c3cc0493f3724d9b39db3aea94987c4439eacd886208 I0505 13:04:18.188575 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=3b87f3bbcb1acf541e0c67072eb069c1c292efaa68b3cc5c1586822a96003c82 I0505 13:04:18.188591 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=c47a1bc34c3766da5898aba177781cd9b1ce55456fe8ca1bbe1457ad191dc1d6 I0505 13:04:18.188611 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=85336aefdef0a7e2aebc2ac293f13a7c736bc19dd1883f17a0dc529f9ccf59c6 I0505 13:04:18.188620 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0505 13:04:18.188643 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=f66c44f9e6e0bb256579e05c8fbe9750fe9d0f8b610aabb887d7421c3d368ca7 I0505 13:04:18.188659 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0505 13:04:18.188667 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0505 13:04:18.188674 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.061437313s to process 36 records I0505 13:04:18.390435 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-z5k5d pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-z5k5d\" is waiting to start: ContainerCreating" I0505 13:04:18.390452 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-z5k5d\" is waiting to start: ContainerCreating" I0505 13:04:18.390461 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-z5k5d pod in namespace openshift-dns (previous: false). I0505 13:04:18.561127 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-z5k5d pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-z5k5d\" is waiting to start: ContainerCreating" I0505 13:04:18.561147 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-z5k5d\" is waiting to start: ContainerCreating" I0505 13:04:18.561158 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-6k7th pod in namespace openshift-dns (previous: false). I0505 13:04:18.763219 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0505 13:04:18.763240 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-tkv4j pod in namespace openshift-dns (previous: false). I0505 13:04:18.961186 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0505 13:04:18.961204 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-vbr4s pod in namespace openshift-dns (previous: false). I0505 13:04:19.162033 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0505 13:04:19.162107 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5f55964995-2vk5f pod in namespace openshift-image-registry (previous: false). W0505 13:04:19.162503 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0505 13:04:19.362263 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5f55964995-2vk5f pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5f55964995-2vk5f\" is waiting to start: ContainerCreating" I0505 13:04:19.362280 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5f55964995-2vk5f\" is waiting to start: ContainerCreating" I0505 13:04:19.362326 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7748997dd-6cg9l pod in namespace openshift-image-registry (previous: false). I0505 13:04:19.560829 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7748997dd-6cg9l pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7748997dd-6cg9l\" is waiting to start: ContainerCreating" I0505 13:04:19.560849 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7748997dd-6cg9l\" is waiting to start: ContainerCreating" I0505 13:04:19.560896 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7748997dd-hrcdk pod in namespace openshift-image-registry (previous: false). I0505 13:04:19.763718 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7748997dd-hrcdk pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7748997dd-hrcdk\" is waiting to start: ContainerCreating" I0505 13:04:19.763735 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7748997dd-hrcdk\" is waiting to start: ContainerCreating" I0505 13:04:19.763747 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-b8lqc pod in namespace openshift-image-registry (previous: false). I0505 13:04:19.961834 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0505 13:04:19.961854 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-pfwfn pod in namespace openshift-image-registry (previous: false). I0505 13:04:20.161660 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0505 13:04:20.161675 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-sr77g pod in namespace openshift-image-registry (previous: false). W0505 13:04:20.162897 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0505 13:04:20.363234 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0505 13:04:20.363251 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5498d7b5c9-lr8ls pod in namespace openshift-ingress (previous: false). I0505 13:04:20.571495 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5498d7b5c9-lr8ls pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5498d7b5c9-lr8ls\" is waiting to start: ContainerCreating" I0505 13:04:20.571517 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5498d7b5c9-lr8ls\" is waiting to start: ContainerCreating" I0505 13:04:20.571528 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5498d7b5c9-qfxrq pod in namespace openshift-ingress (previous: false). I0505 13:04:20.765115 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5498d7b5c9-qfxrq pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5498d7b5c9-qfxrq\" is waiting to start: ContainerCreating" I0505 13:04:20.765133 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5498d7b5c9-qfxrq\" is waiting to start: ContainerCreating" I0505 13:04:20.765143 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-df4986679-bgltq pod in namespace openshift-ingress (previous: false). I0505 13:04:20.977273 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-df4986679-bgltq pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-df4986679-bgltq\" is waiting to start: ContainerCreating" I0505 13:04:20.977289 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-df4986679-bgltq\" is waiting to start: ContainerCreating" I0505 13:04:20.977316 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5kd7h pod in namespace openshift-ingress-canary (previous: false). W0505 13:04:21.163120 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0505 13:04:21.163143 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0505 13:04:21.163158 1 tasks_processing.go:74] worker 12 stopped. E0505 13:04:21.163168 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0505 13:04:21.163178 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0505 13:04:21.163193 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0505 13:04:21.163202 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.038777616s to process 1 records I0505 13:04:21.175219 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-5kd7h pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5kd7h\" is waiting to start: ContainerCreating" I0505 13:04:21.175236 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-5kd7h\" is waiting to start: ContainerCreating" I0505 13:04:21.175246 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-f7vdl pod in namespace openshift-ingress-canary (previous: false). I0505 13:04:21.362828 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-f7vdl pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-f7vdl\" is waiting to start: ContainerCreating" I0505 13:04:21.362844 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-f7vdl\" is waiting to start: ContainerCreating" I0505 13:04:21.362870 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-mkg8m pod in namespace openshift-ingress-canary (previous: false). I0505 13:04:21.561789 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-mkg8m pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mkg8m\" is waiting to start: ContainerCreating" I0505 13:04:21.561807 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mkg8m\" is waiting to start: ContainerCreating" I0505 13:04:21.561819 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-7d5f866c57-jxs9d pod in namespace openshift-kube-storage-version-migrator (previous: false). I0505 13:04:21.764693 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-7d5f866c57-jxs9d pod in namespace openshift-kube-storage-version-migrator (previous: false). I0505 13:04:21.962541 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74848b4cb9-9sfgx pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0505 13:04:22.164881 1 tasks_processing.go:74] worker 50 stopped. I0505 13:04:22.164965 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=11bca195df96058db6d536531b723b44d98b755bf68140e8e2527d57889fea7d I0505 13:04:22.165014 1 recorder.go:75] Recording events/openshift-dns with fingerprint=bccb6fc40d0ebf1946dd4b7bd0ebb84af60d848daa9f374e0095486fd6dcd1e3 I0505 13:04:22.165115 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=3807a077f54fe135f4d0d8ed01f560521f72057175365b11c691e0ba77095585 I0505 13:04:22.165142 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=9e299b9410fc594c4cc50e41d213f674de0a5a6ac3aad91595e8e68e98229ab6 I0505 13:04:22.165186 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=db3e1c9873ad00a9bab099f638802f02d2aad88015373c5f43f24d3b55c54712 I0505 13:04:22.165202 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=476aaee118a28db49dfc83896e01dcadae5036078c8d496c5d34c5fbc73c9996 I0505 13:04:22.165215 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=b44cf12d873f0ffec308bf0a249c4fcbcf679afaf5fd09a22e1be8e303d68fa0 I0505 13:04:22.165261 1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=7e1a274e54191d146fa9c926c37faa06565460cec271301645b87f31f8265853 I0505 13:04:22.165394 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-27rkk with fingerprint=00174a3ca0b8ebb557ad94af74c9468ac6e2225a17beaa067af7d0149ab38bf6 I0505 13:04:22.165476 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-w922b with fingerprint=6bd12cffd0860b633ab62e83b499874dfde3298bed8b3305af8dc2716255d4ed I0505 13:04:22.165574 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5f55964995-2vk5f with fingerprint=647c06c8223651fdd1c11c16fddbd954789b13eca465662c6987bc8e51fe3b82 I0505 13:04:22.165669 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7748997dd-6cg9l with fingerprint=93ae5e4c3429d8a9bc4696012d16ea9ecaa07c6ee0870679b702494615009058 I0505 13:04:22.165756 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7748997dd-hrcdk with fingerprint=0ce3b886b960f3c91f0e92dc135a37bd06e73ec85ef4b64556ea2965d4491ce8 I0505 13:04:22.165811 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-5kd7h with fingerprint=48c877ce39ec99bbaeecbe1419f0331d3ab0df39d4dfdb3b82c92a8e2d90fe09 I0505 13:04:22.165891 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-mkg8m with fingerprint=f7ab755406a0d0d9f373b1bf147cd519859b88a4f4000bfe63cd72210d92893c I0505 13:04:22.165907 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-jxs9d/migrator_current.log with fingerprint=7e9d253ffa042bc9140465a30a5c9d7cda5a85b016db099110d3b91f494faac3 I0505 13:04:22.165912 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-7d5f866c57-jxs9d/graceful-termination_current.log with fingerprint=675b58d2260f7abf3fc267243788110f29fed005a5a92cec64c45c4090a89d16 I0505 13:04:22.165976 1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74848b4cb9-9sfgx/kube-storage-version-migrator-operator_current.log with fingerprint=200a8481fa0d346b6ab3a9f3d9276f2122e8764da44e1788ea9e034ee0c39e9d I0505 13:04:22.165986 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.040514876s to process 18 records I0505 13:04:28.533647 1 configmapobserver.go:84] configmaps "insights-config" not found I0505 13:04:28.950646 1 tasks_processing.go:74] worker 56 stopped. I0505 13:04:28.950693 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0505 13:04:28.950711 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.826309163s to process 1 records I0505 13:04:29.737048 1 tasks_processing.go:74] worker 25 stopped. I0505 13:04:29.737348 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=6f7ec23b175ef6978e72e155e10475689a15847bf4d5aede6cec1cd3ba8d2466 I0505 13:04:29.737367 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.609616326s to process 1 records E0505 13:04:29.737422 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.613s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0505 13:04:29.738528 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0505 13:04:29.738544 1 periodic.go:209] Running workloads gatherer I0505 13:04:29.738560 1 tasks_processing.go:45] number of workers: 2 I0505 13:04:29.738568 1 tasks_processing.go:69] worker 1 listening for tasks. I0505 13:04:29.738572 1 tasks_processing.go:71] worker 1 working on workload_info task. I0505 13:04:29.738576 1 tasks_processing.go:69] worker 0 listening for tasks. I0505 13:04:29.738585 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0505 13:04:29.766734 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0505 13:04:29.774340 1 tasks_processing.go:74] worker 0 stopped. I0505 13:04:29.774364 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 35.740497ms to process 0 records I0505 13:04:29.779517 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (14ms) I0505 13:04:29.791012 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (11ms) I0505 13:04:29.802204 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (11ms) I0505 13:04:29.812624 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (10ms) I0505 13:04:29.823978 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (11ms) I0505 13:04:29.836479 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (12ms) I0505 13:04:29.848424 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (12ms) I0505 13:04:29.868854 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (20ms) I0505 13:04:29.872679 1 configmapobserver.go:84] configmaps "insights-config" not found I0505 13:04:29.884159 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (15ms) I0505 13:04:29.907352 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (23ms) I0505 13:04:29.919610 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (12ms) I0505 13:04:29.978012 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (58ms) I0505 13:04:30.068782 1 configmapobserver.go:84] configmaps "insights-config" not found I0505 13:04:30.077396 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (99ms) I0505 13:04:30.181991 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (105ms) I0505 13:04:30.280365 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (98ms) I0505 13:04:30.381657 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (101ms) I0505 13:04:30.479277 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (98ms) I0505 13:04:30.578703 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (99ms) I0505 13:04:30.679012 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0505 13:04:30.777951 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (99ms) I0505 13:04:30.879226 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (101ms) I0505 13:04:30.978394 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (99ms) I0505 13:04:31.078098 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (100ms) I0505 13:04:31.177875 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (100ms) I0505 13:04:31.278323 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (100ms) I0505 13:04:31.378254 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (100ms) I0505 13:04:31.478241 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (100ms) I0505 13:04:31.577696 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (99ms) I0505 13:04:31.678251 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (101ms) I0505 13:04:31.777618 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (99ms) I0505 13:04:31.878447 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (101ms) I0505 13:04:31.978038 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0505 13:04:31.978073 1 tasks_processing.go:74] worker 1 stopped. E0505 13:04:31.978107 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0505 13:04:31.978410 1 recorder.go:75] Recording config/workload_info with fingerprint=c0148e2f13a017d70f1b0738aafedbeb31e206128c3011d4a92f7afbc61cef03 I0505 13:04:31.978425 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.239492886s to process 1 records E0505 13:04:31.978450 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.239s with: function \"workload_info\" failed with an error" I0505 13:04:31.979552 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0505 13:04:31.979567 1 periodic.go:209] Running conditional gatherer I0505 13:04:32.004388 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0505 13:04:32.010479 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.9:38444->172.30.0.10:53: read: connection refused E0505 13:04:32.010743 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0505 13:04:32.010807 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0505 13:04:32.018305 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0505 13:04:32.018320 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0505 13:04:32.018326 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0505 13:04:32.018330 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0505 13:04:32.018333 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0505 13:04:32.018336 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0505 13:04:32.018339 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0505 13:04:32.018342 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0505 13:04:32.018345 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0505 13:04:32.018348 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0505 13:04:32.018363 1 tasks_processing.go:45] number of workers: 3 I0505 13:04:32.018374 1 tasks_processing.go:69] worker 2 listening for tasks. I0505 13:04:32.018378 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0505 13:04:32.018380 1 tasks_processing.go:69] worker 0 listening for tasks. I0505 13:04:32.018390 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0505 13:04:32.018393 1 tasks_processing.go:69] worker 1 listening for tasks. I0505 13:04:32.018403 1 tasks_processing.go:74] worker 1 stopped. I0505 13:04:32.018406 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0505 13:04:32.018460 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0505 13:04:32.018473 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 912ns to process 1 records I0505 13:04:32.018503 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0505 13:04:32.018528 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.267µs to process 1 records I0505 13:04:32.018536 1 tasks_processing.go:74] worker 0 stopped. I0505 13:04:32.018680 1 tasks_processing.go:74] worker 2 stopped. I0505 13:04:32.018696 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 256.55µs to process 0 records I0505 13:04:32.018733 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.9:38444->172.30.0.10:53: read: connection refused I0505 13:04:32.018754 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0505 13:04:32.043556 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=4ce7a90b724e4aa24d2dc874314bee973d04bf945f1b435196d81c747b51fcff I0505 13:04:32.043689 1 diskrecorder.go:70] Writing 114 records to /var/lib/insights-operator/insights-2026-05-05-130432.tar.gz I0505 13:04:32.050679 1 diskrecorder.go:51] Wrote 114 records to disk in 7ms I0505 13:04:32.050707 1 periodic.go:278] Gathering cluster info every 2h0m0s I0505 13:04:32.050723 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0505 13:04:40.990269 1 configmapobserver.go:84] configmaps "insights-config" not found I0505 13:05:40.414093 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="5336552a1e75e7c8346041c27feac1a253871e9e2a80100cef44a02e468c580f") W0505 13:05:40.414124 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0505 13:05:40.414172 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="1185df2f57eee0446f64521bbb0bfbe74d1280590b0a2b84bb597eb5fccf4b9d")