W0514 11:09:43.042024 1 cmd.go:257] Using insecure, self-signed certificates I0514 11:09:43.491425 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0514 11:09:43.491732 1 observer_polling.go:159] Starting file observer I0514 11:09:44.048116 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0514 11:09:44.048328 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0514 11:09:44.048881 1 secure_serving.go:57] Forcing use of http/1.1 only W0514 11:09:44.048902 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0514 11:09:44.048908 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0514 11:09:44.048912 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0514 11:09:44.048914 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0514 11:09:44.048916 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0514 11:09:44.048919 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0514 11:09:44.048949 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0514 11:09:44.052344 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0514 11:09:44.052404 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"2a7bd6ce-3e2e-46e5-9f1f-09ba474c7b12", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0514 11:09:44.053401 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0514 11:09:44.053428 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0514 11:09:44.053434 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0514 11:09:44.053487 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0514 11:09:44.053476 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0514 11:09:44.053499 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0514 11:09:44.054308 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1443998961/tls.crt::/tmp/serving-cert-1443998961/tls.key" I0514 11:09:44.054646 1 secure_serving.go:213] Serving securely on [::]:8443 I0514 11:09:44.054679 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0514 11:09:44.056925 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0514 11:09:44.056950 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0514 11:09:44.057052 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0514 11:09:44.060991 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 11:09:44.061008 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0514 11:09:44.064759 1 secretconfigobserver.go:119] support secret does not exist I0514 11:09:44.068753 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 11:09:44.072274 1 secretconfigobserver.go:119] support secret does not exist I0514 11:09:44.074420 1 recorder.go:161] Pruning old reports every 5h13m16s, max age is 288h0m0s I0514 11:09:44.078656 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0514 11:09:44.078672 1 periodic.go:209] Running clusterconfig gatherer I0514 11:09:44.078670 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0514 11:09:44.078675 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0514 11:09:44.078700 1 insightsreport.go:296] Starting report retriever I0514 11:09:44.078710 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0514 11:09:44.078725 1 tasks_processing.go:45] number of workers: 64 I0514 11:09:44.078742 1 tasks_processing.go:69] worker 3 listening for tasks. I0514 11:09:44.078748 1 tasks_processing.go:69] worker 5 listening for tasks. I0514 11:09:44.078752 1 tasks_processing.go:69] worker 2 listening for tasks. I0514 11:09:44.078758 1 tasks_processing.go:69] worker 30 listening for tasks. I0514 11:09:44.078758 1 tasks_processing.go:69] worker 4 listening for tasks. I0514 11:09:44.078757 1 tasks_processing.go:69] worker 1 listening for tasks. I0514 11:09:44.078766 1 tasks_processing.go:69] worker 22 listening for tasks. I0514 11:09:44.078766 1 tasks_processing.go:69] worker 21 listening for tasks. I0514 11:09:44.078764 1 tasks_processing.go:69] worker 0 listening for tasks. I0514 11:09:44.078772 1 tasks_processing.go:69] worker 23 listening for tasks. I0514 11:09:44.078778 1 tasks_processing.go:69] worker 24 listening for tasks. I0514 11:09:44.078776 1 tasks_processing.go:69] worker 43 listening for tasks. I0514 11:09:44.078783 1 tasks_processing.go:69] worker 14 listening for tasks. I0514 11:09:44.078776 1 tasks_processing.go:69] worker 6 listening for tasks. I0514 11:09:44.078783 1 tasks_processing.go:69] worker 31 listening for tasks. I0514 11:09:44.078790 1 tasks_processing.go:69] worker 32 listening for tasks. I0514 11:09:44.078793 1 tasks_processing.go:71] worker 6 working on networks task. I0514 11:09:44.078794 1 tasks_processing.go:69] worker 16 listening for tasks. I0514 11:09:44.078800 1 tasks_processing.go:69] worker 33 listening for tasks. I0514 11:09:44.078800 1 tasks_processing.go:71] worker 32 working on proxies task. I0514 11:09:44.078798 1 tasks_processing.go:69] worker 13 listening for tasks. I0514 11:09:44.078811 1 tasks_processing.go:69] worker 18 listening for tasks. I0514 11:09:44.078814 1 tasks_processing.go:71] worker 13 working on active_alerts task. I0514 11:09:44.078816 1 tasks_processing.go:69] worker 28 listening for tasks. I0514 11:09:44.078818 1 tasks_processing.go:69] worker 19 listening for tasks. I0514 11:09:44.078794 1 tasks_processing.go:69] worker 44 listening for tasks. I0514 11:09:44.078803 1 tasks_processing.go:69] worker 45 listening for tasks. I0514 11:09:44.078806 1 tasks_processing.go:69] worker 17 listening for tasks. I0514 11:09:44.078807 1 tasks_processing.go:71] worker 33 working on config_maps task. W0514 11:09:44.078855 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0514 11:09:44.078880 1 tasks_processing.go:69] worker 46 listening for tasks. I0514 11:09:44.078879 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 49.788µs to process 0 records I0514 11:09:44.078823 1 tasks_processing.go:69] worker 10 listening for tasks. I0514 11:09:44.078889 1 tasks_processing.go:69] worker 11 listening for tasks. I0514 11:09:44.078891 1 tasks_processing.go:69] worker 41 listening for tasks. I0514 11:09:44.078899 1 tasks_processing.go:69] worker 12 listening for tasks. I0514 11:09:44.078901 1 tasks_processing.go:69] worker 47 listening for tasks. I0514 11:09:44.078902 1 tasks_processing.go:69] worker 40 listening for tasks. I0514 11:09:44.078910 1 tasks_processing.go:69] worker 61 listening for tasks. I0514 11:09:44.078911 1 tasks_processing.go:71] worker 47 working on sap_config task. I0514 11:09:44.078913 1 tasks_processing.go:71] worker 40 working on validating_webhook_configurations task. I0514 11:09:44.078917 1 tasks_processing.go:69] worker 62 listening for tasks. I0514 11:09:44.079078 1 tasks_processing.go:69] worker 29 listening for tasks. I0514 11:09:44.079097 1 tasks_processing.go:71] worker 43 working on nodenetworkstates task. I0514 11:09:44.079176 1 tasks_processing.go:69] worker 42 listening for tasks. I0514 11:09:44.079181 1 tasks_processing.go:69] worker 8 listening for tasks. I0514 11:09:44.079195 1 tasks_processing.go:69] worker 9 listening for tasks. I0514 11:09:44.079202 1 tasks_processing.go:69] worker 63 listening for tasks. I0514 11:09:44.079202 1 tasks_processing.go:71] worker 4 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0514 11:09:44.079204 1 tasks_processing.go:71] worker 14 working on olm_operators task. I0514 11:09:44.079214 1 tasks_processing.go:71] worker 5 working on openstack_dataplanenodesets task. I0514 11:09:44.079221 1 tasks_processing.go:69] worker 54 listening for tasks. I0514 11:09:44.078785 1 tasks_processing.go:71] worker 23 working on sap_pods task. I0514 11:09:44.079227 1 tasks_processing.go:69] worker 26 listening for tasks. I0514 11:09:44.079238 1 tasks_processing.go:69] worker 57 listening for tasks. I0514 11:09:44.079247 1 tasks_processing.go:69] worker 25 listening for tasks. I0514 11:09:44.079246 1 tasks_processing.go:69] worker 39 listening for tasks. I0514 11:09:44.079251 1 tasks_processing.go:69] worker 55 listening for tasks. I0514 11:09:44.078789 1 tasks_processing.go:69] worker 15 listening for tasks. I0514 11:09:44.079258 1 tasks_processing.go:69] worker 56 listening for tasks. I0514 11:09:44.079264 1 tasks_processing.go:71] worker 18 working on support_secret task. I0514 11:09:44.079262 1 tasks_processing.go:69] worker 20 listening for tasks. I0514 11:09:44.079272 1 tasks_processing.go:69] worker 35 listening for tasks. I0514 11:09:44.079269 1 tasks_processing.go:71] worker 2 working on clusterroles task. I0514 11:09:44.079271 1 tasks_processing.go:69] worker 53 listening for tasks. I0514 11:09:44.079282 1 tasks_processing.go:69] worker 36 listening for tasks. I0514 11:09:44.079279 1 tasks_processing.go:71] worker 19 working on container_runtime_configs task. I0514 11:09:44.079292 1 tasks_processing.go:69] worker 37 listening for tasks. I0514 11:09:44.079298 1 tasks_processing.go:69] worker 49 listening for tasks. I0514 11:09:44.079301 1 tasks_processing.go:69] worker 38 listening for tasks. I0514 11:09:44.078801 1 tasks_processing.go:71] worker 16 working on monitoring_persistent_volumes task. I0514 11:09:44.079304 1 tasks_processing.go:71] worker 30 working on ingress_certificates task. I0514 11:09:44.079258 1 tasks_processing.go:71] worker 17 working on operators_pods_and_events task. I0514 11:09:44.079318 1 tasks_processing.go:69] worker 51 listening for tasks. I0514 11:09:44.079327 1 tasks_processing.go:69] worker 52 listening for tasks. I0514 11:09:44.079330 1 tasks_processing.go:69] worker 7 listening for tasks. I0514 11:09:44.079335 1 tasks_processing.go:69] worker 58 listening for tasks. I0514 11:09:44.079343 1 tasks_processing.go:71] worker 44 working on openstack_version task. I0514 11:09:44.079344 1 tasks_processing.go:69] worker 59 listening for tasks. I0514 11:09:44.078795 1 tasks_processing.go:71] worker 31 working on openshift_machine_api_events task. I0514 11:09:44.079365 1 tasks_processing.go:69] worker 27 listening for tasks. I0514 11:09:44.078787 1 tasks_processing.go:71] worker 24 working on openshift_logging task. I0514 11:09:44.079391 1 tasks_processing.go:71] worker 27 working on pod_network_connectivity_checks task. I0514 11:09:44.079291 1 tasks_processing.go:69] worker 48 listening for tasks. I0514 11:09:44.079308 1 tasks_processing.go:69] worker 50 listening for tasks. I0514 11:09:44.079209 1 tasks_processing.go:71] worker 3 working on image_registries task. I0514 11:09:44.080267 1 tasks_processing.go:71] worker 61 working on nodes task. I0514 11:09:44.080276 1 tasks_processing.go:71] worker 48 working on infrastructures task. I0514 11:09:44.080499 1 tasks_processing.go:71] worker 28 working on feature_gates task. I0514 11:09:44.079206 1 tasks_processing.go:69] worker 60 listening for tasks. I0514 11:09:44.080558 1 tasks_processing.go:69] worker 34 listening for tasks. I0514 11:09:44.080653 1 tasks_processing.go:71] worker 10 working on machine_autoscalers task. I0514 11:09:44.080704 1 tasks_processing.go:71] worker 34 working on openstack_controlplanes task. I0514 11:09:44.080757 1 tasks_processing.go:71] worker 12 working on machine_configs task. I0514 11:09:44.080855 1 tasks_processing.go:71] worker 62 working on oauths task. I0514 11:09:44.080935 1 tasks_processing.go:71] worker 57 working on aggregated_monitoring_cr_names task. I0514 11:09:44.080957 1 tasks_processing.go:71] worker 8 working on machine_healthchecks task. I0514 11:09:44.080986 1 tasks_processing.go:71] worker 49 working on operators task. I0514 11:09:44.081058 1 tasks_processing.go:71] worker 45 working on cluster_apiserver task. I0514 11:09:44.080712 1 tasks_processing.go:71] worker 41 working on mutating_webhook_configurations task. I0514 11:09:44.081156 1 tasks_processing.go:71] worker 60 working on install_plans task. I0514 11:09:44.080863 1 tasks_processing.go:71] worker 56 working on image_pruners task. I0514 11:09:44.081243 1 tasks_processing.go:71] worker 38 working on metrics task. W0514 11:09:44.081270 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0514 11:09:44.081285 1 tasks_processing.go:71] worker 25 working on pdbs task. I0514 11:09:44.081103 1 tasks_processing.go:71] worker 50 working on qemu_kubevirt_launcher_logs task. I0514 11:09:44.081361 1 tasks_processing.go:71] worker 26 working on machines task. I0514 11:09:44.081373 1 tasks_processing.go:71] worker 20 working on overlapping_namespace_uids task. I0514 11:09:44.081415 1 tasks_processing.go:71] worker 35 working on silenced_alerts task. W0514 11:09:44.081474 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0514 11:09:44.081481 1 tasks_processing.go:71] worker 7 working on tsdb_status task. W0514 11:09:44.081550 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0514 11:09:44.080870 1 tasks_processing.go:71] worker 29 working on version task. I0514 11:09:44.081647 1 tasks_processing.go:71] worker 53 working on schedulers task. I0514 11:09:44.081287 1 tasks_processing.go:74] worker 38 stopped. I0514 11:09:44.081428 1 tasks_processing.go:71] worker 58 working on machine_config_pools task. I0514 11:09:44.080756 1 tasks_processing.go:71] worker 22 working on cost_management_metrics_configs task. I0514 11:09:44.081556 1 tasks_processing.go:71] worker 59 working on certificate_signing_requests task. I0514 11:09:44.081169 1 tasks_processing.go:71] worker 46 working on storage_classes task. I0514 11:09:44.081116 1 tasks_processing.go:71] worker 13 working on service_accounts task. I0514 11:09:44.080875 1 tasks_processing.go:71] worker 42 working on node_logs task. I0514 11:09:44.081290 1 tasks_processing.go:71] worker 9 working on storage_cluster task. I0514 11:09:44.081297 1 tasks_processing.go:71] worker 63 working on authentication task. I0514 11:09:44.081298 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 32.793µs to process 0 records I0514 11:09:44.081302 1 tasks_processing.go:71] worker 54 working on crds task. I0514 11:09:44.082034 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 54.894µs to process 0 records I0514 11:09:44.082052 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 38.929µs to process 0 records I0514 11:09:44.082056 1 tasks_processing.go:74] worker 35 stopped. I0514 11:09:44.080760 1 tasks_processing.go:71] worker 11 working on dvo_metrics task. I0514 11:09:44.082069 1 tasks_processing.go:74] worker 7 stopped. I0514 11:09:44.081561 1 tasks_processing.go:71] worker 39 working on image task. I0514 11:09:44.081622 1 tasks_processing.go:71] worker 55 working on lokistack task. I0514 11:09:44.081642 1 tasks_processing.go:71] worker 15 working on openstack_dataplanedeployments task. I0514 11:09:44.080871 1 tasks_processing.go:71] worker 1 working on container_images task. I0514 11:09:44.081189 1 tasks_processing.go:71] worker 52 working on sap_datahubs task. I0514 11:09:44.082789 1 tasks_processing.go:71] worker 21 working on ingress task. I0514 11:09:44.081306 1 tasks_processing.go:71] worker 51 working on ceph_cluster task. I0514 11:09:44.083047 1 tasks_processing.go:71] worker 37 working on jaegers task. I0514 11:09:44.083062 1 tasks_processing.go:71] worker 0 working on nodenetworkconfigurationpolicies task. I0514 11:09:44.083101 1 tasks_processing.go:74] worker 43 stopped. I0514 11:09:44.083117 1 tasks_processing.go:71] worker 36 working on machine_sets task. I0514 11:09:44.083118 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 3.994335ms to process 0 records I0514 11:09:44.083982 1 tasks_processing.go:74] worker 27 stopped. E0514 11:09:44.083999 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0514 11:09:44.084009 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 4.581176ms to process 0 records I0514 11:09:44.084170 1 tasks_processing.go:74] worker 6 stopped. I0514 11:09:44.084190 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0514 11:09:44.084206 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0514 11:09:44.084218 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 11:09:44.084222 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0514 11:09:44.084236 1 controller.go:489] The operator is still being initialized I0514 11:09:44.084245 1 controller.go:512] The operator is healthy I0514 11:09:44.084386 1 recorder.go:75] Recording config/network with fingerprint=c5eb73b2708e9c48171eaef0fc735245da8b43910bfaa7941203c9429970badf I0514 11:09:44.084404 1 gather.go:177] gatherer "clusterconfig" function "networks" took 5.363722ms to process 1 records I0514 11:09:44.084466 1 recorder.go:75] Recording config/proxy with fingerprint=9f321189299bf5423c835a041938326c6d68ddf4f62cbf9ddb1419df5b09a1e2 I0514 11:09:44.084478 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 5.397507ms to process 1 records I0514 11:09:44.084486 1 tasks_processing.go:74] worker 32 stopped. I0514 11:09:44.089951 1 tasks_processing.go:74] worker 34 stopped. I0514 11:09:44.089968 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 9.178897ms to process 0 records I0514 11:09:44.090013 1 tasks_processing.go:74] worker 19 stopped. I0514 11:09:44.090030 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 10.708352ms to process 0 records I0514 11:09:44.090332 1 tasks_processing.go:74] worker 40 stopped. I0514 11:09:44.090526 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=c3754d1d45347c1b9f94e6029385f7666c7a442a2b52a2820c43feba394d5c74 I0514 11:09:44.090606 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=c0bec37379d5bcfe68b1262035bba4234483e360ab59bb8f7014964978021062 I0514 11:09:44.090625 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=94118aee2b09d131805838b937f53db744ba80e4af8eac27e6be3e6a9a220708 I0514 11:09:44.090657 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=6dac9a970bb1e2440c3b817725bcd12aa0d8e73ab9dbd1a4f2a871b609e3fad2 I0514 11:09:44.090709 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=82192080cd5a245fb1fc8dd9c50986aa6f6b09e3815d00c235260ff641e75a4c I0514 11:09:44.090743 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=bb5cecd2268f886cec6d9a171c3fbba2a52c065417362914d976c21f210b0c6b I0514 11:09:44.090772 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=af721e560465caa1f4215553242fa0a23f9fcacb2a99eefdf9e682a961d9901c I0514 11:09:44.090813 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=245dd2fc64c029ad5a0b132b33977f2968b13a6efc4b6c4c59141fe439a0dd85 I0514 11:09:44.090842 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=9e52834b601c74441a97bb26c14b1747abea78df942b36d9b21fa738b7ec72f1 I0514 11:09:44.090873 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=6ea2ef5a925d74ebe6e7a83dc88262e637070ed54b90fdf6b1bb014081522984 I0514 11:09:44.090903 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=892579c2483d0ac410ad72c91453352d06221e342695c4ccb75aeda702c4a96c I0514 11:09:44.090911 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 11.403997ms to process 11 records I0514 11:09:44.098653 1 tasks_processing.go:74] worker 24 stopped. I0514 11:09:44.098667 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 19.273561ms to process 0 records I0514 11:09:44.098675 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 19.323817ms to process 0 records I0514 11:09:44.098683 1 tasks_processing.go:74] worker 44 stopped. I0514 11:09:44.098710 1 tasks_processing.go:74] worker 15 stopped. I0514 11:09:44.098721 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 16.548676ms to process 0 records I0514 11:09:44.098798 1 tasks_processing.go:74] worker 47 stopped. I0514 11:09:44.098816 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 19.876943ms to process 0 records I0514 11:09:44.098824 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 15.962817ms to process 0 records E0514 11:09:44.098829 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0514 11:09:44.098837 1 gather.go:177] gatherer "clusterconfig" function "machines" took 17.433161ms to process 0 records I0514 11:09:44.098842 1 tasks_processing.go:74] worker 26 stopped. I0514 11:09:44.098846 1 tasks_processing.go:74] worker 51 stopped. I0514 11:09:44.098888 1 tasks_processing.go:74] worker 8 stopped. E0514 11:09:44.098900 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0514 11:09:44.098912 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 17.921599ms to process 0 records I0514 11:09:44.098922 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 15.832607ms to process 0 records I0514 11:09:44.098941 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 16.931351ms to process 0 records I0514 11:09:44.098947 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 18.2358ms to process 0 records I0514 11:09:44.098951 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 19.591686ms to process 0 records I0514 11:09:44.098952 1 tasks_processing.go:74] worker 37 stopped. I0514 11:09:44.098956 1 tasks_processing.go:74] worker 31 stopped. I0514 11:09:44.098959 1 tasks_processing.go:74] worker 9 stopped. I0514 11:09:44.098960 1 tasks_processing.go:74] worker 10 stopped. I0514 11:09:44.099027 1 tasks_processing.go:74] worker 48 stopped. I0514 11:09:44.099500 1 recorder.go:75] Recording config/infrastructure with fingerprint=7d77662787d83d355c8c59c30c438237463dff988e5927ea706d61441a7be352 I0514 11:09:44.099513 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 18.735747ms to process 1 records I0514 11:09:44.105520 1 tasks_processing.go:74] worker 0 stopped. I0514 11:09:44.105538 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 22.443836ms to process 0 records I0514 11:09:44.105548 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 26.321766ms to process 0 records I0514 11:09:44.105555 1 tasks_processing.go:74] worker 5 stopped. I0514 11:09:44.105582 1 tasks_processing.go:74] worker 36 stopped. I0514 11:09:44.105597 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 22.45441ms to process 0 records I0514 11:09:44.105603 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 23.771323ms to process 0 records I0514 11:09:44.105608 1 tasks_processing.go:74] worker 22 stopped. I0514 11:09:44.105812 1 tasks_processing.go:74] worker 56 stopped. I0514 11:09:44.106025 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=a1a03b661e7b6b0870398f8b51fad491543c51a5475122a2c64e024d5d12c387 I0514 11:09:44.106060 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 24.560769ms to process 1 records I0514 11:09:44.106098 1 tasks_processing.go:74] worker 62 stopped. I0514 11:09:44.106306 1 recorder.go:75] Recording config/oauth with fingerprint=8919bc829c5b03c047632abd94d8102d647513fe2c6d970cb185e01c5e77e001 I0514 11:09:44.106318 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 25.182788ms to process 1 records I0514 11:09:44.106364 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=9a24ba5b0d44af9ff3f031b0e16a34b4a09b983d20e46fe6efba895e2aab3f91 I0514 11:09:44.106371 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 24.434075ms to process 1 records I0514 11:09:44.106375 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 26.886578ms to process 0 records E0514 11:09:44.106380 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0514 11:09:44.106386 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 26.86071ms to process 0 records I0514 11:09:44.106390 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 23.338076ms to process 0 records I0514 11:09:44.106393 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 24.027703ms to process 0 records I0514 11:09:44.106401 1 tasks_processing.go:74] worker 23 stopped. I0514 11:09:44.106405 1 tasks_processing.go:74] worker 52 stopped. I0514 11:09:44.106409 1 tasks_processing.go:74] worker 53 stopped. I0514 11:09:44.106411 1 tasks_processing.go:74] worker 55 stopped. I0514 11:09:44.106413 1 tasks_processing.go:74] worker 18 stopped. I0514 11:09:44.106478 1 tasks_processing.go:74] worker 21 stopped. I0514 11:09:44.106736 1 gather_logs.go:145] no pods in namespace were found I0514 11:09:44.106903 1 recorder.go:75] Recording config/ingress with fingerprint=4ac48cf7fb2b614c9bfbe44fe0cd5b4f58e7be4e0724cf0d2092075b4fd01565 I0514 11:09:44.106972 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 23.390693ms to process 1 records I0514 11:09:44.107004 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 24.333326ms to process 0 records I0514 11:09:44.107047 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 25.379632ms to process 0 records I0514 11:09:44.107075 1 tasks_processing.go:74] worker 50 stopped. I0514 11:09:44.107091 1 tasks_processing.go:74] worker 42 stopped. I0514 11:09:44.107185 1 tasks_processing.go:74] worker 39 stopped. I0514 11:09:44.107387 1 recorder.go:75] Recording config/image with fingerprint=3f850af8b6c35d6000aa2327fc28f4f36b065def7ef40dd6291bda2ee557396c I0514 11:09:44.107441 1 gather.go:177] gatherer "clusterconfig" function "image" took 25.101018ms to process 1 records I0514 11:09:44.108431 1 tasks_processing.go:74] worker 46 stopped. I0514 11:09:44.108509 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=e2b172563b6f8ae8f1c58a156fd19c4159508997ef0627965014fbd88c3100c5 I0514 11:09:44.108526 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=69097aa28c66b861b8486f41aaed84708da86ab3696ac6c71ca2c7a91390f6ca I0514 11:09:44.108532 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 26.530388ms to process 2 records I0514 11:09:44.108634 1 tasks_processing.go:74] worker 63 stopped. I0514 11:09:44.108901 1 recorder.go:75] Recording config/authentication with fingerprint=1bf3c0ad0fcd8e483c5893b1db830e04756d99c4d3fc0f59f8f141dfb13d9c28 I0514 11:09:44.108917 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 26.6209ms to process 1 records I0514 11:09:44.109117 1 recorder.go:75] Recording config/featuregate with fingerprint=08c5c5533a454ab95d8c6ab42dbf15cc4efdc883a45a5133b1060a1b03fed3f0 I0514 11:09:44.109117 1 tasks_processing.go:74] worker 28 stopped. I0514 11:09:44.109134 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 28.117943ms to process 1 records I0514 11:09:44.109142 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 29.566773ms to process 0 records I0514 11:09:44.109185 1 tasks_processing.go:74] worker 16 stopped. I0514 11:09:44.109260 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=eb0151be9ec904206b5b769536426fffbce2a92c8c32128c7d94878ef2e7e1d0 I0514 11:09:44.109269 1 tasks_processing.go:74] worker 41 stopped. I0514 11:09:44.109318 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=3a977bfe7e77944751b862a6cb3da2c85fa9ee3e6c1b48d316b7c07a95dd0579 I0514 11:09:44.109379 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=6e2f151f62153096ca6dfa52da51db8ea60c59d17d53d3c6fc0f8483345effd5 I0514 11:09:44.109392 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 27.860547ms to process 3 records I0514 11:09:44.109404 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 27.291629ms to process 0 records I0514 11:09:44.109415 1 tasks_processing.go:74] worker 58 stopped. I0514 11:09:44.109565 1 tasks_processing.go:74] worker 3 stopped. I0514 11:09:44.109911 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=5979053a65c8c03bd7bb2d7a046d3e9e94fa09e3f3b1b9a2cf5e10fdc2757c00 I0514 11:09:44.109930 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 29.291293ms to process 1 records I0514 11:09:44.110009 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=8eaa26fb34aab193b15294eab2ad8ca2673cdc84d9abf1e615dd3feafb9e91a4 I0514 11:09:44.110018 1 tasks_processing.go:74] worker 25 stopped. I0514 11:09:44.110036 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=666fb844110594de1d7b337913bd7864e1c29496e613bd506ffb79ebbe2552e4 I0514 11:09:44.110060 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=c9050ccbf5ec04658d52626866c9267fa7fc75a580295955a60a7e593e563df9 I0514 11:09:44.110068 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 28.228828ms to process 3 records I0514 11:09:44.110178 1 tasks_processing.go:74] worker 45 stopped. I0514 11:09:44.110334 1 recorder.go:75] Recording config/apiserver with fingerprint=fec9dc0c9da17a2db967b134ddccbd635190acf3bcb658746c0e4326872516a9 I0514 11:09:44.110352 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 29.058012ms to process 1 records I0514 11:09:44.110426 1 tasks_processing.go:74] worker 61 stopped. I0514 11:09:44.111350 1 recorder.go:75] Recording config/node/ip-10-0-0-53.ec2.internal with fingerprint=4f0f8dd528339155a0914a3a0e2ae497e3694b4712f654787566fc44c89448e4 I0514 11:09:44.111530 1 recorder.go:75] Recording config/node/ip-10-0-1-30.ec2.internal with fingerprint=5bc6fa021ae0cfa70073817779a295af61e95c20238f9daba3ad352137bc8406 I0514 11:09:44.111667 1 recorder.go:75] Recording config/node/ip-10-0-2-69.ec2.internal with fingerprint=5e986e73187af4d9e2d5fc881d7ea5912bd17db3aef92ad0d1ff1cb3d708d475 I0514 11:09:44.111722 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 29.896469ms to process 3 records I0514 11:09:44.113579 1 tasks_processing.go:74] worker 59 stopped. I0514 11:09:44.113597 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 31.749837ms to process 0 records I0514 11:09:44.114342 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0514 11:09:44.114404 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0514 11:09:44.114526 1 operator.go:288] started I0514 11:09:44.114554 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0514 11:09:44.115219 1 tasks_processing.go:74] worker 20 stopped. I0514 11:09:44.115246 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0514 11:09:44.115255 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 33.828493ms to process 1 records I0514 11:09:44.115640 1 tasks_processing.go:74] worker 14 stopped. I0514 11:09:44.115740 1 recorder.go:75] Recording config/olm_operators with fingerprint=d8e34f61fab94435a2cc70ba891bdd0b1df1a57d5994d1d57a20afcc06349a53 I0514 11:09:44.115759 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 36.406804ms to process 1 records W0514 11:09:44.115847 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0514 11:09:44.120956 1 tasks_processing.go:74] worker 54 stopped. I0514 11:09:44.121476 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=aced1f85a2473534ad8038e8dfd4e2fbc60064cc346b5460782f2da0362f9f96 I0514 11:09:44.121710 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=b97ad46c752251e0d39707fe4c0ea9c8427e27e444abadea69f9db669fce1fc5 I0514 11:09:44.121721 1 gather.go:177] gatherer "clusterconfig" function "crds" took 38.916865ms to process 2 records I0514 11:09:44.121807 1 tasks_processing.go:74] worker 2 stopped. I0514 11:09:44.121857 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=1cbdf85916b26d2dae61f5065941f69198c6a0ac72c89a286b05fec16caf68f7 I0514 11:09:44.121935 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=e020721ef352db8907bb0081ab471c31e95e59766a64f286dc37d4846c728c1d I0514 11:09:44.121942 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 41.74611ms to process 2 records I0514 11:09:44.122094 1 tasks_processing.go:74] worker 1 stopped. I0514 11:09:44.122158 1 recorder.go:75] Recording config/running_containers with fingerprint=70163585bc95d1d6bcf75550e0e8ed218aa9ad3c55731813bf3ee805f482758d I0514 11:09:44.122169 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 39.835753ms to process 1 records I0514 11:09:44.124038 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0514 11:09:44.124050 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 11:09:44.124054 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0514 11:09:44.124056 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0514 11:09:44.124060 1 controller.go:212] Source scaController *sca.Controller is not ready I0514 11:09:44.124058 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 43.088324ms to process 0 records I0514 11:09:44.124076 1 controller.go:489] The operator is still being initialized I0514 11:09:44.124082 1 controller.go:512] The operator is healthy I0514 11:09:44.124049 1 tasks_processing.go:74] worker 57 stopped. I0514 11:09:44.124599 1 tasks_processing.go:74] worker 4 stopped. I0514 11:09:44.124611 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 45.375859ms to process 0 records I0514 11:09:44.126823 1 prometheus_rules.go:88] Prometheus rules successfully created E0514 11:09:44.130852 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%277c514017-16b6-4dc9-a02b-03ac6121d5ed%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.10:37667->172.30.0.10:53: read: connection refused I0514 11:09:44.130870 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%277c514017-16b6-4dc9-a02b-03ac6121d5ed%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.10:37667->172.30.0.10:53: read: connection refused I0514 11:09:44.132100 1 tasks_processing.go:74] worker 33 stopped. E0514 11:09:44.132129 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0514 11:09:44.132138 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0514 11:09:44.132144 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0514 11:09:44.132156 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0514 11:09:44.132207 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0514 11:09:44.132219 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0514 11:09:44.132232 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0514 11:09:44.132238 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0514 11:09:44.132293 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0514 11:09:44.132308 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0514 11:09:44.132316 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 53.248502ms to process 7 records I0514 11:09:44.154121 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0514 11:09:44.154133 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0514 11:09:44.154216 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0514 11:09:44.157430 1 base_controller.go:82] Caches are synced for ConfigController I0514 11:09:44.157444 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0514 11:09:44.160953 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 11:09:44.196263 1 tasks_processing.go:74] worker 29 stopped. I0514 11:09:44.196593 1 recorder.go:75] Recording config/version with fingerprint=9427cdc71cc0a6086b090c951a04a42e3c3b98db642a603ecdb5282f79bf9765 I0514 11:09:44.196607 1 recorder.go:75] Recording config/id with fingerprint=f4bd2c5cddca582ed2a69f4239983a1e34ad62ed370596eda1e341958ac5c2d0 I0514 11:09:44.196615 1 gather.go:177] gatherer "clusterconfig" function "version" took 114.600931ms to process 2 records I0514 11:09:44.204981 1 tasks_processing.go:74] worker 12 stopped. I0514 11:09:44.205012 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0514 11:09:44.205025 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 124.160126ms to process 1 records I0514 11:09:44.212789 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0514 11:09:44.214599 1 base_controller.go:82] Caches are synced for LoggingSyncer I0514 11:09:44.214612 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... W0514 11:09:44.216454 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.10:33173->172.30.0.10:53: read: connection refused I0514 11:09:44.216466 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.10:33173->172.30.0.10:53: read: connection refused I0514 11:09:44.222744 1 tasks_processing.go:74] worker 30 stopped. E0514 11:09:44.222761 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0514 11:09:44.222767 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q9lknfj33ljv53suciv2iu36lf923p5-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q9lknfj33ljv53suciv2iu36lf923p5-primary-cert-bundle-secret" not found I0514 11:09:44.222868 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=e5ba15eb49b0fba0d77bf25c5aa28a838106743cb82054b9982f9809dddf7b1b I0514 11:09:44.222882 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 143.425205ms to process 1 records I0514 11:09:44.525233 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0514 11:09:44.525249 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0514 11:09:44.526018 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-2cdh2 pod in namespace openshift-dns (previous: false). I0514 11:09:44.745477 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-2cdh2 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-2cdh2\" is waiting to start: ContainerCreating" I0514 11:09:44.745496 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-2cdh2\" is waiting to start: ContainerCreating" I0514 11:09:44.745505 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-2cdh2 pod in namespace openshift-dns (previous: false). I0514 11:09:44.922950 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-2cdh2 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-2cdh2\" is waiting to start: ContainerCreating" I0514 11:09:44.922973 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-2cdh2\" is waiting to start: ContainerCreating" I0514 11:09:44.922984 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-87c9w pod in namespace openshift-dns (previous: false). W0514 11:09:45.113932 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0514 11:09:45.161590 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-87c9w pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-87c9w\" is waiting to start: ContainerCreating" I0514 11:09:45.161610 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-87c9w\" is waiting to start: ContainerCreating" I0514 11:09:45.161618 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-87c9w pod in namespace openshift-dns (previous: false). I0514 11:09:45.325564 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-87c9w pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-87c9w\" is waiting to start: ContainerCreating" I0514 11:09:45.325583 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-87c9w\" is waiting to start: ContainerCreating" I0514 11:09:45.325616 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-dw82n pod in namespace openshift-dns (previous: false). I0514 11:09:45.536962 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0514 11:09:45.545208 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dw82n pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-dw82n\" is waiting to start: ContainerCreating" I0514 11:09:45.545228 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-dw82n\" is waiting to start: ContainerCreating" I0514 11:09:45.545236 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-dw82n pod in namespace openshift-dns (previous: false). I0514 11:09:45.723618 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dw82n pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-dw82n\" is waiting to start: ContainerCreating" I0514 11:09:45.723635 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-dw82n\" is waiting to start: ContainerCreating" I0514 11:09:45.723644 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-bfkj4 pod in namespace openshift-dns (previous: false). I0514 11:09:45.923236 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0514 11:09:45.923254 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-h9vrp pod in namespace openshift-dns (previous: false). W0514 11:09:46.113485 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0514 11:09:46.131479 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0514 11:09:46.131495 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-zq8sv pod in namespace openshift-dns (previous: false). I0514 11:09:46.140601 1 tasks_processing.go:74] worker 49 stopped. I0514 11:09:46.140647 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=3d1d1a24e1530d223870dc80e2c8ec544bcfd25f590baa048d0aa09ad3f1cb2d I0514 11:09:46.140707 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=fb692b004243cfaf3c59014bc919554f9dff2fca57510d8004612c84c5fb4b85 I0514 11:09:46.140739 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0514 11:09:46.140765 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=ca5437670f809a094df8c940ff6028a64024393b14264ae8576607c68e6be659 I0514 11:09:46.140782 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0514 11:09:46.140819 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=f9c9f66d5c68db6f1d26bcce647f54e34af14bd1dd9ed744661d5efdd4203e92 I0514 11:09:46.140849 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=4bebb97d066ec8d5fbf226b1368322a72892257769750bdb602fff72a66c8868 I0514 11:09:46.140874 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=398668e44dec20d6701fb17471943419135203d6410db626a463f1096c0feedd I0514 11:09:46.140893 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=b81925823975b83ba8f510405f28f23fbe3d68ef0df169de186187cbbb464843 I0514 11:09:46.140918 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=e569ee6e4184581b25d430d29bff44145a61df813cb79d32a22c6763ab747a19 I0514 11:09:46.140929 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0514 11:09:46.140947 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=97a128e5438572d2f67ab34a0754baffcc3400f6f8b2308b46d7ec517e331988 I0514 11:09:46.140965 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0514 11:09:46.140986 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=5080b1881f6b7c36dda018205360db8da822bb1453430ef18613d31176597f26 I0514 11:09:46.140995 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0514 11:09:46.141007 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=d8d7fb76e59a1bb0b83f6e314c32642e1f70a949d936442cb6a2daac9939c948 I0514 11:09:46.141017 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0514 11:09:46.141033 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=1f67891a16b3f8c5edcb09e7316bc59b3b9459c11bb3367373f73b8f5c2af00c I0514 11:09:46.141142 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=b6bf06c8a95a4b28c1337eba4459e7e228ca918be7c3e87b259b1e653a00ca3b I0514 11:09:46.141155 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0514 11:09:46.141162 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0514 11:09:46.141182 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0514 11:09:46.141202 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=b028ab767ad0c06c8b153053b3ac1abf4f5882493cc6c577d40b6ebe3129a4cc I0514 11:09:46.141225 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=d9289ac02bb3722514db126a44b09c746c6fc665e80f063c1f386cfcea2854be I0514 11:09:46.141235 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0514 11:09:46.141250 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=28637433a8b5a090ba2c8816f1081fb6efbaaf08909215048e608921bb23284d I0514 11:09:46.141261 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0514 11:09:46.141275 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=ca915a0d7678e8db04691185c5959e97c5972a3316005d50c7c36316981ce7cc I0514 11:09:46.141290 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=bae2772d3b3ac9d2e346797a515918193ceb6b96b8d5e03a7c6b641284e884c7 I0514 11:09:46.141306 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=ffe136c92edda743ebb32add0c9adccb2732a2023ec694ae6d8c146f3594c7cc I0514 11:09:46.141322 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=ddb912874a380c5663d27a9abc1798925da6a35afc8babe2a7c00ae543286516 I0514 11:09:46.141342 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=6f58762c85cd68d7b0d16f6fb79a3a6594f09aef37ca2eefec3f73af5f31976d I0514 11:09:46.141351 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0514 11:09:46.141378 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=978b2f94486f812a328a91553c15244a5dc2ba720e1443ceadb975a2c19af97c I0514 11:09:46.141418 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0514 11:09:46.141428 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0514 11:09:46.141435 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.059549097s to process 36 records I0514 11:09:46.324462 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0514 11:09:46.324518 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-555fbb478f-hd5z9 pod in namespace openshift-image-registry (previous: false). I0514 11:09:46.524584 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-555fbb478f-hd5z9 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-555fbb478f-hd5z9\" is waiting to start: ContainerCreating" I0514 11:09:46.524601 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-555fbb478f-hd5z9\" is waiting to start: ContainerCreating" I0514 11:09:46.524633 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-555fbb478f-v6sck pod in namespace openshift-image-registry (previous: false). I0514 11:09:46.724868 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-555fbb478f-v6sck pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-555fbb478f-v6sck\" is waiting to start: ContainerCreating" I0514 11:09:46.724887 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-555fbb478f-v6sck\" is waiting to start: ContainerCreating" I0514 11:09:46.724918 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-55b5b595d6-wb6st pod in namespace openshift-image-registry (previous: false). I0514 11:09:46.923535 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-55b5b595d6-wb6st pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-55b5b595d6-wb6st\" is waiting to start: ContainerCreating" I0514 11:09:46.923552 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-55b5b595d6-wb6st\" is waiting to start: ContainerCreating" I0514 11:09:46.923562 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-5mlz5 pod in namespace openshift-image-registry (previous: false). W0514 11:09:47.114648 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0514 11:09:47.124164 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0514 11:09:47.124178 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-hj8k5 pod in namespace openshift-image-registry (previous: false). I0514 11:09:47.322674 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0514 11:09:47.322711 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-lssqq pod in namespace openshift-image-registry (previous: false). I0514 11:09:47.524943 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0514 11:09:47.524959 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7b7549b7b6-4n9nm pod in namespace openshift-ingress (previous: false). I0514 11:09:47.727125 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7b7549b7b6-4n9nm pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7b7549b7b6-4n9nm\" is waiting to start: ContainerCreating" I0514 11:09:47.727142 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7b7549b7b6-4n9nm\" is waiting to start: ContainerCreating" I0514 11:09:47.727153 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7b7549b7b6-jr4jx pod in namespace openshift-ingress (previous: false). I0514 11:09:47.923727 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7b7549b7b6-jr4jx pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7b7549b7b6-jr4jx\" is waiting to start: ContainerCreating" I0514 11:09:47.923743 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7b7549b7b6-jr4jx\" is waiting to start: ContainerCreating" I0514 11:09:47.923762 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-fd897476c-xkfk4 pod in namespace openshift-ingress (previous: false). W0514 11:09:48.113906 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0514 11:09:48.125438 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-fd897476c-xkfk4 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-fd897476c-xkfk4\" is waiting to start: ContainerCreating" I0514 11:09:48.125455 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-fd897476c-xkfk4\" is waiting to start: ContainerCreating" I0514 11:09:48.125482 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-h2mks pod in namespace openshift-ingress-canary (previous: false). I0514 11:09:48.321702 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-h2mks pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-h2mks\" is waiting to start: ContainerCreating" I0514 11:09:48.321720 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-h2mks\" is waiting to start: ContainerCreating" I0514 11:09:48.321731 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-kr7rj pod in namespace openshift-ingress-canary (previous: false). I0514 11:09:48.524829 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-kr7rj pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-kr7rj\" is waiting to start: ContainerCreating" I0514 11:09:48.524847 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-kr7rj\" is waiting to start: ContainerCreating" I0514 11:09:48.524882 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-mpvtr pod in namespace openshift-ingress-canary (previous: false). I0514 11:09:48.724167 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-mpvtr pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mpvtr\" is waiting to start: ContainerCreating" I0514 11:09:48.724187 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mpvtr\" is waiting to start: ContainerCreating" I0514 11:09:48.724205 1 tasks_processing.go:74] worker 17 stopped. I0514 11:09:48.724278 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=1a88262aceb1b9f263115951090b60321dc090b052239baa6aa99eb73f17a60b I0514 11:09:48.724330 1 recorder.go:75] Recording events/openshift-dns with fingerprint=a18ffef93f022e56a262a69fa708f21f00947e2591ecd614b9a9c8e3a88973a7 I0514 11:09:48.724419 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=be7b1595d2d66635bd951448c6f996156de6f9cd6244fe487f6cadb7ea8ca0d5 I0514 11:09:48.724445 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=04d05be5b4783804f5d92df775f080c2dab71229c69e6d8c63a4a76d625f769b I0514 11:09:48.724489 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=85596b6d1f357aa186666a89b9b3dc9d7a2a8c4da18cd9c7417b79fb508f3f61 I0514 11:09:48.724505 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=7c16eeec3eab922f29a6523b661a0f89503c61fe4b37c0865dda37cab2644ce0 I0514 11:09:48.725861 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-2cdh2 with fingerprint=c5d20a80ae49f4a45a10e0c59102fa372f84e7f2de5b956c5f5115c047a5a810 I0514 11:09:48.725952 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-dw82n with fingerprint=8a43e132e5abeb0f3e33a22b65efcb09abdb96a42211886ae840a03cb1bb7bc5 I0514 11:09:48.726054 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-555fbb478f-hd5z9 with fingerprint=8cd11df440cc91fd387b99744ed0a56bf7be4dae39495ef5d6484d3c696a0619 I0514 11:09:48.726150 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-555fbb478f-v6sck with fingerprint=5d54f840e113d5bbdd0399672be5d14e7115745bc3ec02977d8f9525ae1caae8 I0514 11:09:48.726236 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-55b5b595d6-wb6st with fingerprint=436a3e9eca52ddfa55b09f71141261fdaf9e179555cbf8c4ba67aab5dc0d3cec I0514 11:09:48.726295 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-h2mks with fingerprint=2ae0b4f935ac597148de9c5c958157fa462c179a1ccafcfba5d26e717773b081 I0514 11:09:48.726350 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-mpvtr with fingerprint=47fe204a5b4db5344974d843cfa56fe5794837722a36abbaa52426ca4587a7d5 I0514 11:09:48.726359 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.644875392s to process 13 records W0514 11:09:49.110516 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0514 11:09:49.110542 1 tasks_processing.go:74] worker 11 stopped. E0514 11:09:49.110554 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0514 11:09:49.110565 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0514 11:09:49.110582 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0514 11:09:49.110589 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.028463458s to process 1 records I0514 11:09:56.716088 1 tasks_processing.go:74] worker 60 stopped. I0514 11:09:56.716133 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0514 11:09:56.716145 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.63487437s to process 1 records I0514 11:09:56.954983 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 11:09:57.488962 1 tasks_processing.go:74] worker 13 stopped. I0514 11:09:57.489320 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=a7a4de02df1cc1abdf9107bf21a9d837b0f58083251a7f44b02bf3cc6249ecc3 I0514 11:09:57.489339 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.407017915s to process 1 records E0514 11:09:57.489403 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.41s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0514 11:09:57.490507 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0514 11:09:57.490523 1 periodic.go:209] Running workloads gatherer I0514 11:09:57.490537 1 tasks_processing.go:45] number of workers: 2 I0514 11:09:57.490543 1 tasks_processing.go:69] worker 1 listening for tasks. I0514 11:09:57.490547 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I0514 11:09:57.490558 1 tasks_processing.go:69] worker 0 listening for tasks. I0514 11:09:57.490635 1 tasks_processing.go:71] worker 0 working on workload_info task. I0514 11:09:57.515595 1 tasks_processing.go:74] worker 1 stopped. I0514 11:09:57.515615 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 25.034624ms to process 0 records I0514 11:09:57.515709 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0514 11:09:57.523522 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (10ms) I0514 11:09:57.532346 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (9ms) I0514 11:09:57.539924 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (8ms) I0514 11:09:57.547453 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (8ms) I0514 11:09:57.555122 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (8ms) I0514 11:09:57.562922 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (8ms) I0514 11:09:57.570712 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (8ms) I0514 11:09:57.578720 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (8ms) I0514 11:09:57.586503 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (8ms) I0514 11:09:57.594837 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (8ms) I0514 11:09:57.621837 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (27ms) I0514 11:09:57.724561 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (103ms) I0514 11:09:57.823503 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (99ms) I0514 11:09:57.923767 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (100ms) I0514 11:09:58.023491 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (100ms) I0514 11:09:58.123806 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (100ms) I0514 11:09:58.222823 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (99ms) I0514 11:09:58.323195 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms) I0514 11:09:58.423279 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0514 11:09:58.525546 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (102ms) I0514 11:09:58.622821 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (97ms) I0514 11:09:58.724002 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (101ms) I0514 11:09:58.823225 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (99ms) I0514 11:09:58.924827 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (102ms) I0514 11:09:58.934124 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 11:09:59.025154 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0514 11:09:59.122911 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (98ms) I0514 11:09:59.134607 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 11:09:59.223464 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (101ms) I0514 11:09:59.323398 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0514 11:09:59.423568 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (100ms) I0514 11:09:59.524021 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (100ms) I0514 11:09:59.623561 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (100ms) I0514 11:09:59.724043 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (100ms) I0514 11:09:59.823357 1 gather_workloads_info.go:387] No image sha256:f68c0da8268f23078f5f760a91a3c8212f2195acf18c231f6e034207a67adeec (99ms) I0514 11:09:59.823387 1 tasks_processing.go:74] worker 0 stopped. E0514 11:09:59.823397 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0514 11:09:59.823655 1 recorder.go:75] Recording config/workload_info with fingerprint=bd4f6bfaace2d06287dde4b159508755c88c25125e865c5869d69c46d6a33634 I0514 11:09:59.823670 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.332737089s to process 1 records E0514 11:09:59.823724 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.333s with: function \"workload_info\" failed with an error" I0514 11:09:59.824827 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0514 11:09:59.824839 1 periodic.go:209] Running conditional gatherer I0514 11:09:59.830745 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0514 11:09:59.837232 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.10:44311->172.30.0.10:53: read: connection refused E0514 11:09:59.837466 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0514 11:09:59.837526 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0514 11:09:59.843473 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0514 11:09:59.843487 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 11:09:59.843492 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 11:09:59.843496 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 11:09:59.843499 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 11:09:59.843501 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 11:09:59.843505 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 11:09:59.843508 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 11:09:59.843510 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 11:09:59.843513 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0514 11:09:59.843527 1 tasks_processing.go:45] number of workers: 3 I0514 11:09:59.843537 1 tasks_processing.go:69] worker 2 listening for tasks. I0514 11:09:59.843542 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0514 11:09:59.843550 1 tasks_processing.go:69] worker 0 listening for tasks. I0514 11:09:59.843565 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I0514 11:09:59.843570 1 tasks_processing.go:69] worker 1 listening for tasks. I0514 11:09:59.843577 1 tasks_processing.go:74] worker 1 stopped. I0514 11:09:59.843592 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0514 11:09:59.843593 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0514 11:09:59.843604 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.853µs to process 1 records I0514 11:09:59.843660 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0514 11:09:59.843669 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.316µs to process 1 records I0514 11:09:59.843674 1 tasks_processing.go:74] worker 2 stopped. I0514 11:09:59.843817 1 tasks_processing.go:74] worker 0 stopped. I0514 11:09:59.843829 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 242.136µs to process 0 records I0514 11:09:59.843847 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.10:44311->172.30.0.10:53: read: connection refused I0514 11:09:59.843862 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0514 11:09:59.865407 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=20e00b2b96a0f8cfb061539217d4b69afa7781d57c40a60750f646166e7d645b I0514 11:09:59.865536 1 diskrecorder.go:70] Writing 108 records to /var/lib/insights-operator/insights-2026-05-14-110959.tar.gz I0514 11:09:59.872091 1 diskrecorder.go:51] Wrote 108 records to disk in 6ms I0514 11:09:59.872121 1 periodic.go:278] Gathering cluster info every 2h0m0s I0514 11:09:59.872135 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0514 11:10:09.351603 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 11:10:53.492717 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="a67a0db4929c7ce458392eb57f8c50cdc88125dcb3a444599a77dfb622bf6526") W0514 11:10:53.492748 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.key was created I0514 11:10:53.492800 1 periodic.go:170] Shutting down I0514 11:10:53.492800 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0514 11:10:53.492825 1 base_controller.go:181] Shutting down LoggingSyncer ... I0514 11:10:53.492841 1 base_controller.go:181] Shutting down ConfigController ... I0514 11:10:53.492841 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="121d7051c287a866c4b8c91dcfa39912d41f23132314dd913ab20373483f6f65") I0514 11:10:53.492849 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0514 11:10:53.492846 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0514 11:10:53.492889 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" I0514 11:10:53.492910 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting"