W0420 08:58:21.461476 1 cmd.go:257] Using insecure, self-signed certificates I0420 08:58:22.172990 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 08:58:22.173314 1 observer_polling.go:159] Starting file observer I0420 08:58:22.388789 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0420 08:58:22.388999 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0420 08:58:22.389538 1 secure_serving.go:57] Forcing use of http/1.1 only W0420 08:58:22.389565 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0420 08:58:22.389570 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0420 08:58:22.389574 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0420 08:58:22.389577 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0420 08:58:22.389579 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0420 08:58:22.389581 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0420 08:58:22.389626 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0420 08:58:22.393391 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0420 08:58:22.393406 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"f8d536d7-dd81-4b47-89d1-1c313a24734d", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0420 08:58:22.394163 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0420 08:58:22.394183 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0420 08:58:22.394178 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0420 08:58:22.394195 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0420 08:58:22.394178 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0420 08:58:22.394208 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0420 08:58:22.394535 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3691125054/tls.crt::/tmp/serving-cert-3691125054/tls.key" I0420 08:58:22.394840 1 secure_serving.go:213] Serving securely on [::]:8443 I0420 08:58:22.394865 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0420 08:58:22.397856 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0420 08:58:22.397875 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0420 08:58:22.397961 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0420 08:58:22.402734 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0420 08:58:22.402751 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0420 08:58:22.408398 1 secretconfigobserver.go:119] support secret does not exist I0420 08:58:22.412470 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0420 08:58:22.419781 1 secretconfigobserver.go:119] support secret does not exist I0420 08:58:22.422624 1 recorder.go:176] Pruning old reports every 6h54m16s, max age is 288h0m0s I0420 08:58:22.427131 1 periodic.go:216] Running clusterconfig gatherer I0420 08:58:22.427136 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0420 08:58:22.427151 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0420 08:58:22.427169 1 tasks_processing.go:45] number of workers: 64 I0420 08:58:22.427169 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0420 08:58:22.427182 1 insightsreport.go:296] Starting report retriever I0420 08:58:22.427187 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0420 08:58:22.427188 1 tasks_processing.go:69] worker 6 listening for tasks. I0420 08:58:22.427195 1 tasks_processing.go:69] worker 0 listening for tasks. I0420 08:58:22.427202 1 tasks_processing.go:69] worker 28 listening for tasks. I0420 08:58:22.427201 1 tasks_processing.go:69] worker 10 listening for tasks. I0420 08:58:22.427208 1 tasks_processing.go:69] worker 2 listening for tasks. I0420 08:58:22.427209 1 tasks_processing.go:71] worker 28 working on active_alerts task. I0420 08:58:22.427213 1 tasks_processing.go:69] worker 38 listening for tasks. I0420 08:58:22.427216 1 tasks_processing.go:69] worker 7 listening for tasks. I0420 08:58:22.427215 1 tasks_processing.go:69] worker 3 listening for tasks. I0420 08:58:22.427219 1 tasks_processing.go:69] worker 4 listening for tasks. I0420 08:58:22.427224 1 tasks_processing.go:69] worker 5 listening for tasks. I0420 08:58:22.427226 1 tasks_processing.go:69] worker 40 listening for tasks. I0420 08:58:22.427221 1 tasks_processing.go:69] worker 39 listening for tasks. I0420 08:58:22.427227 1 tasks_processing.go:69] worker 32 listening for tasks. I0420 08:58:22.427227 1 tasks_processing.go:69] worker 37 listening for tasks. I0420 08:58:22.427237 1 tasks_processing.go:69] worker 9 listening for tasks. I0420 08:58:22.427240 1 tasks_processing.go:69] worker 33 listening for tasks. I0420 08:58:22.427243 1 tasks_processing.go:69] worker 29 listening for tasks. I0420 08:58:22.427243 1 tasks_processing.go:69] worker 42 listening for tasks. I0420 08:58:22.427247 1 tasks_processing.go:69] worker 35 listening for tasks. I0420 08:58:22.427250 1 tasks_processing.go:69] worker 31 listening for tasks. I0420 08:58:22.427251 1 tasks_processing.go:69] worker 21 listening for tasks. I0420 08:58:22.427249 1 tasks_processing.go:69] worker 30 listening for tasks. I0420 08:58:22.427257 1 tasks_processing.go:69] worker 36 listening for tasks. I0420 08:58:22.427260 1 tasks_processing.go:69] worker 44 listening for tasks. I0420 08:58:22.427257 1 tasks_processing.go:69] worker 59 listening for tasks. I0420 08:58:22.427265 1 tasks_processing.go:69] worker 45 listening for tasks. I0420 08:58:22.427264 1 tasks_processing.go:69] worker 53 listening for tasks. I0420 08:58:22.427269 1 tasks_processing.go:69] worker 61 listening for tasks. I0420 08:58:22.427272 1 tasks_processing.go:69] worker 46 listening for tasks. I0420 08:58:22.427274 1 tasks_processing.go:69] worker 12 listening for tasks. I0420 08:58:22.427231 1 tasks_processing.go:69] worker 8 listening for tasks. I0420 08:58:22.427279 1 tasks_processing.go:69] worker 58 listening for tasks. I0420 08:58:22.427280 1 tasks_processing.go:69] worker 24 listening for tasks. I0420 08:58:22.427282 1 tasks_processing.go:69] worker 63 listening for tasks. I0420 08:58:22.427285 1 tasks_processing.go:69] worker 14 listening for tasks. I0420 08:58:22.427287 1 tasks_processing.go:71] worker 6 working on service_accounts task. I0420 08:58:22.427287 1 tasks_processing.go:69] worker 49 listening for tasks. I0420 08:58:22.427294 1 tasks_processing.go:71] worker 14 working on metrics task. I0420 08:58:22.427293 1 tasks_processing.go:71] worker 24 working on machines task. I0420 08:58:22.427298 1 tasks_processing.go:71] worker 61 working on nodenetworkstates task. I0420 08:58:22.427300 1 tasks_processing.go:71] worker 46 working on ingress task. I0420 08:58:22.427301 1 tasks_processing.go:71] worker 59 working on nodes task. I0420 08:58:22.427307 1 tasks_processing.go:71] worker 3 working on cluster_apiserver task. I0420 08:58:22.427311 1 tasks_processing.go:71] worker 32 working on clusterroles task. I0420 08:58:22.427312 1 tasks_processing.go:71] worker 21 working on openstack_version task. I0420 08:58:22.427317 1 tasks_processing.go:71] worker 4 working on image task. I0420 08:58:22.427317 1 tasks_processing.go:69] worker 50 listening for tasks. W0420 08:58:22.427344 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 08:58:22.427339 1 tasks_processing.go:71] worker 12 working on proxies task. I0420 08:58:22.427355 1 tasks_processing.go:71] worker 9 working on dvo_metrics task. I0420 08:58:22.427362 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 55.397µs to process 0 records I0420 08:58:22.427375 1 tasks_processing.go:71] worker 36 working on config_maps task. I0420 08:58:22.427370 1 tasks_processing.go:71] worker 37 working on overlapping_namespace_uids task. I0420 08:58:22.427205 1 tasks_processing.go:71] worker 0 working on image_pruners task. I0420 08:58:22.427390 1 tasks_processing.go:71] worker 14 working on silenced_alerts task. I0420 08:58:22.427235 1 tasks_processing.go:69] worker 34 listening for tasks. I0420 08:58:22.427301 1 tasks_processing.go:71] worker 40 working on monitoring_persistent_volumes task. I0420 08:58:22.427299 1 tasks_processing.go:71] worker 2 working on ceph_cluster task. I0420 08:58:22.427235 1 tasks_processing.go:69] worker 41 listening for tasks. I0420 08:58:22.427677 1 tasks_processing.go:71] worker 41 working on authentication task. I0420 08:58:22.427242 1 tasks_processing.go:69] worker 20 listening for tasks. I0420 08:58:22.427249 1 tasks_processing.go:69] worker 47 listening for tasks. I0420 08:58:22.427253 1 tasks_processing.go:69] worker 11 listening for tasks. I0420 08:58:22.427255 1 tasks_processing.go:69] worker 54 listening for tasks. I0420 08:58:22.427254 1 tasks_processing.go:69] worker 43 listening for tasks. I0420 08:58:22.427261 1 tasks_processing.go:69] worker 22 listening for tasks. I0420 08:58:22.427715 1 tasks_processing.go:71] worker 43 working on sap_pods task. I0420 08:58:22.427725 1 tasks_processing.go:71] worker 11 working on openshift_machine_api_events task. I0420 08:58:22.427726 1 tasks_processing.go:71] worker 47 working on node_features task. I0420 08:58:22.427735 1 tasks_processing.go:71] worker 54 working on lokistack task. I0420 08:58:22.427745 1 tasks_processing.go:71] worker 20 working on ingress_certificates task. I0420 08:58:22.427717 1 tasks_processing.go:71] worker 22 working on container_images task. I0420 08:58:22.427261 1 tasks_processing.go:69] worker 60 listening for tasks. I0420 08:58:22.427859 1 tasks_processing.go:71] worker 60 working on container_runtime_configs task. I0420 08:58:22.427264 1 tasks_processing.go:69] worker 55 listening for tasks. I0420 08:58:22.427264 1 tasks_processing.go:69] worker 26 listening for tasks. I0420 08:58:22.427268 1 tasks_processing.go:69] worker 27 listening for tasks. I0420 08:58:22.427269 1 tasks_processing.go:69] worker 56 listening for tasks. I0420 08:58:22.427268 1 tasks_processing.go:69] worker 17 listening for tasks. I0420 08:58:22.427203 1 tasks_processing.go:69] worker 1 listening for tasks. I0420 08:58:22.427271 1 tasks_processing.go:69] worker 23 listening for tasks. I0420 08:58:22.427274 1 tasks_processing.go:69] worker 57 listening for tasks. I0420 08:58:22.427278 1 tasks_processing.go:69] worker 18 listening for tasks. I0420 08:58:22.427272 1 tasks_processing.go:69] worker 15 listening for tasks. I0420 08:58:22.427906 1 tasks_processing.go:71] worker 57 working on sap_config task. I0420 08:58:22.427917 1 tasks_processing.go:71] worker 15 working on jaegers task. I0420 08:58:22.427280 1 tasks_processing.go:69] worker 48 listening for tasks. I0420 08:58:22.427942 1 tasks_processing.go:71] worker 27 working on cost_management_metrics_configs task. I0420 08:58:22.427956 1 tasks_processing.go:71] worker 17 working on machine_autoscalers task. I0420 08:58:22.427963 1 tasks_processing.go:71] worker 48 working on operators_pods_and_events task. I0420 08:58:22.427282 1 tasks_processing.go:69] worker 62 listening for tasks. I0420 08:58:22.428046 1 tasks_processing.go:71] worker 62 working on machine_healthchecks task. I0420 08:58:22.427285 1 tasks_processing.go:71] worker 58 working on storage_classes task. I0420 08:58:22.427285 1 tasks_processing.go:71] worker 8 working on install_plans task. I0420 08:58:22.427285 1 tasks_processing.go:69] worker 19 listening for tasks. I0420 08:58:22.428144 1 tasks_processing.go:71] worker 19 working on image_registries task. I0420 08:58:22.427288 1 tasks_processing.go:69] worker 25 listening for tasks. I0420 08:58:22.427290 1 tasks_processing.go:71] worker 10 working on aggregated_monitoring_cr_names task. I0420 08:58:22.427290 1 tasks_processing.go:71] worker 63 working on oauths task. I0420 08:58:22.428343 1 tasks_processing.go:71] worker 25 working on machine_configs task. I0420 08:58:22.427291 1 tasks_processing.go:69] worker 51 listening for tasks. I0420 08:58:22.427294 1 tasks_processing.go:71] worker 42 working on node_logs task. I0420 08:58:22.427293 1 tasks_processing.go:69] worker 52 listening for tasks. I0420 08:58:22.428506 1 tasks_processing.go:71] worker 52 working on operators task. I0420 08:58:22.427296 1 tasks_processing.go:71] worker 5 working on infrastructures task. I0420 08:58:22.427287 1 tasks_processing.go:69] worker 13 listening for tasks. I0420 08:58:22.427296 1 tasks_processing.go:71] worker 29 working on feature_gates task. I0420 08:58:22.428611 1 tasks_processing.go:71] worker 13 working on storage_cluster task. I0420 08:58:22.427299 1 tasks_processing.go:71] worker 44 working on pdbs task. I0420 08:58:22.427300 1 tasks_processing.go:71] worker 53 working on pod_network_connectivity_checks task. I0420 08:58:22.427302 1 tasks_processing.go:71] worker 38 working on support_secret task. I0420 08:58:22.427304 1 tasks_processing.go:71] worker 7 working on version task. I0420 08:58:22.427303 1 tasks_processing.go:71] worker 35 working on nodenetworkconfigurationpolicies task. I0420 08:58:22.427306 1 tasks_processing.go:71] worker 39 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0420 08:58:22.427304 1 tasks_processing.go:71] worker 45 working on crds task. I0420 08:58:22.427308 1 tasks_processing.go:71] worker 31 working on machine_config_pools task. I0420 08:58:22.427406 1 tasks_processing.go:71] worker 30 working on olm_operators task. I0420 08:58:22.427425 1 tasks_processing.go:71] worker 50 working on qemu_kubevirt_launcher_logs task. W0420 08:58:22.427240 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 08:58:22.429057 1 tasks_processing.go:71] worker 28 working on mutating_webhook_configurations task. I0420 08:58:22.427427 1 tasks_processing.go:71] worker 33 working on schedulers task. I0420 08:58:22.427426 1 tasks_processing.go:71] worker 49 working on machine_sets task. I0420 08:58:22.429111 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.839645ms to process 0 records W0420 08:58:22.427517 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 08:58:22.429136 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.631879ms to process 0 records I0420 08:58:22.427538 1 tasks_processing.go:71] worker 34 working on validating_webhook_configurations task. I0420 08:58:22.429193 1 tasks_processing.go:71] worker 14 working on openstack_dataplanedeployments task. I0420 08:58:22.427262 1 tasks_processing.go:69] worker 16 listening for tasks. I0420 08:58:22.429289 1 tasks_processing.go:74] worker 16 stopped. I0420 08:58:22.427905 1 tasks_processing.go:71] worker 18 working on tsdb_status task. W0420 08:58:22.429316 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 08:58:22.429347 1 tasks_processing.go:74] worker 18 stopped. I0420 08:58:22.427931 1 tasks_processing.go:71] worker 56 working on openstack_controlplanes task. I0420 08:58:22.429356 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 46.284µs to process 0 records I0420 08:58:22.427936 1 tasks_processing.go:71] worker 55 working on openshift_logging task. I0420 08:58:22.427939 1 tasks_processing.go:71] worker 26 working on networks task. I0420 08:58:22.427952 1 tasks_processing.go:71] worker 1 working on certificate_signing_requests task. I0420 08:58:22.427953 1 tasks_processing.go:71] worker 23 working on openstack_dataplanenodesets task. I0420 08:58:22.428428 1 tasks_processing.go:71] worker 51 working on sap_datahubs task. I0420 08:58:22.431081 1 tasks_processing.go:74] worker 61 stopped. I0420 08:58:22.431092 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 3.771072ms to process 0 records I0420 08:58:22.431470 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0420 08:58:22.431485 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0420 08:58:22.431490 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0420 08:58:22.431493 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0420 08:58:22.431506 1 controller.go:531] The operator is still being initialized I0420 08:58:22.431513 1 controller.go:554] The operator is healthy I0420 08:58:22.434782 1 tasks_processing.go:74] worker 12 stopped. I0420 08:58:22.434851 1 recorder.go:75] Recording config/proxy with fingerprint=1f0eb7f57f93ebcb475f87aed037682d63d46ad7a43d41cb934c3f7005b505a3 I0420 08:58:22.434862 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 7.417243ms to process 1 records I0420 08:58:22.436155 1 tasks_processing.go:74] worker 54 stopped. I0420 08:58:22.436163 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 8.407158ms to process 0 records I0420 08:58:22.436409 1 tasks_processing.go:74] worker 17 stopped. I0420 08:58:22.436420 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 8.440401ms to process 0 records I0420 08:58:22.437463 1 tasks_processing.go:74] worker 3 stopped. I0420 08:58:22.437584 1 recorder.go:75] Recording config/apiserver with fingerprint=d537678c9b199e0a9b4fcf27cabf9ae15ac0d292d89d7093b5c5f547f315bb4b I0420 08:58:22.437595 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 10.143621ms to process 1 records E0420 08:58:22.440745 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0420 08:58:22.440759 1 tasks_processing.go:74] worker 47 stopped. I0420 08:58:22.440769 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 13.021463ms to process 0 records I0420 08:58:22.441049 1 tasks_processing.go:74] worker 21 stopped. I0420 08:58:22.441061 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 13.723611ms to process 0 records I0420 08:58:22.441576 1 tasks_processing.go:74] worker 27 stopped. I0420 08:58:22.441585 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 13.614926ms to process 0 records I0420 08:58:22.441590 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 13.961291ms to process 0 records I0420 08:58:22.441595 1 tasks_processing.go:74] worker 2 stopped. I0420 08:58:22.441601 1 tasks_processing.go:74] worker 15 stopped. I0420 08:58:22.441612 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 13.674138ms to process 0 records I0420 08:58:22.441671 1 tasks_processing.go:74] worker 24 stopped. E0420 08:58:22.441682 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0420 08:58:22.441689 1 gather.go:177] gatherer "clusterconfig" function "machines" took 14.36308ms to process 0 records I0420 08:58:22.442160 1 tasks_processing.go:74] worker 46 stopped. I0420 08:58:22.442433 1 recorder.go:75] Recording config/ingress with fingerprint=cc9542a20f06d0c2f7a791085d9073d50ce27ec75abc1432ab5dad6d466cfe7a I0420 08:58:22.442449 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 14.847475ms to process 1 records I0420 08:58:22.443903 1 tasks_processing.go:74] worker 0 stopped. I0420 08:58:22.444103 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=9b10dd0d7565fd474714e57e8325deeb530770ec728758ef13d03d344a97f5da I0420 08:58:22.444119 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 16.508083ms to process 1 records I0420 08:58:22.445007 1 tasks_processing.go:74] worker 43 stopped. I0420 08:58:22.445023 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 17.278208ms to process 0 records I0420 08:58:22.445197 1 tasks_processing.go:74] worker 4 stopped. I0420 08:58:22.445276 1 recorder.go:75] Recording config/image with fingerprint=313a975e0afcc7e842989b403c2100af098cc9d5e32366f6a5e9920058dc734b I0420 08:58:22.445288 1 gather.go:177] gatherer "clusterconfig" function "image" took 17.844858ms to process 1 records I0420 08:58:22.446458 1 tasks_processing.go:74] worker 25 stopped. E0420 08:58:22.446469 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0420 08:58:22.446486 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0420 08:58:22.446494 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 18.099775ms to process 1 records I0420 08:58:22.447175 1 tasks_processing.go:74] worker 63 stopped. I0420 08:58:22.447352 1 recorder.go:75] Recording config/oauth with fingerprint=a61cf417e8c2e13f276bc12cb11a14e96fb84166647804d01e81e36c286fb2c3 I0420 08:58:22.447364 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 18.897273ms to process 1 records I0420 08:58:22.447455 1 tasks_processing.go:74] worker 41 stopped. I0420 08:58:22.447490 1 recorder.go:75] Recording config/authentication with fingerprint=5370c74026732400588392c756074df286482645992131d06a0be1f747335622 I0420 08:58:22.447497 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 19.52985ms to process 1 records I0420 08:58:22.448235 1 tasks_processing.go:74] worker 59 stopped. I0420 08:58:22.448610 1 recorder.go:75] Recording config/node/ip-10-0-0-221.ec2.internal with fingerprint=8f8768ad0c6b298416cefb4d648b8feda0e2ad56548284548ba6e696e51ba60c I0420 08:58:22.448681 1 recorder.go:75] Recording config/node/ip-10-0-1-176.ec2.internal with fingerprint=0df3853957a577ebbd0170fdcd2c541d139d59c8020d83e6497504da41b4b843 I0420 08:58:22.448729 1 recorder.go:75] Recording config/node/ip-10-0-2-148.ec2.internal with fingerprint=b5ca20507fddcbc037fdbd47f7ec142c857aae9879e98bf1b439b090a5af6ea2 I0420 08:58:22.448744 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 20.915113ms to process 3 records I0420 08:58:22.451924 1 tasks_processing.go:74] worker 40 stopped. I0420 08:58:22.451936 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 24.367491ms to process 0 records I0420 08:58:22.452392 1 tasks_processing.go:74] worker 37 stopped. I0420 08:58:22.452412 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0420 08:58:22.452423 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 25.001984ms to process 1 records I0420 08:58:22.456961 1 tasks_processing.go:74] worker 32 stopped. I0420 08:58:22.457110 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=2c6ebf690930786165cfc43eaba54c777175cf79ec0ac52c96fbd6c1b0b8c825 I0420 08:58:22.457191 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=dd34855c5ccdc9be22aa1144802a64e0806ad894371f9b0ca3a32c27d00de450 I0420 08:58:22.457199 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 29.639165ms to process 2 records W0420 08:58:22.458401 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0420 08:58:22.461728 1 tasks_processing.go:74] worker 14 stopped. I0420 08:58:22.461740 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 32.510372ms to process 0 records I0420 08:58:22.463879 1 tasks_processing.go:74] worker 55 stopped. I0420 08:58:22.463890 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 34.468122ms to process 0 records I0420 08:58:22.466218 1 tasks_processing.go:74] worker 13 stopped. I0420 08:58:22.466229 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 37.594379ms to process 0 records I0420 08:58:22.471535 1 tasks_processing.go:74] worker 11 stopped. I0420 08:58:22.471552 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 43.803213ms to process 0 records I0420 08:58:22.471568 1 tasks_processing.go:74] worker 53 stopped. E0420 08:58:22.471580 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0420 08:58:22.471585 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 42.927072ms to process 0 records I0420 08:58:22.471590 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 42.448065ms to process 0 records E0420 08:58:22.471595 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0420 08:58:22.471599 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 42.841594ms to process 0 records E0420 08:58:22.471602 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0420 08:58:22.471612 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 43.517389ms to process 0 records I0420 08:58:22.471621 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 42.114098ms to process 0 records I0420 08:58:22.471627 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 42.22364ms to process 0 records I0420 08:58:22.471632 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 42.082632ms to process 0 records I0420 08:58:22.471637 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 43.724535ms to process 0 records I0420 08:58:22.471640 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 43.717426ms to process 0 records I0420 08:58:22.471641 1 tasks_processing.go:74] worker 62 stopped. I0420 08:58:22.471648 1 tasks_processing.go:74] worker 51 stopped. I0420 08:58:22.471647 1 tasks_processing.go:74] worker 56 stopped. I0420 08:58:22.471652 1 tasks_processing.go:74] worker 38 stopped. I0420 08:58:22.471645 1 tasks_processing.go:74] worker 57 stopped. I0420 08:58:22.471652 1 tasks_processing.go:74] worker 23 stopped. I0420 08:58:22.471658 1 tasks_processing.go:74] worker 60 stopped. I0420 08:58:22.471648 1 tasks_processing.go:74] worker 49 stopped. I0420 08:58:22.472030 1 tasks_processing.go:74] worker 10 stopped. I0420 08:58:22.472042 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 43.863548ms to process 0 records I0420 08:58:22.472056 1 tasks_processing.go:74] worker 19 stopped. I0420 08:58:22.472381 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=e2b77546b8fb4a077e41c5174126b1a4de13c87a596627af6349bdedd507ad00 I0420 08:58:22.472401 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 43.902389ms to process 1 records I0420 08:58:22.472763 1 tasks_processing.go:74] worker 35 stopped. I0420 08:58:22.472775 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 44.009215ms to process 0 records I0420 08:58:22.472803 1 tasks_processing.go:74] worker 31 stopped. I0420 08:58:22.472815 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 43.971768ms to process 0 records I0420 08:58:22.472899 1 tasks_processing.go:74] worker 5 stopped. I0420 08:58:22.473386 1 recorder.go:75] Recording config/infrastructure with fingerprint=32a41d5141496a39303fad22533a2a13d19bca0d4af9a4a04427486928b8830f I0420 08:58:22.473398 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 44.361434ms to process 1 records I0420 08:58:22.473452 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=13e780b7f762a8b0d853826856c59d74f9134589f932d6da7aa2a4145f2842db I0420 08:58:22.473459 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 44.114994ms to process 1 records I0420 08:58:22.473481 1 tasks_processing.go:74] worker 33 stopped. I0420 08:58:22.473547 1 recorder.go:75] Recording config/network with fingerprint=254aaea91f7e6ea061da0d522a84f7d0f29da058dc9c694ccc27b31dfd2d5226 I0420 08:58:22.473551 1 tasks_processing.go:74] worker 26 stopped. I0420 08:58:22.473554 1 gather.go:177] gatherer "clusterconfig" function "networks" took 43.791882ms to process 1 records I0420 08:58:22.473845 1 tasks_processing.go:74] worker 34 stopped. I0420 08:58:22.473979 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=5b8e58200059416501faec1dcb7723b4853a3cec6a7f4bd440287f8802d117b1 I0420 08:58:22.474052 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=e2066563e602a404e6725b2b93418d49bea5b0c947064778544fd86945edb1d7 I0420 08:58:22.474069 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=ad4f875a6dba856e17942614773c6350cc3080f2bed84934120e870bce59187d I0420 08:58:22.474111 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=11404bec3d3dc9c24b969ba76263ef259eb22e7f2889aee817c337f1dd368151 I0420 08:58:22.474133 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=8b3b76a91c7db2da8c1f27e34463ac87b65dfb2d61281a436fd930d8f785f857 I0420 08:58:22.474153 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=9efd043ef4cfacb7414663d4477b7d8bec08009379ffd98d8f926baeb4994e9f I0420 08:58:22.474173 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=8b418892ff01e780b487bb04462b43a498f797d16811a08160057ec50b1fe86d I0420 08:58:22.474201 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=7a888e541945dbb333b2c922df2ce149d2c346a58dd5b3961bca3a324f7c83cf I0420 08:58:22.474223 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=06c6d90f56bf57a8b395e880f7f894d328e523d5b0b0e156f5230bde50c87e48 I0420 08:58:22.474242 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=5a4d0540f69509ce04b7f0b8a7841544e5349b079bf867e28ea9fb1f7672387f I0420 08:58:22.474261 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=b43a94df640fee43c275d0fad52ebe579f856cda9a2375959d36bffcb840400c I0420 08:58:22.474275 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 44.693022ms to process 11 records I0420 08:58:22.474367 1 tasks_processing.go:74] worker 29 stopped. I0420 08:58:22.474506 1 recorder.go:75] Recording config/featuregate with fingerprint=c50c6002d4f05920135752570bd54f3edf5fa81393a1656714700b3c274c630a I0420 08:58:22.474525 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 45.744302ms to process 1 records I0420 08:58:22.474598 1 tasks_processing.go:74] worker 28 stopped. I0420 08:58:22.474695 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=64d22af2e5fe48897b8b56b30b133bffa9c6b2b3128182d5a8e5a9150ad9864f I0420 08:58:22.474721 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=456e925ef14038f14ac0d678f84eb886c594da430d96b6f54aa759d4f595b945 I0420 08:58:22.474744 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=1ac8cb2160de79111595ffe161cfcc8f6362abf91d27f77ac896a9edaedabbba I0420 08:58:22.474750 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 45.534393ms to process 3 records I0420 08:58:22.474813 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=3f3275be77352f42a71d3b934b64907e692f764214ca16139d06369f230cd64c I0420 08:58:22.474829 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=ec8443fc0764138abdac3b56ded27cdfba8cae8593aca20a2271dcd03f35ab97 I0420 08:58:22.474834 1 tasks_processing.go:74] worker 44 stopped. I0420 08:58:22.474843 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=0ec35a6d4cd00a9115e5bd3dab90ef67cbdb678a2cd9b712ffe4abb45274d1c3 I0420 08:58:22.474847 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 45.987722ms to process 3 records I0420 08:58:22.474855 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 46.196759ms to process 0 records I0420 08:58:22.474860 1 tasks_processing.go:74] worker 42 stopped. I0420 08:58:22.480837 1 tasks_processing.go:74] worker 1 stopped. I0420 08:58:22.480857 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 51.392781ms to process 0 records I0420 08:58:22.480877 1 gather_logs.go:145] no pods in namespace were found I0420 08:58:22.480891 1 tasks_processing.go:74] worker 50 stopped. I0420 08:58:22.480901 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 51.913601ms to process 0 records I0420 08:58:22.481065 1 tasks_processing.go:74] worker 58 stopped. I0420 08:58:22.481172 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=70e53f3cd9703e97c668422d477322f203234964e4d6b05ccf519b62263ded57 I0420 08:58:22.481202 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=be8659a4dc63574491a0e47ec4bc0c6832e42c0a852dd8b9abf24e0509c9183e I0420 08:58:22.481211 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 52.978508ms to process 2 records I0420 08:58:22.481705 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0420 08:58:22.481725 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0420 08:58:22.481845 1 operator.go:328] started I0420 08:58:22.481866 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0420 08:58:22.482261 1 tasks_processing.go:74] worker 22 stopped. I0420 08:58:22.482343 1 recorder.go:75] Recording config/running_containers with fingerprint=37718190a794b07990c9bc5a557980e536973d211372c9ce102e5851ee690814 I0420 08:58:22.482355 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 54.452591ms to process 1 records I0420 08:58:22.489445 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0420 08:58:22.489455 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0420 08:58:22.489482 1 tasks_processing.go:74] worker 36 stopped. I0420 08:58:22.489496 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0420 08:58:22.489502 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready E0420 08:58:22.489499 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found I0420 08:58:22.489508 1 controller.go:254] Source scaController *sca.Controller is not ready E0420 08:58:22.489512 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0420 08:58:22.489517 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0420 08:58:22.489528 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0420 08:58:22.489530 1 controller.go:531] The operator is still being initialized I0420 08:58:22.489541 1 controller.go:554] The operator is healthy I0420 08:58:22.489581 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0420 08:58:22.489589 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0420 08:58:22.489593 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0420 08:58:22.489597 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0420 08:58:22.489641 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0420 08:58:22.489650 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0420 08:58:22.489654 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 62.095676ms to process 7 records I0420 08:58:22.489730 1 tasks_processing.go:74] worker 45 stopped. I0420 08:58:22.490136 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=64b54aac895a7ab1a90670db916f39946aed54051aff02c40c219a196d5e3a6e I0420 08:58:22.490317 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=0e576adfba19e4bca3b9c3a1220b54807d800eec6c5e98aa2df0cc3b96f7a3f9 I0420 08:58:22.490340 1 gather.go:177] gatherer "clusterconfig" function "crds" took 60.781869ms to process 2 records I0420 08:58:22.490377 1 recorder.go:75] Recording config/olm_operators with fingerprint=5897253a88f354aa12013460bca093eba31e2ff32b0cda2562046c2e0de4b0c9 I0420 08:58:22.490385 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 60.834327ms to process 1 records I0420 08:58:22.490391 1 tasks_processing.go:74] worker 30 stopped. I0420 08:58:22.494418 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0420 08:58:22.494442 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0420 08:58:22.494469 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0420 08:58:22.498014 1 base_controller.go:82] Caches are synced for ConfigController I0420 08:58:22.498026 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0420 08:58:22.498280 1 prometheus_rules.go:88] Prometheus rules successfully created I0420 08:58:22.498942 1 tasks_processing.go:74] worker 39 stopped. I0420 08:58:22.498953 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 70.157639ms to process 0 records E0420 08:58:22.498986 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27c5502114-5c5d-4318-b469-efd8b4c31fad%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:60294->172.30.0.10:53: read: connection refused I0420 08:58:22.498998 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27c5502114-5c5d-4318-b469-efd8b4c31fad%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:60294->172.30.0.10:53: read: connection refused I0420 08:58:22.502051 1 configmapobserver.go:84] configmaps "insights-config" not found I0420 08:58:22.543800 1 tasks_processing.go:74] worker 7 stopped. I0420 08:58:22.544002 1 recorder.go:75] Recording config/version with fingerprint=adf36f15c9f77193dbfcac415610685ad16eab6bfa790e30e29b3a8f1c4d749b I0420 08:58:22.544023 1 recorder.go:75] Recording config/id with fingerprint=83b3750e76292b4acc631310897d19617bfd38f99a8159c6210d1483648e932f I0420 08:58:22.544029 1 gather.go:177] gatherer "clusterconfig" function "version" took 115.060631ms to process 2 records I0420 08:58:22.554740 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0420 08:58:22.557745 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:38620->172.30.0.10:53: read: connection refused I0420 08:58:22.557757 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:38620->172.30.0.10:53: read: connection refused I0420 08:58:22.564762 1 tasks_processing.go:74] worker 20 stopped. E0420 08:58:22.564777 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0420 08:58:22.564783 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ppph9ruf6k5ml3crseffj0vunji1dnc-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ppph9ruf6k5ml3crseffj0vunji1dnc-primary-cert-bundle-secret" not found I0420 08:58:22.564829 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=04c4911657cddf58b201773e49016e8780fd726bc344cfe1cbf0b2299358c227 I0420 08:58:22.564841 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 137.000972ms to process 1 records I0420 08:58:22.582053 1 base_controller.go:82] Caches are synced for LoggingSyncer I0420 08:58:22.582063 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0420 08:58:22.859632 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0420 08:58:22.859647 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0420 08:58:22.860543 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-8lcrq pod in namespace openshift-dns (previous: false). I0420 08:58:23.094217 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-8lcrq pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-8lcrq\" is waiting to start: ContainerCreating" I0420 08:58:23.094233 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-8lcrq\" is waiting to start: ContainerCreating" I0420 08:58:23.094241 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-8lcrq pod in namespace openshift-dns (previous: false). I0420 08:58:23.267627 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-8lcrq pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-8lcrq\" is waiting to start: ContainerCreating" I0420 08:58:23.267642 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-8lcrq\" is waiting to start: ContainerCreating" I0420 08:58:23.267671 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-jfhqn pod in namespace openshift-dns (previous: false). W0420 08:58:23.457898 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0420 08:58:23.479946 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jfhqn pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-jfhqn\" is waiting to start: ContainerCreating" I0420 08:58:23.479962 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-jfhqn\" is waiting to start: ContainerCreating" I0420 08:58:23.479969 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-jfhqn pod in namespace openshift-dns (previous: false). I0420 08:58:23.663556 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jfhqn pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-jfhqn\" is waiting to start: ContainerCreating" I0420 08:58:23.663574 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-jfhqn\" is waiting to start: ContainerCreating" I0420 08:58:23.663586 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-jvkct pod in namespace openshift-dns (previous: false). I0420 08:58:23.888765 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jvkct pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-jvkct\" is waiting to start: ContainerCreating" I0420 08:58:23.888787 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-jvkct\" is waiting to start: ContainerCreating" I0420 08:58:23.888796 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-jvkct pod in namespace openshift-dns (previous: false). I0420 08:58:23.898493 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0420 08:58:24.064239 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jvkct pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-jvkct\" is waiting to start: ContainerCreating" I0420 08:58:24.064254 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-jvkct\" is waiting to start: ContainerCreating" I0420 08:58:24.064266 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-fh66g pod in namespace openshift-dns (previous: false). I0420 08:58:24.268989 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 08:58:24.269006 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-s4qsb pod in namespace openshift-dns (previous: false). W0420 08:58:24.458341 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0420 08:58:24.463487 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 08:58:24.463500 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-wvv79 pod in namespace openshift-dns (previous: false). I0420 08:58:24.502576 1 tasks_processing.go:74] worker 52 stopped. I0420 08:58:24.502639 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=c372cf8828e4351b39c21c2c8b648031053310b6835f9281898ca0aca32fbfd4 I0420 08:58:24.502692 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=4a721ab9c5eb388bd0c42d9d5e20d123510d139455ad24ea2ad4c2386fb6e936 I0420 08:58:24.502726 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0420 08:58:24.502755 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=bcc7289b4388083259d08462b6af68e2e3a05ecb79de9cfea9c3bf65fb915cf0 I0420 08:58:24.502772 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0420 08:58:24.502820 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=5d1516e0aa4658f8f4b7b49978f3b8b26b346ed0329a5e85aca11b72cfbb10c9 I0420 08:58:24.502852 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=08567a26dbbf1bd3814729fed3115cbe26be1d0f8090deab93212a794b0c1aa4 I0420 08:58:24.502880 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=d4b72fbf1e54e161ead5c1823fe46a94187137989f1e70cd1edfb710b1eeb508 I0420 08:58:24.502898 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=96fa286f88eebf7015e304f63d7c6c55c74df78859138ed90b913265924acd85 I0420 08:58:24.502915 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=5d6668ed0ddead294f35b510fa4fc1293c439f422c5d2d4c4f2c1e64d68acc3e I0420 08:58:24.502927 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0420 08:58:24.502942 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=0f69c44b9f80d76dd06d8b9bc6ce29a82e20e63ce44b0c7a357dc72450116fc3 I0420 08:58:24.502952 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0420 08:58:24.502975 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=e95137924022b8909cbae07c56942a74003f28b4c382a1c00dea4be543b5082c I0420 08:58:24.502985 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0420 08:58:24.503015 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=baa5bd302e63d4310a04fb6d9423f31864799d2085a3656109c9250fd1156afc I0420 08:58:24.503031 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0420 08:58:24.503056 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=5a95908bc1a9c826905d0e493c3f6251c05590507546ea8673db70ff3f1b6db3 I0420 08:58:24.503185 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=5e6e5bc1bf93fe59bbef370043a27aa2e01555313646edb2eaa27bd468cccbe7 I0420 08:58:24.503196 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0420 08:58:24.503205 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0420 08:58:24.503231 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0420 08:58:24.503255 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=da3e914695422451551ad5fdf49e34a3aaa6c3133ee7823b83f40a15225ea0c4 I0420 08:58:24.503280 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=3a4d67ab0378ead3950ddca6493d3ecddb49554053928231705e57678fd67b05 I0420 08:58:24.503306 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0420 08:58:24.503339 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=314841a36db1aa5bd7292dfa357fc31ea6ab817af57f72bbac95c75cc4ed61b2 I0420 08:58:24.503346 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0420 08:58:24.503359 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=f98c8f821863878c974eb97d4f7b72c44223f8a6b3df303d4c47436cbfcfb42d I0420 08:58:24.503380 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=ce9cf2232d68d08e7147973d17eec5c392b2688a40829d7e4eb27b720d2c5193 I0420 08:58:24.503398 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=7fdce62897d9082c109e084d06a61f4bd98c6e031661f6cf43985bb9b7815a31 I0420 08:58:24.503412 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=dbbca6eceba031dab8904f2ecb2972e519fe7f4cd4029cf6cca9edd9acbdf010 I0420 08:58:24.503431 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=0ad478d0908b8870f33e3f9b1664de110324e660cba04966a5f90da39b3f0569 I0420 08:58:24.503441 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0420 08:58:24.503475 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=701c69b247fcc6cfec3c4225347f19661dc98e220b91dfd5dd4d534def9fcf86 I0420 08:58:24.503493 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0420 08:58:24.503502 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0420 08:58:24.503509 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.074055292s to process 36 records I0420 08:58:24.664353 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 08:58:24.664447 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-687d4ddf48-qptlf pod in namespace openshift-image-registry (previous: false). I0420 08:58:24.866767 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-687d4ddf48-qptlf pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-687d4ddf48-qptlf\" is waiting to start: ContainerCreating" I0420 08:58:24.866784 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-687d4ddf48-qptlf\" is waiting to start: ContainerCreating" I0420 08:58:24.866831 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-84994b6b87-gq6bs pod in namespace openshift-image-registry (previous: false). I0420 08:58:25.065655 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-84994b6b87-gq6bs pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-84994b6b87-gq6bs\" is waiting to start: ContainerCreating" I0420 08:58:25.065672 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-84994b6b87-gq6bs\" is waiting to start: ContainerCreating" I0420 08:58:25.065709 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-84994b6b87-r6snm pod in namespace openshift-image-registry (previous: false). I0420 08:58:25.263649 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-84994b6b87-r6snm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-84994b6b87-r6snm\" is waiting to start: ContainerCreating" I0420 08:58:25.263665 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-84994b6b87-r6snm\" is waiting to start: ContainerCreating" I0420 08:58:25.263677 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-bhq2t pod in namespace openshift-image-registry (previous: false). W0420 08:58:25.458055 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0420 08:58:25.464220 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 08:58:25.464237 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-cjvvb pod in namespace openshift-image-registry (previous: false). I0420 08:58:25.691260 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 08:58:25.691276 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-fh5sv pod in namespace openshift-image-registry (previous: false). I0420 08:58:25.865781 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0420 08:58:25.865797 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5fcb75cf99-st6hs pod in namespace openshift-ingress (previous: false). I0420 08:58:26.064912 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5fcb75cf99-st6hs pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5fcb75cf99-st6hs\" is waiting to start: ContainerCreating" I0420 08:58:26.064926 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5fcb75cf99-st6hs\" is waiting to start: ContainerCreating" I0420 08:58:26.064937 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6d76f45d78-nvqgw pod in namespace openshift-ingress (previous: false). I0420 08:58:26.265538 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6d76f45d78-nvqgw pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6d76f45d78-nvqgw\" is waiting to start: ContainerCreating" I0420 08:58:26.265552 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6d76f45d78-nvqgw\" is waiting to start: ContainerCreating" I0420 08:58:26.265562 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6d76f45d78-x658d pod in namespace openshift-ingress (previous: false). W0420 08:58:26.459027 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0420 08:58:26.464731 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6d76f45d78-x658d pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6d76f45d78-x658d\" is waiting to start: ContainerCreating" I0420 08:58:26.464756 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6d76f45d78-x658d\" is waiting to start: ContainerCreating" I0420 08:58:26.464771 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-2zfjt pod in namespace openshift-ingress-canary (previous: false). I0420 08:58:26.678743 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-nhqrf pod in namespace openshift-ingress-canary (previous: false). I0420 08:58:26.867036 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-thjfj pod in namespace openshift-ingress-canary (previous: false). I0420 08:58:27.063500 1 tasks_processing.go:74] worker 48 stopped. I0420 08:58:27.063599 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=81a54c03249d82b4b6c6a5e5af1711706cbcda4823e38d74a01a1c932db31629 I0420 08:58:27.063655 1 recorder.go:75] Recording events/openshift-dns with fingerprint=7609a9fa50a113ecb6d20334f854df99684f290314086884aed3f87f85381a2f I0420 08:58:27.063745 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=6032c94261a909db372ad31757562ab2ce777483933f4e4d3d4f5de9fa9c0d2b I0420 08:58:27.063772 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=4cf14983f3eb8eadf6eb97db89554054bfa4d42ba8471ed5c3f26f261296410b I0420 08:58:27.063818 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=8400f534913560d001ebff4688f5e95afd7de1a7288815ae86148a3e9eb62c79 I0420 08:58:27.063855 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=b462e13b96f0e98e01ba16ab83ce5dbbdf09362f6211f119ecac466084796c94 I0420 08:58:27.065162 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-jfhqn with fingerprint=10456dc2f9378e2a46ea9d54af010e9a77767889ea34be6cfe270852b4f982b4 I0420 08:58:27.065281 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-687d4ddf48-qptlf with fingerprint=c64ec76324c96a797adeebe94867dec6c70e8a20207909d271477f7f83ae036a I0420 08:58:27.065388 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-84994b6b87-gq6bs with fingerprint=56b5dbe3b01552673f5319872fca4c433d9cdfb1a17b7e6e51ce4563ae08c80b I0420 08:58:27.065473 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-84994b6b87-r6snm with fingerprint=e8f878a384740a87236ca54785a2742c3eaea2eab5ecdff771990615962f7fa2 I0420 08:58:27.065480 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-2zfjt/serve-healthcheck-canary_current.log with fingerprint=54914204c7c986069186ecb8a3efbc4c407c487df47e656611b80440471f2ba1 I0420 08:58:27.065485 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-nhqrf/serve-healthcheck-canary_current.log with fingerprint=ab50a7e788f490e83da93929cb3b23afe2393ecd0836a672773b4ff3a960d390 I0420 08:58:27.065489 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-thjfj/serve-healthcheck-canary_current.log with fingerprint=71beba254d88ce6026d43bec827db2fe0b8c6ffd36025530c38257a0d08f2610 I0420 08:58:27.065496 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.635520314s to process 13 records W0420 08:58:27.454679 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0420 08:58:27.454705 1 tasks_processing.go:74] worker 9 stopped. E0420 08:58:27.454723 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0420 08:58:27.454757 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0420 08:58:27.454778 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0420 08:58:27.454791 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.02733741s to process 1 records I0420 08:58:34.818315 1 configmapobserver.go:84] configmaps "insights-config" not found I0420 08:58:35.019615 1 configmapobserver.go:84] configmaps "insights-config" not found I0420 08:58:35.079215 1 tasks_processing.go:74] worker 8 stopped. I0420 08:58:35.079265 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0420 08:58:35.079284 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.651085152s to process 1 records I0420 08:58:35.198233 1 configmapobserver.go:84] configmaps "insights-config" not found I0420 08:58:35.833338 1 tasks_processing.go:74] worker 6 stopped. I0420 08:58:35.833646 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=429c3d07cf3ba101c9fcb9f22318176a7c166ecd1506bdf2da650bbe8def5ef8 I0420 08:58:35.833667 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.406011521s to process 1 records E0420 08:58:35.833734 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.406s with: function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0420 08:58:35.834845 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_configs" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0420 08:58:35.834862 1 periodic.go:216] Running workloads gatherer I0420 08:58:35.834878 1 tasks_processing.go:45] number of workers: 2 I0420 08:58:35.834892 1 tasks_processing.go:69] worker 1 listening for tasks. I0420 08:58:35.834899 1 tasks_processing.go:71] worker 1 working on workload_info task. I0420 08:58:35.834908 1 tasks_processing.go:69] worker 0 listening for tasks. I0420 08:58:35.834930 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0420 08:58:35.858890 1 tasks_processing.go:74] worker 0 stopped. I0420 08:58:35.858982 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 23.934564ms to process 0 records I0420 08:58:35.862235 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0420 08:58:35.869909 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (8ms) I0420 08:58:35.877427 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (8ms) I0420 08:58:35.884491 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (7ms) I0420 08:58:35.891944 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (7ms) I0420 08:58:35.898869 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (7ms) I0420 08:58:35.906087 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (7ms) I0420 08:58:35.913357 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (7ms) I0420 08:58:35.919927 1 gather_workloads_info.go:387] No image sha256:ce98d5d844bfc2ba8de1893866ad38166c95157d54abd8192b181e819bc50bb5 (7ms) I0420 08:58:35.927250 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (7ms) I0420 08:58:35.934109 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (7ms) I0420 08:58:35.970058 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (36ms) I0420 08:58:36.071798 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (102ms) I0420 08:58:36.171105 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (99ms) I0420 08:58:36.271423 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (100ms) I0420 08:58:36.370142 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (99ms) I0420 08:58:36.470265 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (100ms) I0420 08:58:36.570438 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (100ms) I0420 08:58:36.670391 1 gather_workloads_info.go:387] No image sha256:0b2e6536a0ca3afc5e64a218087a6287c74b77a359075a385f1949ca5bd51b22 (100ms) I0420 08:58:36.769842 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (99ms) I0420 08:58:36.869961 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (100ms) I0420 08:58:36.970105 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (100ms) I0420 08:58:37.070294 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (100ms) I0420 08:58:37.170548 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (100ms) I0420 08:58:37.269991 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (99ms) I0420 08:58:37.369711 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (100ms) I0420 08:58:37.470020 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (100ms) I0420 08:58:37.569985 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (100ms) I0420 08:58:37.670221 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (100ms) I0420 08:58:37.770600 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (100ms) I0420 08:58:37.870576 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (100ms) I0420 08:58:37.970768 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (100ms) I0420 08:58:38.070828 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (100ms) I0420 08:58:38.170102 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (99ms) I0420 08:58:38.270405 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (100ms) I0420 08:58:38.270435 1 tasks_processing.go:74] worker 1 stopped. E0420 08:58:38.270445 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0420 08:58:38.270714 1 recorder.go:75] Recording config/workload_info with fingerprint=a67ac1a2b00cfb979658bb3c4e2e23cdcd334524b6743eb27e0edba01f5ca4d4 I0420 08:58:38.270732 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.435528498s to process 1 records E0420 08:58:38.270760 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.435s with: function \"workload_info\" failed with an error" I0420 08:58:38.271872 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0420 08:58:38.271889 1 periodic.go:216] Running conditional gatherer I0420 08:58:38.276828 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0420 08:58:38.284205 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.13:38162->172.30.0.10:53: read: connection refused E0420 08:58:38.284546 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0420 08:58:38.284611 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0420 08:58:38.289692 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0420 08:58:38.289707 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 08:58:38.289713 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 08:58:38.289717 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 08:58:38.289720 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 08:58:38.289723 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 08:58:38.289726 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 08:58:38.289729 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 08:58:38.289732 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0420 08:58:38.289735 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0420 08:58:38.289752 1 tasks_processing.go:45] number of workers: 3 I0420 08:58:38.289772 1 tasks_processing.go:69] worker 2 listening for tasks. I0420 08:58:38.289778 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0420 08:58:38.289780 1 tasks_processing.go:69] worker 0 listening for tasks. I0420 08:58:38.289791 1 tasks_processing.go:69] worker 1 listening for tasks. I0420 08:58:38.289811 1 tasks_processing.go:74] worker 1 stopped. I0420 08:58:38.289825 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I0420 08:58:38.289826 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0420 08:58:38.289844 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0420 08:58:38.289855 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 930ns to process 1 records I0420 08:58:38.289930 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0420 08:58:38.289940 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.954µs to process 1 records I0420 08:58:38.289942 1 tasks_processing.go:74] worker 2 stopped. I0420 08:58:38.290112 1 tasks_processing.go:74] worker 0 stopped. I0420 08:58:38.290126 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 277.268µs to process 0 records I0420 08:58:38.290155 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.13:38162->172.30.0.10:53: read: connection refused I0420 08:58:38.290175 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0420 08:58:38.311499 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=1393fe22ef6bfaf15d79f0495a9fce393dc183520c616a2ef8b8460d236945ea I0420 08:58:38.311651 1 diskrecorder.go:70] Writing 108 records to /var/lib/insights-operator/insights-2026-04-20-085838.tar.gz I0420 08:58:38.317975 1 diskrecorder.go:51] Wrote 108 records to disk in 6ms I0420 08:58:38.318011 1 periodic.go:285] Gathering cluster info every 2h0m0s I0420 08:58:38.318030 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0420 08:58:47.344241 1 configmapobserver.go:84] configmaps "insights-config" not found I0420 08:59:32.173705 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="6fc6760a1dd917c65a7359a1b3d7d27fcd07cf2f31e0e03ad1d38ef80e9c890c") W0420 08:59:32.173749 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0420 08:59:32.173812 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="847db83d275107159273300345734359debc154cf0d4a52cc9016419b41a00dc") I0420 08:59:32.173838 1 periodic.go:177] Shutting down