W0424 15:08:24.727719 1 cmd.go:257] Using insecure, self-signed certificates I0424 15:08:24.991030 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0424 15:08:24.991344 1 observer_polling.go:159] Starting file observer I0424 15:08:25.750209 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0424 15:08:25.750545 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0424 15:08:25.750953 1 secure_serving.go:57] Forcing use of http/1.1 only W0424 15:08:25.750974 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0424 15:08:25.750978 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0424 15:08:25.750981 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0424 15:08:25.750984 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0424 15:08:25.750986 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0424 15:08:25.750988 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0424 15:08:25.751548 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0424 15:08:25.755669 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0424 15:08:25.755722 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"2b27f1c9-ed56-42b7-b8fb-88027c0cf254", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0424 15:08:25.756512 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0424 15:08:25.756524 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0424 15:08:25.756537 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0424 15:08:25.756530 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0424 15:08:25.756545 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0424 15:08:25.756854 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0424 15:08:25.757262 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-256352321/tls.crt::/tmp/serving-cert-256352321/tls.key" I0424 15:08:25.758238 1 secure_serving.go:213] Serving securely on [::]:8443 I0424 15:08:25.758268 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0424 15:08:25.762143 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0424 15:08:25.762165 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0424 15:08:25.762257 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0424 15:08:25.768314 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0424 15:08:25.768332 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0424 15:08:25.773101 1 secretconfigobserver.go:119] support secret does not exist I0424 15:08:25.778002 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0424 15:08:25.782679 1 secretconfigobserver.go:119] support secret does not exist I0424 15:08:25.785338 1 recorder.go:161] Pruning old reports every 6h36m49s, max age is 288h0m0s I0424 15:08:25.790995 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0424 15:08:25.791003 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0424 15:08:25.791013 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0424 15:08:25.791016 1 insightsreport.go:296] Starting report retriever I0424 15:08:25.791023 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0424 15:08:25.791043 1 periodic.go:209] Running clusterconfig gatherer I0424 15:08:25.791087 1 tasks_processing.go:45] number of workers: 64 I0424 15:08:25.791115 1 tasks_processing.go:69] worker 3 listening for tasks. I0424 15:08:25.791123 1 tasks_processing.go:69] worker 1 listening for tasks. I0424 15:08:25.791127 1 tasks_processing.go:69] worker 2 listening for tasks. I0424 15:08:25.791130 1 tasks_processing.go:69] worker 0 listening for tasks. I0424 15:08:25.791135 1 tasks_processing.go:69] worker 17 listening for tasks. I0424 15:08:25.791138 1 tasks_processing.go:69] worker 28 listening for tasks. I0424 15:08:25.791138 1 tasks_processing.go:69] worker 10 listening for tasks. I0424 15:08:25.791144 1 tasks_processing.go:69] worker 4 listening for tasks. I0424 15:08:25.791148 1 tasks_processing.go:69] worker 19 listening for tasks. I0424 15:08:25.791143 1 tasks_processing.go:69] worker 18 listening for tasks. I0424 15:08:25.791155 1 tasks_processing.go:71] worker 10 working on machine_autoscalers task. I0424 15:08:25.791159 1 tasks_processing.go:71] worker 18 working on schedulers task. I0424 15:08:25.791160 1 tasks_processing.go:69] worker 12 listening for tasks. I0424 15:08:25.791161 1 tasks_processing.go:69] worker 11 listening for tasks. I0424 15:08:25.791168 1 tasks_processing.go:69] worker 25 listening for tasks. I0424 15:08:25.791169 1 tasks_processing.go:69] worker 16 listening for tasks. I0424 15:08:25.791160 1 tasks_processing.go:69] worker 15 listening for tasks. I0424 15:08:25.791151 1 tasks_processing.go:69] worker 13 listening for tasks. I0424 15:08:25.791157 1 tasks_processing.go:71] worker 4 working on oauths task. I0424 15:08:25.791180 1 tasks_processing.go:69] worker 21 listening for tasks. I0424 15:08:25.791162 1 tasks_processing.go:69] worker 20 listening for tasks. I0424 15:08:25.791175 1 tasks_processing.go:69] worker 26 listening for tasks. I0424 15:08:25.791182 1 tasks_processing.go:69] worker 24 listening for tasks. I0424 15:08:25.791192 1 tasks_processing.go:69] worker 30 listening for tasks. I0424 15:08:25.791175 1 tasks_processing.go:69] worker 22 listening for tasks. I0424 15:08:25.791198 1 tasks_processing.go:69] worker 31 listening for tasks. I0424 15:08:25.791177 1 tasks_processing.go:69] worker 49 listening for tasks. I0424 15:08:25.791201 1 tasks_processing.go:69] worker 41 listening for tasks. I0424 15:08:25.791205 1 tasks_processing.go:69] worker 47 listening for tasks. I0424 15:08:25.791207 1 tasks_processing.go:69] worker 33 listening for tasks. I0424 15:08:25.791179 1 tasks_processing.go:69] worker 27 listening for tasks. I0424 15:08:25.791182 1 tasks_processing.go:69] worker 29 listening for tasks. I0424 15:08:25.791214 1 tasks_processing.go:69] worker 48 listening for tasks. I0424 15:08:25.791209 1 tasks_processing.go:69] worker 23 listening for tasks. I0424 15:08:25.791221 1 tasks_processing.go:69] worker 43 listening for tasks. I0424 15:08:25.791191 1 tasks_processing.go:69] worker 40 listening for tasks. I0424 15:08:25.791226 1 tasks_processing.go:69] worker 9 listening for tasks. I0424 15:08:25.791195 1 tasks_processing.go:69] worker 44 listening for tasks. I0424 15:08:25.791233 1 tasks_processing.go:69] worker 63 listening for tasks. I0424 15:08:25.791235 1 tasks_processing.go:71] worker 40 working on image task. I0424 15:08:25.791236 1 tasks_processing.go:71] worker 9 working on lokistack task. I0424 15:08:25.791239 1 tasks_processing.go:71] worker 1 working on pdbs task. I0424 15:08:25.791240 1 tasks_processing.go:69] worker 38 listening for tasks. I0424 15:08:25.791204 1 tasks_processing.go:69] worker 32 listening for tasks. I0424 15:08:25.791244 1 tasks_processing.go:71] worker 2 working on machine_sets task. I0424 15:08:25.791249 1 tasks_processing.go:71] worker 28 working on machines task. I0424 15:08:25.791236 1 tasks_processing.go:69] worker 5 listening for tasks. I0424 15:08:25.791251 1 tasks_processing.go:71] worker 0 working on storage_classes task. I0424 15:08:25.791261 1 tasks_processing.go:69] worker 54 listening for tasks. I0424 15:08:25.791263 1 tasks_processing.go:71] worker 17 working on openshift_machine_api_events task. I0424 15:08:25.791270 1 tasks_processing.go:71] worker 15 working on openstack_version task. I0424 15:08:25.791278 1 tasks_processing.go:69] worker 56 listening for tasks. I0424 15:08:25.791281 1 tasks_processing.go:69] worker 8 listening for tasks. I0424 15:08:25.791287 1 tasks_processing.go:69] worker 58 listening for tasks. I0424 15:08:25.791154 1 tasks_processing.go:69] worker 14 listening for tasks. I0424 15:08:25.791214 1 tasks_processing.go:69] worker 42 listening for tasks. I0424 15:08:25.791295 1 tasks_processing.go:71] worker 33 working on networks task. I0424 15:08:25.791186 1 tasks_processing.go:69] worker 39 listening for tasks. I0424 15:08:25.791217 1 tasks_processing.go:69] worker 6 listening for tasks. I0424 15:08:25.791220 1 tasks_processing.go:69] worker 34 listening for tasks. I0424 15:08:25.791221 1 tasks_processing.go:71] worker 3 working on certificate_signing_requests task. I0424 15:08:25.791301 1 tasks_processing.go:69] worker 57 listening for tasks. I0424 15:08:25.791252 1 tasks_processing.go:71] worker 12 working on mutating_webhook_configurations task. I0424 15:08:25.791314 1 tasks_processing.go:71] worker 63 working on support_secret task. I0424 15:08:25.791318 1 tasks_processing.go:71] worker 57 working on service_accounts task. I0424 15:08:25.791321 1 tasks_processing.go:71] worker 26 working on openstack_dataplanedeployments task. I0424 15:08:25.791211 1 tasks_processing.go:69] worker 7 listening for tasks. I0424 15:08:25.791327 1 tasks_processing.go:71] worker 24 working on machine_config_pools task. I0424 15:08:25.791715 1 tasks_processing.go:71] worker 31 working on active_alerts task. I0424 15:08:25.791799 1 tasks_processing.go:71] worker 38 working on tsdb_status task. I0424 15:08:25.791869 1 tasks_processing.go:71] worker 39 working on crds task. I0424 15:08:25.791271 1 tasks_processing.go:69] worker 55 listening for tasks. I0424 15:08:25.792150 1 tasks_processing.go:71] worker 55 working on proxies task. I0424 15:08:25.791196 1 tasks_processing.go:69] worker 45 listening for tasks. I0424 15:08:25.791740 1 tasks_processing.go:71] worker 58 working on authentication task. I0424 15:08:25.791877 1 tasks_processing.go:71] worker 8 working on olm_operators task. I0424 15:08:25.792389 1 tasks_processing.go:71] worker 45 working on machine_healthchecks task. W0424 15:08:25.791826 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0424 15:08:25.792517 1 tasks_processing.go:71] worker 31 working on node_logs task. I0424 15:08:25.791261 1 tasks_processing.go:71] worker 25 working on openstack_dataplanenodesets task. I0424 15:08:25.792684 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 732.05µs to process 0 records I0424 15:08:25.791332 1 tasks_processing.go:71] worker 7 working on qemu_kubevirt_launcher_logs task. I0424 15:08:25.791227 1 tasks_processing.go:69] worker 60 listening for tasks. I0424 15:08:25.792875 1 tasks_processing.go:71] worker 60 working on metrics task. I0424 15:08:25.791230 1 tasks_processing.go:69] worker 36 listening for tasks. W0424 15:08:25.792906 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0424 15:08:25.791231 1 tasks_processing.go:69] worker 62 listening for tasks. I0424 15:08:25.791228 1 tasks_processing.go:69] worker 50 listening for tasks. I0424 15:08:25.791235 1 tasks_processing.go:69] worker 37 listening for tasks. I0424 15:08:25.791239 1 tasks_processing.go:69] worker 51 listening for tasks. I0424 15:08:25.791238 1 tasks_processing.go:69] worker 61 listening for tasks. I0424 15:08:25.791246 1 tasks_processing.go:69] worker 52 listening for tasks. I0424 15:08:25.791247 1 tasks_processing.go:71] worker 30 working on container_images task. I0424 15:08:25.792952 1 tasks_processing.go:71] worker 52 working on sap_datahubs task. I0424 15:08:25.793024 1 tasks_processing.go:71] worker 50 working on image_pruners task. I0424 15:08:25.793045 1 tasks_processing.go:71] worker 51 working on storage_cluster task. I0424 15:08:25.793072 1 tasks_processing.go:71] worker 36 working on container_runtime_configs task. I0424 15:08:25.793087 1 tasks_processing.go:71] worker 61 working on infrastructures task. I0424 15:08:25.793121 1 tasks_processing.go:71] worker 37 working on openshift_logging task. I0424 15:08:25.793120 1 tasks_processing.go:71] worker 62 working on validating_webhook_configurations task. I0424 15:08:25.791254 1 tasks_processing.go:69] worker 53 listening for tasks. I0424 15:08:25.791257 1 tasks_processing.go:71] worker 11 working on sap_pods task. I0424 15:08:25.791266 1 tasks_processing.go:71] worker 16 working on config_maps task. I0424 15:08:25.791224 1 tasks_processing.go:69] worker 35 listening for tasks. I0424 15:08:25.791218 1 tasks_processing.go:69] worker 59 listening for tasks. I0424 15:08:25.791617 1 tasks_processing.go:71] worker 44 working on operators_pods_and_events task. I0424 15:08:25.791647 1 tasks_processing.go:71] worker 22 working on monitoring_persistent_volumes task. I0424 15:08:25.791661 1 tasks_processing.go:71] worker 42 working on jaegers task. I0424 15:08:25.791539 1 tasks_processing.go:71] worker 20 working on cluster_apiserver task. I0424 15:08:25.791745 1 tasks_processing.go:71] worker 48 working on ingress_certificates task. I0424 15:08:25.791746 1 tasks_processing.go:71] worker 14 working on clusterroles task. I0424 15:08:25.791748 1 tasks_processing.go:71] worker 5 working on machine_configs task. I0424 15:08:25.791752 1 tasks_processing.go:71] worker 27 working on nodenetworkconfigurationpolicies task. I0424 15:08:25.791753 1 tasks_processing.go:71] worker 6 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0424 15:08:25.791887 1 tasks_processing.go:71] worker 49 working on openstack_controlplanes task. I0424 15:08:25.791892 1 tasks_processing.go:71] worker 54 working on dvo_metrics task. W0424 15:08:25.791889 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0424 15:08:25.791895 1 tasks_processing.go:71] worker 41 working on sap_config task. I0424 15:08:25.791898 1 tasks_processing.go:71] worker 56 working on ceph_cluster task. I0424 15:08:25.791897 1 tasks_processing.go:71] worker 29 working on cost_management_metrics_configs task. I0424 15:08:25.791909 1 tasks_processing.go:71] worker 32 working on version task. I0424 15:08:25.791959 1 tasks_processing.go:71] worker 47 working on nodes task. I0424 15:08:25.791316 1 tasks_processing.go:71] worker 13 working on overlapping_namespace_uids task. I0424 15:08:25.791994 1 tasks_processing.go:71] worker 23 working on aggregated_monitoring_cr_names task. I0424 15:08:25.792011 1 tasks_processing.go:71] worker 21 working on ingress task. I0424 15:08:25.792013 1 tasks_processing.go:71] worker 43 working on image_registries task. I0424 15:08:25.792029 1 tasks_processing.go:71] worker 34 working on silenced_alerts task. W0424 15:08:25.795053 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0424 15:08:25.791201 1 tasks_processing.go:69] worker 46 listening for tasks. I0424 15:08:25.795073 1 tasks_processing.go:74] worker 46 stopped. I0424 15:08:25.793153 1 tasks_processing.go:71] worker 60 working on pod_network_connectivity_checks task. I0424 15:08:25.791153 1 tasks_processing.go:71] worker 19 working on nodenetworkstates task. I0424 15:08:25.795144 1 tasks_processing.go:71] worker 35 working on install_plans task. I0424 15:08:25.793196 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 27.608µs to process 0 records I0424 15:08:25.795209 1 tasks_processing.go:71] worker 59 working on operators task. I0424 15:08:25.793431 1 tasks_processing.go:71] worker 53 working on feature_gates task. I0424 15:08:25.795220 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 2.071145ms to process 0 records I0424 15:08:25.795234 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 33.409µs to process 0 records I0424 15:08:25.795238 1 tasks_processing.go:74] worker 38 stopped. I0424 15:08:25.795244 1 tasks_processing.go:74] worker 34 stopped. I0424 15:08:25.799264 1 tasks_processing.go:74] worker 10 stopped. I0424 15:08:25.799279 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 8.100892ms to process 0 records I0424 15:08:25.799302 1 tasks_processing.go:74] worker 9 stopped. I0424 15:08:25.799315 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 8.055046ms to process 0 records I0424 15:08:25.799327 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 8.032237ms to process 0 records I0424 15:08:25.799335 1 tasks_processing.go:74] worker 15 stopped. I0424 15:08:25.799341 1 tasks_processing.go:74] worker 63 stopped. E0424 15:08:25.799353 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0424 15:08:25.799364 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 8.019024ms to process 0 records I0424 15:08:25.799373 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 8.093338ms to process 0 records I0424 15:08:25.799381 1 tasks_processing.go:74] worker 2 stopped. I0424 15:08:25.799463 1 tasks_processing.go:74] worker 45 stopped. E0424 15:08:25.799475 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0424 15:08:25.799482 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0424 15:08:25.799496 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0424 15:08:25.799504 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0424 15:08:25.799507 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0424 15:08:25.799525 1 controller.go:489] The operator is still being initialized I0424 15:08:25.799532 1 controller.go:512] The operator is healthy I0424 15:08:25.799482 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 7.056291ms to process 0 records I0424 15:08:25.799636 1 tasks_processing.go:74] worker 40 stopped. I0424 15:08:25.799661 1 recorder.go:75] Recording config/image with fingerprint=22cdaf84eec4dd952a67406a91c5cb117e6e64dff2f515e039ca08f17eaa6a1e I0424 15:08:25.799675 1 gather.go:177] gatherer "clusterconfig" function "image" took 8.26723ms to process 1 records I0424 15:08:25.799753 1 tasks_processing.go:74] worker 4 stopped. I0424 15:08:25.799888 1 recorder.go:75] Recording config/oauth with fingerprint=2d1c5e6a62d79cc3b2729438af8fe34da6a9f98eb9326b648cce2d1d3cd2daf5 I0424 15:08:25.799898 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 8.412335ms to process 1 records I0424 15:08:25.808147 1 tasks_processing.go:74] worker 18 stopped. I0424 15:08:25.808236 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=03d25e046dc400802d5c578cde2ba45f85e26904259d604e215e3530e08a7cf3 I0424 15:08:25.808251 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 16.978762ms to process 1 records I0424 15:08:25.808297 1 recorder.go:75] Recording config/proxy with fingerprint=4989ce7e6544be4639e29a4c635594eeb8bb41e7f4272443ec86cb065742fb33 I0424 15:08:25.808304 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 16.025239ms to process 1 records I0424 15:08:25.808309 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 14.916971ms to process 0 records I0424 15:08:25.808313 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 15.261523ms to process 0 records I0424 15:08:25.808318 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 15.218469ms to process 0 records I0424 15:08:25.808319 1 tasks_processing.go:74] worker 37 stopped. I0424 15:08:25.808321 1 tasks_processing.go:74] worker 55 stopped. I0424 15:08:25.808323 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 14.339692ms to process 0 records I0424 15:08:25.808328 1 tasks_processing.go:74] worker 51 stopped. I0424 15:08:25.808333 1 tasks_processing.go:74] worker 52 stopped. I0424 15:08:25.808329 1 tasks_processing.go:74] worker 41 stopped. I0424 15:08:25.808341 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 17.035247ms to process 0 records I0424 15:08:25.808351 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 15.697291ms to process 0 records I0424 15:08:25.808356 1 tasks_processing.go:74] worker 25 stopped. I0424 15:08:25.808359 1 tasks_processing.go:74] worker 17 stopped. I0424 15:08:25.808380 1 tasks_processing.go:74] worker 28 stopped. E0424 15:08:25.808397 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0424 15:08:25.808411 1 gather.go:177] gatherer "clusterconfig" function "machines" took 17.116735ms to process 0 records I0424 15:08:25.808526 1 tasks_processing.go:74] worker 33 stopped. I0424 15:08:25.808690 1 recorder.go:75] Recording config/network with fingerprint=023cb97b0343d7c7f6d74730030c7ee5aeb41c9bcd8c28ed46f4b1ad6ffff95c I0424 15:08:25.808701 1 gather.go:177] gatherer "clusterconfig" function "networks" took 17.224345ms to process 1 records I0424 15:08:25.808771 1 tasks_processing.go:74] worker 12 stopped. I0424 15:08:25.808884 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=b2f421dc117d81faa80c4e026398b5666ac56dc9b724f914d4996133b7dbfdcb I0424 15:08:25.808914 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=bdac8f77b386a793eaec05b0211dd381e87afb3fa56a4903168805121f4cc4fb I0424 15:08:25.808939 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=5d07373ab3417af2c852e6783768f6b523390e3e39d3fbaa3c770ee88abb146a I0424 15:08:25.808947 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 17.21095ms to process 3 records E0424 15:08:25.808957 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0424 15:08:25.808963 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 13.450619ms to process 0 records I0424 15:08:25.808967 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 15.742333ms to process 0 records I0424 15:08:25.808967 1 tasks_processing.go:74] worker 60 stopped. I0424 15:08:25.808971 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 17.504291ms to process 0 records I0424 15:08:25.808976 1 tasks_processing.go:74] worker 36 stopped. I0424 15:08:25.808982 1 tasks_processing.go:74] worker 26 stopped. I0424 15:08:25.809025 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=30e94c0d03ed27b4a8b43299dead4230083cbadf009a6d0cd41bc6a961300414 I0424 15:08:25.809041 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=7887a46c06f16f2df665cbc15bce7e4ee76e9f13e654960607d12ddc5863bd72 I0424 15:08:25.809047 1 tasks_processing.go:74] worker 0 stopped. I0424 15:08:25.809048 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 17.60159ms to process 2 records I0424 15:08:25.809740 1 tasks_processing.go:74] worker 50 stopped. I0424 15:08:25.809944 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=da7c5ffd9a3b30009c623c4a6a4def4246ad30b085f736f48bb2902243ac8610 I0424 15:08:25.809957 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 16.696264ms to process 1 records I0424 15:08:25.814961 1 tasks_processing.go:74] worker 1 stopped. I0424 15:08:25.815063 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=dbf2945576c7106f2fe682fd6bb55830710be2e97644806283db81010a20f23e I0424 15:08:25.815086 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=1f304e0d68738e01c7dbfab0fc1580eaf77a3ca2bc8b0dad5750fb8e68b83505 I0424 15:08:25.815102 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=d42ef27e72fe1a2bc88d2267e08fd8164fe2281af22762777086b17f04c6444e I0424 15:08:25.815109 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 23.708123ms to process 3 records I0424 15:08:25.816159 1 tasks_processing.go:74] worker 19 stopped. I0424 15:08:25.816172 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 21.045993ms to process 0 records I0424 15:08:25.816182 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 23.642011ms to process 0 records I0424 15:08:25.816188 1 tasks_processing.go:74] worker 31 stopped. I0424 15:08:25.816331 1 tasks_processing.go:74] worker 21 stopped. I0424 15:08:25.816444 1 recorder.go:75] Recording config/ingress with fingerprint=2ddc95f24caab28421bf77fe70bbdfd5f0d8384c597184512a82c80048f1c31f I0424 15:08:25.816461 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 21.388337ms to process 1 records I0424 15:08:25.817653 1 tasks_processing.go:74] worker 11 stopped. I0424 15:08:25.817662 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 24.207ms to process 0 records I0424 15:08:25.817671 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 24.128442ms to process 0 records I0424 15:08:25.817677 1 tasks_processing.go:74] worker 42 stopped. I0424 15:08:25.820086 1 tasks_processing.go:74] worker 27 stopped. I0424 15:08:25.820111 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 26.356255ms to process 0 records I0424 15:08:25.820188 1 gather_logs.go:145] no pods in namespace were found I0424 15:08:25.820207 1 tasks_processing.go:74] worker 7 stopped. I0424 15:08:25.820217 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 27.43888ms to process 0 records I0424 15:08:25.820245 1 tasks_processing.go:74] worker 29 stopped. I0424 15:08:25.820261 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 26.224104ms to process 0 records I0424 15:08:25.820270 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 26.364471ms to process 0 records I0424 15:08:25.820275 1 tasks_processing.go:74] worker 49 stopped. I0424 15:08:25.820381 1 tasks_processing.go:74] worker 58 stopped. I0424 15:08:25.820651 1 recorder.go:75] Recording config/authentication with fingerprint=31b522190d0436d9353b3fa1d17ff21d05a0710083d55af3d389d8858a2a4fbf I0424 15:08:25.820669 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 28.1267ms to process 1 records I0424 15:08:25.820677 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 28.136898ms to process 0 records I0424 15:08:25.820754 1 tasks_processing.go:74] worker 8 stopped. I0424 15:08:25.820803 1 tasks_processing.go:74] worker 47 stopped. I0424 15:08:25.820978 1 recorder.go:75] Recording config/node/ip-10-0-0-132.ec2.internal with fingerprint=ba5d7dcc47a16a5d68acbeb35d5bf059a7ecaa797a1fb4e4d37487bfa6aaf475 I0424 15:08:25.821034 1 recorder.go:75] Recording config/node/ip-10-0-1-210.ec2.internal with fingerprint=7911e92e64325f3cd51b6e6f3bd80e6f25239316c4f2e9ac1ed2454dc2a9f06b I0424 15:08:25.821083 1 recorder.go:75] Recording config/node/ip-10-0-2-104.ec2.internal with fingerprint=88d22ace0db31e650602b67a8b83c0f946ca28287faf2d19687057dcc59b9b99 I0424 15:08:25.821090 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 26.378594ms to process 3 records I0424 15:08:25.821174 1 tasks_processing.go:74] worker 20 stopped. I0424 15:08:25.821199 1 recorder.go:75] Recording config/apiserver with fingerprint=0eab762b1da3e1153a330f3ee3b644cb34c7491aa7210eb3e95af2693b95c3e2 I0424 15:08:25.821208 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 26.914721ms to process 1 records I0424 15:08:25.821284 1 recorder.go:75] Recording config/featuregate with fingerprint=5d3d2486733416630929074c6c4501911fc7732ed931d472d5541b86aeae5fa0 I0424 15:08:25.821295 1 tasks_processing.go:74] worker 53 stopped. I0424 15:08:25.821296 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 25.325455ms to process 1 records I0424 15:08:25.821959 1 tasks_processing.go:74] worker 56 stopped. I0424 15:08:25.821975 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 27.950431ms to process 0 records I0424 15:08:25.821996 1 tasks_processing.go:74] worker 3 stopped. I0424 15:08:25.822011 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 30.683381ms to process 0 records I0424 15:08:25.830573 1 tasks_processing.go:74] worker 13 stopped. I0424 15:08:25.830607 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0424 15:08:25.830620 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 35.747949ms to process 1 records I0424 15:08:25.833186 1 tasks_processing.go:74] worker 22 stopped. I0424 15:08:25.833206 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 39.678557ms to process 0 records I0424 15:08:25.833332 1 tasks_processing.go:74] worker 62 stopped. I0424 15:08:25.833527 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=9c18e305d2d609230e2f44760532ba81216f8fd51cf0d89654f3f0bdc907243f I0424 15:08:25.833666 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=9be58bb3e2ae44bcdeea113c5bdd30794baec310cb7a7d3c037470250d222313 I0424 15:08:25.833699 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=2471fa0add88b4aa11c126970073fbe65af5b0f6ec96622898d1fbdceab4e3e4 I0424 15:08:25.833740 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=6a926ec75a7784c1f690e87891150b9f21b010c62cada3ea578689c17835c112 I0424 15:08:25.833778 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=a00ed1efaf8204ba487724e83ca2e1d9aebabc3dcf829f98ad647c32df4fc8cb I0424 15:08:25.833842 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=50440d6237a2b0e401ec14627e0aa23cdad45807d671cbd643123284e47e52c3 I0424 15:08:25.833880 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=e5edbe68fb8f1ec3b28d23a99d258e53659f844d4093371e589eaa94ad6e3bc1 I0424 15:08:25.833945 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=931b65a1913b0e8e63472c60feebb60cec974c11bff33e2a63f270609d2c66e2 I0424 15:08:25.833982 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=ab62d1dd786ab778d8527d234cb91cb4f3ccb35dbcc00d95c2e1b404e682e600 I0424 15:08:25.834019 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=0c52fe42afe57ffe35f21d6a9b0ddb536f0fe1805485409b19aa8769e84fe16a I0424 15:08:25.834056 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=d4ddaf5341621eae931693f2ca0043166374ac41e73d1b6c09e9088a945f9a05 I0424 15:08:25.834067 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 39.923693ms to process 11 records I0424 15:08:25.834159 1 tasks_processing.go:74] worker 61 stopped. I0424 15:08:25.834865 1 recorder.go:75] Recording config/infrastructure with fingerprint=f98ef2fbbf311e71fbe393c2464c5872e3dac2ff57830cfd476c4bfeaeed8ff8 I0424 15:08:25.834879 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 40.337003ms to process 1 records I0424 15:08:25.834969 1 tasks_processing.go:74] worker 39 stopped. I0424 15:08:25.835341 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=4d3698df4f8c0d58ac6af5f127ccfd149d66ad5e2cd307f3c7199454f24b4986 I0424 15:08:25.835534 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=d15ca36715f11eb7b5a876ab5b198b2542bbb350a833a3183fe767504c53ada5 I0424 15:08:25.835543 1 gather.go:177] gatherer "clusterconfig" function "crds" took 41.619576ms to process 2 records I0424 15:08:25.835601 1 tasks_processing.go:74] worker 43 stopped. I0424 15:08:25.835855 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=ea8841da481ce669bdf9afafd64176eeb99002a8d74879bf3b739308ee5c0a17 I0424 15:08:25.835865 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 39.081417ms to process 1 records I0424 15:08:25.837397 1 tasks_processing.go:74] worker 24 stopped. I0424 15:08:25.837420 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 45.693816ms to process 0 records I0424 15:08:25.838005 1 tasks_processing.go:74] worker 23 stopped. I0424 15:08:25.838031 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 43.193274ms to process 0 records I0424 15:08:25.839974 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s W0424 15:08:25.840062 1 operator.go:288] started I0424 15:08:25.839979 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0424 15:08:25.840105 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer W0424 15:08:25.840117 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0424 15:08:25.841174 1 tasks_processing.go:74] worker 14 stopped. I0424 15:08:25.841437 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=0c9b77332ec738c28137c7ca5d81bdfbf28ff965397c962da1e335abe1a57b09 I0424 15:08:25.841586 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=ba39c83929a9666a78a35ff85e789d818e75a282c305aa154db816fab6620b65 I0424 15:08:25.841602 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 47.525398ms to process 2 records I0424 15:08:25.842305 1 tasks_processing.go:74] worker 30 stopped. I0424 15:08:25.845134 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-r2r7k with fingerprint=47d8a475b29ae199f1fc2f311a0cc8ee7a65b8889282537bfea49647dfecc57b I0424 15:08:25.845254 1 recorder.go:75] Recording config/running_containers with fingerprint=760c893afecbb0d6f5785afae8e94fb861acc4d9aeceb4c23bf8216a2f7e6033 I0424 15:08:25.845285 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 49.357558ms to process 2 records I0424 15:08:25.847963 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0424 15:08:25.847978 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0424 15:08:25.847982 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0424 15:08:25.847987 1 controller.go:212] Source scaController *sca.Controller is not ready I0424 15:08:25.847992 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0424 15:08:25.848013 1 controller.go:489] The operator is still being initialized I0424 15:08:25.848022 1 controller.go:512] The operator is healthy I0424 15:08:25.848031 1 tasks_processing.go:74] worker 6 stopped. I0424 15:08:25.848046 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 54.211702ms to process 0 records I0424 15:08:25.854830 1 prometheus_rules.go:88] Prometheus rules successfully created I0424 15:08:25.857772 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0424 15:08:25.857797 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0424 15:08:25.857857 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0424 15:08:25.862909 1 base_controller.go:82] Caches are synced for ConfigController I0424 15:08:25.862924 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0424 15:08:25.866277 1 tasks_processing.go:74] worker 16 stopped. E0424 15:08:25.866291 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0424 15:08:25.866297 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0424 15:08:25.866300 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0424 15:08:25.866312 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0424 15:08:25.866337 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0424 15:08:25.866341 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0424 15:08:25.866346 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0424 15:08:25.866350 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0424 15:08:25.866387 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0424 15:08:25.866395 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0424 15:08:25.866401 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 72.82133ms to process 7 records E0424 15:08:25.867694 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27e18d61e3-e647-4b33-8e8f-0f31a776fb24%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:45764->172.30.0.10:53: read: connection refused I0424 15:08:25.867707 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27e18d61e3-e647-4b33-8e8f-0f31a776fb24%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:45764->172.30.0.10:53: read: connection refused I0424 15:08:25.868400 1 configmapobserver.go:84] configmaps "insights-config" not found I0424 15:08:25.912275 1 tasks_processing.go:74] worker 32 stopped. I0424 15:08:25.912567 1 recorder.go:75] Recording config/version with fingerprint=cc0b4da900f30c96d9f5db14aefe0fb15e0434589e946b4376a4e3a0989abc52 I0424 15:08:25.912582 1 recorder.go:75] Recording config/id with fingerprint=8d6daf9e102d8d54006786f056222efecf595b320c1e5611f80cc6455ed5e03a I0424 15:08:25.912589 1 gather.go:177] gatherer "clusterconfig" function "version" took 118.218261ms to process 2 records I0424 15:08:25.920473 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0424 15:08:25.924202 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:35559->172.30.0.10:53: read: connection refused I0424 15:08:25.924221 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:35559->172.30.0.10:53: read: connection refused I0424 15:08:25.940813 1 base_controller.go:82] Caches are synced for LoggingSyncer I0424 15:08:25.940832 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0424 15:08:25.942322 1 tasks_processing.go:74] worker 48 stopped. E0424 15:08:25.942341 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0424 15:08:25.942349 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2psjafjkt7r8svpr1d4eqmbqppo2ka2q-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2psjafjkt7r8svpr1d4eqmbqppo2ka2q-primary-cert-bundle-secret" not found I0424 15:08:25.942432 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=fe4cf6cd7bd3e0ea607f268d3db13a20b79672a4cfbb792ea1bc07c6e0d2620d I0424 15:08:25.942448 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 148.708483ms to process 1 records I0424 15:08:26.241605 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0424 15:08:26.241623 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0424 15:08:26.241847 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-p8dmw pod in namespace openshift-dns (previous: false). I0424 15:08:26.474167 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-p8dmw pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-p8dmw\" is waiting to start: ContainerCreating" I0424 15:08:26.474195 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-p8dmw\" is waiting to start: ContainerCreating" I0424 15:08:26.474208 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-p8dmw pod in namespace openshift-dns (previous: false). I0424 15:08:26.651350 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-p8dmw pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-p8dmw\" is waiting to start: ContainerCreating" I0424 15:08:26.651367 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-p8dmw\" is waiting to start: ContainerCreating" I0424 15:08:26.651380 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-q89nm pod in namespace openshift-dns (previous: false). W0424 15:08:26.838858 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0424 15:08:26.858093 1 tasks_processing.go:74] worker 5 stopped. I0424 15:08:26.858132 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0424 15:08:26.858145 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 1.064425543s to process 1 records I0424 15:08:26.883689 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-q89nm pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-q89nm\" is waiting to start: ContainerCreating" I0424 15:08:26.883708 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-q89nm\" is waiting to start: ContainerCreating" I0424 15:08:26.883717 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-q89nm pod in namespace openshift-dns (previous: false). I0424 15:08:27.066169 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-q89nm pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-q89nm\" is waiting to start: ContainerCreating" I0424 15:08:27.066190 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-q89nm\" is waiting to start: ContainerCreating" I0424 15:08:27.066202 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-sbbmj pod in namespace openshift-dns (previous: false). I0424 15:08:27.256988 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0424 15:08:27.269779 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-sbbmj pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-sbbmj\" is waiting to start: ContainerCreating" I0424 15:08:27.269811 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-sbbmj\" is waiting to start: ContainerCreating" I0424 15:08:27.269820 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-sbbmj pod in namespace openshift-dns (previous: false). I0424 15:08:27.446397 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-sbbmj pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-sbbmj\" is waiting to start: ContainerCreating" I0424 15:08:27.446416 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-sbbmj\" is waiting to start: ContainerCreating" I0424 15:08:27.446427 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-4ph7t pod in namespace openshift-dns (previous: false). I0424 15:08:27.646313 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0424 15:08:27.646332 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-75hp2 pod in namespace openshift-dns (previous: false). I0424 15:08:27.657819 1 tasks_processing.go:74] worker 59 stopped. I0424 15:08:27.657873 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=27d0e887f247331d6d0fab172cfc95685bd6348ae2c5ec029e0e1fe4d812ca82 I0424 15:08:27.657907 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=70913692d5945460abe4b7b0bd2379cdbda51e46aedf1b6e999a2467e81280e3 I0424 15:08:27.657938 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0424 15:08:27.657968 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=8fe154e45b560441ec1abf9a86355473396e0766553eb5dc67f1d78778fa1d6e I0424 15:08:27.657986 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0424 15:08:27.658023 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=e07eaf10d182718615f54ec74a57e7c4fa64f6a9d59c352d2166065c8e73a96f I0424 15:08:27.658053 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=0e3531e321d2d353a30c96dcc5e406b2c81e275201ce3b68620d0737d6bcaecb I0424 15:08:27.658078 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=a2423acda346969dd92067279143ce75cfc04cf6ae3fc6092d900d618c3d3f22 I0424 15:08:27.658091 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=83fa59da859838e04f71caf7fa72f2441eca73f78adb5fb608f67c21c55f7234 I0424 15:08:27.658109 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=fb251e2865bf93fca70a01b2d9e0063b253860e521fdb71921d019d7a83bf7c8 I0424 15:08:27.658118 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0424 15:08:27.658133 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=ff754259fa780957c286b13d544944ea6112fcc653f77c2915f877fc1ee03d47 I0424 15:08:27.658145 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0424 15:08:27.658161 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=75b5ca5ba47bead14005a263950eedfe5830196f50dead23ef4f92c8813f705e I0424 15:08:27.658171 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0424 15:08:27.658184 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=4c682fa3149b8e4d73ead4de5eb0a2ff6d14913662f5ce63eeda3f1726b976bb I0424 15:08:27.658195 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0424 15:08:27.658214 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=1a26458a163cb625292779da50645518a1299aa6b0d04bb75180917ee20adbc5 I0424 15:08:27.658332 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=1912e64b710172052c1f1eb7cfe6732c290e443dc4b1abb6c19554e326a453b4 I0424 15:08:27.658341 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0424 15:08:27.658347 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0424 15:08:27.658368 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0424 15:08:27.658387 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=1bdcd211b0ccd78bc15f5f6862505661f08b8a488c797d921c2b85618ceec361 I0424 15:08:27.658413 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=178b125486d39ed4c430a3bf5cd1fd58ee0542dfeaf14be1c1a49887fd33bc33 I0424 15:08:27.658434 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0424 15:08:27.658454 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=2aed639298b65772470e045052c80502caad3ed83809fff5fe908258fc824c4a I0424 15:08:27.658463 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0424 15:08:27.658475 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=58353a5d78583ad9378e5bb46aca3b2b8ea41d910bf4ee854dc7d09d6afe9b4c I0424 15:08:27.658490 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=bb1ee203743c36e66f56e462fe6112e41cdff27b16c8006c6211abf03518a32b I0424 15:08:27.658505 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=31a10f7fe55885d0bcc25bd634ab3f745e64948ef109a50f7c03158abcd172a9 I0424 15:08:27.658522 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=4f969b48d7726973ed090176f53c16befd59d1481d3adddd012b41487f07a55d I0424 15:08:27.658535 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=0d33cbe04d321ceecda964a7ad897718d0b397ffe6f5653998857791d3530c58 I0424 15:08:27.658562 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=e34910f97d599b80590b7105de5de2fd01af6bdfcad9816b7502cae1459cdb58 I0424 15:08:27.658578 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0424 15:08:27.658586 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0424 15:08:27.658593 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.862591906s to process 35 records W0424 15:08:27.838694 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0424 15:08:27.850099 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0424 15:08:27.850117 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-vsrjl pod in namespace openshift-dns (previous: false). I0424 15:08:28.048496 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0424 15:08:28.048550 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7bcb4758b8-6fb5d pod in namespace openshift-image-registry (previous: false). I0424 15:08:28.250288 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7bcb4758b8-6fb5d pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7bcb4758b8-6fb5d\" is waiting to start: ContainerCreating" I0424 15:08:28.250311 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7bcb4758b8-6fb5d\" is waiting to start: ContainerCreating" I0424 15:08:28.250365 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7bcb4758b8-zqtqx pod in namespace openshift-image-registry (previous: false). I0424 15:08:28.450957 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7bcb4758b8-zqtqx pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7bcb4758b8-zqtqx\" is waiting to start: ContainerCreating" I0424 15:08:28.450975 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7bcb4758b8-zqtqx\" is waiting to start: ContainerCreating" I0424 15:08:28.451012 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-d5fffb495-4flpg pod in namespace openshift-image-registry (previous: false). I0424 15:08:28.648765 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-d5fffb495-4flpg pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-d5fffb495-4flpg\" is waiting to start: ContainerCreating" I0424 15:08:28.648798 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-d5fffb495-4flpg\" is waiting to start: ContainerCreating" I0424 15:08:28.648810 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-b887w pod in namespace openshift-image-registry (previous: false). W0424 15:08:28.838354 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0424 15:08:28.851103 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0424 15:08:28.851120 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-cwdrm pod in namespace openshift-image-registry (previous: false). I0424 15:08:29.046732 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0424 15:08:29.046751 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-n998m pod in namespace openshift-image-registry (previous: false). I0424 15:08:29.251906 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0424 15:08:29.251928 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-55884d54dc-lx879 pod in namespace openshift-ingress (previous: false). I0424 15:08:29.447883 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-55884d54dc-lx879 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-55884d54dc-lx879\" is waiting to start: ContainerCreating" I0424 15:08:29.447901 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-55884d54dc-lx879\" is waiting to start: ContainerCreating" I0424 15:08:29.447912 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-847bd6db75-6hwgw pod in namespace openshift-ingress (previous: false). I0424 15:08:29.645762 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-847bd6db75-6hwgw pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-847bd6db75-6hwgw\" is waiting to start: ContainerCreating" I0424 15:08:29.645793 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-847bd6db75-6hwgw\" is waiting to start: ContainerCreating" I0424 15:08:29.645808 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-847bd6db75-kjt4z pod in namespace openshift-ingress (previous: false). W0424 15:08:29.838346 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0424 15:08:29.848523 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-847bd6db75-kjt4z pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-847bd6db75-kjt4z\" is waiting to start: ContainerCreating" I0424 15:08:29.848541 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-847bd6db75-kjt4z\" is waiting to start: ContainerCreating" I0424 15:08:29.848552 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-8tw4b pod in namespace openshift-ingress-canary (previous: false). I0424 15:08:30.046222 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-8tw4b pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-8tw4b\" is waiting to start: ContainerCreating" I0424 15:08:30.046240 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-8tw4b\" is waiting to start: ContainerCreating" I0424 15:08:30.046252 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-hndfr pod in namespace openshift-ingress-canary (previous: false). I0424 15:08:30.249848 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-hndfr pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-hndfr\" is waiting to start: ContainerCreating" I0424 15:08:30.249869 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-hndfr\" is waiting to start: ContainerCreating" I0424 15:08:30.249880 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-qmnn8 pod in namespace openshift-ingress-canary (previous: false). I0424 15:08:30.448172 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-qmnn8 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-qmnn8\" is waiting to start: ContainerCreating" I0424 15:08:30.448199 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-qmnn8\" is waiting to start: ContainerCreating" I0424 15:08:30.448220 1 tasks_processing.go:74] worker 44 stopped. I0424 15:08:30.448327 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=5ff7e0c3cfc3e7f29f27967dd0a1272872e9c4c00524fc1253814681d866f477 I0424 15:08:30.448398 1 recorder.go:75] Recording events/openshift-dns with fingerprint=3c7b2293d2ad170003f34483e146fb185780874f563de4cce805ca3cbe4b4d3d I0424 15:08:30.448504 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=0e2a04645e6b3457d06af3861b448f7b2b1b82ee19b5af1917412a4598410501 I0424 15:08:30.448540 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=b545913edb42a77536b69609e4fc47282962cc54b0fddaa62b4808f7463ed723 I0424 15:08:30.448597 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=86e7dffa38f6ce1b363d16c683fb04bbfeac86216a933c40e8b296116bb1d7b7 I0424 15:08:30.448616 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=51f660c68bb85a794d4bdd3a4a96ceba73a54f3f1713139b9ab9a92f9acc40ae I0424 15:08:30.448844 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7bcb4758b8-6fb5d with fingerprint=2dbd7add55a876a2a6f18912b36fcde4c803b2530c2f731d03008f94f2fc8be4 I0424 15:08:30.448994 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-7bcb4758b8-zqtqx with fingerprint=1353e6306ec7bf514f99a272e7db5f890ad818b2c06870c1430b2f583600d820 I0424 15:08:30.449111 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-d5fffb495-4flpg with fingerprint=8556fafbd04867eaa9c195861fe4e9c602f32499b016e702de2b2520f434dd18 I0424 15:08:30.449122 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.654738863s to process 9 records W0424 15:08:30.838012 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0424 15:08:30.838055 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0424 15:08:30.838075 1 tasks_processing.go:74] worker 54 stopped. E0424 15:08:30.838092 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0424 15:08:30.838108 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0424 15:08:30.838128 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0424 15:08:30.838144 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.044153089s to process 1 records I0424 15:08:38.240867 1 tasks_processing.go:74] worker 35 stopped. I0424 15:08:38.240909 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0424 15:08:38.240925 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.445697951s to process 1 records I0424 15:08:38.976721 1 configmapobserver.go:84] configmaps "insights-config" not found I0424 15:08:38.999277 1 tasks_processing.go:74] worker 57 stopped. I0424 15:08:38.999541 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=6f02bbed9776fbc53f719d04062abe458034f9ac95b2963e439b1381b6c8e3c4 I0424 15:08:38.999557 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.207943866s to process 1 records E0424 15:08:38.999613 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.208s with: function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0424 15:08:39.000721 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0424 15:08:39.000734 1 periodic.go:209] Running workloads gatherer I0424 15:08:39.000750 1 tasks_processing.go:45] number of workers: 2 I0424 15:08:39.000765 1 tasks_processing.go:69] worker 1 listening for tasks. I0424 15:08:39.000769 1 tasks_processing.go:71] worker 1 working on workload_info task. I0424 15:08:39.000816 1 tasks_processing.go:69] worker 0 listening for tasks. I0424 15:08:39.000834 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0424 15:08:39.026514 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0424 15:08:39.032234 1 tasks_processing.go:74] worker 0 stopped. I0424 15:08:39.032255 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 31.385366ms to process 0 records I0424 15:08:39.035227 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (11ms) I0424 15:08:39.046141 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (11ms) I0424 15:08:39.056934 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (11ms) I0424 15:08:39.067717 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (11ms) I0424 15:08:39.078183 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (10ms) I0424 15:08:39.089063 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (11ms) I0424 15:08:39.099629 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (11ms) I0424 15:08:39.109972 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (10ms) I0424 15:08:39.123191 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (13ms) I0424 15:08:39.133909 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (11ms) I0424 15:08:39.144632 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (11ms) I0424 15:08:39.236923 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (92ms) I0424 15:08:39.336138 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (99ms) I0424 15:08:39.436073 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (100ms) I0424 15:08:39.539644 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (104ms) I0424 15:08:39.636600 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (97ms) I0424 15:08:39.741288 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (105ms) I0424 15:08:39.835384 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (94ms) I0424 15:08:39.935985 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (101ms) I0424 15:08:40.036892 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (101ms) I0424 15:08:40.135811 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (99ms) I0424 15:08:40.236155 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (100ms) I0424 15:08:40.344697 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (109ms) I0424 15:08:40.435858 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (91ms) I0424 15:08:40.535167 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (99ms) I0424 15:08:40.637147 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (102ms) I0424 15:08:40.735358 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (98ms) I0424 15:08:40.835762 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (100ms) I0424 15:08:40.930435 1 configmapobserver.go:84] configmaps "insights-config" not found I0424 15:08:40.936322 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (101ms) I0424 15:08:41.036425 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0424 15:08:41.130932 1 configmapobserver.go:84] configmaps "insights-config" not found I0424 15:08:41.136028 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (100ms) I0424 15:08:41.236196 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0424 15:08:41.236227 1 tasks_processing.go:74] worker 1 stopped. E0424 15:08:41.236237 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0424 15:08:41.236542 1 recorder.go:75] Recording config/workload_info with fingerprint=929ad5262cbee7daa07b5df2bf0d1ab78bf588e34a744e4df997be7eb3493d83 I0424 15:08:41.236557 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.235451116s to process 1 records E0424 15:08:41.236582 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.235s with: function \"workload_info\" failed with an error" I0424 15:08:41.237685 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0424 15:08:41.237699 1 periodic.go:209] Running conditional gatherer I0424 15:08:41.244167 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0424 15:08:41.250419 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:48967->172.30.0.10:53: read: connection refused E0424 15:08:41.250673 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0424 15:08:41.250734 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0424 15:08:41.256959 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0424 15:08:41.256974 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0424 15:08:41.256979 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0424 15:08:41.256982 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0424 15:08:41.256985 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0424 15:08:41.256988 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0424 15:08:41.256991 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0424 15:08:41.256994 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0424 15:08:41.256997 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0424 15:08:41.256999 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0424 15:08:41.257014 1 tasks_processing.go:45] number of workers: 3 I0424 15:08:41.257024 1 tasks_processing.go:69] worker 2 listening for tasks. I0424 15:08:41.257027 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0424 15:08:41.257035 1 tasks_processing.go:69] worker 0 listening for tasks. I0424 15:08:41.257048 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0424 15:08:41.257053 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0424 15:08:41.257053 1 tasks_processing.go:69] worker 1 listening for tasks. I0424 15:08:41.257060 1 tasks_processing.go:74] worker 1 stopped. I0424 15:08:41.257107 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0424 15:08:41.257119 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 820ns to process 1 records I0424 15:08:41.257150 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0424 15:08:41.257158 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.312µs to process 1 records I0424 15:08:41.257163 1 tasks_processing.go:74] worker 0 stopped. I0424 15:08:41.257306 1 tasks_processing.go:74] worker 2 stopped. I0424 15:08:41.257317 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 244.034µs to process 0 records I0424 15:08:41.257337 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:48967->172.30.0.10:53: read: connection refused I0424 15:08:41.257356 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0424 15:08:41.280469 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=1ab67f945deead82fb62a419acade692e4042c894cfc59f94d8fad2a045467fe I0424 15:08:41.280613 1 diskrecorder.go:70] Writing 103 records to /var/lib/insights-operator/insights-2026-04-24-150841.tar.gz I0424 15:08:41.286974 1 diskrecorder.go:51] Wrote 103 records to disk in 6ms I0424 15:08:41.287010 1 periodic.go:278] Gathering cluster info every 2h0m0s I0424 15:08:41.287027 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0424 15:08:51.989373 1 configmapobserver.go:84] configmaps "insights-config" not found I0424 15:09:34.992007 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="3ec6a596cbe58e3f9a09c261daa4361781979721d47227ef63721aa023bce02b") W0424 15:09:34.992043 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0424 15:09:34.992094 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="f7e846cb5dba2219fb8d21abf87ec7f55e21a4bf2a1fbeb3fa69deb76c861110") I0424 15:09:34.992117 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0424 15:09:34.992144 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="219d88a46f3511a67035cfcb50a624e69c1ce40f620828bedb8411fd8f788136") I0424 15:09:34.992167 1 base_controller.go:181] Shutting down ConfigController ... I0424 15:09:34.992175 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0424 15:09:34.992203 1 periodic.go:170] Shutting down