W0425 08:12:59.948038 1 cmd.go:257] Using insecure, self-signed certificates I0425 08:13:00.577532 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 08:13:00.577832 1 observer_polling.go:159] Starting file observer I0425 08:13:00.719047 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0425 08:13:00.719267 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0425 08:13:00.719796 1 secure_serving.go:57] Forcing use of http/1.1 only W0425 08:13:00.719815 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0425 08:13:00.719820 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0425 08:13:00.719824 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0425 08:13:00.719827 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0425 08:13:00.719829 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0425 08:13:00.719832 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0425 08:13:00.719864 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0425 08:13:00.723254 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0425 08:13:00.723278 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"c2977afb-bf12-40eb-b909-dd66ea774006", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0425 08:13:00.725337 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0425 08:13:00.725349 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0425 08:13:00.725346 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0425 08:13:00.725362 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0425 08:13:00.725363 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0425 08:13:00.725353 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0425 08:13:00.725638 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-2539603777/tls.crt::/tmp/serving-cert-2539603777/tls.key" I0425 08:13:00.725914 1 secure_serving.go:213] Serving securely on [::]:8443 I0425 08:13:00.725941 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0425 08:13:00.728842 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0425 08:13:00.728861 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0425 08:13:00.728954 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0425 08:13:00.734990 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0425 08:13:00.735005 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0425 08:13:00.741019 1 secretconfigobserver.go:119] support secret does not exist I0425 08:13:00.748567 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0425 08:13:00.753565 1 secretconfigobserver.go:119] support secret does not exist I0425 08:13:00.755319 1 recorder.go:161] Pruning old reports every 7h0m47s, max age is 288h0m0s I0425 08:13:00.759905 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0425 08:13:00.759920 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0425 08:13:00.759926 1 periodic.go:209] Running clusterconfig gatherer I0425 08:13:00.759927 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0425 08:13:00.759939 1 insightsreport.go:296] Starting report retriever I0425 08:13:00.759952 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0425 08:13:00.759957 1 tasks_processing.go:45] number of workers: 64 I0425 08:13:00.759992 1 tasks_processing.go:69] worker 63 listening for tasks. I0425 08:13:00.759998 1 tasks_processing.go:71] worker 63 working on operators_pods_and_events task. I0425 08:13:00.760016 1 tasks_processing.go:69] worker 31 listening for tasks. I0425 08:13:00.760025 1 tasks_processing.go:69] worker 16 listening for tasks. I0425 08:13:00.760026 1 tasks_processing.go:69] worker 15 listening for tasks. I0425 08:13:00.760032 1 tasks_processing.go:69] worker 0 listening for tasks. I0425 08:13:00.760040 1 tasks_processing.go:69] worker 1 listening for tasks. I0425 08:13:00.760042 1 tasks_processing.go:69] worker 47 listening for tasks. I0425 08:13:00.760051 1 tasks_processing.go:69] worker 17 listening for tasks. I0425 08:13:00.760050 1 tasks_processing.go:69] worker 9 listening for tasks. I0425 08:13:00.760057 1 tasks_processing.go:69] worker 10 listening for tasks. I0425 08:13:00.760062 1 tasks_processing.go:69] worker 18 listening for tasks. I0425 08:13:00.760063 1 tasks_processing.go:69] worker 32 listening for tasks. I0425 08:13:00.760063 1 tasks_processing.go:69] worker 8 listening for tasks. I0425 08:13:00.760067 1 tasks_processing.go:69] worker 19 listening for tasks. I0425 08:13:00.760071 1 tasks_processing.go:69] worker 20 listening for tasks. I0425 08:13:00.760077 1 tasks_processing.go:69] worker 39 listening for tasks. I0425 08:13:00.760072 1 tasks_processing.go:69] worker 40 listening for tasks. I0425 08:13:00.760087 1 tasks_processing.go:69] worker 2 listening for tasks. I0425 08:13:00.760076 1 tasks_processing.go:69] worker 26 listening for tasks. I0425 08:13:00.760094 1 tasks_processing.go:69] worker 29 listening for tasks. I0425 08:13:00.760096 1 tasks_processing.go:69] worker 46 listening for tasks. I0425 08:13:00.760079 1 tasks_processing.go:69] worker 41 listening for tasks. I0425 08:13:00.760100 1 tasks_processing.go:69] worker 14 listening for tasks. I0425 08:13:00.760102 1 tasks_processing.go:69] worker 30 listening for tasks. I0425 08:13:00.760085 1 tasks_processing.go:69] worker 27 listening for tasks. I0425 08:13:00.760109 1 tasks_processing.go:69] worker 22 listening for tasks. I0425 08:13:00.760084 1 tasks_processing.go:69] worker 12 listening for tasks. I0425 08:13:00.760112 1 tasks_processing.go:69] worker 4 listening for tasks. I0425 08:13:00.760114 1 tasks_processing.go:69] worker 35 listening for tasks. I0425 08:13:00.760117 1 tasks_processing.go:69] worker 21 listening for tasks. I0425 08:13:00.760115 1 tasks_processing.go:69] worker 37 listening for tasks. I0425 08:13:00.760106 1 tasks_processing.go:69] worker 44 listening for tasks. I0425 08:13:00.760124 1 tasks_processing.go:69] worker 38 listening for tasks. I0425 08:13:00.760092 1 tasks_processing.go:69] worker 13 listening for tasks. I0425 08:13:00.760131 1 tasks_processing.go:69] worker 43 listening for tasks. I0425 08:13:00.760133 1 tasks_processing.go:69] worker 54 listening for tasks. I0425 08:13:00.760135 1 tasks_processing.go:69] worker 57 listening for tasks. I0425 08:13:00.760096 1 tasks_processing.go:69] worker 33 listening for tasks. I0425 08:13:00.760143 1 tasks_processing.go:69] worker 62 listening for tasks. I0425 08:13:00.760145 1 tasks_processing.go:69] worker 50 listening for tasks. I0425 08:13:00.760147 1 tasks_processing.go:69] worker 48 listening for tasks. I0425 08:13:00.760103 1 tasks_processing.go:69] worker 3 listening for tasks. I0425 08:13:00.760101 1 tasks_processing.go:69] worker 25 listening for tasks. I0425 08:13:00.760108 1 tasks_processing.go:69] worker 36 listening for tasks. I0425 08:13:00.760103 1 tasks_processing.go:69] worker 34 listening for tasks. I0425 08:13:00.760114 1 tasks_processing.go:69] worker 23 listening for tasks. I0425 08:13:00.760074 1 tasks_processing.go:69] worker 11 listening for tasks. I0425 08:13:00.760089 1 tasks_processing.go:69] worker 45 listening for tasks. I0425 08:13:00.760113 1 tasks_processing.go:69] worker 42 listening for tasks. I0425 08:13:00.760089 1 tasks_processing.go:69] worker 28 listening for tasks. I0425 08:13:00.760119 1 tasks_processing.go:69] worker 24 listening for tasks. I0425 08:13:00.760123 1 tasks_processing.go:69] worker 5 listening for tasks. I0425 08:13:00.760126 1 tasks_processing.go:69] worker 55 listening for tasks. I0425 08:13:00.760123 1 tasks_processing.go:69] worker 7 listening for tasks. I0425 08:13:00.760191 1 tasks_processing.go:69] worker 6 listening for tasks. I0425 08:13:00.760132 1 tasks_processing.go:69] worker 59 listening for tasks. I0425 08:13:00.760136 1 tasks_processing.go:69] worker 61 listening for tasks. I0425 08:13:00.760135 1 tasks_processing.go:69] worker 49 listening for tasks. I0425 08:13:00.760143 1 tasks_processing.go:69] worker 60 listening for tasks. I0425 08:13:00.760147 1 tasks_processing.go:69] worker 52 listening for tasks. I0425 08:13:00.760203 1 tasks_processing.go:69] worker 56 listening for tasks. I0425 08:13:00.760213 1 tasks_processing.go:71] worker 31 working on crds task. I0425 08:13:00.760218 1 tasks_processing.go:71] worker 30 working on aggregated_monitoring_cr_names task. I0425 08:13:00.760220 1 tasks_processing.go:71] worker 44 working on openstack_dataplanedeployments task. I0425 08:13:00.760223 1 tasks_processing.go:71] worker 27 working on olm_operators task. I0425 08:13:00.760222 1 tasks_processing.go:69] worker 58 listening for tasks. I0425 08:13:00.760224 1 tasks_processing.go:69] worker 53 listening for tasks. I0425 08:13:00.760231 1 tasks_processing.go:69] worker 51 listening for tasks. I0425 08:13:00.760234 1 tasks_processing.go:71] worker 13 working on machine_autoscalers task. I0425 08:13:00.760237 1 tasks_processing.go:71] worker 18 working on monitoring_persistent_volumes task. I0425 08:13:00.760241 1 tasks_processing.go:71] worker 19 working on tsdb_status task. I0425 08:13:00.760242 1 tasks_processing.go:71] worker 43 working on silenced_alerts task. I0425 08:13:00.760245 1 tasks_processing.go:71] worker 39 working on cluster_apiserver task. I0425 08:13:00.760246 1 tasks_processing.go:71] worker 53 working on machine_config_pools task. W0425 08:13:00.760269 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory W0425 08:13:00.760273 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 08:13:00.760281 1 tasks_processing.go:71] worker 43 working on sap_pods task. I0425 08:13:00.760285 1 tasks_processing.go:71] worker 8 working on authentication task. I0425 08:13:00.760289 1 tasks_processing.go:71] worker 5 working on openstack_version task. I0425 08:13:00.760239 1 tasks_processing.go:71] worker 26 working on openstack_dataplanenodesets task. I0425 08:13:00.760312 1 tasks_processing.go:71] worker 4 working on sap_datahubs task. I0425 08:13:00.760336 1 tasks_processing.go:71] worker 3 working on ingress task. I0425 08:13:00.760241 1 tasks_processing.go:71] worker 20 working on openshift_logging task. I0425 08:13:00.760429 1 tasks_processing.go:71] worker 46 working on certificate_signing_requests task. I0425 08:13:00.760442 1 tasks_processing.go:71] worker 6 working on sap_config task. I0425 08:13:00.760462 1 tasks_processing.go:71] worker 45 working on container_runtime_configs task. I0425 08:13:00.760234 1 tasks_processing.go:71] worker 58 working on qemu_kubevirt_launcher_logs task. I0425 08:13:00.760517 1 tasks_processing.go:71] worker 59 working on install_plans task. I0425 08:13:00.760514 1 tasks_processing.go:71] worker 55 working on config_maps task. I0425 08:13:00.760530 1 tasks_processing.go:71] worker 57 working on lokistack task. I0425 08:13:00.760565 1 tasks_processing.go:71] worker 28 working on machine_sets task. I0425 08:13:00.760581 1 tasks_processing.go:71] worker 62 working on ceph_cluster task. I0425 08:13:00.760218 1 tasks_processing.go:71] worker 35 working on proxies task. I0425 08:13:00.760869 1 tasks_processing.go:71] worker 36 working on image task. I0425 08:13:00.760880 1 tasks_processing.go:71] worker 41 working on pdbs task. I0425 08:13:00.760224 1 tasks_processing.go:71] worker 2 working on feature_gates task. I0425 08:13:00.760915 1 tasks_processing.go:71] worker 9 working on validating_webhook_configurations task. I0425 08:13:00.760272 1 tasks_processing.go:71] worker 7 working on oauths task. I0425 08:13:00.760972 1 tasks_processing.go:71] worker 50 working on nodenetworkstates task. I0425 08:13:00.760981 1 tasks_processing.go:71] worker 42 working on active_alerts task. I0425 08:13:00.760989 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 31.453µs to process 0 records I0425 08:13:00.760999 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 36.525µs to process 0 records I0425 08:13:00.761001 1 tasks_processing.go:71] worker 21 working on node_logs task. I0425 08:13:00.760227 1 tasks_processing.go:71] worker 15 working on pod_network_connectivity_checks task. I0425 08:13:00.761010 1 tasks_processing.go:71] worker 14 working on version task. I0425 08:13:00.760223 1 tasks_processing.go:71] worker 16 working on ingress_certificates task. I0425 08:13:00.761021 1 tasks_processing.go:71] worker 34 working on networks task. I0425 08:13:00.761043 1 tasks_processing.go:71] worker 37 working on service_accounts task. I0425 08:13:00.760578 1 tasks_processing.go:71] worker 33 working on schedulers task. I0425 08:13:00.761061 1 tasks_processing.go:71] worker 10 working on clusterroles task. I0425 08:13:00.761099 1 tasks_processing.go:71] worker 23 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0425 08:13:00.760230 1 tasks_processing.go:71] worker 38 working on jaegers task. I0425 08:13:00.761155 1 tasks_processing.go:71] worker 48 working on openstack_controlplanes task. I0425 08:13:00.760238 1 tasks_processing.go:71] worker 32 working on operators task. I0425 08:13:00.761170 1 tasks_processing.go:71] worker 49 working on metrics task. I0425 08:13:00.760231 1 tasks_processing.go:71] worker 0 working on mutating_webhook_configurations task. W0425 08:13:00.761191 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 08:13:00.761201 1 tasks_processing.go:74] worker 49 stopped. I0425 08:13:00.761212 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 21.951µs to process 0 records I0425 08:13:00.761221 1 tasks_processing.go:71] worker 61 working on dvo_metrics task. I0425 08:13:00.761284 1 tasks_processing.go:71] worker 60 working on support_secret task. I0425 08:13:00.760232 1 tasks_processing.go:71] worker 22 working on nodes task. I0425 08:13:00.760241 1 tasks_processing.go:71] worker 51 working on image_pruners task. I0425 08:13:00.760278 1 tasks_processing.go:71] worker 24 working on nodenetworkconfigurationpolicies task. I0425 08:13:00.760525 1 tasks_processing.go:71] worker 54 working on container_images task. I0425 08:13:00.761319 1 tasks_processing.go:71] worker 17 working on openshift_machine_api_events task. I0425 08:13:00.761319 1 tasks_processing.go:71] worker 47 working on machines task. I0425 08:13:00.761006 1 tasks_processing.go:74] worker 19 stopped. I0425 08:13:00.760218 1 tasks_processing.go:71] worker 29 working on machine_configs task. I0425 08:13:00.760235 1 tasks_processing.go:71] worker 1 working on image_registries task. I0425 08:13:00.760228 1 tasks_processing.go:71] worker 12 working on overlapping_namespace_uids task. I0425 08:13:00.760225 1 tasks_processing.go:71] worker 56 working on cost_management_metrics_configs task. I0425 08:13:00.760238 1 tasks_processing.go:71] worker 11 working on infrastructures task. I0425 08:13:00.760218 1 tasks_processing.go:71] worker 40 working on storage_classes task. I0425 08:13:00.760866 1 tasks_processing.go:71] worker 25 working on storage_cluster task. W0425 08:13:00.761010 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 08:13:00.761295 1 tasks_processing.go:71] worker 52 working on machine_healthchecks task. I0425 08:13:00.761729 1 tasks_processing.go:74] worker 42 stopped. I0425 08:13:00.761742 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 734.483µs to process 0 records I0425 08:13:00.767562 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0425 08:13:00.767579 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 08:13:00.767583 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0425 08:13:00.767586 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0425 08:13:00.767599 1 controller.go:489] The operator is still being initialized I0425 08:13:00.767604 1 controller.go:512] The operator is healthy I0425 08:13:00.772438 1 tasks_processing.go:74] worker 13 stopped. I0425 08:13:00.772460 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 12.192115ms to process 0 records I0425 08:13:00.778388 1 tasks_processing.go:74] worker 38 stopped. I0425 08:13:00.778399 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 17.23374ms to process 0 records I0425 08:13:00.785527 1 tasks_processing.go:74] worker 48 stopped. I0425 08:13:00.785536 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 24.366277ms to process 0 records I0425 08:13:00.785551 1 tasks_processing.go:74] worker 20 stopped. I0425 08:13:00.785563 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 25.171114ms to process 0 records I0425 08:13:00.785621 1 tasks_processing.go:74] worker 5 stopped. I0425 08:13:00.785635 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 25.320655ms to process 0 records I0425 08:13:00.785676 1 tasks_processing.go:74] worker 62 stopped. I0425 08:13:00.785685 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 25.088417ms to process 0 records I0425 08:13:00.786043 1 tasks_processing.go:74] worker 33 stopped. I0425 08:13:00.786175 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=5fe199fa26c717518910ab7a62706a51dc39dd100c3e440fb7e9cf78da4f7d81 I0425 08:13:00.786191 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 24.973484ms to process 1 records I0425 08:13:00.786446 1 tasks_processing.go:74] worker 4 stopped. I0425 08:13:00.786465 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 26.119848ms to process 0 records I0425 08:13:00.786714 1 tasks_processing.go:74] worker 57 stopped. I0425 08:13:00.786784 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 26.174243ms to process 0 records I0425 08:13:00.787038 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 26.543814ms to process 0 records E0425 08:13:00.787050 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0425 08:13:00.787060 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 25.867724ms to process 0 records I0425 08:13:00.787068 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 26.660773ms to process 0 records I0425 08:13:00.787090 1 tasks_processing.go:74] worker 26 stopped. I0425 08:13:00.787098 1 tasks_processing.go:74] worker 44 stopped. I0425 08:13:00.787091 1 tasks_processing.go:74] worker 15 stopped. I0425 08:13:00.787653 1 tasks_processing.go:74] worker 39 stopped. I0425 08:13:00.787786 1 recorder.go:75] Recording config/apiserver with fingerprint=7976d2fbf964e727021899162031aaa9b709fc15477ce566e7d496e124546185 I0425 08:13:00.787797 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 27.396288ms to process 1 records I0425 08:13:00.790018 1 tasks_processing.go:74] worker 6 stopped. I0425 08:13:00.790033 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 29.566214ms to process 0 records I0425 08:13:00.790099 1 tasks_processing.go:74] worker 43 stopped. I0425 08:13:00.790113 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 29.811241ms to process 0 records I0425 08:13:00.790218 1 tasks_processing.go:74] worker 3 stopped. I0425 08:13:00.790372 1 recorder.go:75] Recording config/ingress with fingerprint=0620f7874854901d5ccb683b5796595a45b353c571dc20257b3ff92be021c239 I0425 08:13:00.790385 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 29.865834ms to process 1 records I0425 08:13:00.790391 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 29.656768ms to process 0 records I0425 08:13:00.790448 1 tasks_processing.go:74] worker 28 stopped. I0425 08:13:00.790516 1 recorder.go:75] Recording config/authentication with fingerprint=8955556a81a1c32928cb719ae087a7f9bc102caf96d4df955ab71a178e0e1cc3 I0425 08:13:00.790523 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 30.081656ms to process 1 records I0425 08:13:00.790526 1 tasks_processing.go:74] worker 8 stopped. I0425 08:13:00.790536 1 tasks_processing.go:74] worker 36 stopped. I0425 08:13:00.790611 1 recorder.go:75] Recording config/image with fingerprint=a7a89d17563fd044672e5e5df7d6a929cff693df51357c90da2d6f34b15be8bf I0425 08:13:00.790623 1 gather.go:177] gatherer "clusterconfig" function "image" took 29.658106ms to process 1 records I0425 08:13:00.790763 1 gather_logs.go:145] no pods in namespace were found I0425 08:13:00.790778 1 tasks_processing.go:74] worker 58 stopped. I0425 08:13:00.790788 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 30.265854ms to process 0 records I0425 08:13:00.790817 1 tasks_processing.go:74] worker 53 stopped. I0425 08:13:00.790831 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 30.560662ms to process 0 records I0425 08:13:00.791029 1 tasks_processing.go:74] worker 34 stopped. I0425 08:13:00.791220 1 recorder.go:75] Recording config/network with fingerprint=98e2feaa0acaf5ba89139bd6e6f3faa37de817e6af69b8af493217341feacd8d I0425 08:13:00.791238 1 gather.go:177] gatherer "clusterconfig" function "networks" took 29.989579ms to process 1 records I0425 08:13:00.792103 1 tasks_processing.go:74] worker 46 stopped. I0425 08:13:00.792117 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 31.653023ms to process 0 records I0425 08:13:00.793592 1 tasks_processing.go:74] worker 41 stopped. I0425 08:13:00.793704 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=d1e52cf8ee7019ee3768b6eca0dea40b23be1e8978aa40e7bf651712acdbae4d I0425 08:13:00.793739 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=44d34831e354deee28b8041c2de3f98801a18e45e5a891c957b9dbec74e0d55d I0425 08:13:00.793764 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=7c66a22bdbbdb2f798a953f4c3fb5bd3eae40de7ec99f4c12af80f22bab4339d I0425 08:13:00.793784 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 32.699748ms to process 3 records I0425 08:13:00.794023 1 tasks_processing.go:74] worker 50 stopped. I0425 08:13:00.794034 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 33.0346ms to process 0 records I0425 08:13:00.794317 1 tasks_processing.go:74] worker 7 stopped. I0425 08:13:00.794579 1 recorder.go:75] Recording config/oauth with fingerprint=99055dccab1bbc838faf391e7766f894b658e31c2b9cd286a7e64464c544af0c I0425 08:13:00.794595 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 33.349084ms to process 1 records I0425 08:13:00.804390 1 tasks_processing.go:74] worker 2 stopped. I0425 08:13:00.804511 1 recorder.go:75] Recording config/featuregate with fingerprint=b06be1ac0f63a2419a8a72ae3571623d8df489da34aa04985bb52206be98e975 I0425 08:13:00.804524 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 43.486547ms to process 1 records I0425 08:13:00.804756 1 tasks_processing.go:74] worker 25 stopped. I0425 08:13:00.804768 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 43.163598ms to process 0 records I0425 08:13:00.804774 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 43.272759ms to process 0 records I0425 08:13:00.804804 1 tasks_processing.go:74] worker 52 stopped. I0425 08:13:00.804806 1 tasks_processing.go:74] worker 56 stopped. E0425 08:13:00.804815 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0425 08:13:00.804823 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 43.068841ms to process 0 records E0425 08:13:00.804828 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0425 08:13:00.804832 1 gather.go:177] gatherer "clusterconfig" function "machines" took 43.48315ms to process 0 records I0425 08:13:00.804837 1 tasks_processing.go:74] worker 47 stopped. I0425 08:13:00.805017 1 tasks_processing.go:74] worker 51 stopped. I0425 08:13:00.805197 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=0bfc18173885d1d158223b06a0cb10a60d4f69ddb0f22d98f1a68fe7cd725619 I0425 08:13:00.805212 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 43.55693ms to process 1 records I0425 08:13:00.805268 1 recorder.go:75] Recording config/proxy with fingerprint=f9d277c19934b6dba0ed172eedf7e3f00bd009fad34e3ad7ab1f06dcca5b23d4 I0425 08:13:00.805280 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 44.207279ms to process 1 records I0425 08:13:00.805287 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 43.637342ms to process 0 records I0425 08:13:00.805317 1 tasks_processing.go:74] worker 35 stopped. I0425 08:13:00.805318 1 tasks_processing.go:74] worker 24 stopped. I0425 08:13:00.805382 1 tasks_processing.go:74] worker 31 stopped. I0425 08:13:00.805726 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0425 08:13:00.805911 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0425 08:13:00.805943 1 operator.go:288] started I0425 08:13:00.805984 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0425 08:13:00.806789 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=7c36e6ddd8c06d57cb4e38df14f399af2176f3214032dfc9e163f6739a8ec69a I0425 08:13:00.807214 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=00e8431136979ea3c0b716f8958806db424cba35b4634b2aee17dde5ac3c727b I0425 08:13:00.807239 1 gather.go:177] gatherer "clusterconfig" function "crds" took 44.926806ms to process 2 records I0425 08:13:00.807257 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 43.828252ms to process 0 records I0425 08:13:00.807275 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 44.689375ms to process 0 records I0425 08:13:00.807279 1 tasks_processing.go:74] worker 17 stopped. I0425 08:13:00.807290 1 tasks_processing.go:74] worker 45 stopped. I0425 08:13:00.807331 1 tasks_processing.go:74] worker 27 stopped. I0425 08:13:00.807377 1 recorder.go:75] Recording config/olm_operators with fingerprint=4a609805ad80680da2612702e517f0dce1df682fa92e87e90ad871fb61710322 I0425 08:13:00.807392 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 45.973459ms to process 1 records I0425 08:13:00.807506 1 tasks_processing.go:74] worker 1 stopped. I0425 08:13:00.808210 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=3eda0843de9bc8fbb4e9ade1b7020522e5f517dfd50c8e02ce1c4d731838e54d I0425 08:13:00.808226 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 44.8925ms to process 1 records I0425 08:13:00.808240 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 47.298593ms to process 0 records E0425 08:13:00.808245 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0425 08:13:00.808251 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 46.028586ms to process 0 records I0425 08:13:00.808254 1 tasks_processing.go:74] worker 18 stopped. I0425 08:13:00.808264 1 tasks_processing.go:74] worker 60 stopped. I0425 08:13:00.808318 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=6f5d137ad068dca3db9e89979ab2c3acbd9f6bf84c0f74551bf04d82fd246c88 I0425 08:13:00.808318 1 tasks_processing.go:74] worker 40 stopped. I0425 08:13:00.808334 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=e36c30bc3b8ab91e0d894dd07bd076f46e6fd7af3c93ebfdfe08311b7b7c49e8 I0425 08:13:00.808340 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 46.031523ms to process 2 records I0425 08:13:00.808442 1 tasks_processing.go:74] worker 11 stopped. I0425 08:13:00.808734 1 recorder.go:75] Recording config/infrastructure with fingerprint=bad3a5bacfcca1ce7b50783e359004deba0997cc432b908e408e67a7ae89c019 I0425 08:13:00.808743 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 46.515343ms to process 1 records W0425 08:13:00.809986 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 08:13:00.811362 1 tasks_processing.go:74] worker 30 stopped. I0425 08:13:00.811375 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 51.130652ms to process 0 records I0425 08:13:00.815842 1 tasks_processing.go:74] worker 10 stopped. I0425 08:13:00.816074 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=5d38995a3715fa0e649822c9a55508d6751c0e94e8a86b6c26647a9280283124 I0425 08:13:00.816270 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=dc8f2a55b5522bbff042d35ce7e7e73c3f720de8a0eba8371e34d2ef9ee12779 I0425 08:13:00.816285 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 54.762906ms to process 2 records I0425 08:13:00.816735 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 08:13:00.816745 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0425 08:13:00.816748 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0425 08:13:00.816751 1 controller.go:212] Source scaController *sca.Controller is not ready I0425 08:13:00.816753 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0425 08:13:00.816770 1 controller.go:489] The operator is still being initialized I0425 08:13:00.816777 1 controller.go:512] The operator is healthy I0425 08:13:00.820602 1 prometheus_rules.go:88] Prometheus rules successfully created E0425 08:13:00.822085 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%271377af2f-de6e-4c13-b835-dc41d1592a2e%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:54377->172.30.0.10:53: read: connection refused I0425 08:13:00.822100 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%271377af2f-de6e-4c13-b835-dc41d1592a2e%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:54377->172.30.0.10:53: read: connection refused I0425 08:13:00.825619 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0425 08:13:00.825629 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0425 08:13:00.825644 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0425 08:13:00.826613 1 tasks_processing.go:74] worker 55 stopped. E0425 08:13:00.826625 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0425 08:13:00.826630 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0425 08:13:00.826634 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0425 08:13:00.826649 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0425 08:13:00.826671 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0425 08:13:00.826678 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0425 08:13:00.826682 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0425 08:13:00.826685 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0425 08:13:00.826721 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0425 08:13:00.826727 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0425 08:13:00.826737 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 66.074269ms to process 7 records I0425 08:13:00.829196 1 base_controller.go:82] Caches are synced for ConfigController I0425 08:13:00.829207 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0425 08:13:00.836005 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 08:13:00.836802 1 tasks_processing.go:74] worker 16 stopped. E0425 08:13:00.836814 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0425 08:13:00.836819 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pt28fcv00987j0otqv8b7704h3iha2q-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pt28fcv00987j0otqv8b7704h3iha2q-primary-cert-bundle-secret" not found I0425 08:13:00.836863 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=a7d15d267cb66212066e56e8e1f76f3beeea095db4abb8c7cfb0ce3c10787035 I0425 08:13:00.836877 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 75.773028ms to process 1 records I0425 08:13:00.838271 1 tasks_processing.go:74] worker 9 stopped. I0425 08:13:00.838425 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=e0dfcc5826417bf3d523539f14727995037b88aa89d1b14575a3074534f19009 I0425 08:13:00.838501 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=3d8b1e0f3e007d0de326fe6aaf47227eb0a5c9ab1822f7beb9dfc5eaf45bc946 I0425 08:13:00.838518 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=5c712abd7132d4219fb2399c8fc3e0434cedd24f63f9f9edbdbfc083096a258e I0425 08:13:00.838541 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=71d48d7222e9d9615e9a976be19981335b804c50309755badba9766074a42030 I0425 08:13:00.838562 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=fd07d38d23cf3e55e66cc1992950860efe9d1396d9552d57cf66a6962f1f32b6 I0425 08:13:00.838584 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=a00fa9c4df77f5682640fd4431ba6033e592161ee95fab118a5251bfd9c90dab I0425 08:13:00.838606 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=648b1744331ac6c77c6a2a5127c458dbb665a0be7f8dd65b5b72e4027b1bb979 I0425 08:13:00.838645 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=1b53385438ea15348a06546e2617334fb6a82f764c646fe65733e85d62c9a16a I0425 08:13:00.838668 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=e2257c7dcbb1ab3c5ef3f640ca92e7c8dd4b2df66d5dd8365c1159aee46c97bc I0425 08:13:00.838689 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=a8bb52987fa67f32de349aec14238623b20d06fe9cbf8672ba923e6186b9f7cd I0425 08:13:00.838721 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=e5cb14d48b30e05c894eda50a333e9f1a96b580d0c5950ca1d527d6ffc67b6b3 I0425 08:13:00.838729 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 77.333594ms to process 11 records I0425 08:13:00.845549 1 tasks_processing.go:74] worker 0 stopped. I0425 08:13:00.845668 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=fbcf5b1e57bae548ef4b0e6a1aa170e6dc912af7069249624c792d89fa3a7733 I0425 08:13:00.845701 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=0c19db11f36c7905acc35bb41e537735ea6c45320fe4e5b33ae6b61f9d32bb3c I0425 08:13:00.845726 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=444b5a289791920b90a90c9b12cf73e994dcf7e3e18ddcc6017c0fca1d8001a2 I0425 08:13:00.845734 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 84.356829ms to process 3 records I0425 08:13:00.852127 1 tasks_processing.go:74] worker 21 stopped. I0425 08:13:00.852141 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 91.109296ms to process 0 records I0425 08:13:00.852736 1 tasks_processing.go:74] worker 22 stopped. I0425 08:13:00.854392 1 recorder.go:75] Recording config/node/ip-10-0-0-42.ec2.internal with fingerprint=256a80e2d50cdebfc7c61b4485b1fbbd3dfdf2def2f3d108c3f730f97e6c38c6 I0425 08:13:00.854450 1 recorder.go:75] Recording config/node/ip-10-0-1-234.ec2.internal with fingerprint=9872504188a0c491268b7fe78a8f568585fb87d9d1edbd12f4a6a8f488c0eabd I0425 08:13:00.854501 1 recorder.go:75] Recording config/node/ip-10-0-2-71.ec2.internal with fingerprint=68d292a23a47015eb3c7cf35e85026f3b4709f5a73aa3fe9820e3c93041f7660 I0425 08:13:00.854509 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 91.394683ms to process 3 records I0425 08:13:00.861397 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0425 08:13:00.864470 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:58893->172.30.0.10:53: read: connection refused I0425 08:13:00.864482 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.12:58893->172.30.0.10:53: read: connection refused I0425 08:13:00.883832 1 tasks_processing.go:74] worker 12 stopped. I0425 08:13:00.883855 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0425 08:13:00.883863 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 122.363041ms to process 1 records I0425 08:13:00.888898 1 tasks_processing.go:74] worker 14 stopped. I0425 08:13:00.889219 1 recorder.go:75] Recording config/version with fingerprint=1eeff078f390b458d3a35f4cdf8ee0a45887f77fb4f4f49cc9fd49569db96d03 I0425 08:13:00.889237 1 recorder.go:75] Recording config/id with fingerprint=07c040389d268f83b6569d7d6907011ba84baf4501f7cf63b9e38936800dc822 I0425 08:13:00.889246 1 gather.go:177] gatherer "clusterconfig" function "version" took 127.876285ms to process 2 records I0425 08:13:00.900831 1 tasks_processing.go:74] worker 29 stopped. I0425 08:13:00.900857 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0425 08:13:00.900866 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 139.447025ms to process 1 records I0425 08:13:00.906238 1 base_controller.go:82] Caches are synced for LoggingSyncer I0425 08:13:00.906265 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0425 08:13:00.907813 1 tasks_processing.go:74] worker 54 stopped. I0425 08:13:00.909068 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-q8xbt with fingerprint=01780f89e5754b4900676c103f8017175b55e787ce3fb9ec0a6a9a0698bfe3e2 I0425 08:13:00.909143 1 recorder.go:75] Recording config/running_containers with fingerprint=188f9c126529c5bda98e841737db970749ab07195a981d6aed1f4a83e134d51e I0425 08:13:00.909152 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 146.487197ms to process 2 records I0425 08:13:00.912197 1 tasks_processing.go:74] worker 23 stopped. I0425 08:13:00.912210 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 151.078639ms to process 0 records I0425 08:13:01.201569 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0425 08:13:01.201585 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0425 08:13:01.201794 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-cmm2w pod in namespace openshift-dns (previous: false). I0425 08:13:01.494842 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-cmm2w pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-cmm2w\" is waiting to start: ContainerCreating" I0425 08:13:01.494859 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-cmm2w\" is waiting to start: ContainerCreating" I0425 08:13:01.494867 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-cmm2w pod in namespace openshift-dns (previous: false). I0425 08:13:01.605896 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-cmm2w pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-cmm2w\" is waiting to start: ContainerCreating" I0425 08:13:01.605913 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-cmm2w\" is waiting to start: ContainerCreating" I0425 08:13:01.605944 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-gx6hx pod in namespace openshift-dns (previous: false). W0425 08:13:01.808570 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 08:13:01.828291 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-gx6hx pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-gx6hx\" is waiting to start: ContainerCreating" I0425 08:13:01.828314 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-gx6hx\" is waiting to start: ContainerCreating" I0425 08:13:01.828322 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-gx6hx pod in namespace openshift-dns (previous: false). I0425 08:13:02.007534 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-gx6hx pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-gx6hx\" is waiting to start: ContainerCreating" I0425 08:13:02.007549 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-gx6hx\" is waiting to start: ContainerCreating" I0425 08:13:02.007558 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-t8d6q pod in namespace openshift-dns (previous: false). I0425 08:13:02.229334 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0425 08:13:02.240174 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-t8d6q pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-t8d6q\" is waiting to start: ContainerCreating" I0425 08:13:02.240184 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-t8d6q\" is waiting to start: ContainerCreating" I0425 08:13:02.240195 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-t8d6q pod in namespace openshift-dns (previous: false). I0425 08:13:02.404543 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-t8d6q pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-t8d6q\" is waiting to start: ContainerCreating" I0425 08:13:02.404555 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-t8d6q\" is waiting to start: ContainerCreating" I0425 08:13:02.404564 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-52lnh pod in namespace openshift-dns (previous: false). I0425 08:13:02.608131 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 08:13:02.608145 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-pmwxw pod in namespace openshift-dns (previous: false). I0425 08:13:02.807399 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 08:13:02.807418 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-rt9lq pod in namespace openshift-dns (previous: false). W0425 08:13:02.809090 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 08:13:02.843929 1 tasks_processing.go:74] worker 32 stopped. I0425 08:13:02.843974 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=8c1a203d1e5a524d205f6fa77f0db5025436523d98524f65687d796289d24a6c I0425 08:13:02.843999 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=af9368415f4ecbead04f2a1087cadbec11c25209c73d5187f40f3847704bfbc6 I0425 08:13:02.844027 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0425 08:13:02.844051 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=7df1524ee927feda94a20756aad46411f89e2207abe62fa47c70616bedb1e22c I0425 08:13:02.844081 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0425 08:13:02.844103 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=c34a7e079b30ce17074a451c0cb570c3d5c9a6be9d6531dd270692cebc9898b3 I0425 08:13:02.844132 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=e8977ee287db2d1bb3b8aa53fe8e4c9d538cfdae532aafe0d3d8de9ddd83afef I0425 08:13:02.844154 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=f6758bf580742f27cdccebaf0fbf5142ac7415aa60d8104755f82e1912fda1ef I0425 08:13:02.844167 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=7823ab5894c7e5b27cedb4517c5ef17c3751ab91e1259940c9a2b52728baa24c I0425 08:13:02.844184 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=a7dbd82c835535b0f5ba46ebdad57454fef4921ffcfd90a6fb0debd8dfbd24a3 I0425 08:13:02.844193 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0425 08:13:02.844210 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=309b2cca746573a7df700fa1c8a2d682c53d7286f5d8019ea1bf06f95831fe2d I0425 08:13:02.844220 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0425 08:13:02.844234 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=7c61692df6b380e4721e1ba974f515d2c3f3c7c369b01444a59bf8e8813f0bd3 I0425 08:13:02.844243 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0425 08:13:02.844255 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=96b6804d8fe471454b52854b31cd717a7bb513a6f92f3dbb73e46ff3e489ba3f I0425 08:13:02.844264 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0425 08:13:02.844280 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=41502dc765150effce4ce3af460940d91102fa2d9e9be28497e136686d9f94f1 I0425 08:13:02.844410 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=2e7b7e0bb1edfb098d3ff52093dc466f15ae0e4de966323b21304f18ea1c1e62 I0425 08:13:02.844419 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0425 08:13:02.844425 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0425 08:13:02.844445 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0425 08:13:02.844466 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=4988d903923846265a47b69eef65e8284a150c923c7a8f85649dc753c39ad4ae I0425 08:13:02.844488 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=7e8968b5afdfdf3e080bcf208d75604a9fc196a2a58fc4a52f686ae3e6b76344 I0425 08:13:02.844496 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0425 08:13:02.844533 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=e2d565d504c3b5e523942bb78e88f1ed4fff4cb4be7b02b083228f5c4573ea12 I0425 08:13:02.844543 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0425 08:13:02.844557 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=a5185e79aefb1498f133909d3398e2b595aa58677d52c15fcd2cbad49903a189 I0425 08:13:02.844571 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=3aeae080a535af947bd133b476b0e59f0ad50a8e9998268205c91c5d5c601c47 I0425 08:13:02.844585 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=bc29095b60c29827a17c0c483a25f15aaf8ab59c605e5765a7b4a15e9ea256f6 I0425 08:13:02.844600 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=56ad097e929ee5089895319319997f3ab4558ae64a4bbea196d0703fb805b07c I0425 08:13:02.844620 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=ba89edd50562bda8394e48de538296e7a9a4e13f217d8344dc3208353c27be46 I0425 08:13:02.844628 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0425 08:13:02.844651 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=ca466269a2f735aec40bfe36c932ddb5ecb053d66d58498e2a4e09bdcc6ec94d I0425 08:13:02.844667 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0425 08:13:02.844675 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0425 08:13:02.844682 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.082750215s to process 36 records I0425 08:13:03.021908 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 08:13:03.021956 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5f9b468665-cfcfh pod in namespace openshift-image-registry (previous: false). I0425 08:13:03.205618 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5f9b468665-cfcfh pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5f9b468665-cfcfh\" is waiting to start: ContainerCreating" I0425 08:13:03.205634 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5f9b468665-cfcfh\" is waiting to start: ContainerCreating" I0425 08:13:03.205666 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-67f79bc658-5b7fb pod in namespace openshift-image-registry (previous: false). I0425 08:13:03.431720 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-67f79bc658-5b7fb pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-67f79bc658-5b7fb\" is waiting to start: ContainerCreating" I0425 08:13:03.431736 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-67f79bc658-5b7fb\" is waiting to start: ContainerCreating" I0425 08:13:03.431780 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-67f79bc658-brj4s pod in namespace openshift-image-registry (previous: false). I0425 08:13:03.621054 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-67f79bc658-brj4s pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-67f79bc658-brj4s\" is waiting to start: ContainerCreating" I0425 08:13:03.621068 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-67f79bc658-brj4s\" is waiting to start: ContainerCreating" I0425 08:13:03.621077 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-bfbfl pod in namespace openshift-image-registry (previous: false). I0425 08:13:03.805357 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 08:13:03.805374 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-mkjsc pod in namespace openshift-image-registry (previous: false). W0425 08:13:03.808139 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 08:13:04.005570 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 08:13:04.005585 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-sk927 pod in namespace openshift-image-registry (previous: false). I0425 08:13:04.205484 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0425 08:13:04.205498 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-744cdcd8d9-bzs5r pod in namespace openshift-ingress (previous: false). I0425 08:13:04.405223 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-744cdcd8d9-bzs5r pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-744cdcd8d9-bzs5r\" is waiting to start: ContainerCreating" I0425 08:13:04.405236 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-744cdcd8d9-bzs5r\" is waiting to start: ContainerCreating" I0425 08:13:04.405244 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7668b48776-gjjkc pod in namespace openshift-ingress (previous: false). I0425 08:13:04.605527 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7668b48776-gjjkc pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7668b48776-gjjkc\" is waiting to start: ContainerCreating" I0425 08:13:04.605540 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7668b48776-gjjkc\" is waiting to start: ContainerCreating" I0425 08:13:04.605549 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7668b48776-zv7hs pod in namespace openshift-ingress (previous: false). I0425 08:13:04.806598 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7668b48776-zv7hs pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7668b48776-zv7hs\" is waiting to start: ContainerCreating" I0425 08:13:04.806613 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7668b48776-zv7hs\" is waiting to start: ContainerCreating" I0425 08:13:04.806622 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-7bxzd pod in namespace openshift-ingress-canary (previous: false). W0425 08:13:04.808473 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0425 08:13:05.006959 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-7bxzd pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-7bxzd\" is waiting to start: ContainerCreating" I0425 08:13:05.006973 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-7bxzd\" is waiting to start: ContainerCreating" I0425 08:13:05.007001 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-znpnd pod in namespace openshift-ingress-canary (previous: false). I0425 08:13:05.205105 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-znpnd pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-znpnd\" is waiting to start: ContainerCreating" I0425 08:13:05.205118 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-znpnd\" is waiting to start: ContainerCreating" I0425 08:13:05.205144 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-zxsx2 pod in namespace openshift-ingress-canary (previous: false). I0425 08:13:05.419427 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-zxsx2 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-zxsx2\" is waiting to start: ContainerCreating" I0425 08:13:05.419441 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-zxsx2\" is waiting to start: ContainerCreating" I0425 08:13:05.419457 1 tasks_processing.go:74] worker 63 stopped. I0425 08:13:05.419574 1 recorder.go:75] Recording events/openshift-dns with fingerprint=76c71e574b94a2b7fd368450c4720a9ac89d08f42eb70d95f1c60bf65dab5be2 I0425 08:13:05.419662 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=4e03c4d9822062bd50ed34cf4e2881830926ad3d9569bd13d7b4587c5155931a I0425 08:13:05.419689 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=5bbb61fc1a1ab539df7347ab886492def74a8cb97c16fb9e9ccd8eab96d5a9ca I0425 08:13:05.419734 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=858e5db3e1146b42db9e791ecd59783b1ad1b0de258e93a98434003b283dd650 I0425 08:13:05.419751 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=e7f1c97d929ce82981fc5f7b7a9ee21d726829800a5f17b6656a25e6cef3ca37 I0425 08:13:05.419880 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-cmm2w with fingerprint=4e3b8843fcd03db4dea62f729cc90934ae5b18f80ec314b8ea43dd18333d337b I0425 08:13:05.419959 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-gx6hx with fingerprint=807160cbf3ce8bd983af3eafb79cd6c180b59424429fbe786f0aa00deed4ff0e I0425 08:13:05.420075 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5f9b468665-cfcfh with fingerprint=9feffa0ab1324cbde6d3bdd14c379d01c7525192247e0b611eee4033bf8a675c I0425 08:13:05.420167 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-67f79bc658-5b7fb with fingerprint=c402927fbeeab2b7c59a717224b74ba665a7d6cc087dfb98fad7cc656d57945d I0425 08:13:05.420251 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-67f79bc658-brj4s with fingerprint=99b50c9df8f40430d8f5a87d742ce92cb8de6261340a88ecba361bcd1e696298 I0425 08:13:05.420322 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-znpnd with fingerprint=da42fe4d505cf64233a6082b5dcfd63f19fb243a38c0b8b1ee84025f751ae877 I0425 08:13:05.420375 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-zxsx2 with fingerprint=4b1719a19afc8e4525733d7f82ed6505f5ffc5f7ee976d3bcaa998f2b396e390 I0425 08:13:05.420384 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.659449334s to process 12 records W0425 08:13:05.808282 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0425 08:13:05.808330 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0425 08:13:05.808346 1 tasks_processing.go:74] worker 61 stopped. E0425 08:13:05.808356 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0425 08:13:05.808366 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0425 08:13:05.808380 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0425 08:13:05.808394 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.047113809s to process 1 records I0425 08:13:12.971719 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 08:13:13.396178 1 tasks_processing.go:74] worker 59 stopped. I0425 08:13:13.396225 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0425 08:13:13.396243 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.635641429s to process 1 records I0425 08:13:14.167025 1 tasks_processing.go:74] worker 37 stopped. I0425 08:13:14.167290 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=5bfe903b1da30878a989600cf95950087bbfed0fc0418c904f1a71b56765f5ff I0425 08:13:14.167323 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.405959848s to process 1 records E0425 08:13:14.167386 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.407s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0425 08:13:14.168501 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0425 08:13:14.168515 1 periodic.go:209] Running workloads gatherer I0425 08:13:14.168530 1 tasks_processing.go:45] number of workers: 2 I0425 08:13:14.168538 1 tasks_processing.go:69] worker 1 listening for tasks. I0425 08:13:14.168542 1 tasks_processing.go:71] worker 1 working on workload_info task. I0425 08:13:14.168606 1 tasks_processing.go:69] worker 0 listening for tasks. I0425 08:13:14.168681 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0425 08:13:14.190330 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0425 08:13:14.193006 1 tasks_processing.go:74] worker 0 stopped. I0425 08:13:14.193022 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 24.306272ms to process 0 records I0425 08:13:14.198933 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (9ms) I0425 08:13:14.207259 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (8ms) I0425 08:13:14.215796 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (9ms) I0425 08:13:14.224163 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (8ms) I0425 08:13:14.232490 1 gather_workloads_info.go:387] No image sha256:e84cb128d930bd1ab867cc89b7b7bf2b2c0e41105ab93b5381069945b3ee9c57 (8ms) I0425 08:13:14.240606 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (8ms) I0425 08:13:14.249201 1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (9ms) I0425 08:13:14.258243 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (9ms) I0425 08:13:14.267124 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (9ms) I0425 08:13:14.276810 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (10ms) I0425 08:13:14.293874 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 08:13:14.299583 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (23ms) I0425 08:13:14.399089 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (99ms) I0425 08:13:14.493587 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 08:13:14.499023 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (100ms) I0425 08:13:14.599385 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0425 08:13:14.700389 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (101ms) I0425 08:13:14.799589 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (99ms) I0425 08:13:14.899201 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (100ms) I0425 08:13:15.000197 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (101ms) I0425 08:13:15.100407 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0425 08:13:15.200515 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms) I0425 08:13:15.299066 1 gather_workloads_info.go:387] No image sha256:ca1344cb64140188b7cae7bbc51fb751566c0b0c97d5e39b5850e628032c4a5e (99ms) I0425 08:13:15.399435 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0425 08:13:15.499407 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0425 08:13:15.600268 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (101ms) I0425 08:13:15.699277 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (99ms) I0425 08:13:15.798881 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0425 08:13:15.898842 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (100ms) I0425 08:13:15.999405 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (101ms) I0425 08:13:16.099882 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (100ms) I0425 08:13:16.199218 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (99ms) I0425 08:13:16.298567 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (99ms) I0425 08:13:16.398726 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (100ms) I0425 08:13:16.398749 1 tasks_processing.go:74] worker 1 stopped. E0425 08:13:16.398758 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0425 08:13:16.399085 1 recorder.go:75] Recording config/workload_info with fingerprint=1275f55894ecf02d8e178b1157cde198e44d2a5c0b3f68eee43f8b293480deff I0425 08:13:16.399100 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.230200587s to process 1 records E0425 08:13:16.399122 1 periodic.go:247] "Unhandled Error" err="workloads failed after 2.23s with: function \"workload_info\" failed with an error" I0425 08:13:16.400223 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0425 08:13:16.400235 1 periodic.go:209] Running conditional gatherer I0425 08:13:16.405756 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0425 08:13:16.411821 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.12:60969->172.30.0.10:53: read: connection refused E0425 08:13:16.412046 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0425 08:13:16.412119 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0425 08:13:16.417638 1 conditional_gatherer.go:392] cluster version is '4.20.8' E0425 08:13:16.417650 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 08:13:16.417655 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 08:13:16.417659 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 08:13:16.417662 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 08:13:16.417665 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 08:13:16.417668 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 08:13:16.417671 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 08:13:16.417674 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0425 08:13:16.417677 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0425 08:13:16.417691 1 tasks_processing.go:45] number of workers: 3 I0425 08:13:16.417713 1 tasks_processing.go:69] worker 2 listening for tasks. I0425 08:13:16.417719 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0425 08:13:16.417721 1 tasks_processing.go:69] worker 0 listening for tasks. I0425 08:13:16.417739 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0425 08:13:16.417739 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0425 08:13:16.417729 1 tasks_processing.go:69] worker 1 listening for tasks. I0425 08:13:16.417763 1 tasks_processing.go:74] worker 1 stopped. I0425 08:13:16.417789 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0425 08:13:16.417800 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.396µs to process 1 records I0425 08:13:16.417830 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0425 08:13:16.417836 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 2.523µs to process 1 records I0425 08:13:16.417842 1 tasks_processing.go:74] worker 0 stopped. I0425 08:13:16.417979 1 tasks_processing.go:74] worker 2 stopped. I0425 08:13:16.417993 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 227.028µs to process 0 records I0425 08:13:16.418018 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.12:60969->172.30.0.10:53: read: connection refused I0425 08:13:16.418037 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0425 08:13:16.439254 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=142a2f46d008db8c3164d9184ba64851d4e38bc27313b2e31cd0c61cd846a2a8 I0425 08:13:16.439389 1 diskrecorder.go:70] Writing 108 records to /var/lib/insights-operator/insights-2026-04-25-081316.tar.gz I0425 08:13:16.445798 1 diskrecorder.go:51] Wrote 108 records to disk in 6ms I0425 08:13:16.445829 1 periodic.go:278] Gathering cluster info every 2h0m0s I0425 08:13:16.445845 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0425 08:13:29.189224 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 08:14:30.760612 1 diskrecorder.go:223] Found files to send: insights-2026-04-25-081316.tar.gz I0425 08:14:30.760636 1 insightsuploader.go:150] Checking archives to upload periodically every 16m14.20909954s I0425 08:14:30.760644 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0425 08:14:30.772380 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0425 08:14:31.155100 1 requests.go:87] Successfully reported id=2026-04-25T08:14:30Z x-rh-insights-request-id=1151128cfec64102b88ecb7fe75e227b, wrote=50254 I0425 08:14:31.155145 1 insightsuploader.go:187] Uploaded report successfully in 394.49412ms I0425 08:14:31.155162 1 controller.go:128] Initializing last reported time to 2026-04-25T08:14:30Z I0425 08:14:31.155185 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0425 08:14:31.155193 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0425 08:14:31.155200 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0425 08:14:31.160919 1 controller.go:512] The operator is healthy I0425 08:14:35.578783 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="1c94767a8a1ea67b58452040694f11d228a72768b0633b0b49d4ec978cfcdbe3") W0425 08:14:35.578814 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0425 08:14:35.578856 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="fd94d4c8f74b794acfb59c84336652e57aedc9fff422ab8542e8767e15a17e7a") I0425 08:14:35.578860 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector