W0421 14:59:32.270852 1 cmd.go:257] Using insecure, self-signed certificates I0421 14:59:32.632704 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 14:59:32.633002 1 observer_polling.go:159] Starting file observer I0421 14:59:33.048166 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0421 14:59:33.048352 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0421 14:59:33.048932 1 secure_serving.go:57] Forcing use of http/1.1 only W0421 14:59:33.048953 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0421 14:59:33.048957 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0421 14:59:33.048961 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. I0421 14:59:33.048956 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0421 14:59:33.048964 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0421 14:59:33.048993 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0421 14:59:33.048998 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0421 14:59:33.053284 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0421 14:59:33.053305 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0421 14:59:33.053258 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0421 14:59:33.053379 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0421 14:59:33.053429 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0421 14:59:33.054185 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1751993263/tls.crt::/tmp/serving-cert-1751993263/tls.key" I0421 14:59:33.054257 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" I0421 14:59:33.054236 1 secure_serving.go:213] Serving securely on [::]:8443 I0421 14:59:33.054481 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0421 14:59:33.054502 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0421 14:59:33.054383 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"4a57c7ba-d3fa-44af-846e-9d692d13f8e0", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} W0421 14:59:33.058970 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0421 14:59:33.058992 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0421 14:59:33.059091 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0421 14:59:33.064463 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0421 14:59:33.064480 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0421 14:59:33.067783 1 secretconfigobserver.go:119] support secret does not exist I0421 14:59:33.071586 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0421 14:59:33.074856 1 secretconfigobserver.go:119] support secret does not exist I0421 14:59:33.077133 1 recorder.go:176] Pruning old reports every 4h35m15s, max age is 288h0m0s I0421 14:59:33.080821 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0421 14:59:33.080838 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0421 14:59:33.080850 1 periodic.go:216] Running clusterconfig gatherer I0421 14:59:33.080854 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0421 14:59:33.080859 1 insightsreport.go:296] Starting report retriever I0421 14:59:33.080863 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0421 14:59:33.080908 1 tasks_processing.go:45] number of workers: 64 I0421 14:59:33.080946 1 tasks_processing.go:69] worker 13 listening for tasks. I0421 14:59:33.080944 1 tasks_processing.go:69] worker 4 listening for tasks. I0421 14:59:33.080955 1 tasks_processing.go:69] worker 1 listening for tasks. I0421 14:59:33.080955 1 tasks_processing.go:69] worker 2 listening for tasks. I0421 14:59:33.080961 1 tasks_processing.go:69] worker 0 listening for tasks. I0421 14:59:33.080960 1 tasks_processing.go:69] worker 5 listening for tasks. I0421 14:59:33.080967 1 tasks_processing.go:71] worker 2 working on certificate_signing_requests task. I0421 14:59:33.080969 1 tasks_processing.go:69] worker 7 listening for tasks. I0421 14:59:33.080974 1 tasks_processing.go:71] worker 7 working on authentication task. I0421 14:59:33.080973 1 tasks_processing.go:71] worker 5 working on lokistack task. I0421 14:59:33.080974 1 tasks_processing.go:69] worker 3 listening for tasks. I0421 14:59:33.080981 1 tasks_processing.go:69] worker 41 listening for tasks. I0421 14:59:33.080976 1 tasks_processing.go:69] worker 53 listening for tasks. I0421 14:59:33.080984 1 tasks_processing.go:69] worker 40 listening for tasks. I0421 14:59:33.080989 1 tasks_processing.go:69] worker 42 listening for tasks. I0421 14:59:33.080993 1 tasks_processing.go:69] worker 63 listening for tasks. I0421 14:59:33.080967 1 tasks_processing.go:71] worker 0 working on ingress task. I0421 14:59:33.080996 1 tasks_processing.go:69] worker 14 listening for tasks. I0421 14:59:33.080999 1 tasks_processing.go:69] worker 43 listening for tasks. I0421 14:59:33.081005 1 tasks_processing.go:69] worker 15 listening for tasks. I0421 14:59:33.081003 1 tasks_processing.go:69] worker 60 listening for tasks. I0421 14:59:33.081009 1 tasks_processing.go:69] worker 44 listening for tasks. I0421 14:59:33.081013 1 tasks_processing.go:69] worker 54 listening for tasks. I0421 14:59:33.081016 1 tasks_processing.go:69] worker 16 listening for tasks. I0421 14:59:33.081017 1 tasks_processing.go:69] worker 46 listening for tasks. I0421 14:59:33.081013 1 tasks_processing.go:69] worker 45 listening for tasks. I0421 14:59:33.081024 1 tasks_processing.go:69] worker 29 listening for tasks. I0421 14:59:33.081025 1 tasks_processing.go:69] worker 55 listening for tasks. I0421 14:59:33.081012 1 tasks_processing.go:71] worker 4 working on cost_management_metrics_configs task. I0421 14:59:33.081032 1 tasks_processing.go:69] worker 57 listening for tasks. I0421 14:59:33.081036 1 tasks_processing.go:69] worker 31 listening for tasks. I0421 14:59:33.081038 1 tasks_processing.go:69] worker 48 listening for tasks. I0421 14:59:33.081030 1 tasks_processing.go:69] worker 47 listening for tasks. I0421 14:59:33.081030 1 tasks_processing.go:69] worker 30 listening for tasks. I0421 14:59:33.081046 1 tasks_processing.go:69] worker 32 listening for tasks. I0421 14:59:33.081047 1 tasks_processing.go:69] worker 56 listening for tasks. I0421 14:59:33.081044 1 tasks_processing.go:69] worker 28 listening for tasks. I0421 14:59:33.081049 1 tasks_processing.go:69] worker 49 listening for tasks. I0421 14:59:33.081057 1 tasks_processing.go:69] worker 51 listening for tasks. I0421 14:59:33.081058 1 tasks_processing.go:69] worker 23 listening for tasks. I0421 14:59:33.081065 1 tasks_processing.go:69] worker 10 listening for tasks. I0421 14:59:33.081066 1 tasks_processing.go:69] worker 52 listening for tasks. I0421 14:59:33.081054 1 tasks_processing.go:69] worker 22 listening for tasks. I0421 14:59:33.081063 1 tasks_processing.go:71] worker 1 working on container_images task. I0421 14:59:33.081074 1 tasks_processing.go:69] worker 24 listening for tasks. I0421 14:59:33.081077 1 tasks_processing.go:69] worker 19 listening for tasks. I0421 14:59:33.081066 1 tasks_processing.go:69] worker 17 listening for tasks. I0421 14:59:33.081080 1 tasks_processing.go:69] worker 9 listening for tasks. I0421 14:59:33.081084 1 tasks_processing.go:69] worker 25 listening for tasks. I0421 14:59:33.081054 1 tasks_processing.go:69] worker 50 listening for tasks. I0421 14:59:33.081085 1 tasks_processing.go:69] worker 20 listening for tasks. I0421 14:59:33.081093 1 tasks_processing.go:69] worker 21 listening for tasks. I0421 14:59:33.081087 1 tasks_processing.go:69] worker 37 listening for tasks. I0421 14:59:33.081098 1 tasks_processing.go:69] worker 36 listening for tasks. I0421 14:59:33.081097 1 tasks_processing.go:69] worker 62 listening for tasks. I0421 14:59:33.081102 1 tasks_processing.go:69] worker 12 listening for tasks. I0421 14:59:33.081105 1 tasks_processing.go:69] worker 58 listening for tasks. I0421 14:59:33.081101 1 tasks_processing.go:69] worker 27 listening for tasks. I0421 14:59:33.081104 1 tasks_processing.go:69] worker 61 listening for tasks. I0421 14:59:33.081132 1 tasks_processing.go:71] worker 53 working on openstack_dataplanenodesets task. I0421 14:59:33.081134 1 tasks_processing.go:71] worker 41 working on oauths task. I0421 14:59:33.081136 1 tasks_processing.go:71] worker 42 working on machine_config_pools task. I0421 14:59:33.081138 1 tasks_processing.go:71] worker 40 working on cluster_apiserver task. I0421 14:59:33.081142 1 tasks_processing.go:71] worker 63 working on operators task. I0421 14:59:33.081149 1 tasks_processing.go:71] worker 49 working on config_maps task. I0421 14:59:33.081152 1 tasks_processing.go:71] worker 29 working on image task. I0421 14:59:33.081154 1 tasks_processing.go:71] worker 23 working on crds task. I0421 14:59:33.081358 1 tasks_processing.go:71] worker 47 working on machine_sets task. I0421 14:59:33.081462 1 tasks_processing.go:71] worker 16 working on overlapping_namespace_uids task. I0421 14:59:33.081541 1 tasks_processing.go:71] worker 31 working on nodes task. I0421 14:59:33.081547 1 tasks_processing.go:71] worker 46 working on machines task. I0421 14:59:33.081559 1 tasks_processing.go:71] worker 57 working on machine_autoscalers task. I0421 14:59:33.081600 1 tasks_processing.go:71] worker 32 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0421 14:59:33.081468 1 tasks_processing.go:71] worker 45 working on sap_pods task. I0421 14:59:33.081760 1 tasks_processing.go:71] worker 36 working on proxies task. I0421 14:59:33.081767 1 tasks_processing.go:71] worker 12 working on install_plans task. I0421 14:59:33.081153 1 tasks_processing.go:71] worker 50 working on service_accounts task. I0421 14:59:33.081154 1 tasks_processing.go:71] worker 44 working on silenced_alerts task. I0421 14:59:33.081877 1 tasks_processing.go:71] worker 21 working on clusterroles task. I0421 14:59:33.081149 1 tasks_processing.go:71] worker 25 working on image_registries task. I0421 14:59:33.081362 1 tasks_processing.go:71] worker 54 working on image_pruners task. I0421 14:59:33.082134 1 tasks_processing.go:71] worker 62 working on feature_gates task. I0421 14:59:33.082204 1 tasks_processing.go:71] worker 15 working on machine_configs task. I0421 14:59:33.082217 1 tasks_processing.go:71] worker 37 working on operators_pods_and_events task. I0421 14:59:33.081094 1 tasks_processing.go:69] worker 26 listening for tasks. I0421 14:59:33.082340 1 tasks_processing.go:71] worker 26 working on machine_healthchecks task. I0421 14:59:33.080965 1 tasks_processing.go:69] worker 6 listening for tasks. I0421 14:59:33.081074 1 tasks_processing.go:69] worker 8 listening for tasks. I0421 14:59:33.082156 1 tasks_processing.go:71] worker 27 working on schedulers task. I0421 14:59:33.082711 1 tasks_processing.go:71] worker 8 working on pod_network_connectivity_checks task. I0421 14:59:33.081077 1 tasks_processing.go:69] worker 38 listening for tasks. I0421 14:59:33.083260 1 tasks_processing.go:71] worker 38 working on olm_operators task. I0421 14:59:33.081069 1 tasks_processing.go:69] worker 35 listening for tasks. I0421 14:59:33.081088 1 tasks_processing.go:69] worker 18 listening for tasks. I0421 14:59:33.083316 1 tasks_processing.go:71] worker 20 working on nodenetworkstates task. I0421 14:59:33.081059 1 tasks_processing.go:69] worker 34 listening for tasks. I0421 14:59:33.083403 1 tasks_processing.go:71] worker 6 working on ingress_certificates task. I0421 14:59:33.081108 1 tasks_processing.go:69] worker 11 listening for tasks. I0421 14:59:33.081126 1 tasks_processing.go:69] worker 59 listening for tasks. I0421 14:59:33.081130 1 tasks_processing.go:71] worker 3 working on jaegers task. I0421 14:59:33.081084 1 tasks_processing.go:69] worker 39 listening for tasks. I0421 14:59:33.083608 1 tasks_processing.go:71] worker 39 working on validating_webhook_configurations task. I0421 14:59:33.083771 1 tasks_processing.go:71] worker 59 working on sap_config task. I0421 14:59:33.081136 1 tasks_processing.go:71] worker 14 working on tsdb_status task. W0421 14:59:33.083966 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 14:59:33.083985 1 tasks_processing.go:71] worker 14 working on storage_cluster task. I0421 14:59:33.083988 1 tasks_processing.go:71] worker 35 working on ceph_cluster task. I0421 14:59:33.081054 1 tasks_processing.go:69] worker 33 listening for tasks. I0421 14:59:33.081144 1 tasks_processing.go:71] worker 9 working on version task. I0421 14:59:33.081155 1 tasks_processing.go:71] worker 52 working on sap_datahubs task. I0421 14:59:33.081156 1 tasks_processing.go:71] worker 48 working on metrics task. I0421 14:59:33.081156 1 tasks_processing.go:71] worker 30 working on node_features task. I0421 14:59:33.081345 1 tasks_processing.go:71] worker 43 working on openshift_logging task. I0421 14:59:33.081378 1 tasks_processing.go:71] worker 22 working on nodenetworkconfigurationpolicies task. I0421 14:59:33.081371 1 tasks_processing.go:71] worker 55 working on infrastructures task. I0421 14:59:33.081287 1 tasks_processing.go:71] worker 28 working on node_logs task. W0421 14:59:33.084617 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 14:59:33.081397 1 tasks_processing.go:71] worker 51 working on openstack_dataplanedeployments task. I0421 14:59:33.081490 1 tasks_processing.go:71] worker 24 working on pdbs task. I0421 14:59:33.081490 1 tasks_processing.go:71] worker 19 working on networks task. I0421 14:59:33.081497 1 tasks_processing.go:71] worker 17 working on container_runtime_configs task. I0421 14:59:33.081496 1 tasks_processing.go:71] worker 56 working on active_alerts task. W0421 14:59:33.081970 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 14:59:33.082163 1 tasks_processing.go:71] worker 58 working on openshift_machine_api_events task. W0421 14:59:33.084834 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 14:59:33.082170 1 tasks_processing.go:71] worker 60 working on aggregated_monitoring_cr_names task. I0421 14:59:33.081020 1 tasks_processing.go:71] worker 13 working on openstack_controlplanes task. I0421 14:59:33.083596 1 tasks_processing.go:71] worker 11 working on monitoring_persistent_volumes task. I0421 14:59:33.081144 1 tasks_processing.go:71] worker 61 working on dvo_metrics task. I0421 14:59:33.085018 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 104.941µs to process 0 records I0421 14:59:33.085034 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 590.655µs to process 0 records I0421 14:59:33.085042 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 2.983807ms to process 0 records I0421 14:59:33.085046 1 tasks_processing.go:71] worker 48 working on qemu_kubevirt_launcher_logs task. I0421 14:59:33.085057 1 tasks_processing.go:74] worker 56 stopped. I0421 14:59:33.085058 1 tasks_processing.go:74] worker 44 stopped. I0421 14:59:33.085069 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0421 14:59:33.085082 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0421 14:59:33.085048 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 27.129µs to process 0 records I0421 14:59:33.081481 1 tasks_processing.go:71] worker 10 working on storage_classes task. I0421 14:59:33.084769 1 tasks_processing.go:71] worker 34 working on openstack_version task. I0421 14:59:33.084775 1 tasks_processing.go:71] worker 18 working on mutating_webhook_configurations task. I0421 14:59:33.084504 1 tasks_processing.go:71] worker 33 working on support_secret task. I0421 14:59:33.085086 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0421 14:59:33.085268 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0421 14:59:33.085335 1 controller.go:531] The operator is still being initialized I0421 14:59:33.085349 1 controller.go:554] The operator is healthy I0421 14:59:33.085604 1 tasks_processing.go:74] worker 5 stopped. I0421 14:59:33.085619 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 4.618787ms to process 0 records I0421 14:59:33.086265 1 tasks_processing.go:74] worker 4 stopped. I0421 14:59:33.086279 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 5.226033ms to process 0 records I0421 14:59:33.086351 1 tasks_processing.go:74] worker 46 stopped. E0421 14:59:33.086361 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0421 14:59:33.086368 1 gather.go:177] gatherer "clusterconfig" function "machines" took 4.788869ms to process 0 records I0421 14:59:33.086498 1 tasks_processing.go:74] worker 7 stopped. I0421 14:59:33.086691 1 recorder.go:75] Recording config/authentication with fingerprint=a89a4fd97070392d58dc5553462dbe85da8414c5828fb6c137d4557c0dac0652 I0421 14:59:33.086705 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 5.513313ms to process 1 records I0421 14:59:33.087911 1 tasks_processing.go:74] worker 42 stopped. I0421 14:59:33.087921 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 6.765491ms to process 0 records I0421 14:59:33.087935 1 tasks_processing.go:74] worker 57 stopped. I0421 14:59:33.087945 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 6.362291ms to process 0 records I0421 14:59:33.087964 1 tasks_processing.go:74] worker 26 stopped. E0421 14:59:33.087974 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0421 14:59:33.087981 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 5.593228ms to process 0 records I0421 14:59:33.088173 1 tasks_processing.go:74] worker 41 stopped. I0421 14:59:33.088340 1 recorder.go:75] Recording config/oauth with fingerprint=9c76eab65767f89f4417d653ca22b5e9470b2019d97f75325aac9357ab614f3b I0421 14:59:33.088352 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 7.023771ms to process 1 records I0421 14:59:33.091004 1 tasks_processing.go:74] worker 8 stopped. E0421 14:59:33.091016 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0421 14:59:33.091024 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 8.259317ms to process 0 records I0421 14:59:33.091224 1 tasks_processing.go:74] worker 36 stopped. I0421 14:59:33.091282 1 recorder.go:75] Recording config/proxy with fingerprint=018798af7210987a4b23b4b18c0e6b9924043f345dfc926abcecdfa46d5e4787 I0421 14:59:33.091295 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 9.445793ms to process 1 records I0421 14:59:33.091377 1 tasks_processing.go:74] worker 40 stopped. I0421 14:59:33.091392 1 recorder.go:75] Recording config/apiserver with fingerprint=acccdf5483945ff27760ed563ca1ea61516025d862cd38d608c834aca3e9f403 I0421 14:59:33.091399 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 10.143408ms to process 1 records I0421 14:59:33.091492 1 tasks_processing.go:74] worker 54 stopped. I0421 14:59:33.091695 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=114050a4394272b0f450a910d0c950503de77b9c98c13366ac61f5d2d52ef34e I0421 14:59:33.091713 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 9.412506ms to process 1 records I0421 14:59:33.101047 1 tasks_processing.go:74] worker 20 stopped. I0421 14:59:33.101059 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 17.713124ms to process 0 records I0421 14:59:33.101066 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 19.91966ms to process 0 records I0421 14:59:33.101073 1 tasks_processing.go:74] worker 53 stopped. I0421 14:59:33.101099 1 tasks_processing.go:74] worker 3 stopped. I0421 14:59:33.101107 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 17.488163ms to process 0 records I0421 14:59:33.101154 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 17.108628ms to process 0 records I0421 14:59:33.101167 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 17.348527ms to process 0 records I0421 14:59:33.101176 1 tasks_processing.go:74] worker 59 stopped. I0421 14:59:33.101183 1 tasks_processing.go:74] worker 14 stopped. I0421 14:59:33.101351 1 tasks_processing.go:74] worker 29 stopped. I0421 14:59:33.101446 1 recorder.go:75] Recording config/image with fingerprint=193754af1717c0b9206e1f3207bb93b3d43e5f97dedd44232269471586d7a353 I0421 14:59:33.101470 1 gather.go:177] gatherer "clusterconfig" function "image" took 20.045307ms to process 1 records I0421 14:59:33.108773 1 tasks_processing.go:74] worker 13 stopped. I0421 14:59:33.108786 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 23.906487ms to process 0 records E0421 14:59:33.108842 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0421 14:59:33.108842 1 tasks_processing.go:74] worker 51 stopped. I0421 14:59:33.108849 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 24.201885ms to process 0 records I0421 14:59:33.108858 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 24.805829ms to process 0 records I0421 14:59:33.108863 1 tasks_processing.go:74] worker 30 stopped. I0421 14:59:33.109045 1 tasks_processing.go:74] worker 62 stopped. I0421 14:59:33.109241 1 recorder.go:75] Recording config/featuregate with fingerprint=00ba7d85d385a96b27aafdf9b624564186ee9aa9805f949cc95f57a0b0470e27 I0421 14:59:33.109254 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 26.843207ms to process 1 records I0421 14:59:33.109333 1 tasks_processing.go:74] worker 24 stopped. I0421 14:59:33.109358 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=5b9285a6aed5c410cb135476e429bf1fd6e2f7c243c50592b3f4285f69af7483 I0421 14:59:33.109374 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=4954527f1cd2b94e1ab4991b13dc23dc8a11f7ba27b385532db06f70bb494250 I0421 14:59:33.109391 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=8eb0cd36ba2c320f9d1617c141130e2ff2fe4ca916df6405f3dbfa21f03930dc I0421 14:59:33.109398 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 24.382005ms to process 3 records I0421 14:59:33.109402 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 25.085205ms to process 0 records I0421 14:59:33.109421 1 tasks_processing.go:74] worker 43 stopped. I0421 14:59:33.109494 1 tasks_processing.go:74] worker 19 stopped. I0421 14:59:33.110367 1 recorder.go:75] Recording config/network with fingerprint=49aa00aa898d80766b88105ea1c9deecccbe62d16e1f3588e1a6aa2a3b064129 I0421 14:59:33.110398 1 gather.go:177] gatherer "clusterconfig" function "networks" took 24.488667ms to process 1 records I0421 14:59:33.110661 1 tasks_processing.go:74] worker 55 stopped. I0421 14:59:33.111704 1 recorder.go:75] Recording config/infrastructure with fingerprint=5f26703438e2bf8c1311b6745882b74ca1c51ec680dbbff872b3e1dd2294a9d5 I0421 14:59:33.111720 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 24.635544ms to process 1 records I0421 14:59:33.111731 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 27.594392ms to process 0 records I0421 14:59:33.111736 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 25.375363ms to process 0 records I0421 14:59:33.111748 1 tasks_processing.go:74] worker 45 stopped. I0421 14:59:33.111756 1 tasks_processing.go:74] worker 35 stopped. I0421 14:59:33.111822 1 tasks_processing.go:74] worker 31 stopped. I0421 14:59:33.112002 1 recorder.go:75] Recording config/node/ip-10-0-0-80.ec2.internal with fingerprint=140df334c2961e998e7b25059409fd815843eaeb891e780acb2e4387f431a529 I0421 14:59:33.112064 1 recorder.go:75] Recording config/node/ip-10-0-1-145.ec2.internal with fingerprint=7e877a7b089e57b22a04fcdd86e2626cf5b3421ca3453813ac1a0a27a4d52304 I0421 14:59:33.112134 1 recorder.go:75] Recording config/node/ip-10-0-2-250.ec2.internal with fingerprint=5a842cf37128bf3680a9949fa7af281e89cb4de4ae1be5c872eb0703c8458def I0421 14:59:33.112145 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 27.88376ms to process 3 records I0421 14:59:33.112155 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 26.570824ms to process 0 records I0421 14:59:33.112160 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 25.220751ms to process 0 records I0421 14:59:33.112163 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 25.978952ms to process 0 records I0421 14:59:33.112167 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 28.609301ms to process 0 records I0421 14:59:33.112170 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 25.556233ms to process 0 records I0421 14:59:33.112171 1 tasks_processing.go:74] worker 38 stopped. I0421 14:59:33.112178 1 tasks_processing.go:74] worker 52 stopped. I0421 14:59:33.112180 1 tasks_processing.go:74] worker 47 stopped. I0421 14:59:33.112184 1 tasks_processing.go:74] worker 22 stopped. I0421 14:59:33.112193 1 tasks_processing.go:74] worker 17 stopped. I0421 14:59:33.112249 1 tasks_processing.go:74] worker 25 stopped. I0421 14:59:33.112461 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=9054098dff7b149d3451c4be7bd95f80cede30d26afd856d3e037770a65cd383 I0421 14:59:33.112472 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 28.674487ms to process 1 records I0421 14:59:33.112558 1 tasks_processing.go:74] worker 0 stopped. I0421 14:59:33.112567 1 recorder.go:75] Recording config/ingress with fingerprint=86a6ab07e7dfb7006a66c5d6ce6cde1e1914f0b817ec013951dddb212cbcdca4 I0421 14:59:33.112573 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 29.821445ms to process 1 records I0421 14:59:33.112655 1 tasks_processing.go:74] worker 39 stopped. I0421 14:59:33.112698 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=00b70f2963c77e1575143d53d0897fc4fed4e03f9a154d0b6578f8657af40d52 I0421 14:59:33.112772 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=0b70470e5d12053ffb108195170cabe99db998e63c3307469b178eff5785af18 I0421 14:59:33.112790 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=202ead32650ffa1a7a67b2d60bd55d923651d2213bf9ba0d75ce22992038de55 I0421 14:59:33.112814 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=43520daff2739bb29916b8f30b794d784f3b83c6d06abb035496c7f8958fca52 I0421 14:59:33.112838 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=f9a43cb7f1f4ba6d2e49588e93de40b35da4f01d8af7300f8a3ebaa08b9a352d I0421 14:59:33.112861 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=44fbb4c275e34b1c8cc27108b6a4bf4f2177570257e9e1250b8510d93011b511 I0421 14:59:33.112883 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=6fd1b20ba2eecf09f46e3d9529ab08a5b66f4f69c4a37ac7380c7f3e24a4298d I0421 14:59:33.112919 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=fcd4c777de177952a28531ea676deccf8e486219c7eb82ef4867d0933c6554fa I0421 14:59:33.112945 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=d7d977f33d1115ab6aa45d84bd056868998fae599552b6b9a0ebc2007afb5dd9 I0421 14:59:33.112967 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=8e572713850361c3a05a7f8976dcd627fc05d6f6a7a72109ee25ea034dad951e I0421 14:59:33.112988 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=0ea5ff94a305b9577864b3d29b5f982cbdbc4c66b8f14d08c0e7da2cff9946ef I0421 14:59:33.112996 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 27.283773ms to process 11 records I0421 14:59:33.113003 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 31.968777ms to process 0 records I0421 14:59:33.113009 1 tasks_processing.go:74] worker 2 stopped. I0421 14:59:33.119983 1 tasks_processing.go:74] worker 15 stopped. E0421 14:59:33.119996 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0421 14:59:33.120032 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0421 14:59:33.120056 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 37.756816ms to process 1 records I0421 14:59:33.120129 1 tasks_processing.go:74] worker 27 stopped. I0421 14:59:33.120140 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=c6968d6aea178b95e8ff3aba647cf994ad3b15ca535b0477ae20a81d9db8d2dd I0421 14:59:33.120148 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 37.39265ms to process 1 records I0421 14:59:33.120153 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 34.865783ms to process 0 records I0421 14:59:33.120156 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 35.134407ms to process 0 records I0421 14:59:33.120160 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 35.205018ms to process 0 records I0421 14:59:33.120165 1 tasks_processing.go:74] worker 58 stopped. I0421 14:59:33.120168 1 tasks_processing.go:74] worker 34 stopped. I0421 14:59:33.120172 1 tasks_processing.go:74] worker 11 stopped. I0421 14:59:33.120437 1 gather_logs.go:145] no pods in namespace were found I0421 14:59:33.120453 1 tasks_processing.go:74] worker 33 stopped. E0421 14:59:33.120467 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0421 14:59:33.120485 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 35.215613ms to process 0 records I0421 14:59:33.120493 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 35.394843ms to process 0 records I0421 14:59:33.120499 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 35.831052ms to process 0 records I0421 14:59:33.120508 1 tasks_processing.go:74] worker 28 stopped. I0421 14:59:33.120510 1 tasks_processing.go:74] worker 48 stopped. I0421 14:59:33.121181 1 tasks_processing.go:74] worker 10 stopped. I0421 14:59:33.121311 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=e14825d5b225ad20598ac401fec0b47279ee67f88d983f65d96880c2ac6c4563 I0421 14:59:33.121338 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=87bd591a74c49af23c2097cf8368422e59e1f90291b99bc56e9fa62765c7d2bd I0421 14:59:33.121348 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 36.077919ms to process 2 records I0421 14:59:33.121930 1 tasks_processing.go:74] worker 18 stopped. I0421 14:59:33.122050 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=397340711914136ca4d402b30f8750cada83505b207e367079b46adf51b8f50d I0421 14:59:33.122098 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=fc13e629a674ba777772cd7c709a0f486a49b90548a7a9116ac88474b1b4e030 I0421 14:59:33.122149 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=33b778c3360e3bbc786d63c0704e794128dd6f5ba0d7307f5cc7008d18d0c86e I0421 14:59:33.122162 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 36.696945ms to process 3 records I0421 14:59:33.122992 1 tasks_processing.go:74] worker 23 stopped. I0421 14:59:33.125495 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=173ec4c999961d02be06f719e30dd5139882ef8136ceab28e5bbc5ab0a70c8b4 I0421 14:59:33.126224 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=289f25261b3dab2b59d8a84cb652e895df2ccc20946d5df8a430c0db9ada363c I0421 14:59:33.126242 1 gather.go:177] gatherer "clusterconfig" function "crds" took 41.630866ms to process 2 records I0421 14:59:33.126329 1 tasks_processing.go:74] worker 21 stopped. I0421 14:59:33.126383 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=be94c8291b2cd3730a9d021898e9a80048fff431207c287cde6fa3f3d4490c5d I0421 14:59:33.126434 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0421 14:59:33.126449 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0421 14:59:33.126507 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=4bf30c9be29031d26ff4ff4a17e1eaf59f0e6ad852e5329aaab991193504bd3f W0421 14:59:33.126516 1 operator.go:328] started I0421 14:59:33.126518 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 41.273044ms to process 2 records I0421 14:59:33.126535 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0421 14:59:33.126538 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0421 14:59:33.126542 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 43.228362ms to process 1 records I0421 14:59:33.126550 1 tasks_processing.go:74] worker 16 stopped. W0421 14:59:33.128333 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0421 14:59:33.141922 1 tasks_processing.go:74] worker 60 stopped. I0421 14:59:33.141941 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 57.068356ms to process 0 records I0421 14:59:33.144659 1 tasks_processing.go:74] worker 1 stopped. I0421 14:59:33.146018 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-9vpd5 with fingerprint=ac28e2546b68ed1f8b31e3e510ba70c5363fc536dda1a76d3fd29bd558bc16b1 I0421 14:59:33.146069 1 recorder.go:75] Recording config/running_containers with fingerprint=2424da253a86ce63c51fe1d79aaaa035c774e9f61ed91ebf9866bf736651c070 I0421 14:59:33.146079 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 63.572349ms to process 2 records I0421 14:59:33.153975 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0421 14:59:33.153989 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0421 14:59:33.154914 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0421 14:59:33.154999 1 tasks_processing.go:74] worker 32 stopped. I0421 14:59:33.155015 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 73.383928ms to process 0 records I0421 14:59:33.159674 1 base_controller.go:82] Caches are synced for ConfigController I0421 14:59:33.159684 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0421 14:59:33.170648 1 prometheus_rules.go:88] Prometheus rules successfully created E0421 14:59:33.180022 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27e52ea8a4-b48e-4ebd-98fc-af88cc659d1e%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:55258->172.30.0.10:53: read: connection refused I0421 14:59:33.180036 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27e52ea8a4-b48e-4ebd-98fc-af88cc659d1e%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:55258->172.30.0.10:53: read: connection refused I0421 14:59:33.204938 1 controller.go:254] Source scaController *sca.Controller is not ready I0421 14:59:33.204950 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0421 14:59:33.204955 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0421 14:59:33.204959 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0421 14:59:33.204981 1 controller.go:531] The operator is still being initialized I0421 14:59:33.204988 1 controller.go:554] The operator is healthy I0421 14:59:33.226903 1 base_controller.go:82] Caches are synced for LoggingSyncer I0421 14:59:33.226916 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0421 14:59:33.239216 1 tasks_processing.go:74] worker 9 stopped. I0421 14:59:33.239426 1 recorder.go:75] Recording config/version with fingerprint=a2bfa3313bcf5163d534fea91a7919b590884b9e15187bb2cf7e234da18dcc20 I0421 14:59:33.239439 1 recorder.go:75] Recording config/id with fingerprint=c2f5e0f9fd5050cdd524b2162cfc0b07d9977098bb4ac3d31c6cb534eb3258a5 I0421 14:59:33.239445 1 gather.go:177] gatherer "clusterconfig" function "version" took 155.17967ms to process 2 records I0421 14:59:33.264147 1 configmapobserver.go:84] configmaps "insights-config" not found I0421 14:59:33.286085 1 tasks_processing.go:74] worker 49 stopped. E0421 14:59:33.286100 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0421 14:59:33.286106 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0421 14:59:33.286122 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0421 14:59:33.286131 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0421 14:59:33.286173 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0421 14:59:33.286181 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0421 14:59:33.286186 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0421 14:59:33.286190 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0421 14:59:33.286232 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0421 14:59:33.286242 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0421 14:59:33.286248 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 204.921083ms to process 7 records I0421 14:59:33.288844 1 tasks_processing.go:74] worker 6 stopped. E0421 14:59:33.288858 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0421 14:59:33.288866 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pqjtmvbm33oc5395jk2up7svnpqpdjs-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pqjtmvbm33oc5395jk2up7svnpqpdjs-primary-cert-bundle-secret" not found I0421 14:59:33.288910 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=9ebc704d494c02ef0dd93d502b79462b59cb04ae9d9b484d4aac965405bebd72 I0421 14:59:33.288923 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 205.426728ms to process 1 records I0421 14:59:33.327023 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0421 14:59:33.330082 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:42740->172.30.0.10:53: read: connection refused I0421 14:59:33.330094 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.10:42740->172.30.0.10:53: read: connection refused I0421 14:59:33.355997 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0421 14:59:33.372156 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0421 14:59:33.583987 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0421 14:59:33.584000 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0421 14:59:33.584726 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-bxk89 pod in namespace openshift-dns (previous: false). I0421 14:59:33.749382 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bxk89 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-bxk89\" is waiting to start: ContainerCreating" I0421 14:59:33.749400 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-bxk89\" is waiting to start: ContainerCreating" I0421 14:59:33.749407 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-bxk89 pod in namespace openshift-dns (previous: false). I0421 14:59:33.934751 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bxk89 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-bxk89\" is waiting to start: ContainerCreating" I0421 14:59:33.934769 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-bxk89\" is waiting to start: ContainerCreating" I0421 14:59:33.934779 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-ffsxb pod in namespace openshift-dns (previous: false). W0421 14:59:34.125463 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0421 14:59:34.157167 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-ffsxb pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-ffsxb\" is waiting to start: ContainerCreating" I0421 14:59:34.157182 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-ffsxb\" is waiting to start: ContainerCreating" I0421 14:59:34.157190 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-ffsxb pod in namespace openshift-dns (previous: false). I0421 14:59:34.335170 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-ffsxb pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-ffsxb\" is waiting to start: ContainerCreating" I0421 14:59:34.335184 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-ffsxb\" is waiting to start: ContainerCreating" I0421 14:59:34.335195 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-mfnhf pod in namespace openshift-dns (previous: false). I0421 14:59:34.554584 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mfnhf pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-mfnhf\" is waiting to start: ContainerCreating" I0421 14:59:34.554602 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-mfnhf\" is waiting to start: ContainerCreating" I0421 14:59:34.554610 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-mfnhf pod in namespace openshift-dns (previous: false). I0421 14:59:34.569407 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0421 14:59:34.735350 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mfnhf pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-mfnhf\" is waiting to start: ContainerCreating" I0421 14:59:34.735363 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-mfnhf\" is waiting to start: ContainerCreating" I0421 14:59:34.735372 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-6s9r5 pod in namespace openshift-dns (previous: false). I0421 14:59:34.933724 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 14:59:34.933737 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-mlp8m pod in namespace openshift-dns (previous: false). I0421 14:59:34.972165 1 tasks_processing.go:74] worker 63 stopped. I0421 14:59:34.972224 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=830468d3bc399a742798f112703437e0b2dab6806d00fc05657d8d63350a083d I0421 14:59:34.972275 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=9d8f4b7ca5c0ecda02d5e7a16d4c40fe165759ac815166125a9ec892b5493704 I0421 14:59:34.972304 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0421 14:59:34.972330 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=00c3a6a0f8c0e93a76097b3685dd292d9412c1a32b67c8c01de107bbc85e1a28 I0421 14:59:34.972348 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0421 14:59:34.972383 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=85ac77ec38b5d47bc1437166fd8d163d531246b1ab95de17c12ef363902fa6db I0421 14:59:34.972414 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=3137b1e3a3295c817c2611d7815aa2300c645f051fe534f569d75bac4656c5ff I0421 14:59:34.972439 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=9a623f37fc04cf52e502ed9ac686e3974585393d4747de0c9c162a8d763fdacc I0421 14:59:34.972451 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=c91486df6aa0c28bbe46a65046e715a4c844898eff2f1c0448ecdb1f9d1ff890 I0421 14:59:34.972467 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=ed61ea262e091173f3fa2f66234705288b59b882a01609f1961b6e2e26c143cd I0421 14:59:34.972477 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0421 14:59:34.972493 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=38b96baffe9219e558a3de8e8d3c9a568de809d956e719470b5b32d34e8a03f5 I0421 14:59:34.972503 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0421 14:59:34.972520 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=d38a604a82b625baf54ffadba9996bf810a4f36c27c34139a8662ebab99d0eaa I0421 14:59:34.972530 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0421 14:59:34.972542 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=09528158f3d72376af8eec939397a51f0ff0d8ce2e9f8094200900b5bf5a78e2 I0421 14:59:34.972551 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0421 14:59:34.972566 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=7e50671bff1fdac04e02a2e1b565a671062c540878f42a77fd1eed3475f114ba I0421 14:59:34.972705 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=e13ec15d3127d4f51c04f4d8edd39811ca605693da91b46f389fbe00b5d0ba48 I0421 14:59:34.972715 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0421 14:59:34.972723 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0421 14:59:34.972744 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0421 14:59:34.972768 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=36256302544839cfb7909c32d2fef64f8de01cb3bb9ee5b884f60616ef016800 I0421 14:59:34.972791 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=9a6e37a0af78f2b8ad58d131202855f967bdbdd63a63bafab36969a8cdd7d473 I0421 14:59:34.972800 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0421 14:59:34.972816 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=1241c737af0b3b299e6c9f55d3550245482d7982edff1ff4c3cf478a8cb31735 I0421 14:59:34.972825 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0421 14:59:34.972837 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=5d3500a7a61e72a0aeb47ef7ae1bb8d9a6d195276bf396c95aedafcb60aad380 I0421 14:59:34.972852 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=c6beb05641a73194683a2f49b4c8cc8f00c2477c510f6ae65eebe70fabf7fae6 I0421 14:59:34.972865 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=bfe92bed0665cdcd2d07b476d4cdbefc8154ea6b5da06d41165518d0cb783a77 I0421 14:59:34.972878 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=1bff035c5a28c5c46db91c69ea981f575c817ee77b185abf673029576597f22f I0421 14:59:34.972890 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=b973516c95a5d4d58dee587d914b00d04285b8ce70632e52579be4377ef29cf0 I0421 14:59:34.972919 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=93416a674fd705bba8ed04bfdf62cf4d1d374a16434da8f373cc647fbf25c8b3 I0421 14:59:34.972934 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0421 14:59:34.972941 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0421 14:59:34.972948 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.891005189s to process 35 records W0421 14:59:35.125167 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0421 14:59:35.154665 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 14:59:35.154678 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-qqpdb pod in namespace openshift-dns (previous: false). I0421 14:59:35.336195 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 14:59:35.336211 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-77fbd4bf84-m4fh6 pod in namespace openshift-image-registry (previous: false). I0421 14:59:35.538649 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-77fbd4bf84-m4fh6 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-77fbd4bf84-m4fh6\" is waiting to start: ContainerCreating" I0421 14:59:35.538667 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-77fbd4bf84-m4fh6\" is waiting to start: ContainerCreating" I0421 14:59:35.538678 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-c84f4bc9f-2g2lg pod in namespace openshift-image-registry (previous: false). I0421 14:59:35.736445 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-c84f4bc9f-2g2lg pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-c84f4bc9f-2g2lg\" is waiting to start: ContainerCreating" I0421 14:59:35.736461 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-c84f4bc9f-2g2lg\" is waiting to start: ContainerCreating" I0421 14:59:35.736473 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-c84f4bc9f-jlflm pod in namespace openshift-image-registry (previous: false). I0421 14:59:35.935723 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-c84f4bc9f-jlflm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-c84f4bc9f-jlflm\" is waiting to start: ContainerCreating" I0421 14:59:35.935737 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-c84f4bc9f-jlflm\" is waiting to start: ContainerCreating" I0421 14:59:35.935748 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-fsszs pod in namespace openshift-image-registry (previous: false). W0421 14:59:36.125335 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0421 14:59:36.134890 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 14:59:36.134905 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-t8dnh pod in namespace openshift-image-registry (previous: false). I0421 14:59:36.335157 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 14:59:36.335171 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-xdthz pod in namespace openshift-image-registry (previous: false). I0421 14:59:36.534348 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0421 14:59:36.534362 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-56fcddd55d-pmx62 pod in namespace openshift-ingress (previous: false). I0421 14:59:36.733566 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-56fcddd55d-pmx62 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-56fcddd55d-pmx62\" is waiting to start: ContainerCreating" I0421 14:59:36.733582 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-56fcddd55d-pmx62\" is waiting to start: ContainerCreating" I0421 14:59:36.733592 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-56fcddd55d-rvl6b pod in namespace openshift-ingress (previous: false). I0421 14:59:36.934941 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-56fcddd55d-rvl6b pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-56fcddd55d-rvl6b\" is waiting to start: ContainerCreating" I0421 14:59:36.934955 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-56fcddd55d-rvl6b\" is waiting to start: ContainerCreating" I0421 14:59:36.934967 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-57d867779-zjpj8 pod in namespace openshift-ingress (previous: false). W0421 14:59:37.125283 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0421 14:59:37.136589 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-57d867779-zjpj8 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-57d867779-zjpj8\" is waiting to start: ContainerCreating" I0421 14:59:37.136602 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-57d867779-zjpj8\" is waiting to start: ContainerCreating" I0421 14:59:37.136612 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-8m5k7 pod in namespace openshift-ingress-canary (previous: false). I0421 14:59:37.337918 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-flmzr pod in namespace openshift-ingress-canary (previous: false). I0421 14:59:37.537859 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-pth9b pod in namespace openshift-ingress-canary (previous: false). I0421 14:59:37.738164 1 tasks_processing.go:74] worker 37 stopped. I0421 14:59:37.738253 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=5886453f6440e9a07a0bc5b25f1d37eef221cf8e5f2f0ba838cdbee65bcf92a7 I0421 14:59:37.738305 1 recorder.go:75] Recording events/openshift-dns with fingerprint=50e566165944eac786b2489b2ebbf6d5e52a2cb2eb4ad70a7406cdfc624c726f I0421 14:59:37.738393 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=f25db2643d4473f27c4e9ae904f73d7e5ebe77864ad0a442c225fabe0083783d I0421 14:59:37.738420 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=ca507bd56d809c9a32b114fd80183b22f21ba1629106a530191fd804e6a030c2 I0421 14:59:37.738467 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=0db19b76a8c49e9e853556bbb3164455c756661382a619b68e4d11d9deead90b I0421 14:59:37.738504 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=bcab978bd7d230db06c6d3ceba69ee302e25445134d9efc24a6271252ce653e8 I0421 14:59:37.738511 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-8m5k7/serve-healthcheck-canary_current.log with fingerprint=1aaa3dcbfed70b55764caea9ffd420a63b146d6041f3d8fa8823eba21b6a6156 I0421 14:59:37.738516 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-flmzr/serve-healthcheck-canary_current.log with fingerprint=a7d24c01386cdc41fce7f8321e3f72789927ea39f39a6e5b1393fc51316db45f I0421 14:59:37.738519 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-pth9b/serve-healthcheck-canary_current.log with fingerprint=3298b81e6c21c7973845bdf3e6c223946a5079eb99d562fdad9f4c44a18f4a7c I0421 14:59:37.738526 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.655928597s to process 9 records W0421 14:59:38.125571 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0421 14:59:38.125597 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0421 14:59:38.125613 1 tasks_processing.go:74] worker 61 stopped. E0421 14:59:38.125625 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0421 14:59:38.125638 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0421 14:59:38.125654 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0421 14:59:38.125665 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.04068915s to process 1 records I0421 14:59:45.532275 1 tasks_processing.go:74] worker 12 stopped. I0421 14:59:45.532321 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0421 14:59:45.532335 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.450487868s to process 1 records I0421 14:59:46.122073 1 configmapobserver.go:84] configmaps "insights-config" not found I0421 14:59:46.289998 1 tasks_processing.go:74] worker 50 stopped. I0421 14:59:46.290302 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=7c1a3e3c431de69ce4ee6fb33aad2158a3d38446a91ec5899ca71ceaf725097e I0421 14:59:46.290323 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.208142517s to process 1 records E0421 14:59:46.290416 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.209s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0421 14:59:46.291538 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0421 14:59:46.291558 1 periodic.go:216] Running workloads gatherer I0421 14:59:46.291576 1 tasks_processing.go:45] number of workers: 2 I0421 14:59:46.291582 1 tasks_processing.go:69] worker 1 listening for tasks. I0421 14:59:46.291589 1 tasks_processing.go:71] worker 1 working on workload_info task. I0421 14:59:46.291593 1 tasks_processing.go:69] worker 0 listening for tasks. I0421 14:59:46.291611 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0421 14:59:46.301494 1 configmapobserver.go:84] configmaps "insights-config" not found I0421 14:59:46.311067 1 configmapobserver.go:84] configmaps "insights-config" not found I0421 14:59:46.317382 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0421 14:59:46.319377 1 tasks_processing.go:74] worker 0 stopped. I0421 14:59:46.319397 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 27.748882ms to process 0 records I0421 14:59:46.326430 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (10ms) I0421 14:59:46.335203 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (9ms) I0421 14:59:46.345048 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (10ms) I0421 14:59:46.358024 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (13ms) I0421 14:59:46.370266 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (12ms) I0421 14:59:46.383837 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (14ms) I0421 14:59:46.394248 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (10ms) I0421 14:59:46.404994 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (11ms) I0421 14:59:46.414233 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (9ms) I0421 14:59:46.422515 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (8ms) I0421 14:59:46.432214 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (10ms) I0421 14:59:46.504834 1 configmapobserver.go:84] configmaps "insights-config" not found I0421 14:59:46.526275 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (94ms) I0421 14:59:46.626210 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (100ms) I0421 14:59:46.725805 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms) I0421 14:59:46.825549 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (100ms) I0421 14:59:46.925449 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (100ms) I0421 14:59:47.025484 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (100ms) I0421 14:59:47.125889 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (100ms) I0421 14:59:47.226248 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (100ms) I0421 14:59:47.328088 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (102ms) I0421 14:59:47.425712 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (98ms) I0421 14:59:47.525198 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (99ms) I0421 14:59:47.625823 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (101ms) I0421 14:59:47.725328 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (99ms) I0421 14:59:47.828591 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (103ms) I0421 14:59:47.929049 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (100ms) I0421 14:59:48.033020 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (104ms) I0421 14:59:48.132001 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (99ms) I0421 14:59:48.235216 1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (103ms) I0421 14:59:48.337126 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (102ms) I0421 14:59:48.425409 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (88ms) I0421 14:59:48.528776 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (103ms) I0421 14:59:48.635864 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (107ms) I0421 14:59:48.635894 1 tasks_processing.go:74] worker 1 stopped. E0421 14:59:48.635903 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0421 14:59:48.636149 1 recorder.go:75] Recording config/workload_info with fingerprint=2611f29988f40c109e112fc95858fd3493c5988295d77c4ad6bfa9ab9c845add I0421 14:59:48.636165 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.344298337s to process 1 records E0421 14:59:48.636189 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.344s with: function \"workload_info\" failed with an error" I0421 14:59:48.637292 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0421 14:59:48.637306 1 periodic.go:216] Running conditional gatherer I0421 14:59:48.645708 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0421 14:59:48.653984 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.10:47009->172.30.0.10:53: read: connection refused E0421 14:59:48.654311 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0421 14:59:48.654366 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0421 14:59:48.659377 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0421 14:59:48.659388 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 14:59:48.659393 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 14:59:48.659396 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 14:59:48.659399 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 14:59:48.659402 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 14:59:48.659405 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 14:59:48.659408 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 14:59:48.659410 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0421 14:59:48.659413 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0421 14:59:48.659427 1 tasks_processing.go:45] number of workers: 3 I0421 14:59:48.659436 1 tasks_processing.go:69] worker 2 listening for tasks. I0421 14:59:48.659440 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0421 14:59:48.659447 1 tasks_processing.go:69] worker 0 listening for tasks. I0421 14:59:48.659464 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0421 14:59:48.659467 1 tasks_processing.go:69] worker 1 listening for tasks. I0421 14:59:48.659483 1 tasks_processing.go:74] worker 1 stopped. I0421 14:59:48.659479 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0421 14:59:48.659512 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0421 14:59:48.659524 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 698ns to process 1 records I0421 14:59:48.659553 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0421 14:59:48.659560 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.239µs to process 1 records I0421 14:59:48.659565 1 tasks_processing.go:74] worker 0 stopped. I0421 14:59:48.659718 1 tasks_processing.go:74] worker 2 stopped. I0421 14:59:48.659730 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 224.371µs to process 0 records I0421 14:59:48.659758 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.10:47009->172.30.0.10:53: read: connection refused I0421 14:59:48.659776 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0421 14:59:48.682051 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=69ffb046cda5c46a6df9ab3fca8043684a8345c63fd65af2a0d6ee21d1218191 I0421 14:59:48.682197 1 diskrecorder.go:70] Writing 103 records to /var/lib/insights-operator/insights-2026-04-21-145948.tar.gz I0421 14:59:48.688584 1 diskrecorder.go:51] Wrote 103 records to disk in 6ms I0421 14:59:48.688616 1 periodic.go:285] Gathering cluster info every 2h0m0s I0421 14:59:48.688638 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0421 15:00:52.633795 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="7eac90d36ada7686ebb73d6c2c6bdd47b7a6dd152c64ac76503c66adee943f78") W0421 15:00:52.633827 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0421 15:00:52.633870 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="8b9b377855cf8ebc313ea21b48ac835063de6f487d680697b9daf2831a220221")