W0422 23:37:18.567136 1 cmd.go:257] Using insecure, self-signed certificates I0422 23:37:19.177812 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0422 23:37:19.178203 1 observer_polling.go:159] Starting file observer I0422 23:37:19.454303 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0422 23:37:19.454498 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0422 23:37:19.455134 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0422 23:37:19.455615 1 secure_serving.go:57] Forcing use of http/1.1 only W0422 23:37:19.455641 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0422 23:37:19.455647 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0422 23:37:19.455654 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0422 23:37:19.455658 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0422 23:37:19.455663 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0422 23:37:19.455666 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0422 23:37:19.458515 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0422 23:37:19.458523 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"3520320e-0a22-4f67-86a2-313a4a8e0505", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0422 23:37:19.460941 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0422 23:37:19.460962 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0422 23:37:19.461020 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0422 23:37:19.461023 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0422 23:37:19.461057 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0422 23:37:19.461062 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0422 23:37:19.461312 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-161339814/tls.crt::/tmp/serving-cert-161339814/tls.key" I0422 23:37:19.461522 1 secure_serving.go:213] Serving securely on [::]:8443 I0422 23:37:19.461544 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0422 23:37:19.468599 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0422 23:37:19.468629 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0422 23:37:19.468729 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0422 23:37:19.474473 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0422 23:37:19.474495 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0422 23:37:19.486779 1 secretconfigobserver.go:119] support secret does not exist I0422 23:37:19.494993 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0422 23:37:19.500588 1 secretconfigobserver.go:119] support secret does not exist I0422 23:37:19.511883 1 recorder.go:176] Pruning old reports every 7h57m25s, max age is 288h0m0s I0422 23:37:19.517491 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0422 23:37:19.517510 1 periodic.go:216] Running clusterconfig gatherer I0422 23:37:19.517520 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0422 23:37:19.517493 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0422 23:37:19.517545 1 insightsreport.go:296] Starting report retriever I0422 23:37:19.517551 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0422 23:37:19.517555 1 tasks_processing.go:45] number of workers: 64 I0422 23:37:19.517591 1 tasks_processing.go:69] worker 4 listening for tasks. I0422 23:37:19.517609 1 tasks_processing.go:69] worker 2 listening for tasks. I0422 23:37:19.517609 1 tasks_processing.go:69] worker 1 listening for tasks. I0422 23:37:19.517620 1 tasks_processing.go:69] worker 3 listening for tasks. I0422 23:37:19.517623 1 tasks_processing.go:69] worker 0 listening for tasks. I0422 23:37:19.517628 1 tasks_processing.go:69] worker 5 listening for tasks. I0422 23:37:19.517629 1 tasks_processing.go:69] worker 6 listening for tasks. I0422 23:37:19.517630 1 tasks_processing.go:69] worker 7 listening for tasks. I0422 23:37:19.517638 1 tasks_processing.go:69] worker 20 listening for tasks. I0422 23:37:19.517634 1 tasks_processing.go:69] worker 15 listening for tasks. I0422 23:37:19.517640 1 tasks_processing.go:69] worker 9 listening for tasks. I0422 23:37:19.517644 1 tasks_processing.go:69] worker 16 listening for tasks. I0422 23:37:19.517646 1 tasks_processing.go:69] worker 8 listening for tasks. I0422 23:37:19.517657 1 tasks_processing.go:69] worker 23 listening for tasks. I0422 23:37:19.517658 1 tasks_processing.go:69] worker 22 listening for tasks. I0422 23:37:19.517665 1 tasks_processing.go:69] worker 24 listening for tasks. I0422 23:37:19.517671 1 tasks_processing.go:69] worker 19 listening for tasks. I0422 23:37:19.517662 1 tasks_processing.go:69] worker 17 listening for tasks. I0422 23:37:19.517665 1 tasks_processing.go:69] worker 10 listening for tasks. I0422 23:37:19.517679 1 tasks_processing.go:69] worker 14 listening for tasks. I0422 23:37:19.517671 1 tasks_processing.go:69] worker 12 listening for tasks. I0422 23:37:19.517680 1 tasks_processing.go:69] worker 11 listening for tasks. I0422 23:37:19.517674 1 tasks_processing.go:69] worker 21 listening for tasks. I0422 23:37:19.517689 1 tasks_processing.go:69] worker 18 listening for tasks. I0422 23:37:19.517699 1 tasks_processing.go:69] worker 25 listening for tasks. I0422 23:37:19.517746 1 tasks_processing.go:69] worker 33 listening for tasks. I0422 23:37:19.517755 1 tasks_processing.go:69] worker 37 listening for tasks. I0422 23:37:19.517761 1 tasks_processing.go:69] worker 39 listening for tasks. I0422 23:37:19.517764 1 tasks_processing.go:69] worker 34 listening for tasks. I0422 23:37:19.517767 1 tasks_processing.go:69] worker 27 listening for tasks. I0422 23:37:19.517762 1 tasks_processing.go:69] worker 26 listening for tasks. I0422 23:37:19.517773 1 tasks_processing.go:69] worker 35 listening for tasks. I0422 23:37:19.517778 1 tasks_processing.go:69] worker 38 listening for tasks. I0422 23:37:19.517778 1 tasks_processing.go:69] worker 36 listening for tasks. I0422 23:37:19.517783 1 tasks_processing.go:69] worker 30 listening for tasks. I0422 23:37:19.517789 1 tasks_processing.go:69] worker 41 listening for tasks. I0422 23:37:19.517786 1 tasks_processing.go:69] worker 32 listening for tasks. I0422 23:37:19.517781 1 tasks_processing.go:69] worker 31 listening for tasks. I0422 23:37:19.517778 1 tasks_processing.go:69] worker 40 listening for tasks. I0422 23:37:19.517799 1 tasks_processing.go:69] worker 42 listening for tasks. I0422 23:37:19.517792 1 tasks_processing.go:69] worker 28 listening for tasks. I0422 23:37:19.517790 1 tasks_processing.go:69] worker 29 listening for tasks. I0422 23:37:19.517784 1 tasks_processing.go:69] worker 13 listening for tasks. I0422 23:37:19.517847 1 tasks_processing.go:71] worker 13 working on support_secret task. I0422 23:37:19.517854 1 tasks_processing.go:71] worker 9 working on container_runtime_configs task. I0422 23:37:19.517860 1 tasks_processing.go:71] worker 37 working on node_logs task. I0422 23:37:19.517863 1 tasks_processing.go:71] worker 30 working on monitoring_persistent_volumes task. I0422 23:37:19.517869 1 tasks_processing.go:71] worker 16 working on nodes task. I0422 23:37:19.517874 1 tasks_processing.go:71] worker 40 working on cost_management_metrics_configs task. I0422 23:37:19.517903 1 tasks_processing.go:71] worker 42 working on openshift_logging task. I0422 23:37:19.517906 1 tasks_processing.go:69] worker 58 listening for tasks. I0422 23:37:19.517917 1 tasks_processing.go:71] worker 58 working on openstack_controlplanes task. I0422 23:37:19.517919 1 tasks_processing.go:71] worker 29 working on olm_operators task. I0422 23:37:19.517943 1 tasks_processing.go:69] worker 59 listening for tasks. I0422 23:37:19.517949 1 tasks_processing.go:71] worker 26 working on machine_config_pools task. I0422 23:37:19.517959 1 tasks_processing.go:71] worker 0 working on cluster_apiserver task. I0422 23:37:19.517963 1 tasks_processing.go:71] worker 1 working on schedulers task. I0422 23:37:19.517983 1 tasks_processing.go:71] worker 24 working on machine_autoscalers task. I0422 23:37:19.517995 1 tasks_processing.go:71] worker 59 working on operators_pods_and_events task. I0422 23:37:19.517880 1 tasks_processing.go:71] worker 28 working on oauths task. I0422 23:37:19.518044 1 tasks_processing.go:69] worker 43 listening for tasks. I0422 23:37:19.518558 1 tasks_processing.go:71] worker 35 working on storage_classes task. I0422 23:37:19.518614 1 tasks_processing.go:69] worker 60 listening for tasks. I0422 23:37:19.518632 1 tasks_processing.go:71] worker 60 working on feature_gates task. I0422 23:37:19.518647 1 tasks_processing.go:71] worker 34 working on install_plans task. I0422 23:37:19.518664 1 tasks_processing.go:71] worker 8 working on machine_healthchecks task. I0422 23:37:19.518736 1 tasks_processing.go:71] worker 36 working on ingress task. I0422 23:37:19.518748 1 tasks_processing.go:69] worker 61 listening for tasks. I0422 23:37:19.518756 1 tasks_processing.go:71] worker 61 working on aggregated_monitoring_cr_names task. I0422 23:37:19.518764 1 tasks_processing.go:71] worker 41 working on version task. I0422 23:37:19.518798 1 tasks_processing.go:69] worker 62 listening for tasks. I0422 23:37:19.518808 1 tasks_processing.go:71] worker 62 working on certificate_signing_requests task. I0422 23:37:19.518581 1 tasks_processing.go:71] worker 39 working on service_accounts task. I0422 23:37:19.518976 1 tasks_processing.go:71] worker 38 working on crds task. I0422 23:37:19.519058 1 tasks_processing.go:71] worker 27 working on sap_config task. I0422 23:37:19.517864 1 tasks_processing.go:71] worker 10 working on ingress_certificates task. I0422 23:37:19.519208 1 tasks_processing.go:71] worker 19 working on qemu_kubevirt_launcher_logs task. I0422 23:37:19.519690 1 tasks_processing.go:71] worker 23 working on dvo_metrics task. I0422 23:37:19.519867 1 tasks_processing.go:71] worker 14 working on machine_sets task. I0422 23:37:19.519908 1 tasks_processing.go:69] worker 44 listening for tasks. I0422 23:37:19.519965 1 tasks_processing.go:69] worker 63 listening for tasks. I0422 23:37:19.519976 1 tasks_processing.go:69] worker 45 listening for tasks. I0422 23:37:19.519979 1 tasks_processing.go:71] worker 4 working on machine_configs task. I0422 23:37:19.519984 1 tasks_processing.go:69] worker 46 listening for tasks. I0422 23:37:19.520010 1 tasks_processing.go:69] worker 47 listening for tasks. I0422 23:37:19.520013 1 tasks_processing.go:71] worker 22 working on storage_cluster task. I0422 23:37:19.520093 1 tasks_processing.go:71] worker 2 working on nodenetworkstates task. I0422 23:37:19.517955 1 tasks_processing.go:71] worker 3 working on openshift_machine_api_events task. I0422 23:37:19.520213 1 tasks_processing.go:71] worker 46 working on image task. I0422 23:37:19.520275 1 tasks_processing.go:71] worker 31 working on jaegers task. I0422 23:37:19.520319 1 tasks_processing.go:71] worker 25 working on pdbs task. I0422 23:37:19.518619 1 tasks_processing.go:71] worker 43 working on nodenetworkconfigurationpolicies task. I0422 23:37:19.520280 1 tasks_processing.go:69] worker 55 listening for tasks. I0422 23:37:19.520559 1 tasks_processing.go:71] worker 55 working on openstack_version task. I0422 23:37:19.520093 1 tasks_processing.go:71] worker 12 working on config_maps task. I0422 23:37:19.520122 1 tasks_processing.go:71] worker 32 working on silenced_alerts task. I0422 23:37:19.520182 1 tasks_processing.go:71] worker 21 working on authentication task. I0422 23:37:19.520188 1 tasks_processing.go:71] worker 47 working on overlapping_namespace_uids task. I0422 23:37:19.521450 1 tasks_processing.go:69] worker 51 listening for tasks. I0422 23:37:19.521464 1 tasks_processing.go:71] worker 51 working on clusterroles task. I0422 23:37:19.520186 1 tasks_processing.go:71] worker 5 working on metrics task. W0422 23:37:19.521550 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0422 23:37:19.520193 1 tasks_processing.go:71] worker 44 working on proxies task. I0422 23:37:19.521572 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 30.245µs to process 0 records I0422 23:37:19.520194 1 tasks_processing.go:71] worker 18 working on image_registries task. I0422 23:37:19.521672 1 tasks_processing.go:71] worker 5 working on openstack_dataplanedeployments task. I0422 23:37:19.520203 1 tasks_processing.go:71] worker 63 working on lokistack task. I0422 23:37:19.520208 1 tasks_processing.go:71] worker 45 working on sap_datahubs task. I0422 23:37:19.520215 1 tasks_processing.go:69] worker 50 listening for tasks. I0422 23:37:19.521819 1 tasks_processing.go:71] worker 50 working on operators task. I0422 23:37:19.520245 1 tasks_processing.go:71] worker 7 working on tsdb_status task. W0422 23:37:19.521848 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0422 23:37:19.520280 1 tasks_processing.go:69] worker 48 listening for tasks. I0422 23:37:19.520290 1 tasks_processing.go:71] worker 11 working on openstack_dataplanenodesets task. I0422 23:37:19.520415 1 tasks_processing.go:69] worker 57 listening for tasks. I0422 23:37:19.520311 1 tasks_processing.go:71] worker 17 working on active_alerts task. I0422 23:37:19.520477 1 tasks_processing.go:69] worker 52 listening for tasks. W0422 23:37:19.521285 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0422 23:37:19.521930 1 tasks_processing.go:71] worker 6 working on image_pruners task. W0422 23:37:19.521954 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0422 23:37:19.521874 1 tasks_processing.go:71] worker 33 working on networks task. I0422 23:37:19.522045 1 tasks_processing.go:71] worker 20 working on validating_webhook_configurations task. I0422 23:37:19.522054 1 tasks_processing.go:71] worker 7 working on machines task. I0422 23:37:19.522062 1 tasks_processing.go:71] worker 48 working on ceph_cluster task. I0422 23:37:19.522079 1 tasks_processing.go:71] worker 57 working on infrastructures task. I0422 23:37:19.522056 1 tasks_processing.go:71] worker 52 working on pod_network_connectivity_checks task. I0422 23:37:19.521916 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 72.436µs to process 0 records I0422 23:37:19.522178 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.13668ms to process 0 records I0422 23:37:19.522191 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 42.772µs to process 0 records I0422 23:37:19.522199 1 tasks_processing.go:71] worker 32 working on container_images task. I0422 23:37:19.521924 1 tasks_processing.go:69] worker 49 listening for tasks. I0422 23:37:19.522298 1 tasks_processing.go:71] worker 49 working on node_features task. I0422 23:37:19.522327 1 tasks_processing.go:69] worker 53 listening for tasks. I0422 23:37:19.522338 1 tasks_processing.go:71] worker 17 working on sap_pods task. I0422 23:37:19.522347 1 tasks_processing.go:71] worker 15 working on mutating_webhook_configurations task. I0422 23:37:19.522341 1 tasks_processing.go:71] worker 53 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0422 23:37:19.522477 1 tasks_processing.go:69] worker 54 listening for tasks. I0422 23:37:19.522492 1 tasks_processing.go:74] worker 54 stopped. I0422 23:37:19.522484 1 tasks_processing.go:69] worker 56 listening for tasks. I0422 23:37:19.522500 1 tasks_processing.go:74] worker 56 stopped. I0422 23:37:19.523032 1 tasks_processing.go:74] worker 9 stopped. I0422 23:37:19.523050 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 5.169524ms to process 0 records I0422 23:37:19.524311 1 tasks_processing.go:74] worker 8 stopped. E0422 23:37:19.524327 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0422 23:37:19.524339 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 5.573053ms to process 0 records I0422 23:37:19.526993 1 tasks_processing.go:74] worker 14 stopped. I0422 23:37:19.527005 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 7.105267ms to process 0 records I0422 23:37:19.527017 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 9.083235ms to process 0 records I0422 23:37:19.527025 1 tasks_processing.go:74] worker 42 stopped. I0422 23:37:19.527513 1 tasks_processing.go:74] worker 26 stopped. I0422 23:37:19.527528 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 9.543809ms to process 0 records I0422 23:37:19.528323 1 tasks_processing.go:74] worker 43 stopped. I0422 23:37:19.528338 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 7.789137ms to process 0 records I0422 23:37:19.528349 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 7.696355ms to process 0 records I0422 23:37:19.528355 1 tasks_processing.go:74] worker 55 stopped. I0422 23:37:19.528431 1 tasks_processing.go:74] worker 31 stopped. I0422 23:37:19.528448 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 8.104942ms to process 0 records I0422 23:37:19.529425 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0422 23:37:19.529441 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0422 23:37:19.529446 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0422 23:37:19.529449 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0422 23:37:19.529464 1 controller.go:531] The operator is still being initialized I0422 23:37:19.529470 1 controller.go:554] The operator is healthy I0422 23:37:19.533339 1 tasks_processing.go:74] worker 5 stopped. I0422 23:37:19.533352 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 11.648788ms to process 0 records I0422 23:37:19.534471 1 tasks_processing.go:74] worker 63 stopped. I0422 23:37:19.534479 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 12.735046ms to process 0 records I0422 23:37:19.534484 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 12.686202ms to process 0 records I0422 23:37:19.534488 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 12.544853ms to process 0 records I0422 23:37:19.534493 1 tasks_processing.go:74] worker 11 stopped. I0422 23:37:19.534502 1 tasks_processing.go:74] worker 45 stopped. I0422 23:37:19.534600 1 tasks_processing.go:74] worker 58 stopped. I0422 23:37:19.534614 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 16.67261ms to process 0 records I0422 23:37:19.535682 1 tasks_processing.go:74] worker 48 stopped. I0422 23:37:19.535694 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 13.607637ms to process 0 records I0422 23:37:19.537290 1 tasks_processing.go:74] worker 22 stopped. I0422 23:37:19.537301 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 17.251507ms to process 0 records I0422 23:37:19.537344 1 tasks_processing.go:74] worker 33 stopped. I0422 23:37:19.537534 1 recorder.go:75] Recording config/network with fingerprint=9ec85878aa227f92717dae6f86a3ba5b1826711c881cd961fa6e3a317b6d3e7f I0422 23:37:19.537549 1 gather.go:177] gatherer "clusterconfig" function "networks" took 15.289201ms to process 1 records E0422 23:37:19.550531 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0422 23:37:19.550549 1 tasks_processing.go:74] worker 49 stopped. I0422 23:37:19.550558 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 28.238939ms to process 0 records I0422 23:37:19.550638 1 tasks_processing.go:74] worker 46 stopped. I0422 23:37:19.550669 1 recorder.go:75] Recording config/image with fingerprint=f1e405fe44d01b24400469383a09e5c52c83e594e56efb83cbe68ca71df71670 I0422 23:37:19.550683 1 gather.go:177] gatherer "clusterconfig" function "image" took 30.282702ms to process 1 records I0422 23:37:19.552839 1 tasks_processing.go:74] worker 24 stopped. I0422 23:37:19.552931 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 34.844845ms to process 0 records I0422 23:37:19.552947 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 34.952758ms to process 0 records E0422 23:37:19.552954 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0422 23:37:19.552963 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 35.064925ms to process 0 records I0422 23:37:19.552971 1 tasks_processing.go:74] worker 13 stopped. I0422 23:37:19.552985 1 tasks_processing.go:74] worker 40 stopped. I0422 23:37:19.553272 1 tasks_processing.go:74] worker 21 stopped. I0422 23:37:19.553565 1 recorder.go:75] Recording config/authentication with fingerprint=1f50064f473648ebb33566eb2d1d69aaa398ac62769592c87e150df483e1ae07 I0422 23:37:19.553584 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 31.956194ms to process 1 records I0422 23:37:19.553591 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 34.48405ms to process 0 records I0422 23:37:19.553598 1 tasks_processing.go:74] worker 27 stopped. I0422 23:37:19.553802 1 tasks_processing.go:74] worker 44 stopped. I0422 23:37:19.553919 1 recorder.go:75] Recording config/proxy with fingerprint=181418a1812a6f55fc0b2fffb70838ab9e7f3bc067a74f4ca24280d3b9f4cebc I0422 23:37:19.553945 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 32.226747ms to process 1 records I0422 23:37:19.554059 1 tasks_processing.go:74] worker 36 stopped. I0422 23:37:19.554117 1 recorder.go:75] Recording config/ingress with fingerprint=f58bb92f719e13a19e234582b70cbc053f3647c240badd6517b28035a9503b23 I0422 23:37:19.554138 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 35.157528ms to process 1 records I0422 23:37:19.554148 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 36.027903ms to process 0 records I0422 23:37:19.554199 1 tasks_processing.go:74] worker 29 stopped. I0422 23:37:19.554272 1 recorder.go:75] Recording config/apiserver with fingerprint=b5eef391def601936d67b68af39bd1e4b434bb218d83a1057e2245f56730318b I0422 23:37:19.554284 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 36.031234ms to process 1 records I0422 23:37:19.554274 1 tasks_processing.go:74] worker 0 stopped. I0422 23:37:19.554291 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 36.352901ms to process 0 records I0422 23:37:19.554300 1 tasks_processing.go:74] worker 30 stopped. I0422 23:37:19.554795 1 tasks_processing.go:74] worker 28 stopped. I0422 23:37:19.555086 1 recorder.go:75] Recording config/oauth with fingerprint=e8b8e1e9db5101b97c320c05f867f213a0d05b358ed167aa0557590b92dc0ce2 I0422 23:37:19.555103 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 36.73385ms to process 1 records I0422 23:37:19.555206 1 tasks_processing.go:74] worker 2 stopped. I0422 23:37:19.555219 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 35.049772ms to process 0 records I0422 23:37:19.556031 1 tasks_processing.go:74] worker 17 stopped. I0422 23:37:19.556053 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 33.678156ms to process 0 records E0422 23:37:19.556066 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0422 23:37:19.556077 1 gather.go:177] gatherer "clusterconfig" function "machines" took 33.976243ms to process 0 records E0422 23:37:19.556097 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0422 23:37:19.556109 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 33.986329ms to process 0 records I0422 23:37:19.556120 1 tasks_processing.go:74] worker 52 stopped. I0422 23:37:19.556121 1 tasks_processing.go:74] worker 7 stopped. I0422 23:37:19.556273 1 tasks_processing.go:74] worker 57 stopped. I0422 23:37:19.557427 1 recorder.go:75] Recording config/infrastructure with fingerprint=b70976927ec7c268208d7087f6f3ef2338fc7096b112214f8bb47f94d72279fc I0422 23:37:19.557507 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 34.177142ms to process 1 records I0422 23:37:19.557566 1 tasks_processing.go:74] worker 6 stopped. I0422 23:37:19.558262 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=8c999e201c7eade4c6287b63a7b99493c9280219904aec2cb373308f6c5d590b I0422 23:37:19.558293 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 34.731114ms to process 1 records I0422 23:37:19.558352 1 tasks_processing.go:74] worker 1 stopped. I0422 23:37:19.558613 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=4770c70471c53bf2b2320068b948ab029745ddbfbc9a4ea1731ea91ec1643837 I0422 23:37:19.558643 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 40.214714ms to process 1 records I0422 23:37:19.558711 1 tasks_processing.go:74] worker 60 stopped. I0422 23:37:19.559334 1 recorder.go:75] Recording config/featuregate with fingerprint=b6513adb668d3382dbe03f669b6bac966ddbd3bb848524a5d7bd71a648991a3f I0422 23:37:19.559358 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 39.996499ms to process 1 records I0422 23:37:19.559368 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 40.984951ms to process 0 records I0422 23:37:19.559399 1 tasks_processing.go:74] worker 37 stopped. I0422 23:37:19.559477 1 tasks_processing.go:74] worker 15 stopped. I0422 23:37:19.559632 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=624a1104f3626d99e9d190878617d3adf1065c119febf78d59e1d55ad973fa06 I0422 23:37:19.559667 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=e6d05ef1c54a68d4c80eb74accd91b8fb93a3a06f3b823fa0f8492e7d5c30e88 I0422 23:37:19.559695 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=1559cc4084719df8caa419e3466d734e8c0feabecd0cec5b070224b7d60eddf2 I0422 23:37:19.559703 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 36.984744ms to process 3 records I0422 23:37:19.559795 1 tasks_processing.go:74] worker 18 stopped. I0422 23:37:19.560033 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=7406ee60204e257cbe8c5a9e13e7648ef9d4bb917760e5d9a96acdf0dbdd9a83 I0422 23:37:19.560047 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 37.969952ms to process 1 records I0422 23:37:19.560062 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0422 23:37:19.560067 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 38.596935ms to process 1 records I0422 23:37:19.560073 1 tasks_processing.go:74] worker 47 stopped. I0422 23:37:19.560241 1 tasks_processing.go:74] worker 62 stopped. I0422 23:37:19.560261 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 41.419993ms to process 0 records I0422 23:37:19.560297 1 gather_logs.go:145] no pods in namespace were found I0422 23:37:19.560311 1 tasks_processing.go:74] worker 19 stopped. I0422 23:37:19.560318 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 41.08723ms to process 0 records I0422 23:37:19.560564 1 tasks_processing.go:74] worker 16 stopped. I0422 23:37:19.561008 1 recorder.go:75] Recording config/node/ip-10-0-0-182.ec2.internal with fingerprint=d6e544216db4573539ae6e1bec952792c761b39faeb65cf860f8e1616b91c25f I0422 23:37:19.561091 1 recorder.go:75] Recording config/node/ip-10-0-1-69.ec2.internal with fingerprint=d36c41a4458948fc383523931e03be8e9a159a9f9ee2104e2095fdcad135a698 I0422 23:37:19.561098 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0422 23:37:19.561116 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0422 23:37:19.561178 1 recorder.go:75] Recording config/node/ip-10-0-2-213.ec2.internal with fingerprint=dbcde172ea57ae0c6da8916f2c6ab20f00369b10bdf75dbfb0b4e9ebca376749 I0422 23:37:19.561193 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 42.683916ms to process 3 records I0422 23:37:19.561091 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file W0422 23:37:19.562190 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0422 23:37:19.564041 1 tasks_processing.go:74] worker 4 stopped. E0422 23:37:19.564053 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0422 23:37:19.564082 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0422 23:37:19.564098 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 44.049515ms to process 1 records I0422 23:37:19.568012 1 tasks_processing.go:74] worker 35 stopped. I0422 23:37:19.568135 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=ab4f82f88c62a5dfe56a149f3ff9b61d54b833f8be45eb0b582021c90989c0c7 I0422 23:37:19.568164 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=31786ed739a50f1934e79d34335f77e0cf974157657a37a567fb7127e5f8f4fa I0422 23:37:19.568178 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 49.417937ms to process 2 records I0422 23:37:19.568917 1 base_controller.go:82] Caches are synced for ConfigController I0422 23:37:19.568934 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0422 23:37:19.570125 1 tasks_processing.go:74] worker 20 stopped. I0422 23:37:19.570376 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=1d796d7d8a3369ae4032fa4f81e1bfa505ec287398b0487f64f406e90521692a I0422 23:37:19.570515 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=4aae376b170aff316f3dfb70210d3decabf919cfb1db55baeec2dc4a7d4b655f I0422 23:37:19.570562 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=bedeefb5b315d1323d59ece98bc3a0044411e863d7ddc1ca81276d387a6c2f5e I0422 23:37:19.570607 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=e00374339cabd64949d20bca3eada2eca36c9c3bbba9d6c70b9cf69d6317a8c8 I0422 23:37:19.570657 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=161f27d3daa60a3d1b9328566cbc34976c3d434b1a4ca2cd3414b8d4263dc851 I0422 23:37:19.570698 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=e18eb0e97b2ead793d34a172ac3c23efe8af864706e62ec275e12731032b3fae I0422 23:37:19.570755 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=c9abdb214fee770af54baa121be14314cb415479c231e658a93dc58254a6e087 I0422 23:37:19.570835 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=bd101d86877b029a41c8636e0b735c14236008d396a5788ab44a82bae935f9a9 I0422 23:37:19.570877 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=f2981974dac27897b65b1ebb86773bc48e0c614f1c15be0ff31a868e2df1ce53 I0422 23:37:19.570946 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=f02d416c9e612128e43ac2eac2616aa6f942882ee096b7fa8aeddbc62acd02df I0422 23:37:19.570990 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=ff1fa0684e1cffa990d787f4fcbe4b90798fc061b747f1a38edcf503380b5741 I0422 23:37:19.571003 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 48.064321ms to process 11 records I0422 23:37:19.573227 1 tasks_processing.go:74] worker 25 stopped. I0422 23:37:19.573353 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=8b74bbbe17505b6865f3918b566b629e61cc2c965fe40f3ef5ae9f27e2806a34 I0422 23:37:19.573384 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=0b52e05af8e30579520d21e5258ea72b9911e996bf04b4f2586583248e6702eb I0422 23:37:19.573414 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=191121ce7ff5d3b491d8f3bb87946a2b1fda047ee5970ffa45df93eece2494e5 I0422 23:37:19.573426 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 52.732352ms to process 3 records I0422 23:37:19.573726 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0422 23:37:19.573734 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0422 23:37:19.573932 1 operator.go:328] started I0422 23:37:19.573961 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0422 23:37:19.579264 1 tasks_processing.go:74] worker 32 stopped. I0422 23:37:19.581314 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-phh4f with fingerprint=f44e2d92199a25725130399edf4bbf064c3f30a72995f3fabeede0a1e95c0de9 I0422 23:37:19.581371 1 recorder.go:75] Recording config/running_containers with fingerprint=23c899fbabc18dabe48c309033079c8ecaec36fb6709c28f3ff3346a0eb18b30 I0422 23:37:19.581381 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 57.052844ms to process 2 records I0422 23:37:19.582823 1 tasks_processing.go:74] worker 51 stopped. I0422 23:37:19.583005 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=001f413b2d7068c3e469798944c2fd73122e042638d81d492e2f3e73d03c167a I0422 23:37:19.583108 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=27415914c304784f5d5a93998f7c1415ab921d744a28c8b494973ab5ea0fcec0 I0422 23:37:19.583119 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 61.350325ms to process 2 records I0422 23:37:19.583206 1 tasks_processing.go:74] worker 38 stopped. I0422 23:37:19.583585 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=b530c49d827d298dea8052f83f6c980c43344adc8e3da1855feb8b2d6975d02c I0422 23:37:19.583791 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=e54accc2e5d306d9e2666dc2bc6ed5b71c8fb8c97ceba340869bf6344b27be69 I0422 23:37:19.583805 1 gather.go:177] gatherer "clusterconfig" function "crds" took 63.901436ms to process 2 records I0422 23:37:19.591504 1 tasks_processing.go:74] worker 3 stopped. I0422 23:37:19.591527 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 71.265957ms to process 0 records I0422 23:37:19.596807 1 tasks_processing.go:74] worker 53 stopped. I0422 23:37:19.596831 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 74.427428ms to process 0 records I0422 23:37:19.611800 1 prometheus_rules.go:88] Prometheus rules successfully created I0422 23:37:19.612172 1 configmapobserver.go:84] configmaps "insights-config" not found I0422 23:37:19.613307 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0422 23:37:19.613320 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0422 23:37:19.613323 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0422 23:37:19.613327 1 controller.go:254] Source scaController *sca.Controller is not ready I0422 23:37:19.613330 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0422 23:37:19.613349 1 controller.go:531] The operator is still being initialized I0422 23:37:19.613354 1 controller.go:554] The operator is healthy I0422 23:37:19.614144 1 tasks_processing.go:74] worker 61 stopped. I0422 23:37:19.614167 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 95.37583ms to process 0 records E0422 23:37:19.619775 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27cb3e9864-0a2d-49fb-b4e2-ec6be6625186%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:33748->172.30.0.10:53: read: connection refused I0422 23:37:19.619789 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27cb3e9864-0a2d-49fb-b4e2-ec6be6625186%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:33748->172.30.0.10:53: read: connection refused I0422 23:37:19.629585 1 tasks_processing.go:74] worker 12 stopped. E0422 23:37:19.629599 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0422 23:37:19.629605 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0422 23:37:19.629609 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0422 23:37:19.629622 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0422 23:37:19.629658 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0422 23:37:19.629665 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0422 23:37:19.629670 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0422 23:37:19.629674 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0422 23:37:19.629712 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0422 23:37:19.629720 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0422 23:37:19.629725 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 108.88208ms to process 7 records I0422 23:37:19.652023 1 tasks_processing.go:74] worker 41 stopped. I0422 23:37:19.652379 1 recorder.go:75] Recording config/version with fingerprint=9d630e8eed0298ee285fd97706656ebf320f8c5a5c2e7131d3ab32a0dd057ef3 I0422 23:37:19.652401 1 recorder.go:75] Recording config/id with fingerprint=5faedee61b0d707fecf8d1341ce6a15115c3867a8f45443506cee68b7ff4bdd1 I0422 23:37:19.652408 1 gather.go:177] gatherer "clusterconfig" function "version" took 133.243596ms to process 2 records I0422 23:37:19.661559 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0422 23:37:19.665017 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:39190->172.30.0.10:53: read: connection refused I0422 23:37:19.665031 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:39190->172.30.0.10:53: read: connection refused I0422 23:37:19.674508 1 base_controller.go:82] Caches are synced for LoggingSyncer I0422 23:37:19.674521 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0422 23:37:19.716988 1 tasks_processing.go:74] worker 10 stopped. E0422 23:37:19.717004 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0422 23:37:19.717013 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2prgjhduhjsungevuuvlv1ornuu76ung-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2prgjhduhjsungevuuvlv1ornuu76ung-primary-cert-bundle-secret" not found I0422 23:37:19.717082 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=181a5ebe1b70836912929f30470d1547b2f70d680083634ed4367911a6c830bd I0422 23:37:19.717096 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 197.830677ms to process 1 records I0422 23:37:19.971817 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0422 23:37:19.971833 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0422 23:37:19.972587 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-58gz9 pod in namespace openshift-dns (previous: false). I0422 23:37:20.198128 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-58gz9 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-58gz9\" is waiting to start: ContainerCreating" I0422 23:37:20.198151 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-58gz9\" is waiting to start: ContainerCreating" I0422 23:37:20.198160 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-58gz9 pod in namespace openshift-dns (previous: false). I0422 23:37:20.375407 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-58gz9 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-58gz9\" is waiting to start: ContainerCreating" I0422 23:37:20.375437 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-58gz9\" is waiting to start: ContainerCreating" I0422 23:37:20.375448 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-kt9vh pod in namespace openshift-dns (previous: false). W0422 23:37:20.558054 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0422 23:37:20.601746 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-kt9vh pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-kt9vh\" is waiting to start: ContainerCreating" I0422 23:37:20.601772 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-kt9vh\" is waiting to start: ContainerCreating" I0422 23:37:20.601782 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-kt9vh pod in namespace openshift-dns (previous: false). I0422 23:37:20.777055 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-kt9vh pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-kt9vh\" is waiting to start: ContainerCreating" I0422 23:37:20.777096 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-kt9vh\" is waiting to start: ContainerCreating" I0422 23:37:20.777252 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-lc88n pod in namespace openshift-dns (previous: false). I0422 23:37:21.002039 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-lc88n pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-lc88n\" is waiting to start: ContainerCreating" I0422 23:37:21.002063 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-lc88n\" is waiting to start: ContainerCreating" I0422 23:37:21.002071 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-lc88n pod in namespace openshift-dns (previous: false). I0422 23:37:21.011759 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0422 23:37:21.176610 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-lc88n pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-lc88n\" is waiting to start: ContainerCreating" I0422 23:37:21.176632 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-lc88n\" is waiting to start: ContainerCreating" I0422 23:37:21.176641 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-2dzsr pod in namespace openshift-dns (previous: false). I0422 23:37:21.377857 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0422 23:37:21.377881 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-7kjfq pod in namespace openshift-dns (previous: false). I0422 23:37:21.413773 1 tasks_processing.go:74] worker 50 stopped. I0422 23:37:21.413840 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=54424ed3b8dfe4ca2ffb12de4f6c53981791e0a598c8286e990467fdea728084 I0422 23:37:21.413921 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=fc01ed52cb098249a0af02e352e73c9c28d97825523cc59d9d6a33df499a7d56 I0422 23:37:21.413965 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0422 23:37:21.414006 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=03881bb6a2969815b3c9db77ab7f7d08a56802c358c38c1e1fd49dd9704f46d0 I0422 23:37:21.414036 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0422 23:37:21.414087 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=e3268c285f2e6cbd755668d1ec3aa87695e516e027ea197a0c6a5fade6404fee I0422 23:37:21.414132 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=7871c84a04b44e2f9931058f5815b84829c1fe7267b1a470b79da09b19fd0cf1 I0422 23:37:21.414172 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=253bb25128f59d6c0e9ae9247470c7140446665939e961488be2e4a52fc40570 I0422 23:37:21.414198 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=e720fd719453b51d8d4895eb5e91a217b2e8ca3182e3a275dde13d149ffc0bc1 I0422 23:37:21.414229 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=02d81610d2cf955622645758ce5d190fd5062d19a697440c347f3f6af9fae690 I0422 23:37:21.414245 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0422 23:37:21.414273 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=14d2a91a98108e67eb440254d81da13a864e4e21815007ba13db0c0b0ade8f80 I0422 23:37:21.414291 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0422 23:37:21.414321 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=30f591268256f7ad7d4415b47ad9459b4448b268811c81cbaf9880d198ef006a I0422 23:37:21.414337 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0422 23:37:21.414364 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=23129b55b42a5a72c84f87d2938a952bca36a596583a0178ae57808c34a1926e I0422 23:37:21.414379 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0422 23:37:21.414407 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=62a473f70eee2d9a7330a4809eb7fdb0279872d6f7d91f40797139451595ca8d I0422 23:37:21.414545 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=668de2ad583a3ee5a9c761142498ce490af02f6e40d208f70e47b90d47104ad5 I0422 23:37:21.414561 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0422 23:37:21.414574 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0422 23:37:21.414604 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0422 23:37:21.414642 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=c5f4b814b138ba7dca064940493133b7591653e8024a589d9b3a7590a6068756 I0422 23:37:21.414681 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=dfdbab5417b24fa743bac433fa3a9e1f2b8405f11cb63662ebc327f0d8445b2e I0422 23:37:21.414698 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0422 23:37:21.414726 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=0bf4f111d55101103f92cf9795c5cfb5fb00db325e73ddc3ed8138df15f406ec I0422 23:37:21.414741 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0422 23:37:21.414767 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=66ca9668ec6790189a454b4ca4f2ff1150acff384d2a901700348a141320cbb5 I0422 23:37:21.414793 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=7ab65a5dbe4c7d54d5854311fd5802725a898c723b5a71bac35bb00d4dae26c4 I0422 23:37:21.414821 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=77fc3843e24fd167604e43887f41fc3fe047fdd90d1ace96d4965942f39fc433 I0422 23:37:21.414851 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=0fb3c04567b1159c3c7f61e5bd237b2854003e8aff24d3ec98a612c7e2fce0fb I0422 23:37:21.414874 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=a7ee72a5d065dcc925981df628dd1698fac32abe31298d031768b468644f7587 I0422 23:37:21.414935 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=2d9668f7044e1f390f770c3e5139df0a1966fe08f2893af80c2010cf90c7a651 I0422 23:37:21.414964 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0422 23:37:21.414977 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0422 23:37:21.414990 1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.891931123s to process 35 records W0422 23:37:21.557466 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0422 23:37:21.576449 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0422 23:37:21.576466 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-ljhk4 pod in namespace openshift-dns (previous: false). I0422 23:37:21.775385 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0422 23:37:21.775445 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5bf6dcdd8b-5lxg8 pod in namespace openshift-image-registry (previous: false). I0422 23:37:21.976067 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5bf6dcdd8b-5lxg8 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5bf6dcdd8b-5lxg8\" is waiting to start: ContainerCreating" I0422 23:37:21.976085 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5bf6dcdd8b-5lxg8\" is waiting to start: ContainerCreating" I0422 23:37:21.976118 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5bf6dcdd8b-74gmm pod in namespace openshift-image-registry (previous: false). I0422 23:37:22.176084 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5bf6dcdd8b-74gmm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5bf6dcdd8b-74gmm\" is waiting to start: ContainerCreating" I0422 23:37:22.176104 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5bf6dcdd8b-74gmm\" is waiting to start: ContainerCreating" I0422 23:37:22.176140 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-bd7f9fb89-jchlr pod in namespace openshift-image-registry (previous: false). I0422 23:37:22.374075 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-bd7f9fb89-jchlr pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-bd7f9fb89-jchlr\" is waiting to start: ContainerCreating" I0422 23:37:22.374100 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-bd7f9fb89-jchlr\" is waiting to start: ContainerCreating" I0422 23:37:22.374116 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6hsfn pod in namespace openshift-image-registry (previous: false). W0422 23:37:22.557908 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0422 23:37:22.581995 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0422 23:37:22.582014 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-82tpb pod in namespace openshift-image-registry (previous: false). I0422 23:37:22.775452 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0422 23:37:22.775471 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-f8st6 pod in namespace openshift-image-registry (previous: false). I0422 23:37:22.976722 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0422 23:37:22.976766 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6f668548f8-7p9rw pod in namespace openshift-ingress (previous: false). I0422 23:37:23.174572 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6f668548f8-7p9rw pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6f668548f8-7p9rw\" is waiting to start: ContainerCreating" I0422 23:37:23.174597 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6f668548f8-7p9rw\" is waiting to start: ContainerCreating" I0422 23:37:23.174612 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6f668548f8-h5sdz pod in namespace openshift-ingress (previous: false). I0422 23:37:23.376605 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6f668548f8-h5sdz pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6f668548f8-h5sdz\" is waiting to start: ContainerCreating" I0422 23:37:23.376624 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6f668548f8-h5sdz\" is waiting to start: ContainerCreating" I0422 23:37:23.376637 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7d9d9c7c9f-jqhrv pod in namespace openshift-ingress (previous: false). W0422 23:37:23.557748 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0422 23:37:23.574723 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-7d9d9c7c9f-jqhrv pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-7d9d9c7c9f-jqhrv\" is waiting to start: ContainerCreating" I0422 23:37:23.574742 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-7d9d9c7c9f-jqhrv\" is waiting to start: ContainerCreating" I0422 23:37:23.574753 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-8ldkb pod in namespace openshift-ingress-canary (previous: false). I0422 23:37:23.777188 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-jj7gd pod in namespace openshift-ingress-canary (previous: false). I0422 23:37:23.977044 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-ksk75 pod in namespace openshift-ingress-canary (previous: false). I0422 23:37:24.176171 1 tasks_processing.go:74] worker 59 stopped. I0422 23:37:24.176291 1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=f657ed557c16739eb3e61864c842b94498b462a661f61e42d937e41c2c10c3dd I0422 23:37:24.176360 1 recorder.go:75] Recording events/openshift-dns with fingerprint=3a273337fed39031bbcea8b39372d3c604078325d17bf2928f3c0bdca010718d I0422 23:37:24.176466 1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=4bec1d947582863a917d5b233a83a4104c7e86f738c4c35a24b360c89d63da45 I0422 23:37:24.176517 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=ae991c046db8aa65d5977df5dbb4fead8798234351bd179f72f1950868063234 I0422 23:37:24.176578 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=f3e0359d04954664b9a1f8cd296d730eb99d4fa323f783682dda5607fb26e1dd I0422 23:37:24.176630 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=c996942edc94fc0def5e761434184b9f6072536bfa77d3cdabe848852edecb54 I0422 23:37:24.176801 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5bf6dcdd8b-5lxg8 with fingerprint=870b557a9c91665cb36a7ca3c5a71ccd29d6003d3e7e52a3ec187fd0e6feb69a I0422 23:37:24.176942 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5bf6dcdd8b-74gmm with fingerprint=c60c449c3b5f0ffe52f695373abe445a1c4bd46dde8bc69023c99ce8d50e2aab I0422 23:37:24.177051 1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-bd7f9fb89-jchlr with fingerprint=e3e3468eaa271e7703b917d3b4c04f3ef67ee3ea3cc99763160d54e4b4d34732 I0422 23:37:24.177065 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-8ldkb/serve-healthcheck-canary_current.log with fingerprint=ecdc45722f9ffa091512ba29fe63a78adc9c6edbd7c21182ff155c1292f7a9cd I0422 23:37:24.177073 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-jj7gd/serve-healthcheck-canary_current.log with fingerprint=ee4c5d4ffe8e1fa261de9086bae746c87e9e1b0ce6f60ca6fa7692c2d40e136e I0422 23:37:24.177082 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-ksk75/serve-healthcheck-canary_current.log with fingerprint=3c896085d85b9e9a0737d50a1f0913012505cb5e49890869f3908450348b2a52 I0422 23:37:24.177094 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.658156951s to process 12 records W0422 23:37:24.557349 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0422 23:37:24.557374 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0422 23:37:24.557389 1 tasks_processing.go:74] worker 23 stopped. E0422 23:37:24.557400 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0422 23:37:24.557411 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0422 23:37:24.557426 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0422 23:37:24.557440 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.037681908s to process 1 records I0422 23:37:31.967560 1 tasks_processing.go:74] worker 34 stopped. I0422 23:37:31.967599 1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0422 23:37:31.967610 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.448890051s to process 1 records I0422 23:37:32.531912 1 configmapobserver.go:84] configmaps "insights-config" not found I0422 23:37:32.730165 1 tasks_processing.go:74] worker 39 stopped. I0422 23:37:32.730421 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=7c1a3e3c431de69ce4ee6fb33aad2158a3d38446a91ec5899ca71ceaf725097e I0422 23:37:32.730437 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.211190495s to process 1 records E0422 23:37:32.730495 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.212s with: function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0422 23:37:32.731605 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0422 23:37:32.731622 1 periodic.go:216] Running workloads gatherer I0422 23:37:32.731639 1 tasks_processing.go:45] number of workers: 2 I0422 23:37:32.731648 1 tasks_processing.go:69] worker 1 listening for tasks. I0422 23:37:32.731654 1 tasks_processing.go:71] worker 1 working on workload_info task. I0422 23:37:32.731660 1 tasks_processing.go:69] worker 0 listening for tasks. I0422 23:37:32.731678 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0422 23:37:32.757078 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0422 23:37:32.766666 1 tasks_processing.go:74] worker 0 stopped. I0422 23:37:32.766689 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 34.966336ms to process 0 records I0422 23:37:32.768040 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (12ms) I0422 23:37:32.777438 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (9ms) I0422 23:37:32.787083 1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (10ms) I0422 23:37:32.796660 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (10ms) I0422 23:37:32.807041 1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (10ms) I0422 23:37:32.817203 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (10ms) I0422 23:37:32.826918 1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (10ms) I0422 23:37:32.839167 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (12ms) I0422 23:37:32.848631 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (9ms) I0422 23:37:32.860795 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (12ms) I0422 23:37:32.869966 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (9ms) I0422 23:37:32.968174 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (98ms) I0422 23:37:33.067781 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (100ms) I0422 23:37:33.168334 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (101ms) I0422 23:37:33.267832 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (99ms) I0422 23:37:33.368637 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (101ms) I0422 23:37:33.468429 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (100ms) I0422 23:37:33.567791 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (99ms) I0422 23:37:33.671688 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (104ms) I0422 23:37:33.779614 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (108ms) I0422 23:37:33.873238 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (94ms) I0422 23:37:33.976360 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (103ms) I0422 23:37:34.077563 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (101ms) I0422 23:37:34.173765 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (96ms) I0422 23:37:34.273556 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (100ms) I0422 23:37:34.387919 1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (114ms) I0422 23:37:34.479036 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (91ms) I0422 23:37:34.568561 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (90ms) I0422 23:37:34.667512 1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (99ms) I0422 23:37:34.768048 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (101ms) I0422 23:37:34.864246 1 configmapobserver.go:84] configmaps "insights-config" not found I0422 23:37:34.868264 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (100ms) I0422 23:37:34.968513 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (100ms) I0422 23:37:35.065851 1 configmapobserver.go:84] configmaps "insights-config" not found I0422 23:37:35.068399 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (100ms) I0422 23:37:35.068431 1 tasks_processing.go:74] worker 1 stopped. E0422 23:37:35.068444 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0422 23:37:35.068709 1 recorder.go:75] Recording config/workload_info with fingerprint=4c74d426acb3d4314d624f97ff950e39e1131c9d037fcd19f8f2428449c3cdcc I0422 23:37:35.068724 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.336770172s to process 1 records E0422 23:37:35.068748 1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.337s with: function \"workload_info\" failed with an error" I0422 23:37:35.069850 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0422 23:37:35.069861 1 periodic.go:216] Running conditional gatherer I0422 23:37:35.075974 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0422 23:37:35.082926 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.13:53598->172.30.0.10:53: read: connection refused E0422 23:37:35.083260 1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0422 23:37:35.083325 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0422 23:37:35.089521 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0422 23:37:35.089540 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0422 23:37:35.089546 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0422 23:37:35.089549 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0422 23:37:35.089552 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0422 23:37:35.089556 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0422 23:37:35.089559 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0422 23:37:35.089562 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0422 23:37:35.089565 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0422 23:37:35.089568 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0422 23:37:35.089583 1 tasks_processing.go:45] number of workers: 3 I0422 23:37:35.089596 1 tasks_processing.go:69] worker 2 listening for tasks. I0422 23:37:35.089601 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0422 23:37:35.089606 1 tasks_processing.go:69] worker 0 listening for tasks. I0422 23:37:35.089618 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0422 23:37:35.089618 1 tasks_processing.go:69] worker 1 listening for tasks. I0422 23:37:35.089624 1 tasks_processing.go:71] worker 0 working on conditional_gatherer_rules task. I0422 23:37:35.089630 1 tasks_processing.go:74] worker 1 stopped. I0422 23:37:35.089689 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0422 23:37:35.089707 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.435µs to process 1 records I0422 23:37:35.089769 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0422 23:37:35.089777 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 569ns to process 1 records I0422 23:37:35.089784 1 tasks_processing.go:74] worker 0 stopped. I0422 23:37:35.089842 1 tasks_processing.go:74] worker 2 stopped. I0422 23:37:35.089853 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 233.31µs to process 0 records I0422 23:37:35.089873 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.13:53598->172.30.0.10:53: read: connection refused I0422 23:37:35.089908 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0422 23:37:35.115522 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=e442e1d6b4fae1fe018238139641430c11e9e837c2073d97138b13abf04c8738 I0422 23:37:35.115708 1 diskrecorder.go:70] Writing 106 records to /var/lib/insights-operator/insights-2026-04-22-233735.tar.gz I0422 23:37:35.122409 1 diskrecorder.go:51] Wrote 106 records to disk in 6ms I0422 23:37:35.122450 1 periodic.go:285] Gathering cluster info every 2h0m0s I0422 23:37:35.122475 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0422 23:37:50.014286 1 configmapobserver.go:84] configmaps "insights-config" not found I0422 23:38:39.179154 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="702e0713ea4eaaba5c66e6c9136daf86987e41aab6627cb3c3f1591dcc66039a") W0422 23:38:39.179188 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0422 23:38:39.179233 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="5ae77a35a353e6514ef9595e593989a53d42ef75688fe2ca868ba1e08a07ddbb") I0422 23:38:39.179246 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0422 23:38:39.179310 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="ad2b7bd66a1c5328c37660d48dd679a74a411aec9ea313207b35654446710306")