I0419 18:47:55.012154 1 cmd.go:253] Using service-serving-cert provided certificates I0419 18:47:55.012594 1 observer_polling.go:159] Starting file observer I0419 18:47:55.495865 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0419 18:47:55.496067 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0419 18:47:55.496734 1 secure_serving.go:57] Forcing use of http/1.1 only W0419 18:47:55.496760 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0419 18:47:55.496768 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. I0419 18:47:55.496770 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0419 18:47:55.496775 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0419 18:47:55.496809 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0419 18:47:55.496821 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0419 18:47:55.496826 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0419 18:47:55.501182 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0419 18:47:55.501193 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"c9a79d31-6253-4e0b-bbcd-e950a72f0a7d", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0419 18:47:55.502064 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0419 18:47:55.502075 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0419 18:47:55.502086 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0419 18:47:55.502083 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0419 18:47:55.502099 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0419 18:47:55.502089 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0419 18:47:55.502518 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0419 18:47:55.503035 1 secure_serving.go:213] Serving securely on [::]:8443 I0419 18:47:55.503144 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0419 18:47:55.506947 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0419 18:47:55.506977 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0419 18:47:55.507081 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0419 18:47:55.512607 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0419 18:47:55.512626 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0419 18:47:55.517357 1 secretconfigobserver.go:119] support secret does not exist I0419 18:47:55.522300 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0419 18:47:55.529818 1 secretconfigobserver.go:119] support secret does not exist I0419 18:47:55.532592 1 recorder.go:176] Pruning old reports every 6h38m47s, max age is 288h0m0s I0419 18:47:55.538369 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0419 18:47:55.538387 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0419 18:47:55.538384 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0419 18:47:55.538405 1 periodic.go:216] Running clusterconfig gatherer I0419 18:47:55.538444 1 tasks_processing.go:45] number of workers: 64 I0419 18:47:55.538488 1 tasks_processing.go:69] worker 18 listening for tasks. I0419 18:47:55.538498 1 tasks_processing.go:69] worker 41 listening for tasks. I0419 18:47:55.538502 1 tasks_processing.go:71] worker 18 working on operators task. I0419 18:47:55.538505 1 tasks_processing.go:69] worker 53 listening for tasks. I0419 18:47:55.538511 1 tasks_processing.go:69] worker 19 listening for tasks. I0419 18:47:55.538512 1 tasks_processing.go:69] worker 59 listening for tasks. I0419 18:47:55.538512 1 tasks_processing.go:69] worker 52 listening for tasks. I0419 18:47:55.538519 1 tasks_processing.go:69] worker 60 listening for tasks. I0419 18:47:55.538522 1 tasks_processing.go:69] worker 42 listening for tasks. I0419 18:47:55.538526 1 tasks_processing.go:69] worker 61 listening for tasks. I0419 18:47:55.538525 1 tasks_processing.go:69] worker 58 listening for tasks. I0419 18:47:55.538532 1 tasks_processing.go:69] worker 62 listening for tasks. I0419 18:47:55.538532 1 tasks_processing.go:69] worker 43 listening for tasks. I0419 18:47:55.538531 1 tasks_processing.go:69] worker 20 listening for tasks. I0419 18:47:55.538535 1 tasks_processing.go:69] worker 21 listening for tasks. I0419 18:47:55.538540 1 tasks_processing.go:69] worker 22 listening for tasks. I0419 18:47:55.538540 1 tasks_processing.go:69] worker 54 listening for tasks. I0419 18:47:55.538539 1 tasks_processing.go:69] worker 9 listening for tasks. I0419 18:47:55.538551 1 tasks_processing.go:69] worker 44 listening for tasks. I0419 18:47:55.538552 1 tasks_processing.go:69] worker 23 listening for tasks. I0419 18:47:55.538556 1 tasks_processing.go:69] worker 56 listening for tasks. I0419 18:47:55.538560 1 tasks_processing.go:69] worker 0 listening for tasks. I0419 18:47:55.538564 1 tasks_processing.go:69] worker 24 listening for tasks. I0419 18:47:55.538540 1 tasks_processing.go:69] worker 48 listening for tasks. I0419 18:47:55.538557 1 tasks_processing.go:69] worker 49 listening for tasks. I0419 18:47:55.538572 1 tasks_processing.go:69] worker 5 listening for tasks. I0419 18:47:55.538548 1 tasks_processing.go:69] worker 55 listening for tasks. I0419 18:47:55.538407 1 insightsreport.go:296] Starting report retriever I0419 18:47:55.538581 1 tasks_processing.go:69] worker 6 listening for tasks. I0419 18:47:55.538582 1 tasks_processing.go:69] worker 46 listening for tasks. I0419 18:47:55.538585 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0419 18:47:55.538583 1 tasks_processing.go:69] worker 33 listening for tasks. I0419 18:47:55.538547 1 tasks_processing.go:69] worker 45 listening for tasks. I0419 18:47:55.538596 1 tasks_processing.go:69] worker 1 listening for tasks. I0419 18:47:55.538600 1 tasks_processing.go:69] worker 8 listening for tasks. I0419 18:47:55.538597 1 tasks_processing.go:69] worker 32 listening for tasks. I0419 18:47:55.538606 1 tasks_processing.go:69] worker 27 listening for tasks. I0419 18:47:55.538605 1 tasks_processing.go:69] worker 26 listening for tasks. I0419 18:47:55.538600 1 tasks_processing.go:69] worker 34 listening for tasks. I0419 18:47:55.538613 1 tasks_processing.go:69] worker 39 listening for tasks. I0419 18:47:55.538614 1 tasks_processing.go:69] worker 36 listening for tasks. I0419 18:47:55.538614 1 tasks_processing.go:69] worker 2 listening for tasks. I0419 18:47:55.538623 1 tasks_processing.go:69] worker 31 listening for tasks. I0419 18:47:55.538622 1 tasks_processing.go:69] worker 30 listening for tasks. I0419 18:47:55.538492 1 tasks_processing.go:69] worker 63 listening for tasks. I0419 18:47:55.538638 1 tasks_processing.go:69] worker 16 listening for tasks. I0419 18:47:55.538638 1 tasks_processing.go:69] worker 12 listening for tasks. I0419 18:47:55.538644 1 tasks_processing.go:69] worker 4 listening for tasks. I0419 18:47:55.538656 1 tasks_processing.go:71] worker 62 working on infrastructures task. I0419 18:47:55.538652 1 tasks_processing.go:71] worker 19 working on service_accounts task. I0419 18:47:55.538622 1 tasks_processing.go:69] worker 11 listening for tasks. I0419 18:47:55.538666 1 tasks_processing.go:71] worker 26 working on sap_pods task. I0419 18:47:55.538669 1 tasks_processing.go:71] worker 30 working on node_features task. I0419 18:47:55.538671 1 tasks_processing.go:71] worker 34 working on lokistack task. I0419 18:47:55.538583 1 tasks_processing.go:69] worker 57 listening for tasks. I0419 18:47:55.538676 1 tasks_processing.go:71] worker 2 working on validating_webhook_configurations task. I0419 18:47:55.538681 1 tasks_processing.go:71] worker 57 working on ceph_cluster task. I0419 18:47:55.538685 1 tasks_processing.go:71] worker 49 working on machine_config_pools task. I0419 18:47:55.538686 1 tasks_processing.go:71] worker 22 working on nodenetworkconfigurationpolicies task. I0419 18:47:55.538711 1 tasks_processing.go:71] worker 63 working on silenced_alerts task. I0419 18:47:55.538686 1 tasks_processing.go:71] worker 45 working on feature_gates task. I0419 18:47:55.538747 1 tasks_processing.go:71] worker 9 working on metrics task. I0419 18:47:55.538566 1 tasks_processing.go:69] worker 50 listening for tasks. I0419 18:47:55.538593 1 tasks_processing.go:69] worker 7 listening for tasks. I0419 18:47:55.538598 1 tasks_processing.go:69] worker 28 listening for tasks. I0419 18:47:55.538564 1 tasks_processing.go:69] worker 47 listening for tasks. I0419 18:47:55.538606 1 tasks_processing.go:69] worker 37 listening for tasks. I0419 18:47:55.538607 1 tasks_processing.go:69] worker 38 listening for tasks. I0419 18:47:55.538614 1 tasks_processing.go:69] worker 29 listening for tasks. I0419 18:47:55.538575 1 tasks_processing.go:69] worker 25 listening for tasks. I0419 18:47:55.538620 1 tasks_processing.go:69] worker 14 listening for tasks. I0419 18:47:55.538624 1 tasks_processing.go:69] worker 17 listening for tasks. I0419 18:47:55.538635 1 tasks_processing.go:69] worker 15 listening for tasks. I0419 18:47:55.538788 1 tasks_processing.go:71] worker 54 working on openstack_version task. I0419 18:47:55.538797 1 tasks_processing.go:71] worker 23 working on clusterroles task. I0419 18:47:55.538795 1 tasks_processing.go:71] worker 39 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0419 18:47:55.538836 1 tasks_processing.go:71] worker 1 working on container_images task. I0419 18:47:55.538678 1 tasks_processing.go:71] worker 46 working on nodes task. I0419 18:47:55.538670 1 tasks_processing.go:71] worker 24 working on openstack_controlplanes task. I0419 18:47:55.538612 1 tasks_processing.go:69] worker 35 listening for tasks. I0419 18:47:55.539127 1 tasks_processing.go:71] worker 35 working on install_plans task. I0419 18:47:55.538680 1 tasks_processing.go:71] worker 21 working on oauths task. I0419 18:47:55.538633 1 tasks_processing.go:69] worker 51 listening for tasks. I0419 18:47:55.539429 1 tasks_processing.go:71] worker 51 working on machine_configs task. I0419 18:47:55.538665 1 tasks_processing.go:71] worker 55 working on openstack_dataplanenodesets task. I0419 18:47:55.538665 1 tasks_processing.go:71] worker 56 working on pod_network_connectivity_checks task. I0419 18:47:55.538501 1 tasks_processing.go:69] worker 40 listening for tasks. I0419 18:47:55.538839 1 tasks_processing.go:71] worker 8 working on ingress_certificates task. I0419 18:47:55.539819 1 tasks_processing.go:71] worker 40 working on version task. I0419 18:47:55.538631 1 tasks_processing.go:69] worker 3 listening for tasks. I0419 18:47:55.538637 1 tasks_processing.go:69] worker 10 listening for tasks. I0419 18:47:55.538645 1 tasks_processing.go:71] worker 53 working on crds task. I0419 18:47:55.538647 1 tasks_processing.go:71] worker 43 working on olm_operators task. I0419 18:47:55.540030 1 tasks_processing.go:71] worker 10 working on config_maps task. I0419 18:47:55.540091 1 tasks_processing.go:71] worker 3 working on storage_classes task. I0419 18:47:55.538647 1 tasks_processing.go:71] worker 52 working on machine_autoscalers task. I0419 18:47:55.538647 1 tasks_processing.go:71] worker 61 working on machine_healthchecks task. I0419 18:47:55.538652 1 tasks_processing.go:71] worker 58 working on node_logs task. I0419 18:47:55.538653 1 tasks_processing.go:71] worker 60 working on pdbs task. I0419 18:47:55.538655 1 tasks_processing.go:71] worker 5 working on overlapping_namespace_uids task. I0419 18:47:55.538651 1 tasks_processing.go:71] worker 41 working on qemu_kubevirt_launcher_logs task. I0419 18:47:55.538655 1 tasks_processing.go:71] worker 31 working on support_secret task. I0419 18:47:55.538655 1 tasks_processing.go:69] worker 13 listening for tasks. I0419 18:47:55.540827 1 tasks_processing.go:71] worker 13 working on nodenetworkstates task. I0419 18:47:55.538653 1 tasks_processing.go:71] worker 16 working on proxies task. I0419 18:47:55.538660 1 tasks_processing.go:71] worker 20 working on image_registries task. I0419 18:47:55.538661 1 tasks_processing.go:71] worker 32 working on certificate_signing_requests task. I0419 18:47:55.538660 1 tasks_processing.go:71] worker 42 working on mutating_webhook_configurations task. I0419 18:47:55.538662 1 tasks_processing.go:71] worker 27 working on cost_management_metrics_configs task. I0419 18:47:55.538659 1 tasks_processing.go:71] worker 59 working on machine_sets task. I0419 18:47:55.538664 1 tasks_processing.go:71] worker 4 working on storage_cluster task. I0419 18:47:55.538666 1 tasks_processing.go:71] worker 0 working on sap_config task. I0419 18:47:55.538666 1 tasks_processing.go:71] worker 36 working on tsdb_status task. I0419 18:47:55.538669 1 tasks_processing.go:71] worker 12 working on authentication task. I0419 18:47:55.538672 1 tasks_processing.go:71] worker 11 working on dvo_metrics task. I0419 18:47:55.538671 1 tasks_processing.go:71] worker 6 working on jaegers task. I0419 18:47:55.538676 1 tasks_processing.go:71] worker 44 working on image task. I0419 18:47:55.538681 1 tasks_processing.go:71] worker 48 working on sap_datahubs task. I0419 18:47:55.538682 1 tasks_processing.go:71] worker 33 working on operators_pods_and_events task. I0419 18:47:55.538853 1 tasks_processing.go:71] worker 15 working on active_alerts task. I0419 18:47:55.538855 1 tasks_processing.go:71] worker 28 working on machines task. I0419 18:47:55.538857 1 tasks_processing.go:71] worker 47 working on openstack_dataplanedeployments task. I0419 18:47:55.538861 1 tasks_processing.go:71] worker 50 working on networks task. I0419 18:47:55.538863 1 tasks_processing.go:71] worker 37 working on image_pruners task. I0419 18:47:55.538867 1 tasks_processing.go:71] worker 38 working on openshift_machine_api_events task. I0419 18:47:55.538865 1 tasks_processing.go:71] worker 7 working on schedulers task. I0419 18:47:55.544045 1 tasks_processing.go:71] worker 49 working on aggregated_monitoring_cr_names task. E0419 18:47:55.544055 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0419 18:47:55.538873 1 tasks_processing.go:71] worker 25 working on container_runtime_configs task. I0419 18:47:55.538876 1 tasks_processing.go:71] worker 17 working on ingress task. I0419 18:47:55.538875 1 tasks_processing.go:71] worker 14 working on openshift_logging task. I0419 18:47:55.544052 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 5.349424ms to process 0 records I0419 18:47:55.538870 1 tasks_processing.go:71] worker 29 working on monitoring_persistent_volumes task. I0419 18:47:55.544334 1 tasks_processing.go:71] worker 30 working on cluster_apiserver task. I0419 18:47:55.544303 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 5.424857ms to process 0 records I0419 18:47:55.544805 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 5.588275ms to process 0 records I0419 18:47:55.544818 1 tasks_processing.go:74] worker 57 stopped. E0419 18:47:55.547632 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.112.214:9091: connect: connection refused I0419 18:47:55.547653 1 tasks_processing.go:74] worker 36 stopped. E0419 18:47:55.547660 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.112.214:9091: connect: connection refused I0419 18:47:55.547669 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 5.588647ms to process 0 records E0419 18:47:55.547680 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.112.214:9091: connect: connection refused I0419 18:47:55.547701 1 tasks_processing.go:74] worker 9 stopped. E0419 18:47:55.547708 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.112.214:9091: connect: connection refused I0419 18:47:55.547720 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 8.942369ms to process 0 records I0419 18:47:55.561840 1 tasks_processing.go:74] worker 24 stopped. I0419 18:47:55.561853 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 22.809654ms to process 0 records I0419 18:47:55.563697 1 tasks_processing.go:74] worker 21 stopped. I0419 18:47:55.564007 1 recorder.go:75] Recording config/oauth with fingerprint=1a3c1e2a0c0112727077cf1d07d748ae91810a5fee1eacf6fdc0f10123ac04fd I0419 18:47:55.564025 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 24.342793ms to process 1 records I0419 18:47:55.568733 1 tasks_processing.go:74] worker 56 stopped. E0419 18:47:55.568749 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0419 18:47:55.568760 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 28.939286ms to process 0 records I0419 18:47:55.568770 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 30.057655ms to process 0 records I0419 18:47:55.568777 1 tasks_processing.go:74] worker 26 stopped. I0419 18:47:55.568825 1 tasks_processing.go:74] worker 34 stopped. I0419 18:47:55.568838 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 30.14085ms to process 0 records I0419 18:47:55.568931 1 tasks_processing.go:74] worker 54 stopped. I0419 18:47:55.568943 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 30.131684ms to process 0 records I0419 18:47:55.569688 1 tasks_processing.go:74] worker 22 stopped. I0419 18:47:55.569704 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 30.979342ms to process 0 records I0419 18:47:55.569832 1 tasks_processing.go:74] worker 55 stopped. I0419 18:47:55.569850 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 30.240439ms to process 0 records I0419 18:47:55.570093 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0419 18:47:55.570119 1 controller.go:368] The initial operator extension status is healthy I0419 18:47:55.570129 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0419 18:47:55.570138 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0419 18:47:55.570143 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0419 18:47:55.570157 1 controller.go:531] The operator is still being initialized I0419 18:47:55.570163 1 controller.go:554] The operator is healthy I0419 18:47:55.570302 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0419 18:47:55.570327 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0419 18:47:55.570400 1 operator.go:328] started I0419 18:47:55.570428 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0419 18:47:55.570607 1 tasks_processing.go:74] worker 62 stopped. I0419 18:47:55.571239 1 recorder.go:75] Recording config/infrastructure with fingerprint=d67ff8e95e22599888f53fb492a87012ae3ff642cf7d95ddedfc8e8adb79c232 I0419 18:47:55.571255 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 31.941763ms to process 1 records E0419 18:47:55.571263 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0419 18:47:55.571268 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 30.732864ms to process 0 records I0419 18:47:55.571275 1 tasks_processing.go:74] worker 61 stopped. I0419 18:47:55.571377 1 tasks_processing.go:74] worker 13 stopped. I0419 18:47:55.571395 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 30.53787ms to process 0 records I0419 18:47:55.571531 1 tasks_processing.go:74] worker 16 stopped. I0419 18:47:55.571603 1 recorder.go:75] Recording config/proxy with fingerprint=2af2afe854e52f41dbc2088daf1b761f417b24debd0705afe1e3bb33a125b7ee I0419 18:47:55.571618 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 30.666454ms to process 1 records I0419 18:47:55.571775 1 tasks_processing.go:74] worker 52 stopped. I0419 18:47:55.571791 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 31.523195ms to process 0 records I0419 18:47:55.573070 1 tasks_processing.go:74] worker 4 stopped. I0419 18:47:55.573095 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 31.443333ms to process 0 records I0419 18:47:55.573108 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 31.81848ms to process 0 records I0419 18:47:55.573115 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 31.133635ms to process 0 records I0419 18:47:55.573122 1 tasks_processing.go:74] worker 0 stopped. I0419 18:47:55.573127 1 tasks_processing.go:74] worker 27 stopped. I0419 18:47:55.573135 1 tasks_processing.go:74] worker 59 stopped. I0419 18:47:55.573153 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 31.832649ms to process 0 records I0419 18:47:55.573238 1 tasks_processing.go:74] worker 3 stopped. I0419 18:47:55.573296 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=08650701c42eb60894be9ddcbfbcbc8e5a74e293836aad926f58613d08cc6731 I0419 18:47:55.573328 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=1dc0a2a63f781a5f4c32da84ae3767d608c6856d7049388672e24d340273eef9 I0419 18:47:55.573338 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 32.996845ms to process 2 records E0419 18:47:55.573349 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0419 18:47:55.573358 1 gather.go:177] gatherer "clusterconfig" function "machines" took 29.615542ms to process 0 records I0419 18:47:55.573365 1 tasks_processing.go:74] worker 28 stopped. I0419 18:47:55.573423 1 tasks_processing.go:74] worker 45 stopped. I0419 18:47:55.573599 1 recorder.go:75] Recording config/featuregate with fingerprint=5ac1a24ff93a0c3c812e25bfc60d1e92d91b21bee9465b6d6bc1780c1a82cb8c I0419 18:47:55.573615 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 34.670177ms to process 1 records I0419 18:47:55.573630 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 29.764003ms to process 0 records E0419 18:47:55.573637 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0419 18:47:55.573645 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 32.678167ms to process 0 records I0419 18:47:55.573651 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 30.769616ms to process 0 records I0419 18:47:55.573661 1 tasks_processing.go:74] worker 47 stopped. I0419 18:47:55.573673 1 tasks_processing.go:74] worker 31 stopped. I0419 18:47:55.573679 1 tasks_processing.go:74] worker 6 stopped. I0419 18:47:55.573777 1 tasks_processing.go:74] worker 60 stopped. I0419 18:47:55.575373 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=20eb52dd9f48552fa9c1f9aca221cda87bdcb386d11f898faf390cfa7c88d5e4 I0419 18:47:55.575724 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=f11a67227325be52a5db9b803cdad07e13f49014abf265768a57a45dcb747ebb I0419 18:47:55.575804 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=fe2974189cf51a06694b8e04bb3f1ea97bea0828c1f348514af264ab6e49352c I0419 18:47:55.576082 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=cb54e8ae09ccad97a0a67d3e5f62b3ef3b4ff5e5750f168b4cc1ef56559266d8 I0419 18:47:55.576184 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=cb39140140b13dd8736dc6ce6304049998d22ed6d8584a6ebe5aa58ec01ae788 I0419 18:47:55.576262 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=7a5c85385dee03d76cd7041e6a126ba2a4344032d06f20c5483703da9430c1a4 I0419 18:47:55.576318 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=b2617f5400ecc84f40959a447469b64fd2be534307f865c38ab307d4150defee I0419 18:47:55.576379 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=c51e84a9c0242b64ed596faafe67f4f81c7dad8aa81126ff79b004aedfef472e I0419 18:47:55.576500 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=17bad6f4a5ac37d247edaf0dc3e597266b54942c071373ded2f39fba1a32e587 I0419 18:47:55.576550 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=9be87b3ffa3398bb8a98011c4ea7b39124a527884167dc5c3bde7908656c2534 I0419 18:47:55.576627 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=e019870cba4d463dbfe6441cd54fc487cbef137194cbba1e55b3c8976b9b2437 I0419 18:47:55.576644 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 33.058036ms to process 11 records I0419 18:47:55.576790 1 tasks_processing.go:74] worker 12 stopped. I0419 18:47:55.577301 1 recorder.go:75] Recording config/authentication with fingerprint=d9f37b19db1f15f984f0cfd21c9f8c882cde88242f2a04a6f6005ca486247000 I0419 18:47:55.577352 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 31.33512ms to process 1 records I0419 18:47:55.577374 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 31.15667ms to process 0 records I0419 18:47:55.577405 1 tasks_processing.go:74] worker 44 stopped. I0419 18:47:55.577433 1 tasks_processing.go:74] worker 48 stopped. I0419 18:47:55.577738 1 recorder.go:75] Recording config/image with fingerprint=192b9e8823e997bbc0126036e7445132c8e4922d156cc928353924df114d4664 I0419 18:47:55.577764 1 gather.go:177] gatherer "clusterconfig" function "image" took 31.471446ms to process 1 records I0419 18:47:55.577807 1 tasks_processing.go:74] worker 46 stopped. I0419 18:47:55.579147 1 recorder.go:75] Recording config/node/ip-10-0-0-39.ec2.internal with fingerprint=4095769158258ac429b423ed99a79769d2463f2fae9ceedf4d58d46a1669a82c I0419 18:47:55.579256 1 recorder.go:75] Recording config/node/ip-10-0-1-170.ec2.internal with fingerprint=3fc83abb10e28c6657f9e855ab0cf4eecbf5d7f5a30dad0ca90a9be72c0e7dc8 I0419 18:47:55.579330 1 recorder.go:75] Recording config/node/ip-10-0-2-180.ec2.internal with fingerprint=26bd81f1ead2bf86ed1896b93a0d1b239fa3ce7951bbcf3ebe893702853bbeb3 I0419 18:47:55.579342 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 35.819259ms to process 3 records I0419 18:47:55.579441 1 tasks_processing.go:74] worker 37 stopped. I0419 18:47:55.579587 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=6a68bd0d0d691175aec74405a7e7d083ee927923a45999ef4e3142ee7aa64c61 I0419 18:47:55.579598 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 31.617959ms to process 1 records I0419 18:47:55.579603 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 31.811367ms to process 0 records I0419 18:47:55.579607 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 31.778191ms to process 0 records I0419 18:47:55.579627 1 tasks_processing.go:74] worker 25 stopped. I0419 18:47:55.579632 1 tasks_processing.go:74] worker 14 stopped. I0419 18:47:55.579703 1 tasks_processing.go:74] worker 20 stopped. I0419 18:47:55.580142 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=ff2fa32e90393c27bac72f4f95a463716867f44f0998148d01685439a75ceb3c I0419 18:47:55.580165 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 35.382282ms to process 1 records W0419 18:47:55.580313 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0419 18:47:55.581571 1 tasks_processing.go:74] worker 32 stopped. I0419 18:47:55.581596 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 40.560783ms to process 0 records I0419 18:47:55.583642 1 tasks_processing.go:74] worker 38 stopped. I0419 18:47:55.583659 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 39.754275ms to process 0 records I0419 18:47:55.583802 1 gather_logs.go:145] no pods in namespace were found I0419 18:47:55.583814 1 tasks_processing.go:74] worker 41 stopped. I0419 18:47:55.583821 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 43.170257ms to process 0 records I0419 18:47:55.583893 1 tasks_processing.go:74] worker 7 stopped. I0419 18:47:55.583913 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=635c51db6c4631a3fe0ac1daee921c3e37ec97ca19a963f01a7ebfd392f36400 I0419 18:47:55.583924 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 39.845165ms to process 1 records I0419 18:47:55.584002 1 tasks_processing.go:74] worker 50 stopped. I0419 18:47:55.584049 1 recorder.go:75] Recording config/network with fingerprint=31c3207a3ca7d9a536ffa117c71887deb6d39a796b34337f0c028d5d8939ea35 I0419 18:47:55.584059 1 gather.go:177] gatherer "clusterconfig" function "networks" took 40.0927ms to process 1 records I0419 18:47:55.584068 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 39.659741ms to process 0 records I0419 18:47:55.584085 1 tasks_processing.go:74] worker 29 stopped. I0419 18:47:55.584152 1 tasks_processing.go:74] worker 30 stopped. I0419 18:47:55.584201 1 recorder.go:75] Recording config/apiserver with fingerprint=28c1e90b1f36f65523b29f104a8e40613b7312239714439ed75fb4b802b4d60c I0419 18:47:55.584224 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 39.373912ms to process 1 records I0419 18:47:55.584314 1 tasks_processing.go:74] worker 17 stopped. I0419 18:47:55.584368 1 recorder.go:75] Recording config/ingress with fingerprint=6782a20372b6b385bbf8dd07eaf280056a324950a0f78561039f2aca1cb1c660 I0419 18:47:55.584381 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 39.840864ms to process 1 records E0419 18:47:55.584395 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0419 18:47:55.584414 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0419 18:47:55.584439 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 44.664404ms to process 1 records I0419 18:47:55.584453 1 tasks_processing.go:74] worker 51 stopped. I0419 18:47:55.591031 1 tasks_processing.go:74] worker 53 stopped. I0419 18:47:55.591753 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=096ddef501486ab5095f00d74eb43e2dd9427072f564bf02dd4cf64f5b494eb8 I0419 18:47:55.592036 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=b2797d1a82b08184b50e283816344000e64b24fb7d58d12d96d6b11381afa3a8 I0419 18:47:55.592055 1 gather.go:177] gatherer "clusterconfig" function "crds" took 51.048681ms to process 2 records I0419 18:47:55.592139 1 tasks_processing.go:74] worker 40 stopped. I0419 18:47:55.592273 1 recorder.go:75] Recording config/version with fingerprint=ab9f9df12dbfacea0a2ff0ad9b5b9b8c9428cd5f329a53e580d3c5ec88944b59 I0419 18:47:55.592284 1 recorder.go:75] Recording config/id with fingerprint=384b8b116ce89f32391192a2be39f2b28920a5a7aab714b7785c609f893938d1 I0419 18:47:55.592288 1 gather.go:177] gatherer "clusterconfig" function "version" took 51.809977ms to process 2 records I0419 18:47:55.592327 1 recorder.go:75] Recording config/olm_operators with fingerprint=52cb103f6fea9875aca398cc9c3f266a6c50bf5a939de1cf01905c7fbad7a783 I0419 18:47:55.592335 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 51.843739ms to process 1 records I0419 18:47:55.592367 1 tasks_processing.go:74] worker 43 stopped. I0419 18:47:55.592434 1 tasks_processing.go:74] worker 23 stopped. I0419 18:47:55.592490 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=70e0eb5e43e00628de1e5b71653a7454c48fe1516e05d5cbb8d20c55c01a19b2 I0419 18:47:55.592573 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=8027ce3354c6739656638ed2da6dea02951e0fd3a7fe559216204ef67e3e34f3 I0419 18:47:55.592582 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 53.274067ms to process 2 records I0419 18:47:55.597408 1 controller.go:254] Source scaController *sca.Controller is not ready I0419 18:47:55.597473 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0419 18:47:55.597504 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0419 18:47:55.597529 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0419 18:47:55.597554 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0419 18:47:55.597618 1 controller.go:531] The operator is still being initialized I0419 18:47:55.597651 1 controller.go:554] The operator is healthy I0419 18:47:55.599823 1 tasks_processing.go:74] worker 49 stopped. I0419 18:47:55.599843 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 55.727811ms to process 0 records I0419 18:47:55.602989 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0419 18:47:55.603063 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0419 18:47:55.603107 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0419 18:47:55.603623 1 tasks_processing.go:74] worker 1 stopped. I0419 18:47:55.604932 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-vmjb8 with fingerprint=8425c2b7de6d61190666b1eef90d4423d910d6b476b1ddd122ed08f3246c93e9 I0419 18:47:55.605042 1 recorder.go:75] Recording config/running_containers with fingerprint=531113a55f45fac4de4b2fc43f625ff08e6b3fb6deceb878576abbcda689f0ac I0419 18:47:55.605058 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 64.728311ms to process 2 records I0419 18:47:55.606470 1 tasks_processing.go:74] worker 39 stopped. I0419 18:47:55.606490 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 67.65772ms to process 0 records I0419 18:47:55.607155 1 base_controller.go:82] Caches are synced for ConfigController I0419 18:47:55.607168 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0419 18:47:55.621672 1 configmapobserver.go:84] configmaps "insights-config" not found I0419 18:47:55.621765 1 tasks_processing.go:74] worker 8 stopped. E0419 18:47:55.621790 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0419 18:47:55.621813 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ppd21iub53sh96ramq6ul1mg6plu4eu-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ppd21iub53sh96ramq6ul1mg6plu4eu-primary-cert-bundle-secret" not found I0419 18:47:55.621889 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=8c37c06578436c78d928839455129415c671c83b900a720ea29740ed480d35ea I0419 18:47:55.621902 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 81.931826ms to process 1 records I0419 18:47:55.622517 1 tasks_processing.go:74] worker 10 stopped. E0419 18:47:55.622542 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0419 18:47:55.622550 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0419 18:47:55.622556 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0419 18:47:55.622569 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0419 18:47:55.622616 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0419 18:47:55.622627 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0419 18:47:55.622639 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0419 18:47:55.622656 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0419 18:47:55.622844 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0419 18:47:55.622903 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0419 18:47:55.622935 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 82.449824ms to process 7 records I0419 18:47:55.632786 1 tasks_processing.go:74] worker 2 stopped. I0419 18:47:55.632921 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=d83e009aeec396bd2db9bf1477f708e178af7fee22474533d913cc8c7ac054cc I0419 18:47:55.632973 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=02739f2eaa51e5019c9223640ea11a2f22e0c6ff343430a1b07c58cf66724823 I0419 18:47:55.633046 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=ddb94e85b127b9eb6a937dc6eac385e77b97b06939d753f65a628678be262f9d I0419 18:47:55.633070 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=ea9e89a9ecd96e9cea3abf6105cf3c8d854994fef239c347eb620048a4a51200 I0419 18:47:55.633091 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=e265885168e28e8ed72ddfacdd0d5d568baa95ff4ddd970320ec4d3c283ecd25 I0419 18:47:55.633114 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=682154e1e558ab3216a428f374810476fdc59c4c9f3a266183ec4a3690b4ca3e I0419 18:47:55.633137 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=ed9ee2c5a99c0edf6a40a390f1b2290537b4b10155359831af3ccebdafcd9116 I0419 18:47:55.633159 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=293fc46cff3297f96c75e52b8088153df6790501f5e2235aeddb7979b0fcbbf2 I0419 18:47:55.633183 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=592fe9a61cf20488e5b0260bfa54dfe7e35e6d1704bbc956517ce8d7887aa4c7 I0419 18:47:55.633235 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=a326da720ad34d4552f667316b447d10198743f1888178dd0684ab4458e5b27c I0419 18:47:55.633259 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=11c9fd84720441d4e39ea1b8518a2c8a2acf54fefedda42624db5d3b7a708b4e I0419 18:47:55.633293 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=7212cbccd8a3cff519b2bde3f71c16fdc45a0876f81c51607779cb9642b2bbbb I0419 18:47:55.633317 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=722198fc8fac543e3aa926d795d9f647c8e69d1c0826b7524a5dac5f38010fa9 I0419 18:47:55.633328 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 94.093027ms to process 13 records I0419 18:47:55.636184 1 tasks_processing.go:74] worker 42 stopped. I0419 18:47:55.636336 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=f228a12d318515e2105fed6e8ec90734cc84792a640d31c2d16210ecc45d3de8 I0419 18:47:55.636370 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=79cfde2285cfa1082f250a541894b3776d9ad3fac95a4b037680552fdaf943a0 I0419 18:47:55.636395 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=d223f3ca17b09438aa2ea9d060e2487ece485994a8413a589439693e8ccae42c I0419 18:47:55.636403 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 95.013554ms to process 3 records I0419 18:47:55.657548 1 tasks_processing.go:74] worker 58 stopped. I0419 18:47:55.657560 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 117.073348ms to process 0 records I0419 18:47:55.659983 1 tasks_processing.go:74] worker 5 stopped. I0419 18:47:55.660017 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0419 18:47:55.660028 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 119.357379ms to process 1 records I0419 18:47:55.669537 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0419 18:47:55.670928 1 base_controller.go:82] Caches are synced for LoggingSyncer I0419 18:47:55.670942 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0419 18:47:55.672483 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0419 18:47:55.685535 1 gather_cluster_operator_pods_and_events.go:121] Found 6 pods with 9 containers I0419 18:47:55.685547 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 2796202 bytes I0419 18:47:55.688100 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-4mb2s pod in namespace openshift-dns (previous: false). I0419 18:47:55.716990 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-4mb2s pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-4mb2s\" is waiting to start: ContainerCreating" I0419 18:47:55.717011 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-4mb2s\" is waiting to start: ContainerCreating" I0419 18:47:55.717021 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-4mb2s pod in namespace openshift-dns (previous: false). I0419 18:47:55.733351 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-4mb2s pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-4mb2s\" is waiting to start: ContainerCreating" I0419 18:47:55.733366 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-4mb2s\" is waiting to start: ContainerCreating" I0419 18:47:55.733394 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-bgt45 pod in namespace openshift-dns (previous: false). I0419 18:47:55.749320 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bgt45 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-bgt45\" is waiting to start: ContainerCreating" I0419 18:47:55.749337 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-bgt45\" is waiting to start: ContainerCreating" I0419 18:47:55.749345 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-bgt45 pod in namespace openshift-dns (previous: false). I0419 18:47:55.766512 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bgt45 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-bgt45\" is waiting to start: ContainerCreating" I0419 18:47:55.766531 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-bgt45\" is waiting to start: ContainerCreating" I0419 18:47:55.766544 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-d5bcz pod in namespace openshift-dns (previous: false). I0419 18:47:55.796636 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-d5bcz pod in namespace openshift-dns (previous: false). I0419 18:47:55.808407 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-9t5vn pod in namespace openshift-dns (previous: false). I0419 18:47:55.853492 1 sca.go:266] etc-pki-entitlement secret successfully created I0419 18:47:55.853510 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0419 18:47:55.873154 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0419 18:47:55.873173 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-bxzvc pod in namespace openshift-dns (previous: false). I0419 18:47:55.895927 1 cluster_transfer.go:102] no available accepted cluster transfer I0419 18:47:55.895945 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0419 18:47:56.074478 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0419 18:47:56.074499 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-jplgp pod in namespace openshift-dns (previous: false). I0419 18:47:56.275507 1 tasks_processing.go:74] worker 33 stopped. I0419 18:47:56.275652 1 recorder.go:75] Recording events/openshift-dns with fingerprint=8068489062f3d7b93d3b4e4b5af1758120928411c8fcd49a41a559e742d8ac2e I0419 18:47:56.275827 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-4mb2s with fingerprint=28ce6b1f819bfeefb62168fed6a0ebea3daeb72465c859dfead9ff50eeddd93c I0419 18:47:56.275921 1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-bgt45 with fingerprint=563f40ebab754c5a4659f045c6ea53e371bb11ec818cb2943b02883ab893ea39 I0419 18:47:56.275936 1 recorder.go:75] Recording config/pod/openshift-dns/logs/dns-default-d5bcz/dns_current.log with fingerprint=5be58b0e5ed6ded9589d46c663766324e05f4378b4ec2958b7faae7ed1ac141c I0419 18:47:56.275946 1 recorder.go:75] Recording config/pod/openshift-dns/logs/dns-default-d5bcz/kube-rbac-proxy_current.log with fingerprint=73d3c8144cfc51c31bf797a56d5feb5d7b33a9d8180ea5f81d56111a83d31553 I0419 18:47:56.275951 1 recorder.go:75] Recording config/pod/openshift-dns/logs/node-resolver-jplgp/dns-node-resolver_current.log with fingerprint=3be6d902aa50d118b942d25eaa5842c469fb6f8f557ccc69c34f9a355dd8273b I0419 18:47:56.275958 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 732.328201ms to process 6 records W0419 18:47:56.580471 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0419 18:47:56.623998 1 tasks_processing.go:74] worker 63 stopped. I0419 18:47:56.624020 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0419 18:47:56.624032 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.085257913s to process 1 records I0419 18:47:56.624092 1 tasks_processing.go:74] worker 15 stopped. I0419 18:47:56.624172 1 recorder.go:75] Recording config/alerts with fingerprint=f1ab9de2649926288ce94dc9ccfdb177e33d8e406887ead09a06309ed7097d0a I0419 18:47:56.624190 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.080593692s to process 1 records I0419 18:47:57.406001 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found W0419 18:47:57.580072 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0419 18:47:58.009231 1 tasks_processing.go:74] worker 18 stopped. I0419 18:47:58.009395 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=11bde5afd74ca2e50ddbbca317079a6957fa9c88a4dd33a4f3b66bdb169d54d1 I0419 18:47:58.009450 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0419 18:47:58.009498 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=582ff1ad8a40b2e5e1b36142ee5c0d438f752d56fda01755b0181c591612c7c5 I0419 18:47:58.009515 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0419 18:47:58.009537 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=8288b18e7849f5082318eba6c4349e105bc0c065570a20a615a6fce0bb29be6b I0419 18:47:58.009552 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0419 18:47:58.009572 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=04360fffde50df9003a3752b4ebb3d3f023ed8f7d1deeeb1110053458729be54 I0419 18:47:58.009604 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=ce9fb4cea2ff9e4661519d551bb3412ddcecd8afc1b81e1156b2a65997f0b2c6 I0419 18:47:58.009628 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=4ed0d9d47a711d8b74204cde5810328d661affc9a5b9c9ada5a7f84d2cf4a486 I0419 18:47:58.009663 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=6110ef70e8140b35f82bf5c358159699d2c57714b5b873a795afd0ee9ab478d6 I0419 18:47:58.010018 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=8acffc14bc683908e9194ce1fe8a3ee168d34f2c3e06e5d98186fe3393019a69 I0419 18:47:58.010053 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=354d9e79a09e5cb0910a3399b4fee5b8475d49c4bdc51d4574c85664edabba22 I0419 18:47:58.010065 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0419 18:47:58.010088 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=ed6462e3fd5f2369033e442f38f1a69c3133f35874b03c44423da699cedc4c4e I0419 18:47:58.010100 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0419 18:47:58.010116 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=e8b532b6616a899e8f1dd9b4ab983e1ce4c1e44701b7bfef23f38b44ef18ae1a I0419 18:47:58.010123 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0419 18:47:58.010143 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=85e685309e4f8a7fcc23727e1f4c67cfd43ac27fb7f0cc7177bcfd4b20d52721 I0419 18:47:58.010154 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0419 18:47:58.010175 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=ea267bab8b55d08cb58cdb57d7ada079e85cbfc9d96bfb26551258ebd22ba432 I0419 18:47:58.010320 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=c33707e5d4a26e735fcd023d0227eead74a85b0796fabe4478d3a1eff661fdbb I0419 18:47:58.010331 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0419 18:47:58.010339 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0419 18:47:58.010370 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0419 18:47:58.010405 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=48cb7f978127c8d4387422fb69e7975e148dc2674f4198c5a0f716721a135f2d I0419 18:47:58.010443 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=26745b76243ad7a7f82bf233050ca6b4b906d5dd3c7c56d77f42abfa31e7a564 I0419 18:47:58.010455 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0419 18:47:58.010473 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=cf55c922ec99dedb16d191e99648a00a2ebdff44dd290e5231e3cb6b45e32970 I0419 18:47:58.010483 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0419 18:47:58.010497 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=3e14eff93b261b4645d0b192c117edd4b8ee2d850652245a34f3e689a297d2c9 I0419 18:47:58.010512 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=4558c605df28d11f2f5f399743f7d265bab2365cc80e46391c12d52ed428c038 I0419 18:47:58.010533 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=7a7a69e188334edddd4b2e45ed8178dfcc123c6672bc1697ae6459e76428b354 I0419 18:47:58.010547 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=75c23e360654792586f1b808331518e89dc9952d51f3aeb8b66164b2da46b70c I0419 18:47:58.010567 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=257a74dd338c9ffdb4289ceff8772ebdc931defee4364efb97878f9d2db60e97 I0419 18:47:58.010577 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0419 18:47:58.010616 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=9cd3f8acab0aebf799962f81971d8469cc8e493f5d9dbfd890cc8317927cc648 I0419 18:47:58.010637 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0419 18:47:58.010644 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0419 18:47:58.010653 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.470696603s to process 38 records W0419 18:47:58.579547 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0419 18:47:59.579186 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0419 18:48:00.579737 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0419 18:48:00.579776 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0419 18:48:00.579796 1 tasks_processing.go:74] worker 11 stopped. E0419 18:48:00.579811 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0419 18:48:00.579829 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0419 18:48:00.579845 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.037233998s to process 1 records I0419 18:48:08.385605 1 tasks_processing.go:74] worker 35 stopped. I0419 18:48:08.385662 1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0419 18:48:08.385678 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.846434498s to process 1 records I0419 18:48:09.148229 1 tasks_processing.go:74] worker 19 stopped. I0419 18:48:09.148539 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=16e4c55b4d63cefcfc7800aa646e617d46f0ec5f940c3fd1a629fc5ae985c964 I0419 18:48:09.148556 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.609536082s to process 1 records E0419 18:48:09.148615 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.61s with: function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error" I0419 18:48:09.149732 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "tsdb_status" failed with an error, function "metrics" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error I0419 18:48:09.149747 1 periodic.go:216] Running workloads gatherer I0419 18:48:09.149765 1 tasks_processing.go:45] number of workers: 2 I0419 18:48:09.149778 1 tasks_processing.go:69] worker 1 listening for tasks. I0419 18:48:09.149782 1 tasks_processing.go:71] worker 1 working on workload_info task. I0419 18:48:09.149791 1 tasks_processing.go:69] worker 0 listening for tasks. I0419 18:48:09.149813 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0419 18:48:09.158976 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-170.ec2.internal... I0419 18:48:09.158990 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-180.ec2.internal... I0419 18:48:09.158999 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-39.ec2.internal... I0419 18:48:09.192780 1 tasks_processing.go:74] worker 0 stopped. I0419 18:48:09.192798 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 42.943154ms to process 0 records I0419 18:48:13.282608 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 4s I0419 18:48:13.306368 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 25s for image data I0419 18:48:13.325298 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (20ms) I0419 18:48:13.336035 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (11ms) I0419 18:48:13.346690 1 gather_workloads_info.go:387] No image sha256:5ff204630794311b0b37fa7b197b933ad85d76a481bf7cdb3bcbada08f0cdcbf (11ms) I0419 18:48:13.359170 1 gather_workloads_info.go:387] No image sha256:6c6d412ccf0c3d6a14645a79df6c4658c0f8725d7954cb83c3d2f0116499345a (12ms) I0419 18:48:13.370016 1 gather_workloads_info.go:387] No image sha256:bdeb1c455cffccdb6c90db238e9d371de06340b1d6105d47f66d87293f878ac1 (11ms) I0419 18:48:13.382494 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (12ms) I0419 18:48:13.392342 1 gather_workloads_info.go:387] No image sha256:52db05084f2a2e7d7bf4040e4865df88ec4074efbbe59a78d861be2c5ab2aa40 (10ms) I0419 18:48:13.402309 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (10ms) I0419 18:48:13.416750 1 gather_workloads_info.go:387] No image sha256:1eb6a6ee3c66ac15be6bc21bb6015c595c11c15b9dfd21bd9f5ce7f7b990ebaa (14ms) I0419 18:48:13.428039 1 gather_workloads_info.go:387] No image sha256:5940cc34b322325618929b1e0eb3864dae73d54c8f5b474e218dfb28123a61c7 (11ms) I0419 18:48:13.437585 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (10ms) I0419 18:48:13.519507 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (82ms) I0419 18:48:13.621870 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (102ms) I0419 18:48:13.718540 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (97ms) I0419 18:48:13.827668 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (109ms) I0419 18:48:13.917405 1 gather_workloads_info.go:387] No image sha256:0b2e6536a0ca3afc5e64a218087a6287c74b77a359075a385f1949ca5bd51b22 (90ms) I0419 18:48:14.018601 1 gather_workloads_info.go:387] No image sha256:9ef6dc311b880a6442b7a3a19006ddd955c7da36850bf000f5c9b68fd0862dd4 (101ms) I0419 18:48:14.118695 1 gather_workloads_info.go:387] No image sha256:15e1b5f763553e86d0230a751b0783e3b990438fd07cf96eed164bccb72ed564 (100ms) I0419 18:48:14.218084 1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (99ms) I0419 18:48:14.316503 1 gather_workloads_info.go:387] No image sha256:572ebf7c7fab1a518582f3ca46c866730423cce6e8a19f614dc15fd61bf0c65a (98ms) I0419 18:48:14.417808 1 gather_workloads_info.go:387] No image sha256:17aefdc2f4752c23dc8f0947bb01fc34635822eeb18f2d8a5eddf8211b84d450 (101ms) I0419 18:48:14.517709 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (100ms) I0419 18:48:14.621735 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (104ms) I0419 18:48:14.717244 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (95ms) I0419 18:48:14.817709 1 gather_workloads_info.go:387] No image sha256:3380fecebaeee139c1607fbcd9346cebc92806679568e2244a8905ef0f52aad2 (100ms) I0419 18:48:14.916811 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (99ms) I0419 18:48:15.025861 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (109ms) I0419 18:48:15.118833 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (93ms) I0419 18:48:15.217146 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (98ms) I0419 18:48:15.323654 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (106ms) I0419 18:48:15.417766 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (94ms) I0419 18:48:15.516526 1 gather_workloads_info.go:387] No image sha256:53ff8efdd8f563421ebc1859ab021a3bbc1306f82d4ff5d9c21bc60ec5f57898 (99ms) I0419 18:48:15.617347 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (101ms) I0419 18:48:15.715610 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (98ms) I0419 18:48:15.819563 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (104ms) I0419 18:48:15.917139 1 gather_workloads_info.go:387] No image sha256:23204877f166455ce8f9de9b91a467eeda576f172d5f96124a68aa986c4775d6 (98ms) I0419 18:48:16.016358 1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (99ms) I0419 18:48:16.115827 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (99ms) I0419 18:48:16.218293 1 gather_workloads_info.go:387] No image sha256:48f5559439bea030a6423652da448c25fff0c62ba293eb521843c1a8eb89ddb0 (102ms) I0419 18:48:16.317859 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (100ms) I0419 18:48:16.416791 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (99ms) I0419 18:48:16.515712 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (99ms) I0419 18:48:16.618949 1 gather_workloads_info.go:387] No image sha256:15928a5b803fa00781b408dbc4c3bfa7c5287b18584ba31f817def8a4430c725 (103ms) I0419 18:48:16.717615 1 gather_workloads_info.go:387] No image sha256:9d6d63dce784df5863e6a0ba4c11317a26c9d756d4e62d47759c97190a71cce5 (99ms) I0419 18:48:16.818805 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (101ms) I0419 18:48:16.922334 1 gather_workloads_info.go:387] No image sha256:5d6a2b8d2508c7da71192661e7c0dcf1335f48b6336a20189abffbe79eeff962 (104ms) I0419 18:48:17.019075 1 gather_workloads_info.go:387] No image sha256:0acfe677ed58031f8381cb8a4f2d8917ec4cfa95485e2a46529dffae54c75ace (97ms) I0419 18:48:17.115485 1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (96ms) I0419 18:48:17.115519 1 tasks_processing.go:74] worker 1 stopped. I0419 18:48:17.115874 1 recorder.go:75] Recording config/workload_info with fingerprint=5e141377b0ced1fd29c56fc7017d941cf07e2fa993f624a6c503007f9d1f6be3 I0419 18:48:17.115930 1 gather.go:177] gatherer "workloads" function "workload_info" took 7.965729984s to process 1 records I0419 18:48:17.115951 1 periodic.go:263] Periodic gather workloads completed in 7.966s I0419 18:48:17.115962 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0419 18:48:17.115967 1 periodic.go:216] Running conditional gatherer I0419 18:48:17.122166 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0419 18:48:17.418716 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer E0419 18:48:17.423925 1 conditional_gatherer.go:324] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.112.214:9091: connect: connection refused I0419 18:48:17.423996 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0419 18:48:17.433823 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0419 18:48:17.433837 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0419 18:48:17.433844 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0419 18:48:17.433847 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0419 18:48:17.433851 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0419 18:48:17.433853 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0419 18:48:17.433856 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0419 18:48:17.433859 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0419 18:48:17.433862 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0419 18:48:17.433865 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0419 18:48:17.433869 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0419 18:48:17.433884 1 tasks_processing.go:45] number of workers: 3 I0419 18:48:17.433891 1 tasks_processing.go:69] worker 2 listening for tasks. I0419 18:48:17.433895 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0419 18:48:17.433914 1 tasks_processing.go:69] worker 0 listening for tasks. I0419 18:48:17.433926 1 tasks_processing.go:69] worker 1 listening for tasks. I0419 18:48:17.433936 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0419 18:48:17.433941 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0419 18:48:17.433944 1 tasks_processing.go:74] worker 1 stopped. I0419 18:48:17.433975 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0419 18:48:17.433988 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.422µs to process 1 records I0419 18:48:17.434021 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0419 18:48:17.434028 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.095µs to process 1 records I0419 18:48:17.434034 1 tasks_processing.go:74] worker 0 stopped. I0419 18:48:17.434203 1 tasks_processing.go:74] worker 2 stopped. I0419 18:48:17.434242 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 252.552µs to process 0 records I0419 18:48:17.434266 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0419 18:48:17.434294 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0419 18:48:17.466644 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=04b0af8e8acc032ab6fdfe6c24d67ab15d8759700ce6763c46f4ec222056f840 I0419 18:48:17.466752 1 diskrecorder.go:70] Writing 116 records to /var/lib/insights-operator/insights-2026-04-19-184817.tar.gz I0419 18:48:17.473757 1 diskrecorder.go:51] Wrote 116 records to disk in 7ms I0419 18:48:17.473783 1 periodic.go:285] Gathering cluster info every 2h0m0s I0419 18:48:17.473797 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0419 18:49:25.538479 1 diskrecorder.go:223] Found files to send: insights-2026-04-19-184817.tar.gz I0419 18:49:25.538508 1 insightsuploader.go:150] Checking archives to upload periodically every 15m17.810215928s I0419 18:49:25.538517 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0419 18:49:25.552175 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0419 18:49:25.710321 1 requests.go:87] Successfully reported id=2026-04-19T18:49:25Z x-rh-insights-request-id=090fd583b73b472b8d657bb442e05a3e, wrote=51474 I0419 18:49:25.710395 1 insightsuploader.go:187] Uploaded report successfully in 171.868558ms I0419 18:49:25.710420 1 controller.go:129] Initializing last reported time to 2026-04-19T18:49:25Z I0419 18:49:25.710462 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0419 18:49:25.710470 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0419 18:49:25.710478 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0419 18:49:25.717426 1 controller.go:554] The operator is healthy I0419 18:49:55.579416 1 controller.go:554] The operator is healthy I0419 18:50:30.042787 1 insightsreport.go:137] Pulling report from smart-proxy I0419 18:50:30.042813 1 insightsreport.go:149] Retrieving report I0419 18:50:30.050084 1 requests.go:110] Retrieving report for cluster: 4c465a98-310e-4de4-ab30-40022225a6d9 I0419 18:50:30.050095 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/4c465a98-310e-4de4-ab30-40022225a6d9/reports I0419 18:50:30.053312 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/4c465a98-310e-4de4-ab30-40022225a6d9/reports I0419 18:50:30.242738 1 insightsreport.go:184] Report retrieved I0419 18:50:30.270177 1 insightsreport.go:239] Report retrieved correctly I0419 18:51:55.578523 1 controller.go:554] The operator is healthy I0419 18:52:55.530542 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0419 18:52:55.536440 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0419 18:52:55.536456 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0419 18:52:55.541872 1 secretconfigobserver.go:119] support secret does not exist I0419 18:53:55.577818 1 controller.go:554] The operator is healthy I0419 18:55:55.579153 1 controller.go:554] The operator is healthy I0419 18:57:55.524770 1 configmapobserver.go:84] configmaps "insights-config" not found I0419 18:57:55.541947 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0419 18:57:55.547988 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0419 18:57:55.548022 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0419 18:57:55.556000 1 secretconfigobserver.go:119] support secret does not exist I0419 18:57:55.578113 1 controller.go:554] The operator is healthy I0419 18:59:55.578424 1 controller.go:554] The operator is healthy I0419 19:01:55.577837 1 controller.go:554] The operator is healthy I0419 19:02:55.556733 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0419 19:02:55.563970 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0419 19:02:55.563988 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0419 19:02:55.569341 1 secretconfigobserver.go:119] support secret does not exist I0419 19:03:55.578947 1 controller.go:554] The operator is healthy I0419 19:04:48.521061 1 insightsuploader.go:146] Nothing to report since 2026-04-19T18:49:25Z I0419 19:05:55.577522 1 controller.go:554] The operator is healthy I0419 19:07:55.525157 1 configmapobserver.go:84] configmaps "insights-config" not found I0419 19:07:55.532088 1 configmapobserver.go:84] configmaps "insights-config" not found I0419 19:07:55.570395 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0419 19:07:55.579241 1 controller.go:554] The operator is healthy I0419 19:07:55.580059 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0419 19:07:55.580076 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0419 19:07:55.587523 1 secretconfigobserver.go:119] support secret does not exist I0419 19:09:55.578281 1 controller.go:554] The operator is healthy I0419 19:11:55.578586 1 controller.go:554] The operator is healthy I0419 19:12:55.587609 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0419 19:12:55.594338 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0419 19:12:55.594355 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0419 19:12:55.599269 1 secretconfigobserver.go:119] support secret does not exist I0419 19:13:55.578995 1 controller.go:554] The operator is healthy I0419 19:15:55.580707 1 controller.go:554] The operator is healthy I0419 19:17:55.528794 1 configmapobserver.go:84] configmaps "insights-config" not found I0419 19:17:55.534330 1 configmapobserver.go:84] configmaps "insights-config" not found I0419 19:17:55.577366 1 controller.go:554] The operator is healthy I0419 19:17:55.599330 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0419 19:17:55.605306 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0419 19:17:55.605328 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0419 19:17:55.610402 1 secretconfigobserver.go:119] support secret does not exist I0419 19:19:55.581124 1 controller.go:554] The operator is healthy I0419 19:20:30.401163 1 insightsuploader.go:146] Nothing to report since 2026-04-19T18:49:25Z I0419 19:21:55.581311 1 controller.go:554] The operator is healthy