I0514 16:09:46.720151 1 cmd.go:253] Using service-serving-cert provided certificates I0514 16:09:46.720612 1 observer_polling.go:159] Starting file observer I0514 16:09:47.275440 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0514 16:09:47.275655 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0514 16:09:47.276312 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0514 16:09:47.276687 1 secure_serving.go:57] Forcing use of http/1.1 only W0514 16:09:47.276717 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0514 16:09:47.276724 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0514 16:09:47.276728 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0514 16:09:47.276731 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0514 16:09:47.276734 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0514 16:09:47.276737 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0514 16:09:47.282004 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0514 16:09:47.282761 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"b5f54062-54f6-481e-9a97-de74a6dac1e8", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0514 16:09:47.283204 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0514 16:09:47.283224 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0514 16:09:47.283232 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0514 16:09:47.283231 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0514 16:09:47.283250 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0514 16:09:47.283278 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0514 16:09:47.283619 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0514 16:09:47.283894 1 secure_serving.go:213] Serving securely on [::]:8443 I0514 16:09:47.283923 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0514 16:09:47.293334 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0514 16:09:47.293374 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0514 16:09:47.293471 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0514 16:09:47.299360 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 16:09:47.299376 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0514 16:09:47.304635 1 secretconfigobserver.go:119] support secret does not exist I0514 16:09:47.310063 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 16:09:47.315539 1 secretconfigobserver.go:119] support secret does not exist I0514 16:09:47.317637 1 recorder.go:176] Pruning old reports every 6h6m43s, max age is 288h0m0s I0514 16:09:47.324241 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0514 16:09:47.324279 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0514 16:09:47.324282 1 periodic.go:216] Running clusterconfig gatherer I0514 16:09:47.324300 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0514 16:09:47.324305 1 insightsreport.go:296] Starting report retriever I0514 16:09:47.324308 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0514 16:09:47.324326 1 tasks_processing.go:45] number of workers: 64 I0514 16:09:47.324350 1 tasks_processing.go:69] worker 4 listening for tasks. I0514 16:09:47.324360 1 tasks_processing.go:69] worker 0 listening for tasks. I0514 16:09:47.324363 1 tasks_processing.go:69] worker 14 listening for tasks. I0514 16:09:47.324366 1 tasks_processing.go:69] worker 3 listening for tasks. I0514 16:09:47.324374 1 tasks_processing.go:69] worker 5 listening for tasks. I0514 16:09:47.324375 1 tasks_processing.go:69] worker 1 listening for tasks. I0514 16:09:47.324378 1 tasks_processing.go:71] worker 3 working on machine_config_pools task. I0514 16:09:47.324376 1 tasks_processing.go:69] worker 2 listening for tasks. I0514 16:09:47.324384 1 tasks_processing.go:71] worker 1 working on openstack_dataplanedeployments task. I0514 16:09:47.324388 1 tasks_processing.go:69] worker 15 listening for tasks. I0514 16:09:47.324383 1 tasks_processing.go:69] worker 40 listening for tasks. I0514 16:09:47.324395 1 tasks_processing.go:71] worker 15 working on version task. I0514 16:09:47.324400 1 tasks_processing.go:69] worker 11 listening for tasks. I0514 16:09:47.324394 1 tasks_processing.go:69] worker 9 listening for tasks. I0514 16:09:47.324407 1 tasks_processing.go:69] worker 10 listening for tasks. I0514 16:09:47.324412 1 tasks_processing.go:69] worker 6 listening for tasks. I0514 16:09:47.324411 1 tasks_processing.go:69] worker 7 listening for tasks. I0514 16:09:47.324415 1 tasks_processing.go:69] worker 53 listening for tasks. I0514 16:09:47.324421 1 tasks_processing.go:69] worker 12 listening for tasks. I0514 16:09:47.324423 1 tasks_processing.go:69] worker 41 listening for tasks. I0514 16:09:47.324423 1 tasks_processing.go:69] worker 8 listening for tasks. I0514 16:09:47.324431 1 tasks_processing.go:69] worker 60 listening for tasks. I0514 16:09:47.324438 1 tasks_processing.go:69] worker 61 listening for tasks. I0514 16:09:47.324431 1 tasks_processing.go:69] worker 42 listening for tasks. I0514 16:09:47.324441 1 tasks_processing.go:69] worker 43 listening for tasks. I0514 16:09:47.324433 1 tasks_processing.go:69] worker 63 listening for tasks. I0514 16:09:47.324444 1 tasks_processing.go:69] worker 62 listening for tasks. I0514 16:09:47.324439 1 tasks_processing.go:69] worker 54 listening for tasks. I0514 16:09:47.324437 1 tasks_processing.go:69] worker 28 listening for tasks. I0514 16:09:47.324454 1 tasks_processing.go:69] worker 13 listening for tasks. I0514 16:09:47.324447 1 tasks_processing.go:69] worker 55 listening for tasks. I0514 16:09:47.324451 1 tasks_processing.go:69] worker 44 listening for tasks. I0514 16:09:47.324450 1 tasks_processing.go:69] worker 22 listening for tasks. I0514 16:09:47.324455 1 tasks_processing.go:69] worker 56 listening for tasks. I0514 16:09:47.324464 1 tasks_processing.go:69] worker 17 listening for tasks. I0514 16:09:47.324469 1 tasks_processing.go:69] worker 58 listening for tasks. I0514 16:09:47.324457 1 tasks_processing.go:69] worker 45 listening for tasks. I0514 16:09:47.324474 1 tasks_processing.go:69] worker 34 listening for tasks. I0514 16:09:47.324477 1 tasks_processing.go:69] worker 59 listening for tasks. I0514 16:09:47.324458 1 tasks_processing.go:69] worker 23 listening for tasks. I0514 16:09:47.324459 1 tasks_processing.go:69] worker 18 listening for tasks. I0514 16:09:47.324482 1 tasks_processing.go:69] worker 48 listening for tasks. I0514 16:09:47.324477 1 tasks_processing.go:69] worker 16 listening for tasks. I0514 16:09:47.324486 1 tasks_processing.go:69] worker 27 listening for tasks. I0514 16:09:47.324492 1 tasks_processing.go:71] worker 4 working on clusterroles task. I0514 16:09:47.324493 1 tasks_processing.go:69] worker 20 listening for tasks. I0514 16:09:47.324496 1 tasks_processing.go:69] worker 33 listening for tasks. I0514 16:09:47.324506 1 tasks_processing.go:69] worker 51 listening for tasks. I0514 16:09:47.324510 1 tasks_processing.go:69] worker 36 listening for tasks. I0514 16:09:47.324512 1 tasks_processing.go:69] worker 35 listening for tasks. I0514 16:09:47.324515 1 tasks_processing.go:69] worker 38 listening for tasks. I0514 16:09:47.324388 1 tasks_processing.go:71] worker 2 working on support_secret task. I0514 16:09:47.324509 1 tasks_processing.go:69] worker 39 listening for tasks. I0514 16:09:47.324504 1 tasks_processing.go:69] worker 52 listening for tasks. I0514 16:09:47.324503 1 tasks_processing.go:71] worker 14 working on infrastructures task. I0514 16:09:47.324462 1 tasks_processing.go:69] worker 57 listening for tasks. I0514 16:09:47.324488 1 tasks_processing.go:71] worker 0 working on ceph_cluster task. I0514 16:09:47.324585 1 tasks_processing.go:71] worker 11 working on validating_webhook_configurations task. I0514 16:09:47.324587 1 tasks_processing.go:71] worker 40 working on ingress_certificates task. I0514 16:09:47.324595 1 tasks_processing.go:71] worker 41 working on lokistack task. I0514 16:09:47.324601 1 tasks_processing.go:71] worker 60 working on ingress task. I0514 16:09:47.324600 1 tasks_processing.go:71] worker 57 working on olm_operators task. I0514 16:09:47.324613 1 tasks_processing.go:71] worker 9 working on container_runtime_configs task. I0514 16:09:47.324668 1 tasks_processing.go:71] worker 61 working on overlapping_namespace_uids task. I0514 16:09:47.324675 1 tasks_processing.go:71] worker 7 working on sap_datahubs task. I0514 16:09:47.324681 1 tasks_processing.go:71] worker 10 working on proxies task. I0514 16:09:47.324593 1 tasks_processing.go:71] worker 54 working on openstack_controlplanes task. I0514 16:09:47.324720 1 tasks_processing.go:71] worker 42 working on storage_cluster task. I0514 16:09:47.324738 1 tasks_processing.go:71] worker 63 working on openshift_logging task. I0514 16:09:47.324759 1 tasks_processing.go:71] worker 62 working on crds task. I0514 16:09:47.324780 1 tasks_processing.go:71] worker 53 working on aggregated_monitoring_cr_names task. I0514 16:09:47.324837 1 tasks_processing.go:71] worker 17 working on machine_configs task. I0514 16:09:47.324848 1 tasks_processing.go:71] worker 38 working on operators_pods_and_events task. I0514 16:09:47.324894 1 tasks_processing.go:71] worker 59 working on nodenetworkconfigurationpolicies task. I0514 16:09:47.324904 1 tasks_processing.go:71] worker 52 working on openstack_dataplanenodesets task. I0514 16:09:47.324907 1 tasks_processing.go:71] worker 12 working on dvo_metrics task. I0514 16:09:47.324933 1 tasks_processing.go:71] worker 39 working on operators task. I0514 16:09:47.324948 1 tasks_processing.go:71] worker 23 working on image task. I0514 16:09:47.324974 1 tasks_processing.go:71] worker 45 working on openshift_machine_api_events task. I0514 16:09:47.324609 1 tasks_processing.go:71] worker 6 working on sap_config task. I0514 16:09:47.324804 1 tasks_processing.go:71] worker 28 working on machine_sets task. I0514 16:09:47.325113 1 tasks_processing.go:71] worker 48 working on config_maps task. I0514 16:09:47.325117 1 tasks_processing.go:71] worker 34 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0514 16:09:47.324597 1 tasks_processing.go:71] worker 8 working on sap_pods task. I0514 16:09:47.324837 1 tasks_processing.go:71] worker 36 working on active_alerts task. I0514 16:09:47.325158 1 tasks_processing.go:71] worker 58 working on mutating_webhook_configurations task. I0514 16:09:47.324943 1 tasks_processing.go:71] worker 18 working on openstack_version task. I0514 16:09:47.324479 1 tasks_processing.go:69] worker 26 listening for tasks. I0514 16:09:47.325527 1 tasks_processing.go:71] worker 26 working on image_pruners task. I0514 16:09:47.324484 1 tasks_processing.go:69] worker 19 listening for tasks. I0514 16:09:47.324486 1 tasks_processing.go:69] worker 31 listening for tasks. I0514 16:09:47.325554 1 tasks_processing.go:71] worker 19 working on tsdb_status task. I0514 16:09:47.324492 1 tasks_processing.go:69] worker 49 listening for tasks. I0514 16:09:47.324498 1 tasks_processing.go:69] worker 50 listening for tasks. I0514 16:09:47.324491 1 tasks_processing.go:69] worker 32 listening for tasks. I0514 16:09:47.324492 1 tasks_processing.go:69] worker 30 listening for tasks. I0514 16:09:47.324505 1 tasks_processing.go:69] worker 37 listening for tasks. I0514 16:09:47.324379 1 tasks_processing.go:71] worker 5 working on monitoring_persistent_volumes task. I0514 16:09:47.325628 1 tasks_processing.go:71] worker 37 working on storage_classes task. I0514 16:09:47.325639 1 tasks_processing.go:71] worker 50 working on install_plans task. I0514 16:09:47.325662 1 tasks_processing.go:71] worker 31 working on node_logs task. I0514 16:09:47.324715 1 tasks_processing.go:71] worker 43 working on authentication task. I0514 16:09:47.325695 1 tasks_processing.go:71] worker 49 working on certificate_signing_requests task. I0514 16:09:47.325699 1 tasks_processing.go:71] worker 32 working on container_images task. I0514 16:09:47.325717 1 tasks_processing.go:71] worker 30 working on feature_gates task. I0514 16:09:47.324809 1 tasks_processing.go:71] worker 13 working on machine_healthchecks task. I0514 16:09:47.324813 1 tasks_processing.go:71] worker 55 working on pod_network_connectivity_checks task. I0514 16:09:47.324819 1 tasks_processing.go:71] worker 44 working on nodenetworkstates task. I0514 16:09:47.324820 1 tasks_processing.go:71] worker 16 working on image_registries task. I0514 16:09:47.324823 1 tasks_processing.go:71] worker 27 working on metrics task. I0514 16:09:47.324827 1 tasks_processing.go:71] worker 20 working on networks task. I0514 16:09:47.324827 1 tasks_processing.go:71] worker 22 working on nodes task. I0514 16:09:47.324830 1 tasks_processing.go:71] worker 33 working on schedulers task. I0514 16:09:47.324833 1 tasks_processing.go:71] worker 56 working on jaegers task. I0514 16:09:47.324833 1 tasks_processing.go:71] worker 51 working on silenced_alerts task. I0514 16:09:47.324844 1 tasks_processing.go:71] worker 35 working on machines task. I0514 16:09:47.324471 1 tasks_processing.go:69] worker 25 listening for tasks. I0514 16:09:47.324464 1 tasks_processing.go:69] worker 21 listening for tasks. I0514 16:09:47.327986 1 tasks_processing.go:71] worker 25 working on cluster_apiserver task. I0514 16:09:47.324475 1 tasks_processing.go:69] worker 47 listening for tasks. I0514 16:09:47.324484 1 tasks_processing.go:69] worker 29 listening for tasks. I0514 16:09:47.324464 1 tasks_processing.go:69] worker 24 listening for tasks. I0514 16:09:47.324464 1 tasks_processing.go:69] worker 46 listening for tasks. I0514 16:09:47.328024 1 tasks_processing.go:71] worker 46 working on qemu_kubevirt_launcher_logs task. I0514 16:09:47.328088 1 tasks_processing.go:71] worker 29 working on service_accounts task. I0514 16:09:47.328125 1 tasks_processing.go:71] worker 21 working on oauths task. I0514 16:09:47.328125 1 tasks_processing.go:71] worker 24 working on pdbs task. I0514 16:09:47.328077 1 tasks_processing.go:71] worker 47 working on cost_management_metrics_configs task. I0514 16:09:47.329049 1 tasks_processing.go:71] worker 1 working on node_features task. I0514 16:09:47.329053 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 4.652941ms to process 0 records E0514 16:09:47.330713 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.207.0:9091: connect: connection refused E0514 16:09:47.330714 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.207.0:9091: connect: connection refused I0514 16:09:47.330735 1 tasks_processing.go:71] worker 19 working on machine_autoscalers task. E0514 16:09:47.330738 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.33.89:9094: connect: connection refused E0514 16:09:47.330740 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.207.0:9091: connect: connection refused I0514 16:09:47.330755 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 5.166939ms to process 0 records E0514 16:09:47.330757 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.33.89:9094: connect: connection refused E0514 16:09:47.330774 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.207.0:9091: connect: connection refused I0514 16:09:47.330797 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 4.682817ms to process 0 records E0514 16:09:47.330818 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.33.89:9094: connect: connection refused I0514 16:09:47.330830 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 5.593097ms to process 0 records I0514 16:09:47.330832 1 tasks_processing.go:74] worker 27 stopped. E0514 16:09:47.330842 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.33.89:9094: connect: connection refused I0514 16:09:47.330855 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 2.999202ms to process 0 records I0514 16:09:47.330870 1 tasks_processing.go:74] worker 51 stopped. I0514 16:09:47.330881 1 tasks_processing.go:74] worker 36 stopped. I0514 16:09:47.331323 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0514 16:09:47.331339 1 controller.go:368] The initial operator extension status is healthy I0514 16:09:47.331347 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 16:09:47.331351 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0514 16:09:47.331354 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0514 16:09:47.331368 1 controller.go:531] The operator is still being initialized I0514 16:09:47.331376 1 controller.go:554] The operator is healthy I0514 16:09:47.331436 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0514 16:09:47.331442 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0514 16:09:47.331570 1 operator.go:328] started I0514 16:09:47.331591 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0514 16:09:47.334067 1 tasks_processing.go:74] worker 52 stopped. I0514 16:09:47.334080 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 9.149288ms to process 0 records I0514 16:09:47.335060 1 tasks_processing.go:74] worker 6 stopped. I0514 16:09:47.335072 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 10.068995ms to process 0 records I0514 16:09:47.335327 1 tasks_processing.go:74] worker 3 stopped. I0514 16:09:47.335338 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 10.942588ms to process 0 records I0514 16:09:47.335353 1 tasks_processing.go:74] worker 0 stopped. I0514 16:09:47.335357 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 10.810819ms to process 0 records I0514 16:09:47.335415 1 tasks_processing.go:74] worker 42 stopped. I0514 16:09:47.335431 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 10.684502ms to process 0 records I0514 16:09:47.335779 1 tasks_processing.go:74] worker 18 stopped. I0514 16:09:47.335794 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 10.598156ms to process 0 records I0514 16:09:47.335808 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 11.031913ms to process 0 records I0514 16:09:47.335812 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 10.722447ms to process 0 records I0514 16:09:47.335818 1 tasks_processing.go:74] worker 28 stopped. I0514 16:09:47.335826 1 tasks_processing.go:74] worker 63 stopped. I0514 16:09:47.337075 1 tasks_processing.go:74] worker 59 stopped. I0514 16:09:47.337089 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 12.164939ms to process 0 records I0514 16:09:47.337557 1 tasks_processing.go:74] worker 7 stopped. I0514 16:09:47.337568 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 12.870945ms to process 0 records I0514 16:09:47.338280 1 tasks_processing.go:74] worker 9 stopped. I0514 16:09:47.338291 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 13.654283ms to process 0 records I0514 16:09:47.343776 1 tasks_processing.go:74] worker 54 stopped. I0514 16:09:47.343789 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 19.051852ms to process 0 records I0514 16:09:47.343796 1 tasks_processing.go:74] worker 8 stopped. I0514 16:09:47.343805 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 18.661486ms to process 0 records I0514 16:09:47.343826 1 tasks_processing.go:74] worker 41 stopped. I0514 16:09:47.343839 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 19.218437ms to process 0 records E0514 16:09:47.343843 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) E0514 16:09:47.343848 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0514 16:09:47.343854 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 18.014339ms to process 0 records I0514 16:09:47.343859 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 14.788602ms to process 0 records E0514 16:09:47.343863 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0514 16:09:47.343866 1 tasks_processing.go:74] worker 55 stopped. I0514 16:09:47.343870 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 19.327995ms to process 0 records I0514 16:09:47.343873 1 tasks_processing.go:74] worker 1 stopped. I0514 16:09:47.343875 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 13.121339ms to process 0 records I0514 16:09:47.343880 1 tasks_processing.go:74] worker 2 stopped. I0514 16:09:47.343882 1 tasks_processing.go:74] worker 19 stopped. I0514 16:09:47.343884 1 tasks_processing.go:74] worker 45 stopped. I0514 16:09:47.343892 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 18.902012ms to process 0 records I0514 16:09:47.343981 1 tasks_processing.go:74] worker 13 stopped. E0514 16:09:47.343994 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0514 16:09:47.344001 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 18.17883ms to process 0 records I0514 16:09:47.344016 1 tasks_processing.go:74] worker 14 stopped. I0514 16:09:47.344551 1 recorder.go:75] Recording config/infrastructure with fingerprint=0a9cab10bcb59c294b209ef0a91353f1038f7897155e6efca0e928f9a98c340a I0514 16:09:47.344571 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 19.48198ms to process 1 records I0514 16:09:47.344641 1 recorder.go:75] Recording config/proxy with fingerprint=cc908abf03d52de6e0642bf596a6262ac8ed57d42a61b2716f900fbc1f089a4a I0514 16:09:47.344654 1 tasks_processing.go:74] worker 10 stopped. I0514 16:09:47.344653 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 19.652897ms to process 1 records I0514 16:09:47.344736 1 tasks_processing.go:74] worker 23 stopped. I0514 16:09:47.344747 1 recorder.go:75] Recording config/image with fingerprint=133fddb69104f43187f3bb9e6ba9e477803298b9649854014561188fad261057 I0514 16:09:47.344754 1 gather.go:177] gatherer "clusterconfig" function "image" took 19.603309ms to process 1 records I0514 16:09:47.344821 1 tasks_processing.go:74] worker 60 stopped. I0514 16:09:47.345033 1 recorder.go:75] Recording config/ingress with fingerprint=9302564deed278e85133c6dee4c1d510c8c321227a7b3ee5114123ce7975adc4 I0514 16:09:47.345050 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 20.202828ms to process 1 records I0514 16:09:47.357275 1 tasks_processing.go:74] worker 58 stopped. I0514 16:09:47.357436 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=fb0ff4f5bbfb0738204e8df2ae737dad2e187de0f8f3a5ce77014b8f3a0ad8f8 I0514 16:09:47.357473 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=b4945074ab570d41f420ab2ffa76e2e3be6e6089b384c60c5ed5a133cc8f4641 I0514 16:09:47.357505 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=cd6b705ea08d6284f97d06515238a218ef7f0b6a24b784b75e5c7162f5580990 I0514 16:09:47.357514 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 32.086316ms to process 3 records I0514 16:09:47.357600 1 tasks_processing.go:74] worker 26 stopped. I0514 16:09:47.357704 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=3d0997d8d764b8142ba0820aaf27a899f9d9af1400fe9bc0b8ea637b4b89abfd I0514 16:09:47.357714 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 31.938817ms to process 1 records I0514 16:09:47.357836 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0514 16:09:47.357850 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 16:09:47.357853 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0514 16:09:47.357856 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0514 16:09:47.357860 1 controller.go:254] Source scaController *sca.Controller is not ready I0514 16:09:47.357876 1 controller.go:531] The operator is still being initialized I0514 16:09:47.357881 1 controller.go:554] The operator is healthy I0514 16:09:47.359737 1 tasks_processing.go:74] worker 21 stopped. I0514 16:09:47.359927 1 recorder.go:75] Recording config/oauth with fingerprint=ec766b59e6697e3514a7771858270c562a85a951f068d1ab3471c3952d4bc317 I0514 16:09:47.359944 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 31.587103ms to process 1 records I0514 16:09:47.360536 1 tasks_processing.go:74] worker 17 stopped. E0514 16:09:47.360549 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0514 16:09:47.360574 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0514 16:09:47.360586 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 35.682964ms to process 1 records I0514 16:09:47.360593 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 33.385846ms to process 0 records I0514 16:09:47.360598 1 tasks_processing.go:74] worker 56 stopped. I0514 16:09:47.360626 1 tasks_processing.go:74] worker 35 stopped. E0514 16:09:47.360639 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0514 16:09:47.360647 1 gather.go:177] gatherer "clusterconfig" function "machines" took 32.710466ms to process 0 records I0514 16:09:47.360655 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 34.671264ms to process 0 records I0514 16:09:47.360665 1 tasks_processing.go:74] worker 44 stopped. I0514 16:09:47.360671 1 tasks_processing.go:74] worker 37 stopped. I0514 16:09:47.360683 1 gather_logs.go:145] no pods in namespace were found I0514 16:09:47.360985 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=67fcc28d19f84549114eca23ae59a56cc4db4941b251d766db2c0a5576fa48d1 I0514 16:09:47.361435 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=7284a0dc31e1eefb6df0f1e7e8aa769fc71acdb67c8f15930cc774c13dfda877 I0514 16:09:47.361524 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 35.03053ms to process 2 records I0514 16:09:47.361561 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 32.649083ms to process 0 records I0514 16:09:47.361597 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 32.386446ms to process 0 records I0514 16:09:47.361641 1 tasks_processing.go:74] worker 47 stopped. I0514 16:09:47.361668 1 tasks_processing.go:74] worker 46 stopped. I0514 16:09:47.363457 1 tasks_processing.go:74] worker 24 stopped. I0514 16:09:47.363610 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=14adf7c8cc727c26a9f76fd1768e9b412ae332072cf4b4a5eb9c9d7b4b341eda I0514 16:09:47.363646 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=3e3d5dcb881c9a81f58820dd4712b6f1765dc00d1673563536df226dddc0c1b5 I0514 16:09:47.363668 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=4d3598cf580c809bb791d4604ac6f968aaa5c12effd71af844edf2d5577c9d98 I0514 16:09:47.363694 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=6977551d0ef5aec51d914946267a99840c99878aa56f912d0d86a1f744884b27 I0514 16:09:47.363766 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=73bc62b8f907493a2f3cbbedca8fc2a4deba1a0e0f535e0fc52b14e3c15117f9 I0514 16:09:47.363794 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=be8e9c40f240664ae14e331f30d282865d239f6186c505502b802f4327eb67db I0514 16:09:47.363816 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=498e7886fa0d65653a8f1f7de6f91841d2ec882b78b21e55dbc71467416b4efc I0514 16:09:47.363840 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=4522bde311c9e61abc14cbcb3df317446e4d73c33d519cecd7070a60586ac5e0 I0514 16:09:47.363863 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=3dd9efa0b9c952ae41d061a4f959c7f9591e8a8bb22e90fa7dcebda097b2d904 I0514 16:09:47.363888 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=6e83a957403db26a1680215d0c626ae17a27b52a507d11e266fedecddcc8d911 I0514 16:09:47.363897 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 35.248695ms to process 10 records I0514 16:09:47.363982 1 tasks_processing.go:74] worker 43 stopped. I0514 16:09:47.364175 1 recorder.go:75] Recording config/authentication with fingerprint=5312cc59bf69a20226ad8d977990a78a2071c6d14214c059d06bf7be82719dcb I0514 16:09:47.364191 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 37.883357ms to process 1 records I0514 16:09:47.364326 1 tasks_processing.go:74] worker 11 stopped. I0514 16:09:47.364349 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=f28c33eb8e0d33f7156c2bc9d330ac07a56865ed9c6a7c8bcfd31b73ca651392 I0514 16:09:47.364425 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=16573d80b26e21bd2f4095212e2655b57d69e9bb8ffdc7ee4ba10f6eb523fa76 I0514 16:09:47.364533 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=a1d064be465470edd02a7721d47940fb8418e55594eb9681a7e3e07ee2e85f7f I0514 16:09:47.364574 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=a3c8afeaf9d858e5658ade13fe5c45272a3766adff2af74bc6754ab6de1a8b08 I0514 16:09:47.364612 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=201904b8dcb0c7de9f41f8811db44decd10c0b51557cd7319e2aa8f7f9fc558a I0514 16:09:47.364691 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=5a6a198c3db0f0d6e33980fd6e0534c6b83f0fb831a93a120f00b23a4d2eba05 W0514 16:09:47.364734 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0514 16:09:47.364751 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=585944ddcbfe87775d066d766d1f1c0c5de71ac7e94e3e91137369dcc6c6620e I0514 16:09:47.364799 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=d1ebcbc83186ceded26cbedcbc25e2ab391955173345cc1b7895cbd5d20a28e2 I0514 16:09:47.364855 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=d4c35459827c78ab16f419f26a752aef2dc4a062252e015da5f49a7f94bbc1b9 I0514 16:09:47.364922 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=919950b6b018abef5a2e67286cce205e66f3676fabb6e797f76007b46ddea0bd I0514 16:09:47.364973 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=d59ac288d2793de5ce5599ebbf609f2b6859bd23ef5dad1a6afa6b1b3cd4960a I0514 16:09:47.365015 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=0fd98e24a41abea67cf756d2fd2203cd512f117f829ddbb2ba39e5bd192a32fd I0514 16:09:47.365048 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=f47d6ccfc474fc0ec528442cc6a1ba8b76edccb25a6a46362d2d806fd0d97fd5 I0514 16:09:47.365056 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 38.995027ms to process 13 records I0514 16:09:47.365072 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 37.960757ms to process 0 records I0514 16:09:47.365085 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 38.30604ms to process 0 records I0514 16:09:47.365098 1 tasks_processing.go:74] worker 31 stopped. I0514 16:09:47.365112 1 tasks_processing.go:74] worker 5 stopped. I0514 16:09:47.365183 1 tasks_processing.go:74] worker 4 stopped. I0514 16:09:47.365328 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=41268878ec99b6cb973bf0fbe0c08e295e1289f210b4402a6798c334c83397a1 I0514 16:09:47.365474 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=32ecad2cc4938275dc76d28c9b3ab922a143766b76f5d1e2fec42fcfac61e87e I0514 16:09:47.365487 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 39.688127ms to process 2 records I0514 16:09:47.365505 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0514 16:09:47.365512 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 39.572718ms to process 1 records I0514 16:09:47.365569 1 tasks_processing.go:74] worker 61 stopped. I0514 16:09:47.365919 1 recorder.go:75] Recording config/network with fingerprint=8abbb87ac72e5968a3e0dcf5f1453f0928aa512b0233f692a3fad2a011f2db3c I0514 16:09:47.365943 1 gather.go:177] gatherer "clusterconfig" function "networks" took 37.697047ms to process 1 records I0514 16:09:47.366056 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=7abb22b921d56bd50fe2dd0fc024f24dae983a9f52c5ef59a04ffaee4b46bd94 I0514 16:09:47.366097 1 tasks_processing.go:74] worker 20 stopped. I0514 16:09:47.366179 1 tasks_processing.go:74] worker 33 stopped. I0514 16:09:47.366218 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 37.850767ms to process 1 records I0514 16:09:47.366509 1 recorder.go:75] Recording config/apiserver with fingerprint=d849d8ad181a5c3bd0a2b8080f39c8cb17ca37e289a4a48e5addae1d710875be I0514 16:09:47.366526 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 36.971797ms to process 1 records I0514 16:09:47.366665 1 recorder.go:75] Recording config/featuregate with fingerprint=df94fa248d9235167aed4a8eddc17a8e88e903daa96bd70c0c7bb9b1473e7c2e I0514 16:09:47.366681 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 39.562979ms to process 1 records I0514 16:09:47.366764 1 tasks_processing.go:74] worker 25 stopped. I0514 16:09:47.366786 1 tasks_processing.go:74] worker 30 stopped. I0514 16:09:47.366858 1 tasks_processing.go:74] worker 16 stopped. I0514 16:09:47.367359 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=8c407713dadbc0388974400cad4e2acef932dcb2039ed50bb5771905db18492b I0514 16:09:47.367422 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 39.465256ms to process 1 records I0514 16:09:47.367789 1 tasks_processing.go:74] worker 62 stopped. I0514 16:09:47.371592 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=ae84c582712fd0082147c62e6807ff566abc9475aff598f81cd642a597ce182e I0514 16:09:47.372132 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=6b0785b2140cf42a9ac00c6cedf5104c3d229dd61b66059066ade44cda92c521 I0514 16:09:47.372153 1 gather.go:177] gatherer "clusterconfig" function "crds" took 41.342743ms to process 2 records I0514 16:09:47.372240 1 tasks_processing.go:74] worker 22 stopped. I0514 16:09:47.372747 1 recorder.go:75] Recording config/node/ip-10-0-0-158.ec2.internal with fingerprint=26b61745b435b617d948b286e8e8f0f3afe1ea07421f84155db305027c610e25 I0514 16:09:47.372888 1 recorder.go:75] Recording config/node/ip-10-0-1-122.ec2.internal with fingerprint=899ebf2cae97249027408bb9bddc98609778d0c18eba6da485d5378a8ea62562 I0514 16:09:47.372998 1 recorder.go:75] Recording config/node/ip-10-0-2-139.ec2.internal with fingerprint=ce2b2101809cdeb930870a9d7ac852305cf3765173ebe8b054af2544a61f9120 I0514 16:09:47.373017 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 45.341605ms to process 3 records I0514 16:09:47.373042 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 46.590428ms to process 0 records I0514 16:09:47.373115 1 tasks_processing.go:74] worker 49 stopped. I0514 16:09:47.373139 1 recorder.go:75] Recording config/olm_operators with fingerprint=3a16c28f9603292dab922ada4de4ebcf802dc32190845ebd1e9f0fbfba899dcf I0514 16:09:47.373176 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 47.919129ms to process 1 records I0514 16:09:47.373185 1 tasks_processing.go:74] worker 57 stopped. I0514 16:09:47.383276 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0514 16:09:47.383366 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0514 16:09:47.383378 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0514 16:09:47.393594 1 base_controller.go:82] Caches are synced for ConfigController I0514 16:09:47.393604 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0514 16:09:47.396887 1 tasks_processing.go:74] worker 53 stopped. I0514 16:09:47.396909 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 72.039652ms to process 0 records I0514 16:09:47.399473 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 16:09:47.402039 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0514 16:09:47.402175 1 tasks_processing.go:74] worker 32 stopped. I0514 16:09:47.403596 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-wnfmv with fingerprint=ed6676abc85eb65a4c04c157c4983fad1a2d862ebc803665aca3e5aa2588cf83 I0514 16:09:47.403938 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-jmv5n with fingerprint=69be1c17e209e98a61f3e771207984f9998239f4474bf3a5cd742a06699fd27d I0514 16:09:47.404008 1 recorder.go:75] Recording config/running_containers with fingerprint=7f54333f39b032f442f8a1e385bb7ac95f672e1739b9f6d688aa1ba8f0281ae2 I0514 16:09:47.404022 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 76.457317ms to process 3 records E0514 16:09:47.404034 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0514 16:09:47.404039 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2q9q434hk8vgse7t1urllt227aefs26c-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2q9q434hk8vgse7t1urllt227aefs26c-primary-cert-bundle-secret" not found I0514 16:09:47.404082 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=f1f97b07627dfc3c9c25f1331621654651cba78152e61443daa3d3e6b8dc7696 I0514 16:09:47.404092 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 78.508829ms to process 1 records I0514 16:09:47.404099 1 tasks_processing.go:74] worker 40 stopped. I0514 16:09:47.406766 1 tasks_processing.go:74] worker 34 stopped. I0514 16:09:47.406782 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 81.630354ms to process 0 records I0514 16:09:47.409407 1 tasks_processing.go:74] worker 48 stopped. E0514 16:09:47.409420 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0514 16:09:47.409425 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0514 16:09:47.409429 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0514 16:09:47.409438 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0514 16:09:47.409474 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0514 16:09:47.409485 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0514 16:09:47.409503 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0514 16:09:47.409516 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0514 16:09:47.409553 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0514 16:09:47.409560 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0514 16:09:47.409565 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 84.275371ms to process 7 records I0514 16:09:47.432104 1 base_controller.go:82] Caches are synced for LoggingSyncer I0514 16:09:47.432142 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0514 16:09:47.440792 1 tasks_processing.go:74] worker 15 stopped. I0514 16:09:47.441070 1 recorder.go:75] Recording config/version with fingerprint=cdc402c109b55d4c7811c10ebc908138e90d570584c4f8211e1df620b4ad59ed I0514 16:09:47.441084 1 recorder.go:75] Recording config/id with fingerprint=3cbd641f2e086b5fe2c9fde6aaa562c154f9e654137474c587214f731a259f6e I0514 16:09:47.441091 1 gather.go:177] gatherer "clusterconfig" function "version" took 116.384553ms to process 2 records I0514 16:09:47.452360 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0514 16:09:47.459172 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0514 16:09:47.471369 1 gather_cluster_operator_pods_and_events.go:121] Found 6 pods with 6 containers I0514 16:09:47.471381 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 4194304 bytes I0514 16:09:47.473086 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6d5d57f4bf-g7mz6 pod in namespace openshift-ingress (previous: false). I0514 16:09:47.503152 1 cluster_transfer.go:102] no available accepted cluster transfer I0514 16:09:47.503170 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0514 16:09:47.509018 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6d969849c5-4l44k pod in namespace openshift-ingress (previous: false). I0514 16:09:47.539856 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6d969849c5-5qmsv pod in namespace openshift-ingress (previous: false). I0514 16:09:47.551424 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5g787 pod in namespace openshift-ingress-canary (previous: false). I0514 16:09:47.562372 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-lqpjv pod in namespace openshift-ingress-canary (previous: false). I0514 16:09:47.587409 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-z5vsl pod in namespace openshift-ingress-canary (previous: false). I0514 16:09:47.626407 1 sca.go:266] etc-pki-entitlement secret successfully created I0514 16:09:47.626430 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0514 16:09:47.788532 1 tasks_processing.go:74] worker 38 stopped. I0514 16:09:47.788640 1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=1bef6d4c66755a2f505e23d66867c9c018964d7bf236a0864d6e751335a2e75c I0514 16:09:47.788733 1 recorder.go:75] Recording events/openshift-ingress with fingerprint=1dde400bca627bb7210cabdc09c5146fa1d9547f3c7ebc0a38c2d483e61e9620 I0514 16:09:47.788782 1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=5e0bb019ace1476b760b59eadf6b88fb084e8613b18944087f213bf9e7841456 I0514 16:09:47.788802 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-6d5d57f4bf-g7mz6/router_current.log with fingerprint=f6e35e219bcd1544f15a29d464447e5d8aa1a95ec42d672998f158de8dd3d327 I0514 16:09:47.788822 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-6d969849c5-4l44k/router_current.log with fingerprint=c056a594af1a1774934cadaedf096999ec8d5f14f4ae98aabe1208c95f43d90c I0514 16:09:47.788843 1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-6d969849c5-5qmsv/router_current.log with fingerprint=2b667cc272238d848910f5b30c58220f07839f905ed10477e428ce62c9bd6933 I0514 16:09:47.788853 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-5g787/serve-healthcheck-canary_current.log with fingerprint=9538753e07030090de8055eda3fd223b6176c1ef1ab85c60f865272d309f304d I0514 16:09:47.788857 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-lqpjv/serve-healthcheck-canary_current.log with fingerprint=44c4a6fc5830e28fbddeb305360a2712f647f8b8b81e88d3acbcacf599bdc643 I0514 16:09:47.788861 1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-z5vsl/serve-healthcheck-canary_current.log with fingerprint=e2bfd2e58a144caaf215f676397eaeec2ae6757aeb36a30c2967aca3cef7c9f6 I0514 16:09:47.788868 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 463.662731ms to process 9 records W0514 16:09:48.363983 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0514 16:09:49.363726 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0514 16:09:49.807544 1 tasks_processing.go:74] worker 39 stopped. I0514 16:09:49.807666 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=08913b86a93aeeb10a12c81e8ac8c2c2bd3b3cd9af884b07557935471e17ae3e I0514 16:09:49.807713 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0514 16:09:49.807747 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=2653c0cddda2b6040a422100b4f6303502e699ca7ff3b7952e5084c35fbac378 I0514 16:09:49.807757 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0514 16:09:49.807777 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=6cacf2f6aa3371036f9f950368887bf3f5e9d2161c98b4b95083abc9b9350c12 I0514 16:09:49.807793 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0514 16:09:49.807813 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=ec3bfe12415942c5f893d7da6b25fcef2985f87a273c93250681d2c800a09a89 I0514 16:09:49.807838 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=f747240122a6a7ea60a06f7e862b5381f4e94a18c407db82e1b561029f930b99 I0514 16:09:49.807861 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=3ba0956b1db4a69147c52855b3cdcf39fdd36b87cb72fceb7b1c79b82098a21e I0514 16:09:49.807893 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=9dbfe26b4bdf17310f129cc04a8d21a440ed5bd45f7a9facbd8211f1aba3ebca I0514 16:09:49.808174 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=20508627ad18c65164767af1abd43b878dc33e490c33f4868f4b8dd0558f67bc I0514 16:09:49.808193 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=f1ff1df306f807e3760b43722f9ca730e06cffbb35140dce25bcade767c1b324 I0514 16:09:49.808202 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0514 16:09:49.808217 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=ac26168630b5fef4278f4ef88eec25ffd997b3e1ec6a852b5bff529dd89b0cd6 I0514 16:09:49.808227 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0514 16:09:49.808242 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=7b6e0d358086141d66adbc945c91c008ebb63fa34ad3ab7c6e3c2277e0b8347e I0514 16:09:49.808249 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0514 16:09:49.808282 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=6d4e66c88e0c8ba4feff75fec2205302a2654db5ee1e0a3097b13163c0186b10 I0514 16:09:49.808293 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0514 16:09:49.808311 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=5d8126971d443c9cfb9fc93d0325c709215300818835247847d7a3a0eaf892ab I0514 16:09:49.808410 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=c877fa7db261678ed52678c97d14ae5665b368013b920cc07e7d012374a63da4 I0514 16:09:49.808420 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0514 16:09:49.808427 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0514 16:09:49.808447 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0514 16:09:49.808470 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=cdd72bddb36d1eebff8174104ecb2fa349c81f2a5c25f434744fea857621b038 I0514 16:09:49.808493 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=3725d06dc57d9c620c04d4156b2e5aa7f6b881dd9a335bea98c920241b88d099 I0514 16:09:49.808504 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0514 16:09:49.808520 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=7e353a5da262d924a4e572a1d055bac827bdac3d0bf956272d84027036a6bb4d I0514 16:09:49.808530 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0514 16:09:49.808547 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=98f9d59872e9a6aed22f50555010efd5737524267465bf142220ae13d4ad1ffa I0514 16:09:49.808557 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0514 16:09:49.808570 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=922aa2c7c2a215888880ab4129fad6e04b676b18cb5516b652eb82256d392e2b I0514 16:09:49.808584 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=62a00bc79f57adc42b11cc01f8c9d557612698560b105219f8dce978b7d629b7 I0514 16:09:49.808597 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=641d4f8e2b9c8d18fe988328c065009a011d575802a23fb2e06b89c9f6f48542 I0514 16:09:49.808618 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=d2a47b0ff4140dda029cc36d5770031924f6dd3a1612fbcc59d03d801549a399 I0514 16:09:49.808628 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0514 16:09:49.808655 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=4ebaf670003ed283207bab8cb9cf41b92fbb900efe6d9530fb66ce240d97b5f5 I0514 16:09:49.808672 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0514 16:09:49.808681 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0514 16:09:49.808688 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.482584137s to process 39 records W0514 16:09:50.363207 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0514 16:09:51.363314 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0514 16:09:52.363887 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0514 16:09:52.363914 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0514 16:09:52.363932 1 tasks_processing.go:74] worker 12 stopped. E0514 16:09:52.363945 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0514 16:09:52.363956 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0514 16:09:52.363966 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.039006798s to process 1 records I0514 16:10:00.371392 1 tasks_processing.go:74] worker 50 stopped. I0514 16:10:00.371436 1 recorder.go:75] Recording config/installplans with fingerprint=95dfd5f33a9a46199239158a0ec0183b629818eca24ae41f4d706d7a3d604aec I0514 16:10:00.371478 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.045734811s to process 1 records I0514 16:10:01.135853 1 tasks_processing.go:74] worker 29 stopped. I0514 16:10:01.136132 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=4beec2c603fb3d8842305a07eebc66583bf101d72c28dd1b52fdf1785569c930 I0514 16:10:01.136150 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.8077043s to process 1 records E0514 16:10:01.136219 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.811s with: function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"active_alerts\" failed with an error, function \"silenced_alerts\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machine_configs\" failed with an error, function \"machines\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error" I0514 16:10:01.137327 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "tsdb_status" failed with an error, function "metrics" failed with an error, function "active_alerts" failed with an error, function "silenced_alerts" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "machines" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error I0514 16:10:01.137341 1 periodic.go:216] Running workloads gatherer I0514 16:10:01.137362 1 tasks_processing.go:45] number of workers: 2 I0514 16:10:01.137375 1 tasks_processing.go:69] worker 1 listening for tasks. I0514 16:10:01.137381 1 tasks_processing.go:71] worker 1 working on workload_info task. I0514 16:10:01.137387 1 tasks_processing.go:69] worker 0 listening for tasks. I0514 16:10:01.137398 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0514 16:10:01.144933 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-139.ec2.internal... I0514 16:10:01.144940 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-158.ec2.internal... I0514 16:10:01.144950 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-122.ec2.internal... I0514 16:10:01.171851 1 tasks_processing.go:74] worker 0 stopped. I0514 16:10:01.171870 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 34.436321ms to process 0 records I0514 16:10:05.666463 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 5s I0514 16:10:05.693533 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 25s for image data I0514 16:10:05.703000 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (11ms) I0514 16:10:05.712729 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (10ms) I0514 16:10:05.722510 1 gather_workloads_info.go:387] No image sha256:3a1c7ec9bb0db343348170a70697ea3209ed81e22f1259ff694190e5d04ef250 (10ms) I0514 16:10:05.732331 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (10ms) I0514 16:10:05.741671 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (9ms) I0514 16:10:05.751180 1 gather_workloads_info.go:387] No image sha256:9d6d63dce784df5863e6a0ba4c11317a26c9d756d4e62d47759c97190a71cce5 (9ms) I0514 16:10:05.760462 1 gather_workloads_info.go:387] No image sha256:17aefdc2f4752c23dc8f0947bb01fc34635822eeb18f2d8a5eddf8211b84d450 (9ms) I0514 16:10:05.771051 1 gather_workloads_info.go:387] No image sha256:9ef6dc311b880a6442b7a3a19006ddd955c7da36850bf000f5c9b68fd0862dd4 (11ms) I0514 16:10:05.780861 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (10ms) I0514 16:10:05.790652 1 gather_workloads_info.go:387] No image sha256:1f118a4ec0b92cb88c8544ea31d2b9adfc7006eeddb7a8d260150ecbce4adb8c (10ms) I0514 16:10:05.802640 1 gather_workloads_info.go:387] No image sha256:1eb6a6ee3c66ac15be6bc21bb6015c595c11c15b9dfd21bd9f5ce7f7b990ebaa (12ms) I0514 16:10:05.916201 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (114ms) I0514 16:10:06.002897 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (87ms) I0514 16:10:06.108813 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (106ms) I0514 16:10:06.203933 1 gather_workloads_info.go:387] No image sha256:6c6d412ccf0c3d6a14645a79df6c4658c0f8725d7954cb83c3d2f0116499345a (95ms) I0514 16:10:06.302564 1 gather_workloads_info.go:387] No image sha256:0b2e6536a0ca3afc5e64a218087a6287c74b77a359075a385f1949ca5bd51b22 (99ms) I0514 16:10:06.402903 1 gather_workloads_info.go:387] No image sha256:f68c0da8268f23078f5f760a91a3c8212f2195acf18c231f6e034207a67adeec (100ms) I0514 16:10:06.503707 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (101ms) I0514 16:10:06.603319 1 gather_workloads_info.go:398] Found image sha256:23204877f166455ce8f9de9b91a467eeda576f172d5f96124a68aa986c4775d6 (100ms) I0514 16:10:06.702840 1 gather_workloads_info.go:387] No image sha256:15928a5b803fa00781b408dbc4c3bfa7c5287b18584ba31f817def8a4430c725 (99ms) I0514 16:10:06.803380 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (101ms) I0514 16:10:06.902427 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (99ms) I0514 16:10:07.002589 1 gather_workloads_info.go:387] No image sha256:5940cc34b322325618929b1e0eb3864dae73d54c8f5b474e218dfb28123a61c7 (100ms) I0514 16:10:07.104969 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (102ms) I0514 16:10:07.207476 1 gather_workloads_info.go:398] Found image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (102ms) I0514 16:10:07.303345 1 gather_workloads_info.go:387] No image sha256:53ff8efdd8f563421ebc1859ab021a3bbc1306f82d4ff5d9c21bc60ec5f57898 (96ms) I0514 16:10:07.403996 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (101ms) I0514 16:10:07.503403 1 gather_workloads_info.go:387] No image sha256:52db05084f2a2e7d7bf4040e4865df88ec4074efbbe59a78d861be2c5ab2aa40 (99ms) I0514 16:10:07.602779 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (99ms) I0514 16:10:07.705769 1 gather_workloads_info.go:387] No image sha256:bdeb1c455cffccdb6c90db238e9d371de06340b1d6105d47f66d87293f878ac1 (103ms) I0514 16:10:07.802830 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (97ms) I0514 16:10:07.902881 1 gather_workloads_info.go:387] No image sha256:0acfe677ed58031f8381cb8a4f2d8917ec4cfa95485e2a46529dffae54c75ace (100ms) I0514 16:10:08.003017 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (100ms) I0514 16:10:08.103539 1 gather_workloads_info.go:387] No image sha256:5ff204630794311b0b37fa7b197b933ad85d76a481bf7cdb3bcbada08f0cdcbf (101ms) I0514 16:10:08.202497 1 gather_workloads_info.go:387] No image sha256:5d6a2b8d2508c7da71192661e7c0dcf1335f48b6336a20189abffbe79eeff962 (99ms) I0514 16:10:08.303729 1 gather_workloads_info.go:387] No image sha256:572ebf7c7fab1a518582f3ca46c866730423cce6e8a19f614dc15fd61bf0c65a (101ms) I0514 16:10:08.403237 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (99ms) I0514 16:10:08.502479 1 gather_workloads_info.go:387] No image sha256:3380fecebaeee139c1607fbcd9346cebc92806679568e2244a8905ef0f52aad2 (99ms) I0514 16:10:08.602794 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (100ms) I0514 16:10:08.703090 1 gather_workloads_info.go:387] No image sha256:15e1b5f763553e86d0230a751b0783e3b990438fd07cf96eed164bccb72ed564 (100ms) I0514 16:10:08.802849 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (100ms) I0514 16:10:08.903385 1 gather_workloads_info.go:387] No image sha256:48f5559439bea030a6423652da448c25fff0c62ba293eb521843c1a8eb89ddb0 (101ms) I0514 16:10:09.003437 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (100ms) I0514 16:10:09.102893 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (99ms) I0514 16:10:09.203381 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (100ms) I0514 16:10:09.304301 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (101ms) I0514 16:10:09.403058 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (99ms) I0514 16:10:09.504795 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (102ms) I0514 16:10:09.603124 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (98ms) I0514 16:10:09.603160 1 tasks_processing.go:74] worker 1 stopped. I0514 16:10:09.603577 1 recorder.go:75] Recording config/workload_info with fingerprint=8c699c096e65ed3bfdc7b48c0ceb73bcb10f17063692ec5a0b7a8ffa03b44a5e I0514 16:10:09.603598 1 gather.go:177] gatherer "workloads" function "workload_info" took 8.465770465s to process 1 records I0514 16:10:09.603614 1 periodic.go:263] Periodic gather workloads completed in 8.466s I0514 16:10:09.603623 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0514 16:10:09.603627 1 periodic.go:216] Running conditional gatherer I0514 16:10:09.609751 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0514 16:10:09.760003 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer E0514 16:10:09.762435 1 conditional_gatherer.go:324] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.207.0:9091: connect: connection refused I0514 16:10:09.762512 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0514 16:10:09.768769 1 conditional_gatherer.go:392] cluster version is '4.21.9' E0514 16:10:09.768786 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 16:10:09.768791 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 16:10:09.768794 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 16:10:09.768797 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 16:10:09.768801 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 16:10:09.768804 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 16:10:09.768806 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 16:10:09.768809 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 16:10:09.768813 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing E0514 16:10:09.768817 1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing I0514 16:10:09.768831 1 tasks_processing.go:45] number of workers: 3 I0514 16:10:09.768843 1 tasks_processing.go:69] worker 2 listening for tasks. I0514 16:10:09.768849 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0514 16:10:09.768853 1 tasks_processing.go:69] worker 0 listening for tasks. I0514 16:10:09.768865 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0514 16:10:09.768871 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0514 16:10:09.768870 1 tasks_processing.go:69] worker 1 listening for tasks. I0514 16:10:09.768880 1 tasks_processing.go:74] worker 1 stopped. I0514 16:10:09.768930 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0514 16:10:09.768945 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.132µs to process 1 records I0514 16:10:09.768978 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0514 16:10:09.768986 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.064µs to process 1 records I0514 16:10:09.768992 1 tasks_processing.go:74] worker 0 stopped. I0514 16:10:09.769580 1 tasks_processing.go:74] worker 2 stopped. I0514 16:10:09.769669 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 692.836µs to process 0 records I0514 16:10:09.769722 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0514 16:10:09.769766 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0514 16:10:09.798024 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=e4ab70aeb733ad0d65541540dcd2a69b8a240bd1197c220abb88ff99ee3821a1 I0514 16:10:09.798160 1 diskrecorder.go:70] Writing 118 records to /var/lib/insights-operator/insights-2026-05-14-161009.tar.gz I0514 16:10:09.805775 1 diskrecorder.go:51] Wrote 118 records to disk in 7ms I0514 16:10:09.805806 1 periodic.go:285] Gathering cluster info every 2h0m0s I0514 16:10:09.805825 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0514 16:11:17.325249 1 diskrecorder.go:223] Found files to send: insights-2026-05-14-161009.tar.gz I0514 16:11:17.325308 1 insightsuploader.go:150] Checking archives to upload periodically every 15m10.783760505s I0514 16:11:17.325320 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0514 16:11:17.335951 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0514 16:11:17.569203 1 requests.go:87] Successfully reported id=2026-05-14T16:11:17Z x-rh-insights-request-id=56b4c01f7b9d4942b0ec93e1f9aa50d0, wrote=56855 I0514 16:11:17.569328 1 insightsuploader.go:187] Uploaded report successfully in 244.001731ms I0514 16:11:17.569348 1 controller.go:129] Initializing last reported time to 2026-05-14T16:11:17Z I0514 16:11:17.569402 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0514 16:11:17.569416 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0514 16:11:17.569425 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0514 16:11:17.575399 1 controller.go:554] The operator is healthy I0514 16:11:47.340526 1 controller.go:554] The operator is healthy I0514 16:12:21.527414 1 insightsreport.go:137] Pulling report from smart-proxy I0514 16:12:21.527440 1 insightsreport.go:149] Retrieving report I0514 16:12:21.534602 1 requests.go:110] Retrieving report for cluster: 8d7c9b51-a3ca-46bd-a5e4-e29b828b595e I0514 16:12:21.534615 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/8d7c9b51-a3ca-46bd-a5e4-e29b828b595e/reports I0514 16:12:21.537698 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/8d7c9b51-a3ca-46bd-a5e4-e29b828b595e/reports I0514 16:12:21.798621 1 insightsreport.go:184] Report retrieved I0514 16:12:21.834731 1 insightsreport.go:239] Report retrieved correctly I0514 16:13:47.344312 1 controller.go:554] The operator is healthy I0514 16:14:47.316460 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 16:14:47.325630 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 16:14:47.325648 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 16:14:47.330018 1 secretconfigobserver.go:119] support secret does not exist I0514 16:15:47.341865 1 controller.go:554] The operator is healthy I0514 16:17:47.338543 1 controller.go:554] The operator is healthy I0514 16:19:47.310167 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 16:19:47.317242 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 16:19:47.330290 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 16:19:47.335284 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 16:19:47.335309 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 16:19:47.338836 1 controller.go:554] The operator is healthy I0514 16:19:47.339705 1 secretconfigobserver.go:119] support secret does not exist I0514 16:21:47.338946 1 controller.go:554] The operator is healthy I0514 16:23:47.338284 1 controller.go:554] The operator is healthy I0514 16:24:47.340450 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 16:24:47.348231 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 16:24:47.348248 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 16:24:47.352700 1 secretconfigobserver.go:119] support secret does not exist I0514 16:25:47.338720 1 controller.go:554] The operator is healthy I0514 16:26:33.354148 1 insightsuploader.go:146] Nothing to report since 2026-05-14T16:11:17Z I0514 16:27:47.341485 1 controller.go:554] The operator is healthy I0514 16:29:47.311011 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 16:29:47.337845 1 controller.go:554] The operator is healthy I0514 16:29:47.353670 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 16:29:47.358463 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 16:29:47.358479 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 16:29:47.362929 1 secretconfigobserver.go:119] support secret does not exist I0514 16:31:47.339476 1 controller.go:554] The operator is healthy I0514 16:33:47.339575 1 controller.go:554] The operator is healthy I0514 16:34:47.363941 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 16:34:47.370767 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 16:34:47.370798 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 16:34:47.375541 1 secretconfigobserver.go:119] support secret does not exist I0514 16:35:47.339343 1 controller.go:554] The operator is healthy I0514 16:37:47.338667 1 controller.go:554] The operator is healthy I0514 16:39:47.311472 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 16:39:47.317193 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 16:39:47.339833 1 controller.go:554] The operator is healthy I0514 16:39:47.375788 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 16:39:47.380896 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 16:39:47.380917 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 16:39:47.385625 1 secretconfigobserver.go:119] support secret does not exist I0514 16:41:47.339698 1 controller.go:554] The operator is healthy I0514 16:42:09.687948 1 insightsuploader.go:146] Nothing to report since 2026-05-14T16:11:17Z I0514 16:43:47.338945 1 controller.go:554] The operator is healthy I0514 16:44:47.385869 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 16:44:47.391821 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 16:44:47.391842 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 16:44:47.396118 1 secretconfigobserver.go:119] support secret does not exist I0514 16:45:47.338599 1 controller.go:554] The operator is healthy I0514 16:47:47.338143 1 controller.go:554] The operator is healthy I0514 16:49:47.311647 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 16:49:47.337199 1 controller.go:554] The operator is healthy I0514 16:49:47.396365 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 16:49:47.401033 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 16:49:47.401053 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 16:49:47.405187 1 secretconfigobserver.go:119] support secret does not exist I0514 16:51:47.339317 1 controller.go:554] The operator is healthy I0514 16:53:47.338773 1 controller.go:554] The operator is healthy I0514 16:54:47.405514 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 16:54:47.414414 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 16:54:47.414435 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 16:54:47.418769 1 secretconfigobserver.go:119] support secret does not exist