I0311 02:41:41.730748 1 cmd.go:253] Using service-serving-cert provided certificates I0311 02:41:41.731271 1 observer_polling.go:159] Starting file observer W0311 02:41:41.752013 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0311 02:41:42.096006 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0311 02:41:42.096343 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0311 02:41:42.097326 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0311 02:41:42.097611 1 secure_serving.go:57] Forcing use of http/1.1 only W0311 02:41:42.097635 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0311 02:41:42.097645 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0311 02:41:42.097651 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0311 02:41:42.097655 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0311 02:41:42.097658 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0311 02:41:42.097661 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0311 02:41:42.101289 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0311 02:41:42.101368 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0311 02:41:42.102620 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0311 02:41:42.102636 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0311 02:41:42.102652 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0311 02:41:42.102652 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0311 02:41:42.102669 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0311 02:41:42.102702 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0311 02:41:42.103077 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0311 02:41:42.103905 1 secure_serving.go:213] Serving securely on [::]:8443 I0311 02:41:42.104004 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" E0311 02:41:42.105443 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.189ba9300a91914d openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-03-11 02:41:42.101258573 +0000 UTC m=+0.414707452,LastTimestamp:2026-03-11 02:41:42.101258573 +0000 UTC m=+0.414707452,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0311 02:41:42.106289 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0311 02:41:42.106315 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0311 02:41:42.106436 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0311 02:41:42.110844 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0311 02:41:42.110865 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0311 02:41:42.114902 1 secretconfigobserver.go:119] support secret does not exist I0311 02:41:42.119091 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0311 02:41:42.122870 1 secretconfigobserver.go:119] support secret does not exist I0311 02:41:42.125339 1 recorder.go:156] Pruning old reports every 8h32m25s, max age is 288h0m0s I0311 02:41:42.129646 1 periodic.go:212] Running clusterconfig gatherer I0311 02:41:42.129694 1 tasks_processing.go:45] number of workers: 32 I0311 02:41:42.129719 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0311 02:41:42.129726 1 tasks_processing.go:69] worker 13 listening for tasks. I0311 02:41:42.129730 1 insightsreport.go:296] Starting report retriever I0311 02:41:42.129734 1 tasks_processing.go:71] worker 13 working on openshift_machine_api_events task. I0311 02:41:42.129735 1 tasks_processing.go:69] worker 31 listening for tasks. I0311 02:41:42.129738 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0311 02:41:42.129743 1 tasks_processing.go:69] worker 1 listening for tasks. I0311 02:41:42.129736 1 tasks_processing.go:69] worker 19 listening for tasks. I0311 02:41:42.129735 1 tasks_processing.go:69] worker 0 listening for tasks. I0311 02:41:42.129747 1 tasks_processing.go:69] worker 20 listening for tasks. I0311 02:41:42.129757 1 tasks_processing.go:69] worker 2 listening for tasks. I0311 02:41:42.129756 1 tasks_processing.go:69] worker 11 listening for tasks. I0311 02:41:42.129763 1 tasks_processing.go:69] worker 22 listening for tasks. I0311 02:41:42.129766 1 tasks_processing.go:69] worker 14 listening for tasks. I0311 02:41:42.129756 1 tasks_processing.go:69] worker 21 listening for tasks. I0311 02:41:42.129771 1 tasks_processing.go:69] worker 10 listening for tasks. I0311 02:41:42.129773 1 tasks_processing.go:69] worker 23 listening for tasks. I0311 02:41:42.129763 1 tasks_processing.go:69] worker 9 listening for tasks. I0311 02:41:42.129778 1 tasks_processing.go:69] worker 15 listening for tasks. I0311 02:41:42.129774 1 tasks_processing.go:69] worker 3 listening for tasks. I0311 02:41:42.129781 1 tasks_processing.go:69] worker 4 listening for tasks. I0311 02:41:42.129783 1 tasks_processing.go:69] worker 28 listening for tasks. I0311 02:41:42.129782 1 tasks_processing.go:69] worker 27 listening for tasks. I0311 02:41:42.129789 1 tasks_processing.go:69] worker 29 listening for tasks. I0311 02:41:42.129789 1 tasks_processing.go:69] worker 16 listening for tasks. I0311 02:41:42.129792 1 tasks_processing.go:69] worker 24 listening for tasks. I0311 02:41:42.129796 1 tasks_processing.go:69] worker 17 listening for tasks. I0311 02:41:42.129799 1 tasks_processing.go:69] worker 25 listening for tasks. I0311 02:41:42.129800 1 tasks_processing.go:69] worker 30 listening for tasks. I0311 02:41:42.129797 1 tasks_processing.go:69] worker 5 listening for tasks. I0311 02:41:42.129804 1 tasks_processing.go:69] worker 6 listening for tasks. I0311 02:41:42.129806 1 tasks_processing.go:69] worker 18 listening for tasks. I0311 02:41:42.129807 1 tasks_processing.go:69] worker 26 listening for tasks. I0311 02:41:42.129809 1 tasks_processing.go:69] worker 12 listening for tasks. I0311 02:41:42.129726 1 tasks_processing.go:69] worker 8 listening for tasks. I0311 02:41:42.129816 1 tasks_processing.go:69] worker 7 listening for tasks. I0311 02:41:42.129818 1 tasks_processing.go:71] worker 23 working on cost_management_metrics_configs task. I0311 02:41:42.129823 1 tasks_processing.go:71] worker 14 working on install_plans task. I0311 02:41:42.129827 1 tasks_processing.go:71] worker 1 working on machine_config_pools task. I0311 02:41:42.129831 1 tasks_processing.go:71] worker 15 working on machine_sets task. I0311 02:41:42.129894 1 tasks_processing.go:71] worker 3 working on silenced_alerts task. I0311 02:41:42.129983 1 tasks_processing.go:71] worker 11 working on ceph_cluster task. I0311 02:41:42.130034 1 tasks_processing.go:71] worker 19 working on sap_pods task. I0311 02:41:42.130080 1 tasks_processing.go:71] worker 21 working on openstack_dataplanedeployments task. I0311 02:41:42.130218 1 tasks_processing.go:71] worker 22 working on tsdb_status task. I0311 02:41:42.129647 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0311 02:41:42.130290 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0311 02:41:42.130339 1 tasks_processing.go:71] worker 10 working on storage_cluster task. I0311 02:41:42.129823 1 tasks_processing.go:71] worker 7 working on oauths task. I0311 02:41:42.129823 1 tasks_processing.go:71] worker 31 working on operators task. I0311 02:41:42.130526 1 tasks_processing.go:71] worker 4 working on image_pruners task. I0311 02:41:42.130537 1 tasks_processing.go:71] worker 20 working on operators_pods_and_events task. I0311 02:41:42.129827 1 tasks_processing.go:71] worker 9 working on metrics task. I0311 02:41:42.129818 1 tasks_processing.go:71] worker 2 working on nodenetworkconfigurationpolicies task. I0311 02:41:42.130731 1 tasks_processing.go:71] worker 30 working on version task. I0311 02:41:42.130795 1 tasks_processing.go:71] worker 26 working on openstack_dataplanenodesets task. I0311 02:41:42.130834 1 tasks_processing.go:71] worker 17 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0311 02:41:42.130884 1 tasks_processing.go:71] worker 12 working on jaegers task. I0311 02:41:42.130978 1 tasks_processing.go:71] worker 8 working on networks task. I0311 02:41:42.131082 1 tasks_processing.go:71] worker 5 working on cluster_apiserver task. I0311 02:41:42.131206 1 tasks_processing.go:71] worker 0 working on validating_webhook_configurations task. I0311 02:41:42.131332 1 tasks_processing.go:71] worker 25 working on machine_autoscalers task. I0311 02:41:42.131430 1 tasks_processing.go:71] worker 24 working on nodenetworkstates task. I0311 02:41:42.131293 1 tasks_processing.go:71] worker 6 working on machine_configs task. I0311 02:41:42.130819 1 tasks_processing.go:71] worker 28 working on overlapping_namespace_uids task. I0311 02:41:42.130823 1 tasks_processing.go:71] worker 27 working on proxies task. I0311 02:41:42.130826 1 tasks_processing.go:71] worker 29 working on mutating_webhook_configurations task. I0311 02:41:42.131298 1 tasks_processing.go:71] worker 18 working on active_alerts task. I0311 02:41:42.130812 1 tasks_processing.go:71] worker 16 working on container_images task. I0311 02:41:42.135574 1 tasks_processing.go:71] worker 10 working on pdbs task. I0311 02:41:42.135664 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 5.219531ms to process 0 records I0311 02:41:42.135686 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 4.952362ms to process 0 records I0311 02:41:42.135701 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 5.526287ms to process 0 records I0311 02:41:42.135708 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 5.807547ms to process 0 records I0311 02:41:42.135713 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 5.826631ms to process 0 records I0311 02:41:42.135715 1 tasks_processing.go:71] worker 2 working on dvo_metrics task. I0311 02:41:42.135727 1 tasks_processing.go:71] worker 23 working on support_secret task. I0311 02:41:42.135718 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 5.66373ms to process 0 records I0311 02:41:42.135996 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 5.895119ms to process 0 records I0311 02:41:42.136015 1 tasks_processing.go:71] worker 19 working on feature_gates task. I0311 02:41:42.136055 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0311 02:41:42.136075 1 controller.go:317] The initial operator extension status is healthy I0311 02:41:42.136086 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0311 02:41:42.136092 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0311 02:41:42.136097 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0311 02:41:42.136114 1 controller.go:458] The operator is still being initialized I0311 02:41:42.136122 1 controller.go:481] The operator is healthy I0311 02:41:42.135732 1 tasks_processing.go:71] worker 21 working on certificate_signing_requests task. I0311 02:41:42.136300 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0311 02:41:42.136334 1 operator.go:287] started I0311 02:41:42.136359 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0311 02:41:42.135757 1 tasks_processing.go:71] worker 1 working on image_registries task. I0311 02:41:42.135737 1 tasks_processing.go:71] worker 11 working on aggregated_monitoring_cr_names task. I0311 02:41:42.136381 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s E0311 02:41:42.137682 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.129.0.13:53294->172.30.0.10:53: read: connection refused I0311 02:41:42.137697 1 tasks_processing.go:71] worker 22 working on config_maps task. E0311 02:41:42.137748 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.129.0.13:53294->172.30.0.10:53: read: connection refused E0311 02:41:42.137759 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.129.0.13:53294->172.30.0.10:53: read: connection refused I0311 02:41:42.137781 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 7.467152ms to process 0 records E0311 02:41:42.137796 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.129.0.13:53294->172.30.0.10:53: read: connection refused I0311 02:41:42.137820 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 7.221473ms to process 0 records I0311 02:41:42.137842 1 tasks_processing.go:71] worker 9 working on lokistack task. E0311 02:41:42.138084 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.129.0.13:33220->172.30.0.10:53: read: connection refused I0311 02:41:42.138103 1 tasks_processing.go:71] worker 18 working on crds task. E0311 02:41:42.138100 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.129.0.13:33220->172.30.0.10:53: read: connection refused E0311 02:41:42.138121 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.129.0.13:33220->172.30.0.10:53: read: connection refused I0311 02:41:42.138156 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 3.481635ms to process 0 records E0311 02:41:42.138170 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.129.0.13:33220->172.30.0.10:53: read: connection refused I0311 02:41:42.138186 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 8.211711ms to process 0 records I0311 02:41:42.138199 1 tasks_processing.go:71] worker 3 working on sap_datahubs task. I0311 02:41:42.139833 1 tasks_processing.go:71] worker 26 working on sap_config task. I0311 02:41:42.139853 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 8.992017ms to process 0 records I0311 02:41:42.140198 1 tasks_processing.go:71] worker 7 working on pod_network_connectivity_checks task. I0311 02:41:42.140629 1 recorder.go:70] Recording config/oauth with fingerprint=7ecc139632a2356aa583e1293fdfaaf955a4d2def41639d6f7bfa0a483d6f2ff I0311 02:41:42.140648 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 9.829393ms to process 1 records I0311 02:41:42.140729 1 tasks_processing.go:71] worker 4 working on ingress_certificates task. I0311 02:41:42.141098 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=330548adc27d77c6ec10be709af9946f830a268aeb0ddae745bdb1c018f1f3e6 I0311 02:41:42.141112 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 9.773206ms to process 1 records I0311 02:41:42.144046 1 tasks_processing.go:71] worker 24 working on monitoring_persistent_volumes task. I0311 02:41:42.144053 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 12.113606ms to process 0 records I0311 02:41:42.144067 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 12.673106ms to process 0 records I0311 02:41:42.144129 1 tasks_processing.go:71] worker 25 working on schedulers task. I0311 02:41:42.144279 1 tasks_processing.go:71] worker 15 working on service_accounts task. I0311 02:41:42.144308 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 14.440664ms to process 0 records I0311 02:41:42.144479 1 tasks_processing.go:71] worker 12 working on clusterroles task. I0311 02:41:42.144493 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 13.577968ms to process 0 records I0311 02:41:42.165502 1 tasks_processing.go:71] worker 13 working on machine_healthchecks task. I0311 02:41:42.165578 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 35.758143ms to process 0 records I0311 02:41:42.165638 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 27.302635ms to process 0 records I0311 02:41:42.165670 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 25.717162ms to process 0 records E0311 02:41:42.165697 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0311 02:41:42.165724 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 25.374336ms to process 0 records I0311 02:41:42.165743 1 tasks_processing.go:71] worker 7 working on image task. I0311 02:41:42.165777 1 tasks_processing.go:71] worker 5 working on node_logs task. I0311 02:41:42.165736 1 tasks_processing.go:71] worker 26 working on openstack_version task. I0311 02:41:42.165744 1 tasks_processing.go:71] worker 3 working on machines task. I0311 02:41:42.166014 1 recorder.go:70] Recording config/apiserver with fingerprint=8eadcb7e788e57a48436b9e1769a3c1c9b79adb142a4c4a739f3e1b385eeee08 I0311 02:41:42.166066 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 34.649374ms to process 1 records I0311 02:41:42.166343 1 tasks_processing.go:71] worker 9 working on authentication task. I0311 02:41:42.166367 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 28.49236ms to process 0 records I0311 02:41:42.166721 1 tasks_processing.go:71] worker 8 working on container_runtime_configs task. I0311 02:41:42.166980 1 recorder.go:70] Recording config/network with fingerprint=b55bbbd58935f43dc4a00c2e7d12ae41dc02a0a7b7ceaed41c8cdbb6da44a77b I0311 02:41:42.166999 1 gather.go:177] gatherer "clusterconfig" function "networks" took 35.722372ms to process 1 records I0311 02:41:42.167541 1 tasks_processing.go:71] worker 27 working on olm_operators task. I0311 02:41:42.167664 1 recorder.go:70] Recording config/proxy with fingerprint=449333874737d893b25d4500e39b5837fc9d28b514245296d74aaeeaf80e4991 I0311 02:41:42.167678 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 33.06388ms to process 1 records I0311 02:41:42.169266 1 tasks_processing.go:71] worker 0 working on storage_classes task. I0311 02:41:42.170022 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=cf2997f1b5c08b0224380f8b6966c77658eaa9bb656fb14246cadd72e74fccbc I0311 02:41:42.170201 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=5daab0701581adbf493909dd71e15937ecbeaf93078c7311e2cfa413456ed9ec I0311 02:41:42.170402 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=a43f06557bbd123adbdcfcf194c237c632148b94ba37ee05072463715a285d56 I0311 02:41:42.170454 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=05689940641ebea0e7403122067a244871b0cd29c6bf83f16942babbce0e6144 I0311 02:41:42.170500 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=b5c03bfa1568fc02f66c7cac7db508e21a42fdee0e42ee73023faba7e07dd7b4 I0311 02:41:42.170548 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=3dd0be6a89dcb9f289fb063a2a60694d38307cc91ad337d36a774533c57c7a09 I0311 02:41:42.170599 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=66ef99b48cb2260ad7341eda51a0271b2aa702f1d730d1652c859f9ecf234f41 I0311 02:41:42.170644 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=a42c431cfdd0c17cdd0b3b0f00c04d9ac8441418cb5d480650c7eee6026a0aba I0311 02:41:42.170711 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=98dbb4b5e942213832321f78b4042a5741cb56314eeb573d5253aa75791a2aae I0311 02:41:42.170758 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=f73a0e13b747c8599361501ac3a0341bedca4aa81c7131f5d9518f5a695737c4 I0311 02:41:42.170863 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=7eb5eda87cd0f43bd4d7a47b89ea0de2e38f70a0ad6117b8d572428c34dc0f40 I0311 02:41:42.170908 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=5ca2d3b9fb1cc1dc50652515c2157b40436d7ea23c297c2422337a829c11758e I0311 02:41:42.170927 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 37.933753ms to process 12 records I0311 02:41:42.171766 1 tasks_processing.go:71] worker 24 working on ingress task. I0311 02:41:42.171773 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 27.694645ms to process 0 records I0311 02:41:42.172515 1 tasks_processing.go:71] worker 23 working on openshift_logging task. E0311 02:41:42.172763 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0311 02:41:42.172805 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 36.733035ms to process 0 records I0311 02:41:42.172988 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=488e1fab5cab2426c3752128907663585e711a07bcbbac143b2873c0d78295ad I0311 02:41:42.173104 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=34ca7d16592104dcb5b2fdc25375598797cb4b00192d2850cac59246e562584c I0311 02:41:42.173190 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=8f6af7ff046a9474182254fb3109abd90108251ee9014a1c3d9087c4eeb80a7c I0311 02:41:42.173223 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 38.205192ms to process 3 records I0311 02:41:42.173387 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=0aec3553e068b968f743f59ddb5a5938c69650034aafaebaff324de6449b45ba I0311 02:41:42.173424 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 28.668271ms to process 1 records I0311 02:41:42.173573 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=1ddab9042988ccb36dc8f7c5d2fef750eb0a57af02f4538a5bb46a9fb58cda51 I0311 02:41:42.173622 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=367b8bfa6fb78075880c7ea0c815b04878cb006666d5589b1762cf0b2e43de51 I0311 02:41:42.173664 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=4557e2cad8fe976bdf0ab8a8fff7b2e46530585f58fc614c1e079177e07faa3e I0311 02:41:42.173706 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=299a48b859350b09539ec79b05cd886c5c008964526536350a01430e9d56ae87 I0311 02:41:42.173753 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=21323fb6e58b7f12502647f59ed9e7c739451738d9344fc6c7cc65c3964da07d I0311 02:41:42.173798 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=ea69a2bcfd3bac7159ab48f4e5d5157cbb7a79992812c9938ac88f8a8867b3c3 I0311 02:41:42.173852 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=0254a8f680a167210ff447ec297b7a31199ecd1a5bcd806be8e92fe9416e1f12 I0311 02:41:42.173896 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=4f67dff0412430e3a7faabdf1f0e1e94744aab0959e96888dafe8122d06b96c1 I0311 02:41:42.173943 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=c40b08df5485a751b384b7d75169ea4699bb40182a38b1b8296a1c8441b38302 I0311 02:41:42.174020 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=522e4dc226a2962f9ebea49e9396060bac81fd3f91414469c59d1595dcc030f5 I0311 02:41:42.174052 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 37.378729ms to process 10 records I0311 02:41:42.174076 1 tasks_processing.go:71] worker 10 working on openstack_controlplanes task. I0311 02:41:42.174221 1 recorder.go:70] Recording config/featuregate with fingerprint=2f8f8c1b1f4b5a8f9b2c8bd10840f9204096870e0b957452596f6bb486ce1ac3 I0311 02:41:42.174258 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 37.023813ms to process 1 records I0311 02:41:42.174038 1 tasks_processing.go:71] worker 25 working on infrastructures task. I0311 02:41:42.174581 1 tasks_processing.go:74] worker 19 stopped. I0311 02:41:42.173026 1 tasks_processing.go:71] worker 29 working on nodes task. I0311 02:41:42.174847 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0311 02:41:42.174896 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0311 02:41:42.174925 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0311 02:41:42.174940 1 tasks_processing.go:74] worker 1 stopped. I0311 02:41:42.174932 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=6b97513dbf2e5de60e01163f418f35ddbd65d4bf855f9d12c1089d564f2840c8 I0311 02:41:42.175030 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 37.088215ms to process 1 records E0311 02:41:42.175061 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0311 02:41:42.175096 1 gather.go:177] gatherer "clusterconfig" function "machines" took 8.01428ms to process 0 records E0311 02:41:42.175106 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0311 02:41:42.175146 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0311 02:41:42.175157 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 39.811067ms to process 1 records I0311 02:41:42.175165 1 tasks_processing.go:74] worker 6 stopped. I0311 02:41:42.175170 1 tasks_processing.go:74] worker 3 stopped. I0311 02:41:42.174947 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0311 02:41:42.175182 1 controller.go:203] Source scaController *sca.Controller is not ready I0311 02:41:42.175213 1 controller.go:458] The operator is still being initialized I0311 02:41:42.175246 1 controller.go:481] The operator is healthy I0311 02:41:42.175450 1 tasks_processing.go:74] worker 13 stopped. E0311 02:41:42.175491 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0311 02:41:42.175524 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 9.931605ms to process 0 records I0311 02:41:42.177242 1 tasks_processing.go:74] worker 26 stopped. I0311 02:41:42.177307 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 11.367014ms to process 0 records I0311 02:41:42.180038 1 tasks_processing.go:74] worker 28 stopped. I0311 02:41:42.180122 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0311 02:41:42.180171 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 45.592822ms to process 1 records I0311 02:41:42.180677 1 tasks_processing.go:74] worker 8 stopped. I0311 02:41:42.180742 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 13.93617ms to process 0 records I0311 02:41:42.181110 1 tasks_processing.go:74] worker 5 stopped. I0311 02:41:42.181168 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 15.301806ms to process 0 records I0311 02:41:42.181373 1 recorder.go:70] Recording config/image with fingerprint=6845454e9ca24a1f7898894e480b2d82bba5edab7dfc336b510932f9207f87ad I0311 02:41:42.181420 1 gather.go:177] gatherer "clusterconfig" function "image" took 15.412958ms to process 1 records I0311 02:41:42.181458 1 tasks_processing.go:74] worker 7 stopped. I0311 02:41:42.182634 1 tasks_processing.go:74] worker 9 stopped. I0311 02:41:42.183145 1 recorder.go:70] Recording config/authentication with fingerprint=f2cb51b6c6f2a5ea094566ac98d4720934ab4332e45226e3ff2f1cad88e08bba I0311 02:41:42.183171 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 16.274437ms to process 1 records W0311 02:41:42.183272 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0311 02:41:42.185429 1 tasks_processing.go:74] worker 23 stopped. I0311 02:41:42.185447 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 12.861756ms to process 0 records I0311 02:41:42.185473 1 tasks_processing.go:74] worker 21 stopped. I0311 02:41:42.185537 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 49.265335ms to process 0 records I0311 02:41:42.185789 1 tasks_processing.go:74] worker 30 stopped. I0311 02:41:42.187652 1 recorder.go:70] Recording config/version with fingerprint=5065125b209cb38d290a9ad9834bc0e127b153aa55ccb428c239d2b2bb7ba7c2 I0311 02:41:42.187716 1 recorder.go:70] Recording config/id with fingerprint=c1b81d4c32906b6740bda0de8aaf96c57481eabd3d09c0fb1bbec1d1c2035051 I0311 02:41:42.187752 1 gather.go:177] gatherer "clusterconfig" function "version" took 54.833821ms to process 2 records I0311 02:41:42.187787 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 11.653029ms to process 0 records I0311 02:41:42.188291 1 tasks_processing.go:74] worker 10 stopped. I0311 02:41:42.188409 1 tasks_processing.go:74] worker 18 stopped. I0311 02:41:42.188936 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=99df1fbf951e45e4e8cc57d369388f8d976ba1c62c06915e0fdf2b2a800a2645 I0311 02:41:42.189460 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=8d7cb04018a755cbd3f99d0fcd754ffb79cc1b63c594bf76650c6d46eb936732 I0311 02:41:42.189523 1 gather.go:177] gatherer "clusterconfig" function "crds" took 48.778241ms to process 2 records I0311 02:41:42.189837 1 recorder.go:70] Recording config/ingress with fingerprint=30f2a4a7e6f6aaa3780a76f6590ea978e0e39f2624a2da5ad06facfb7cfc51c1 I0311 02:41:42.189859 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 16.258237ms to process 1 records I0311 02:41:42.190033 1 tasks_processing.go:74] worker 24 stopped. I0311 02:41:42.190122 1 tasks_processing.go:74] worker 25 stopped. I0311 02:41:42.191173 1 recorder.go:70] Recording config/infrastructure with fingerprint=000834357d143f001e22950d61888c0cfe527e229c2677fb45eef20687e16fcc I0311 02:41:42.191197 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 13.53725ms to process 1 records I0311 02:41:42.191309 1 tasks_processing.go:74] worker 0 stopped. I0311 02:41:42.191350 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=a942019b13a8e6527fb39cf89b2ae8678a9736316fd337b45d93f9bcc79fc867 I0311 02:41:42.191376 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=823b1b3da5a6265eebfc62b219de600d889167a4df96343e9a8050eee5306e25 I0311 02:41:42.191390 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 18.913165ms to process 2 records E0311 02:41:42.191468 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27ebd2de4e-29fa-4480-a262-2adab41f5ceb%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:41354->172.30.0.10:53: read: connection refused I0311 02:41:42.191483 1 tasks_processing.go:74] worker 29 stopped. I0311 02:41:42.191494 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27ebd2de4e-29fa-4480-a262-2adab41f5ceb%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:41354->172.30.0.10:53: read: connection refused I0311 02:41:42.192020 1 recorder.go:70] Recording config/node/ip-10-0-0-56.ec2.internal with fingerprint=a6a921e56059887fb536187fc8e545e99238a29d902b2ade181c1eb191453dd7 I0311 02:41:42.192158 1 recorder.go:70] Recording config/node/ip-10-0-1-5.ec2.internal with fingerprint=304383b8b590c8ab8af4714534475013c92c40b97f6eaf1e65a7bab6482a6a0b I0311 02:41:42.192314 1 recorder.go:70] Recording config/node/ip-10-0-2-253.ec2.internal with fingerprint=8734457f97653b87a8dd88db8c76394b3a18ea4e339e3dfaf3341d68738b5308 I0311 02:41:42.192331 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 14.214645ms to process 3 records I0311 02:41:42.192435 1 tasks_processing.go:74] worker 12 stopped. I0311 02:41:42.192631 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=599ed22cdf629f72840df0591f7f0e3c610c283c602f5017b1105bf3cbf7ea23 I0311 02:41:42.192821 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=eb63ca70f5435659e5148de9e2b7ca1e20d9d60c38dbee53e0f5ff212afcd9f9 I0311 02:41:42.192836 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 45.18322ms to process 2 records I0311 02:41:42.197287 1 tasks_processing.go:74] worker 11 stopped. I0311 02:41:42.197352 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 60.727017ms to process 0 records I0311 02:41:42.198505 1 tasks_processing.go:74] worker 27 stopped. I0311 02:41:42.198792 1 recorder.go:70] Recording config/olm_operators with fingerprint=aca412c154117a91d530dd0cfb998cc34617182457d195801bbe28746c55ed39 I0311 02:41:42.198847 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 30.946402ms to process 1 records I0311 02:41:42.203158 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0311 02:41:42.203176 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0311 02:41:42.203196 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0311 02:41:42.203669 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0311 02:41:42.204573 1 tasks_processing.go:74] worker 4 stopped. E0311 02:41:42.204593 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0311 02:41:42.204599 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ov813frpdl19kmdpqltdi74ogel090g-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ov813frpdl19kmdpqltdi74ogel090g-primary-cert-bundle-secret" not found I0311 02:41:42.204663 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=ebedc5ac6eaa0e941bea7e71fc00e174755f69ad58ad334c022c599c10ed25f7 I0311 02:41:42.204675 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 63.830593ms to process 1 records I0311 02:41:42.206439 1 tasks_processing.go:74] worker 22 stopped. I0311 02:41:42.206524 1 base_controller.go:82] Caches are synced for ConfigController I0311 02:41:42.206569 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... E0311 02:41:42.206521 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0311 02:41:42.206617 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0311 02:41:42.206630 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0311 02:41:42.206644 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I0311 02:41:42.206694 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0311 02:41:42.206707 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0311 02:41:42.206718 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I0311 02:41:42.206734 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0311 02:41:42.206801 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0311 02:41:42.206852 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0311 02:41:42.206866 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 68.725411ms to process 7 records I0311 02:41:42.206908 1 tasks_processing.go:74] worker 17 stopped. I0311 02:41:42.206924 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 76.02358ms to process 0 records I0311 02:41:42.207443 1 tasks_processing.go:74] worker 16 stopped. W0311 02:41:42.208062 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:43377->172.30.0.10:53: read: connection refused I0311 02:41:42.208075 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.13:43377->172.30.0.10:53: read: connection refused I0311 02:41:42.208943 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-zmdbz with fingerprint=17960119b2d5c918fda43418fadcbb52dee895472bd6b59056d75ecb1e0add56 I0311 02:41:42.209071 1 recorder.go:70] Recording config/pod/openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-0-56.ec2.internal with fingerprint=07df9781afd09fb9626e9af6c5d19232fa9fd86d6e3e78ffcff18f997627e298 I0311 02:41:42.209327 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-fgfh6 with fingerprint=7dd2302fcd2c98ec13c36238e52a58f1434a6536452466348861ba4382b5ab78 I0311 02:41:42.209414 1 recorder.go:70] Recording config/running_containers with fingerprint=1f36ce290a8144827ad39ff604b908d2b8f9ee29c6e345a381f44658fb54143e I0311 02:41:42.209423 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 72.610018ms to process 4 records I0311 02:41:42.211467 1 configmapobserver.go:84] configmaps "insights-config" not found I0311 02:41:42.236803 1 base_controller.go:82] Caches are synced for LoggingSyncer I0311 02:41:42.236816 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0311 02:41:42.246680 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I0311 02:41:42.249088 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress" I0311 02:41:43.004315 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W0311 02:41:43.176820 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0311 02:41:43.204663 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0311 02:41:43.383808 1 gather_cluster_operator_pods_and_events.go:121] Found 25 pods with 28 containers I0311 02:41:43.383824 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 898779 bytes I0311 02:41:43.384010 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-85b84f584d-zmdbz pod in namespace openshift-console-operator (previous: true). I0311 02:41:44.005971 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found W0311 02:41:44.175776 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0311 02:41:44.608998 1 tasks_processing.go:74] worker 31 stopped. I0311 02:41:44.609120 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=5adaf425017c51df38c4ca504becdeaea3baac1b6ae26711065189f0b83452c9 I0311 02:41:44.609169 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0311 02:41:44.609191 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=385653cf4c7a4a0c257e6fe2d4ccdafb955cde3939432afe636f98880d14c012 I0311 02:41:44.609203 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0311 02:41:44.609225 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=78d850b199358391126f4427bb90f3ccbb9865044d2e7e2634fefa5fcaf73325 I0311 02:41:44.609245 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0311 02:41:44.609270 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=107f0c5d2b9780b3f57cf414baa6f32deea9571c5f4fede6f810b561f0237c78 I0311 02:41:44.609299 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=ea483c39834c96b06f961455b13130bd859ea5b20b814107e51fd17b96844b01 I0311 02:41:44.609325 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ddf21b31466affefeb109bc2d832bb4ad5ec49b44df0dfce1bdd62ffd63ea3fd I0311 02:41:44.609364 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=9d5ff3c9804b253b004103843ed5525f1a1066406f31a68449a4ad29c56a0005 I0311 02:41:44.609639 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=69661bf4bcb21d157ed8e747b7995b48d2dc3c32b01b77316f1019189f194fb0 I0311 02:41:44.609662 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=8490ae61718d4cbfe718e1dea49a0d704de8a125af1d7b9f30d4d1a6607d78f2 I0311 02:41:44.609671 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0311 02:41:44.609687 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=81fff9cf7f3117f50a4f9436a899b6e1e05d3c5e83222373921af4aa7c65127a I0311 02:41:44.609699 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0311 02:41:44.609715 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=09ff08e4f98336a699876c0645f885f8b09e3daeea68679888477c0329b690ae I0311 02:41:44.609725 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0311 02:41:44.609744 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=5216c9bebcbd9e5c2f02d7b29bc49110355c2a3cf4fa17fbf57579087c115caa I0311 02:41:44.609754 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0311 02:41:44.609774 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=f012850c3d740c2b8eff9ddc5e56d344a974dba64b7ad36960e8c4f25944a36f I0311 02:41:44.609877 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=12224138fab8366bf9156eb4d21397d9a800bc3edb1d42c8f2fc719c4a7773e1 I0311 02:41:44.609901 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0311 02:41:44.609920 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=e56361396209a98e172491c40bd7c9f37cf7f2b6695de4493c83c8f58dd9985d I0311 02:41:44.609944 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=4aca991510dcb8323c95d22d4f8853300da8beef1345b56694341bd2e59765df I0311 02:41:44.609979 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0311 02:41:44.609999 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=0cf18b65916502279034c770cbebf153965c50296cc4fd1715672f73fd825948 I0311 02:41:44.610010 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0311 02:41:44.610024 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=4b2eec85b6f22bbdf0dcf6d6263154c09d87e0a6541a6efbe4053371a44ae119 I0311 02:41:44.610041 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=1f7990e1a1098db8be8c3b48930ac8284be900ce74b09503ba311fe4226f7b75 I0311 02:41:44.610057 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=55948f92ba3b6372fbc4dafca89d250117333f86d905ad780d0bfdebba987349 I0311 02:41:44.610073 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=7fb5763ea79a73aa515f535a601cd9fa371df05372576966474113ebb927b4b6 I0311 02:41:44.610094 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=b785efbd6a0b77694afbe52c136718bf4af09fda74f72d98b7d88e022a3e7a10 I0311 02:41:44.610104 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0311 02:41:44.610128 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=9e2c20d401d36bb0595f43134a821584d359806c6cafc3e1b4e589290ed5d7ed I0311 02:41:44.610147 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0311 02:41:44.610156 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0311 02:41:44.610163 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.478478731s to process 36 records W0311 02:41:45.176587 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0311 02:41:46.175804 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0311 02:41:47.175610 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0311 02:41:47.175632 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0311 02:41:47.175648 1 tasks_processing.go:74] worker 2 stopped. E0311 02:41:47.175659 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0311 02:41:47.175669 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0311 02:41:47.175678 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.0399177s to process 1 records I0311 02:41:54.976584 1 tasks_processing.go:74] worker 14 stopped. I0311 02:41:54.976631 1 recorder.go:70] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539 I0311 02:41:54.976643 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.846743192s to process 1 records I0311 02:41:55.750756 1 tasks_processing.go:74] worker 15 stopped. I0311 02:41:55.751065 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=73582af525bf551f979ef96bfb3cbb0257826668d63659ccecb8b26ded60e307 I0311 02:41:55.751082 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.606451271s to process 1 records I0311 02:41:55.978625 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for console-operator-85b84f584d-zmdbz pod in namespace openshift-console-operator for failing operator console-operator (previous: true): "Get \"https://10.0.1.5:10250/containerLogs/openshift-console-operator/console-operator-85b84f584d-zmdbz/console-operator?limitBytes=898779&previous=true&tailLines=100×tamps=true\": http2: client connection lost" I0311 02:41:55.978647 1 gather_cluster_operator_pods_and_events.go:280] Error: "Get \"https://10.0.1.5:10250/containerLogs/openshift-console-operator/console-operator-85b84f584d-zmdbz/console-operator?limitBytes=898779&previous=true&tailLines=100×tamps=true\": http2: client connection lost" I0311 02:41:55.978658 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-85b84f584d-zmdbz pod in namespace openshift-console-operator (previous: false). I0311 02:41:56.010716 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-5bc959fc99-z487x pod in namespace openshift-console (previous: false). I0311 02:41:56.022001 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-69584d9c9f-szx5h pod in namespace openshift-console (previous: false). I0311 02:41:56.026942 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for console-69584d9c9f-szx5h pod in namespace openshift-console for failing operator console (previous: false): "pods \"console-69584d9c9f-szx5h\" not found" I0311 02:41:56.026986 1 gather_cluster_operator_pods_and_events.go:280] Error: "pods \"console-69584d9c9f-szx5h\" not found" I0311 02:41:56.027000 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-bf96f7cc7-brmgj pod in namespace openshift-console (previous: false). I0311 02:41:56.030921 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0311 02:41:56.030937 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-bf96f7cc7-p4m6j pod in namespace openshift-console (previous: false). I0311 02:41:56.040206 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-7b98f8c767-qt5vn pod in namespace openshift-console (previous: false). I0311 02:41:56.050895 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-7b98f8c767-rqqv8 pod in namespace openshift-console (previous: false). I0311 02:41:56.059486 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-bvrfn pod in namespace openshift-dns (previous: false). I0311 02:41:56.182192 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bvrfn pod in namespace openshift-dns for failing operator dns (previous: false): "Get \"https://10.0.2.253:10250/containerLogs/openshift-dns/dns-default-bvrfn/dns?limitBytes=898779&tailLines=100×tamps=true\": http2: client connection lost" I0311 02:41:56.182213 1 gather_cluster_operator_pods_and_events.go:280] Error: "Get \"https://10.0.2.253:10250/containerLogs/openshift-dns/dns-default-bvrfn/dns?limitBytes=898779&tailLines=100×tamps=true\": http2: client connection lost" I0311 02:41:56.182223 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-bvrfn pod in namespace openshift-dns (previous: false). I0311 02:42:01.200159 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bvrfn pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "Get \"https://10.0.2.253:10250/containerLogs/openshift-dns/dns-default-bvrfn/kube-rbac-proxy?limitBytes=898779&tailLines=100×tamps=true\": http: server gave HTTP response to HTTPS client" I0311 02:42:01.200182 1 gather_cluster_operator_pods_and_events.go:280] Error: "Get \"https://10.0.2.253:10250/containerLogs/openshift-dns/dns-default-bvrfn/kube-rbac-proxy?limitBytes=898779&tailLines=100×tamps=true\": http: server gave HTTP response to HTTPS client" I0311 02:42:01.200212 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-fcvmh pod in namespace openshift-dns (previous: false). I0311 02:42:01.211107 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-fcvmh pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-fcvmh\" is waiting to start: ContainerCreating" I0311 02:42:01.211123 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-fcvmh\" is waiting to start: ContainerCreating" I0311 02:42:01.211131 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-fcvmh pod in namespace openshift-dns (previous: false). I0311 02:42:01.221461 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-fcvmh pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-fcvmh\" is waiting to start: ContainerCreating" I0311 02:42:01.221474 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-fcvmh\" is waiting to start: ContainerCreating" I0311 02:42:01.221503 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-jnn86 pod in namespace openshift-dns (previous: false). I0311 02:42:01.230910 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-jnn86 pod in namespace openshift-dns (previous: false). I0311 02:42:01.240100 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-q2fxx pod in namespace openshift-dns (previous: false). I0311 02:42:06.258547 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-resolver-q2fxx pod in namespace openshift-dns for failing operator dns-node-resolver (previous: false): "Get \"https://10.0.2.253:10250/containerLogs/openshift-dns/node-resolver-q2fxx/dns-node-resolver?limitBytes=898779&tailLines=100×tamps=true\": http: server gave HTTP response to HTTPS client" I0311 02:42:06.258567 1 gather_cluster_operator_pods_and_events.go:280] Error: "Get \"https://10.0.2.253:10250/containerLogs/openshift-dns/node-resolver-q2fxx/dns-node-resolver?limitBytes=898779&tailLines=100×tamps=true\": http: server gave HTTP response to HTTPS client" I0311 02:42:06.258578 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-qjfsd pod in namespace openshift-dns (previous: false). I0311 02:42:06.268241 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0311 02:42:06.268257 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-vvmzn pod in namespace openshift-dns (previous: false). I0311 02:42:06.279051 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-749b4fd975-b5424 pod in namespace openshift-image-registry (previous: false). I0311 02:42:06.288616 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-798cf758cb-688qn pod in namespace openshift-image-registry (previous: false). I0311 02:42:06.292514 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0311 02:42:06.292527 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-798cf758cb-pwfqd pod in namespace openshift-image-registry (previous: false). I0311 02:42:06.306996 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-5hddq pod in namespace openshift-image-registry (previous: false). I0311 02:42:16.330646 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-ca-5hddq pod in namespace openshift-image-registry for failing operator node-ca (previous: false): "Get \"https://10.0.2.253:10250/containerLogs/openshift-image-registry/node-ca-5hddq/node-ca?limitBytes=898779&tailLines=100×tamps=true\": net/http: TLS handshake timeout" I0311 02:42:16.330666 1 gather_cluster_operator_pods_and_events.go:280] Error: "Get \"https://10.0.2.253:10250/containerLogs/openshift-image-registry/node-ca-5hddq/node-ca?limitBytes=898779&tailLines=100×tamps=true\": net/http: TLS handshake timeout" I0311 02:42:16.330679 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-lvv4z pod in namespace openshift-image-registry (previous: false). I0311 02:42:16.342605 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-t95md pod in namespace openshift-image-registry (previous: false). I0311 02:42:16.352776 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-664f95fc47-xtp7j pod in namespace openshift-ingress (previous: false). I0311 02:42:16.364195 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-868bd75fd6-gjkq7 pod in namespace openshift-ingress (previous: false). I0311 02:42:16.375929 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-868bd75fd6-x9rqw pod in namespace openshift-ingress (previous: false). I0311 02:42:16.388816 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-6vkkg pod in namespace openshift-ingress-canary (previous: false). I0311 02:42:16.397534 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-w7z4m pod in namespace openshift-ingress-canary (previous: false). I0311 02:42:16.408095 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-zsxgl pod in namespace openshift-ingress-canary (previous: false). I0311 02:42:21.427882 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-zsxgl pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "Get \"https://10.0.2.253:10250/containerLogs/openshift-ingress-canary/ingress-canary-zsxgl/serve-healthcheck-canary?limitBytes=898779&tailLines=100×tamps=true\": http: server gave HTTP response to HTTPS client" I0311 02:42:21.427902 1 gather_cluster_operator_pods_and_events.go:280] Error: "Get \"https://10.0.2.253:10250/containerLogs/openshift-ingress-canary/ingress-canary-zsxgl/serve-healthcheck-canary?limitBytes=898779&tailLines=100×tamps=true\": http: server gave HTTP response to HTTPS client" I0311 02:42:21.427921 1 tasks_processing.go:74] worker 20 stopped. I0311 02:42:21.428201 1 recorder.go:70] Recording events/openshift-console-operator with fingerprint=b526d6c5663127d66a788c8c9ed933d96bb2e9c6561e769e393917e278cd53a1 I0311 02:42:21.428306 1 recorder.go:70] Recording events/openshift-console with fingerprint=2b79b2229c13146e07812e15e3a6d04107b15429a0a055763650a967c4b5f608 I0311 02:42:21.428354 1 recorder.go:70] Recording events/openshift-dns with fingerprint=1ed9aee1ccc7cfee5ecaf4de6ed898f3da316f0cfbbbfd48c98f9014fdd09714 I0311 02:42:21.428467 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=8ac31b8e5297fd26a4a99bfd37a3a183f29812da57046fbfd34f95858cec57b5 I0311 02:42:21.428496 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=c3d1a5a2a3425cb11f16d0f95f2dc132a9c3c4a1dbc6a64766a590b56f2e33c1 I0311 02:42:21.428583 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=efa35a394d73b1991c61ee6be2d344f67aab92ee7a098413a85e969fbd4774fd I0311 02:42:21.428602 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=ba2b3677cf8b8b508f9815da77555a400daa5d24432db9388ad87488b2a6eeaf I0311 02:42:21.428736 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-zmdbz with fingerprint=17960119b2d5c918fda43418fadcbb52dee895472bd6b59056d75ecb1e0add56 E0311 02:42:21.428754 1 gather.go:161] error recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-85b84f584d-zmdbz.json" because of the error: the record with the same name "config/pod/openshift-console-operator/console-operator-85b84f584d-zmdbz.json" was already recorded and had the fingerprint "17960119b2d5c918fda43418fadcbb52dee895472bd6b59056d75ecb1e0add56", overwriting with the record having fingerprint "17960119b2d5c918fda43418fadcbb52dee895472bd6b59056d75ecb1e0add56" W0311 02:42:21.428768 1 gather.go:155] issue recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-85b84f584d-zmdbz.json" because of the warning: warning: the record with the same fingerprint "17960119b2d5c918fda43418fadcbb52dee895472bd6b59056d75ecb1e0add56" was already recorded at path "config/pod/openshift-console-operator/console-operator-85b84f584d-zmdbz.json", recording another one with a different path "config/pod/openshift-console-operator/console-operator-85b84f584d-zmdbz.json" I0311 02:42:21.428925 1 recorder.go:70] Recording config/pod/openshift-console-operator/logs/console-operator-85b84f584d-zmdbz/console-operator_current.log with fingerprint=a26e04ec4e0c0c069adcfa4329146b1ac1e43606e094c7a6c741206d5755e49f I0311 02:42:21.428938 1 recorder.go:70] Recording config/pod/openshift-console/logs/console-5bc959fc99-z487x/console_current.log with fingerprint=821ff89014d9dd3ffac6680938296b709074e2dfdef44a491f5fb14d4d829764 I0311 02:42:21.428972 1 recorder.go:70] Recording config/pod/openshift-console/logs/console-bf96f7cc7-p4m6j/console_current.log with fingerprint=a4597e6a93940923d98800411422bb52e24865b039c8a88dd1217490a001908f I0311 02:42:21.428989 1 recorder.go:70] Recording config/pod/openshift-console/logs/downloads-7b98f8c767-qt5vn/download-server_current.log with fingerprint=3a17768d538906e7a86c1cad750186e29ac38fef127d042abdc8e0d5b7caed73 I0311 02:42:21.428997 1 recorder.go:70] Recording config/pod/openshift-console/logs/downloads-7b98f8c767-rqqv8/download-server_current.log with fingerprint=08389254ed801ed5b0ae9c00c1fe6664cb03bc07ccfc1565f250b6f10cf92e05 I0311 02:42:21.429091 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-bvrfn with fingerprint=5130d2228e9c64c918e6a680e8c6d7a180e0798d14f79fad904ee5591f5bf96e I0311 02:42:21.429161 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-fcvmh with fingerprint=ee97313c6e97e2db0fcef0c0d36d382b444e321a6d4428371b74948af1a510d3 I0311 02:42:21.429230 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-jnn86 with fingerprint=eea3505c4ede14367117417fa96e9c42d5d65259b001e23af43ba0b2efcf97c4 I0311 02:42:21.429241 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-jnn86/dns_current.log with fingerprint=65fed67907850bdcc84b298e27d57dfb4ec6bad9367675c4b8b172c0c8bea7bb I0311 02:42:21.429250 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-jnn86/kube-rbac-proxy_current.log with fingerprint=5012ef8978e9d766c80646d7d638e1ca4020183bae23a300da093843dfa609e7 I0311 02:42:21.429256 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-vvmzn/dns-node-resolver_current.log with fingerprint=a633d26a6fa4a67994b4c189062f29d0869a90f03925dbbd2fb0585f4046111e I0311 02:42:21.429356 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-749b4fd975-b5424 with fingerprint=d892d3865f88891879ae4c472e266866703e45938a343e0a746dfad5999eba2b I0311 02:42:21.429373 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/image-registry-749b4fd975-b5424/registry_current.log with fingerprint=30584d5ece540f2ba27d96db5e99d9391c0ca99d2967985d590f339bb35ea5fe I0311 02:42:21.429410 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/image-registry-798cf758cb-pwfqd/registry_current.log with fingerprint=1f6a1325906094c679b4f1540363959b62b6f3e2b566415f6e8460392f92f881 I0311 02:42:21.429417 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/node-ca-lvv4z/node-ca_current.log with fingerprint=b2b5df1a3aaf555038be6ea17d60434a3de4be0816413cf6d8133a74af93070f I0311 02:42:21.429423 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/node-ca-t95md/node-ca_current.log with fingerprint=9a54f3e2b65cb17924be1498fd1bbd9644ec1a0e0ca16f3d5d30f2300498f921 I0311 02:42:21.429451 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-664f95fc47-xtp7j/router_current.log with fingerprint=36dd1f95c806430bc9f691d3aecee9e0b737006e422b50c30eb1adaaecbce599 I0311 02:42:21.429493 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-868bd75fd6-gjkq7/router_current.log with fingerprint=26516063d3b3c8491b476c2b116b30c57b4e43077a3209caba24f3bc0f382ead I0311 02:42:21.429540 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-868bd75fd6-x9rqw/router_current.log with fingerprint=06afbb80485f5915ec0c22d7b3ebd21c704702f7e4558ee4c4cb21e54ae86319 I0311 02:42:21.429596 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-6vkkg with fingerprint=d16ca92170276ede25b1bc902e511bf4e04922b814a5ba0e38187b523e6b3c72 I0311 02:42:21.429603 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-6vkkg/serve-healthcheck-canary_current.log with fingerprint=9f9a805458025e85c77066a9ad0cdb51dc8c36dbfffb14df09fe54eb5426cacc I0311 02:42:21.429655 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-w7z4m with fingerprint=e73eebb6a625c640094a3975fde669a87c56071c5be5facf9dd66e8fd9e64da8 I0311 02:42:21.429660 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-w7z4m/serve-healthcheck-canary_current.log with fingerprint=86693246a8fedfc6d56e007236695c0f2dbdaab734407de9ff761e06b5e12de9 I0311 02:42:21.429713 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-zsxgl with fingerprint=446401f087a6053ecc57f289444847cff1cf400f1dff57321d1906ea6a241cda I0311 02:42:21.429722 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 39.297370737s to process 32 records E0311 02:42:21.429790 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 39.3s with: function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"active_alerts\" failed with an error, function \"silenced_alerts\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error, unable to record function \"operators_pods_and_events\" record \"config/pod/openshift-console-operator/console-operator-85b84f584d-zmdbz.json\"" I0311 02:42:21.430900 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "tsdb_status" failed with an error, function "metrics" failed with an error, function "active_alerts" failed with an error, function "silenced_alerts" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "machine_healthchecks" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error, unable to record function "operators_pods_and_events" record "config/pod/openshift-console-operator/console-operator-85b84f584d-zmdbz.json" I0311 02:42:21.430915 1 periodic.go:212] Running workloads gatherer I0311 02:42:21.430932 1 tasks_processing.go:45] number of workers: 2 I0311 02:42:21.430938 1 tasks_processing.go:69] worker 1 listening for tasks. I0311 02:42:21.430942 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I0311 02:42:21.430968 1 tasks_processing.go:69] worker 0 listening for tasks. I0311 02:42:21.431033 1 tasks_processing.go:71] worker 0 working on workload_info task. I0311 02:42:21.437403 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-56.ec2.internal... I0311 02:42:21.437428 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-5.ec2.internal... I0311 02:42:21.437411 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-253.ec2.internal... I0311 02:42:21.456086 1 tasks_processing.go:74] worker 1 stopped. I0311 02:42:21.456103 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 25.129114ms to process 0 records I0311 02:43:12.131278 1 diskrecorder.go:223] Found files to send: insights-2026-03-11-024052.tar.gz I0311 02:43:12.131308 1 insightsuploader.go:150] Checking archives to upload periodically every 15m39.846210461s I0311 02:43:12.131317 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0311 02:43:12.143214 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0311 02:43:12.379197 1 requests.go:87] Successfully reported id=2026-03-11T02:43:12Z x-rh-insights-request-id=8bdb872e101d44da8a1a234d6a386fa6, wrote=55743 I0311 02:43:12.379263 1 insightsuploader.go:187] Uploaded report successfully in 247.934164ms I0311 02:43:12.379288 1 controller.go:119] Initializing last reported time to 2026-03-11T02:43:12Z I0311 02:43:12.379307 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0311 02:43:12.379314 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0311 02:43:12.379323 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0311 02:43:12.384758 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0311 02:43:12.384769 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0311 02:43:12.384785 1 controller.go:458] The operator is still being initialized I0311 02:43:12.384791 1 controller.go:481] The operator is healthy I0311 02:43:42.143033 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0311 02:43:42.143049 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0311 02:43:42.143071 1 controller.go:458] The operator is still being initialized I0311 02:43:42.143076 1 controller.go:481] The operator is healthy I0311 02:44:12.820606 1 insightsreport.go:137] Pulling report from smart-proxy I0311 02:44:12.820631 1 insightsreport.go:149] Retrieving report I0311 02:44:12.829844 1 requests.go:110] Retrieving report for cluster: ebd2de4e-29fa-4480-a262-2adab41f5ceb I0311 02:44:12.829857 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/ebd2de4e-29fa-4480-a262-2adab41f5ceb/reports I0311 02:44:12.832676 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/ebd2de4e-29fa-4480-a262-2adab41f5ceb/reports I0311 02:44:12.971770 1 insightsreport.go:184] Report retrieved I0311 02:44:12.997293 1 insightsreport.go:239] Report retrieved correctly I0311 02:44:21.437727 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 2m0s I0311 02:44:21.460981 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0311 02:44:21.472978 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (13ms) I0311 02:44:21.482010 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (9ms) I0311 02:44:21.490559 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (9ms) I0311 02:44:21.498792 1 gather_workloads_info.go:387] No image sha256:46c2c396ca651699738c3f26b79b10af2922123dd27c2e32382d2a31a87e92c7 (8ms) I0311 02:44:21.507220 1 gather_workloads_info.go:387] No image sha256:1cc2f3c83068c8c67d9070f67677e1bb6b4feff7ac5744cad08711893e56b55f (8ms) I0311 02:44:21.515844 1 gather_workloads_info.go:387] No image sha256:68d8e92046969bcfcbca2d2b3dcf4dcad5f6edc5fcb44861eb22f8079a43ea4d (9ms) I0311 02:44:21.524691 1 gather_workloads_info.go:387] No image sha256:6277dac65decba0ea094146bb99600f479eaf804696842e724de1f1b436f9a38 (9ms) I0311 02:44:21.535764 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (11ms) I0311 02:44:21.544484 1 gather_workloads_info.go:387] No image sha256:039479f355d6903e1018abf8427fece3465c4348d4de2144ec38114b51bec27e (9ms) I0311 02:44:21.553250 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (9ms) I0311 02:44:21.569218 1 gather_workloads_info.go:387] No image sha256:929a4a9c96a08b57fe4c315deca55c30d1990c83e34b8b5692f7646d29f715c8 (16ms) I0311 02:44:21.670599 1 gather_workloads_info.go:387] No image sha256:7854174b4b98e9b10d9c8e9b43113df1217ab21db4b2395d9399af0c3d7911a3 (101ms) I0311 02:44:21.770915 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (100ms) I0311 02:44:21.870167 1 gather_workloads_info.go:387] No image sha256:1f2aa1e1026570162984f7fbb634635bcf319e408cafa8f9034ee842a2f193ab (99ms) I0311 02:44:21.970148 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (100ms) I0311 02:44:22.070464 1 gather_workloads_info.go:387] No image sha256:38dd36da63b1f01316a02daf6c18b821318c6ec313712147292d74abf955e0da (100ms) I0311 02:44:22.170110 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (100ms) I0311 02:44:22.270371 1 gather_workloads_info.go:387] No image sha256:5cba745f09f3bd6b8028c6773597cbb30bf3639a84f2b4b6493fe20642339a2c (100ms) I0311 02:44:22.370145 1 gather_workloads_info.go:387] No image sha256:6c3c7f77d7a3815bbb69cad5f6f1742c17d9597bc135ba3d116c9736d98fae33 (100ms) I0311 02:44:22.470172 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (100ms) I0311 02:44:22.570183 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (100ms) I0311 02:44:22.670920 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (101ms) I0311 02:44:22.770417 1 gather_workloads_info.go:387] No image sha256:799f5628c18e77a49c08645c03179046b5200c8cbcfd65737fb59668132f393e (99ms) I0311 02:44:22.871361 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (101ms) I0311 02:44:22.970578 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (99ms) I0311 02:44:23.070700 1 gather_workloads_info.go:387] No image sha256:e40bbab1e52f580ab471bd7ab19ae23a4bcbaf1893243a05238af6bede7ba9cc (100ms) I0311 02:44:23.169816 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (99ms) I0311 02:44:23.270701 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (101ms) I0311 02:44:23.370948 1 gather_workloads_info.go:387] No image sha256:ce98d5d844bfc2ba8de1893866ad38166c95157d54abd8192b181e819bc50bb5 (100ms) I0311 02:44:23.469707 1 gather_workloads_info.go:387] No image sha256:527ed405bf66234718321996dacf51f91c64c746de9f1509416ef6ce89c90a50 (99ms) I0311 02:44:23.570683 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (101ms) I0311 02:44:23.670340 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (100ms) I0311 02:44:23.770619 1 gather_workloads_info.go:387] No image sha256:00f977c2275f5bf03d423911159a39ca44fabc1862ecb7ae492198ec8c46c6bb (100ms) I0311 02:44:23.870772 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms) I0311 02:44:23.971498 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (101ms) I0311 02:44:24.070431 1 gather_workloads_info.go:387] No image sha256:bcca5c17371caa2dce7e28da4c9fe30163c340fa172187f94db90ea1bd6ab80d (99ms) I0311 02:44:24.169859 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (99ms) I0311 02:44:24.269655 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (100ms) I0311 02:44:24.370945 1 gather_workloads_info.go:398] Found image sha256:59db91eadf1e1e5343777be43ff25fb712f300f9341be48ba05f45270944536f (101ms) I0311 02:44:24.469986 1 gather_workloads_info.go:387] No image sha256:a3d34d8f38a540ce79d34a5248b1965346155497db57b72cb4758d659418059c (99ms) I0311 02:44:24.569861 1 gather_workloads_info.go:398] Found image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (100ms) I0311 02:44:24.670878 1 gather_workloads_info.go:387] No image sha256:ce3d8211c0bde5788a4fd04c3eff31ae591437ceab2b3168dbbdfe408673c8b1 (101ms) I0311 02:44:24.770804 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (100ms) I0311 02:44:24.871111 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (100ms) I0311 02:44:24.970281 1 gather_workloads_info.go:387] No image sha256:270a7bac889ed64d75ce11ae26e8634a6209ff718b83fae2c888cfc758316aa3 (99ms) I0311 02:44:25.070064 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (100ms) I0311 02:44:25.170832 1 gather_workloads_info.go:387] No image sha256:1d471ad866b8564b209214d7dd3a7363c47e9535211d660b63b46abb278af7ab (101ms) I0311 02:44:25.170866 1 tasks_processing.go:74] worker 0 stopped. E0311 02:44:25.170876 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: received unexpected status code 500 Internal Server Error from https://10.128.0.19:8443/gather_runtime_info E0311 02:44:25.170886 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: Get "https://10.130.0.7:8443/gather_runtime_info": context deadline exceeded I0311 02:44:25.171211 1 recorder.go:70] Recording config/workload_info with fingerprint=88f3f50a78f873c3b1aff5d405a21e996d43847ec6daf62838a36e361f26557c I0311 02:44:25.171226 1 gather.go:177] gatherer "workloads" function "workload_info" took 2m3.739821688s to process 1 records E0311 02:44:25.171253 1 periodic.go:250] "Unhandled Error" err="workloads failed after 2m3.74s with: function \"workload_info\" failed with an error" I0311 02:44:25.172351 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0311 02:44:25.172364 1 periodic.go:212] Running conditional gatherer I0311 02:44:25.180338 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I0311 02:44:25.229941 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer I0311 02:44:26.259462 1 conditional_gatherer.go:372] alert "Watchdog" has state "firing" I0311 02:44:26.259478 1 conditional_gatherer.go:372] alert "TargetDown" has state "pending" I0311 02:44:26.259483 1 conditional_gatherer.go:372] alert "TargetDown" has state "pending" I0311 02:44:26.259487 1 conditional_gatherer.go:372] alert "AlertmanagerReceiversNotConfigured" has state "pending" I0311 02:44:26.259491 1 conditional_gatherer.go:372] alert "KubePodNotScheduled" has state "pending" I0311 02:44:26.259495 1 conditional_gatherer.go:372] alert "AlertmanagerMembersInconsistent" has state "pending" I0311 02:44:26.259499 1 conditional_gatherer.go:372] alert "AlertmanagerMembersInconsistent" has state "pending" I0311 02:44:26.259502 1 conditional_gatherer.go:372] alert "AlertmanagerMembersInconsistent" has state "pending" I0311 02:44:26.259505 1 conditional_gatherer.go:372] alert "KubeStatefulSetReplicasMismatch" has state "pending" I0311 02:44:26.259509 1 conditional_gatherer.go:372] alert "KubeJobFailed" has state "pending" I0311 02:44:26.259512 1 conditional_gatherer.go:372] alert "TargetDown" has state "pending" I0311 02:44:26.259598 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0311 02:44:26.267296 1 conditional_gatherer.go:390] cluster version is '4.19.9' I0311 02:44:26.267328 1 tasks_processing.go:45] number of workers: 3 I0311 02:44:26.267342 1 tasks_processing.go:69] worker 2 listening for tasks. I0311 02:44:26.267348 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0311 02:44:26.267354 1 tasks_processing.go:69] worker 0 listening for tasks. I0311 02:44:26.267365 1 tasks_processing.go:69] worker 1 listening for tasks. I0311 02:44:26.267373 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0311 02:44:26.267378 1 tasks_processing.go:74] worker 1 stopped. I0311 02:44:26.267370 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0311 02:44:26.267457 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0311 02:44:26.267476 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.134µs to process 1 records I0311 02:44:26.267521 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0311 02:44:26.267534 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.145µs to process 1 records I0311 02:44:26.267543 1 tasks_processing.go:74] worker 0 stopped. I0311 02:44:26.267634 1 tasks_processing.go:74] worker 2 stopped. I0311 02:44:26.267646 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 254.386µs to process 0 records I0311 02:44:26.267662 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I0311 02:44:26.267679 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0311 02:44:26.291888 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=d37719eb4016fe39846827e9fa27c5dcf0ba898e01070a417a7cbaf3b6da70ac I0311 02:44:26.292055 1 diskrecorder.go:70] Writing 137 records to /var/lib/insights-operator/insights-2026-03-11-024426.tar.gz I0311 02:44:26.302612 1 diskrecorder.go:51] Wrote 137 records to disk in 10ms I0311 02:44:26.302649 1 periodic.go:281] Gathering cluster info every 2h0m0s I0311 02:44:26.302666 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0311 02:45:42.143265 1 controller.go:481] The operator is healthy I0311 02:46:42.123653 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0311 02:46:42.144902 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0311 02:46:42.144927 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0311 02:46:42.169196 1 secretconfigobserver.go:119] support secret does not exist I0311 02:47:42.143181 1 controller.go:481] The operator is healthy I0311 02:49:42.142671 1 controller.go:481] The operator is healthy I0311 02:51:42.121112 1 configmapobserver.go:84] configmaps "insights-config" not found I0311 02:51:42.125016 1 configmapobserver.go:84] configmaps "insights-config" not found I0311 02:51:42.142029 1 controller.go:481] The operator is healthy I0311 02:51:42.169864 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0311 02:51:42.174411 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0311 02:51:42.174428 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0311 02:51:42.178271 1 secretconfigobserver.go:119] support secret does not exist I0311 02:53:42.143021 1 controller.go:481] The operator is healthy I0311 02:55:42.142655 1 controller.go:481] The operator is healthy I0311 02:56:42.178843 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0311 02:56:42.183509 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0311 02:56:42.183529 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0311 02:56:42.187316 1 secretconfigobserver.go:119] support secret does not exist I0311 02:57:42.142668 1 controller.go:481] The operator is healthy I0311 02:58:57.226702 1 diskrecorder.go:223] Found files to send: insights-2026-03-11-024426.tar.gz I0311 02:58:57.226732 1 insightsuploader.go:150] Checking archives to upload periodically every 15m44.988593974s I0311 02:58:57.226741 1 insightsuploader.go:165] Uploading latest report since 2026-03-11T02:43:12Z I0311 02:58:57.238506 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0311 02:58:57.328026 1 requests.go:87] Successfully reported id=2026-03-11T02:58:57Z x-rh-insights-request-id=6fce15d882e743d68e4d03e12795712c, wrote=81444 I0311 02:58:57.328131 1 insightsuploader.go:187] Uploaded report successfully in 101.384335ms I0311 02:58:57.328162 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0311 02:58:57.328173 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0311 02:58:57.328182 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0311 02:58:57.333891 1 controller.go:481] The operator is healthy I0311 02:59:42.143455 1 controller.go:481] The operator is healthy I0311 02:59:57.973989 1 insightsreport.go:137] Pulling report from smart-proxy I0311 02:59:57.974017 1 insightsreport.go:149] Retrieving report I0311 02:59:57.982894 1 requests.go:110] Retrieving report for cluster: ebd2de4e-29fa-4480-a262-2adab41f5ceb I0311 02:59:57.982906 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/ebd2de4e-29fa-4480-a262-2adab41f5ceb/reports I0311 02:59:57.986101 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/ebd2de4e-29fa-4480-a262-2adab41f5ceb/reports I0311 02:59:58.092720 1 insightsreport.go:184] Report retrieved I0311 02:59:58.123776 1 insightsreport.go:239] Report retrieved correctly I0311 03:01:42.122851 1 configmapobserver.go:84] configmaps "insights-config" not found I0311 03:01:42.143035 1 controller.go:481] The operator is healthy I0311 03:01:42.188050 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0311 03:01:42.192994 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0311 03:01:42.193010 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0311 03:01:42.197033 1 secretconfigobserver.go:119] support secret does not exist I0311 03:03:42.143172 1 controller.go:481] The operator is healthy I0311 03:05:42.143888 1 controller.go:481] The operator is healthy I0311 03:06:42.197842 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0311 03:06:42.203527 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0311 03:06:42.203550 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0311 03:06:42.207724 1 secretconfigobserver.go:119] support secret does not exist I0311 03:07:42.143021 1 controller.go:481] The operator is healthy I0311 03:09:42.142692 1 controller.go:481] The operator is healthy I0311 03:11:42.122723 1 configmapobserver.go:84] configmaps "insights-config" not found I0311 03:11:42.126924 1 configmapobserver.go:84] configmaps "insights-config" not found I0311 03:11:42.142465 1 controller.go:481] The operator is healthy I0311 03:11:42.208694 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0311 03:11:42.213230 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0311 03:11:42.213247 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0311 03:11:42.217096 1 secretconfigobserver.go:119] support secret does not exist I0311 03:13:42.144022 1 controller.go:481] The operator is healthy I0311 03:14:47.318070 1 insightsuploader.go:146] Nothing to report since 2026-03-11T02:58:57Z I0311 03:15:42.143916 1 controller.go:481] The operator is healthy I0311 03:16:42.217605 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0311 03:16:42.223411 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0311 03:16:42.223432 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0311 03:16:42.227869 1 secretconfigobserver.go:119] support secret does not exist I0311 03:17:42.143707 1 controller.go:481] The operator is healthy I0311 03:19:42.143590 1 controller.go:481] The operator is healthy