W0310 08:38:21.398309       1 cmd.go:257] Using insecure, self-signed certificates
I0310 08:38:21.732176       1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0310 08:38:21.732906       1 observer_polling.go:159] Starting file observer
W0310 08:38:21.764328       1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights"
I0310 08:38:22.085476       1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$
I0310 08:38:22.085692       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0310 08:38:22.086261       1 secure_serving.go:57] Forcing use of http/1.1 only
W0310 08:38:22.086283       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0310 08:38:22.086288       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0310 08:38:22.086294       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
I0310 08:38:22.086294       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
W0310 08:38:22.086300       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
W0310 08:38:22.086341       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
W0310 08:38:22.086560       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0310 08:38:22.090719       1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot]
I0310 08:38:22.090788       1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}}
I0310 08:38:22.092054       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0310 08:38:22.092071       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0310 08:38:22.092070       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0310 08:38:22.092088       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0310 08:38:22.092087       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0310 08:38:22.092101       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0310 08:38:22.092427       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1277813608/tls.crt::/tmp/serving-cert-1277813608/tls.key"
I0310 08:38:22.092513       1 secure_serving.go:213] Serving securely on [::]:8443
I0310 08:38:22.092582       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
E0310 08:38:22.093284       1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.189b6e120c0740a8  openshift-insights    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-03-10 08:38:22.090690728 +0000 UTC m=+0.759012858,LastTimestamp:2026-03-10 08:38:22.090690728 +0000 UTC m=+0.759012858,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}"
W0310 08:38:22.095468       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0310 08:38:22.095498       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0310 08:38:22.095543       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0310 08:38:22.100157       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0310 08:38:22.100178       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0310 08:38:22.104107       1 secretconfigobserver.go:119] support secret does not exist
I0310 08:38:22.107957       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0310 08:38:22.111795       1 secretconfigobserver.go:119] support secret does not exist
I0310 08:38:22.115319       1 recorder.go:156] Pruning old reports every 4h5m57s, max age is 288h0m0s
I0310 08:38:22.120062       1 periodic.go:212] Running clusterconfig gatherer
I0310 08:38:22.120161       1 tasks_processing.go:45] number of workers: 32
I0310 08:38:22.120213       1 tasks_processing.go:69] worker 31 listening for tasks.
I0310 08:38:22.120224       1 tasks_processing.go:71] worker 31 working on support_secret task.
I0310 08:38:22.120708       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0310 08:38:22.120727       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s
I0310 08:38:22.120769       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0310 08:38:22.120781       1 insightsreport.go:296] Starting report retriever
I0310 08:38:22.120787       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0310 08:38:22.120801       1 tasks_processing.go:69] worker 0 listening for tasks.
I0310 08:38:22.120816       1 tasks_processing.go:69] worker 1 listening for tasks.
I0310 08:38:22.120825       1 tasks_processing.go:69] worker 2 listening for tasks.
I0310 08:38:22.120839       1 tasks_processing.go:69] worker 3 listening for tasks.
I0310 08:38:22.120872       1 tasks_processing.go:69] worker 4 listening for tasks.
I0310 08:38:22.120888       1 tasks_processing.go:69] worker 5 listening for tasks.
I0310 08:38:22.120896       1 tasks_processing.go:69] worker 6 listening for tasks.
I0310 08:38:22.120905       1 tasks_processing.go:69] worker 7 listening for tasks.
I0310 08:38:22.120913       1 tasks_processing.go:69] worker 8 listening for tasks.
I0310 08:38:22.120921       1 tasks_processing.go:69] worker 9 listening for tasks.
I0310 08:38:22.120929       1 tasks_processing.go:69] worker 10 listening for tasks.
I0310 08:38:22.120941       1 tasks_processing.go:69] worker 11 listening for tasks.
I0310 08:38:22.120950       1 tasks_processing.go:69] worker 12 listening for tasks.
I0310 08:38:22.120959       1 tasks_processing.go:69] worker 13 listening for tasks.
I0310 08:38:22.120967       1 tasks_processing.go:69] worker 14 listening for tasks.
I0310 08:38:22.120975       1 tasks_processing.go:69] worker 15 listening for tasks.
I0310 08:38:22.120982       1 tasks_processing.go:69] worker 16 listening for tasks.
I0310 08:38:22.120990       1 tasks_processing.go:69] worker 17 listening for tasks.
I0310 08:38:22.120997       1 tasks_processing.go:69] worker 18 listening for tasks.
I0310 08:38:22.121009       1 tasks_processing.go:69] worker 19 listening for tasks.
I0310 08:38:22.121016       1 tasks_processing.go:69] worker 20 listening for tasks.
I0310 08:38:22.121028       1 tasks_processing.go:69] worker 21 listening for tasks.
I0310 08:38:22.121037       1 tasks_processing.go:69] worker 22 listening for tasks.
I0310 08:38:22.121045       1 tasks_processing.go:69] worker 23 listening for tasks.
I0310 08:38:22.121053       1 tasks_processing.go:69] worker 24 listening for tasks.
I0310 08:38:22.121061       1 tasks_processing.go:69] worker 25 listening for tasks.
I0310 08:38:22.121068       1 tasks_processing.go:69] worker 26 listening for tasks.
I0310 08:38:22.121080       1 tasks_processing.go:69] worker 27 listening for tasks.
I0310 08:38:22.121088       1 tasks_processing.go:69] worker 28 listening for tasks.
I0310 08:38:22.121096       1 tasks_processing.go:69] worker 29 listening for tasks.
I0310 08:38:22.121103       1 tasks_processing.go:69] worker 30 listening for tasks.
I0310 08:38:22.121121       1 tasks_processing.go:71] worker 30 working on nodenetworkconfigurationpolicies task.
I0310 08:38:22.121407       1 tasks_processing.go:71] worker 0 working on sap_config task.
I0310 08:38:22.121446       1 tasks_processing.go:71] worker 3 working on ingress_certificates task.
I0310 08:38:22.121496       1 tasks_processing.go:71] worker 6 working on storage_classes task.
I0310 08:38:22.121510       1 tasks_processing.go:71] worker 26 working on cost_management_metrics_configs task.
I0310 08:38:22.121513       1 tasks_processing.go:71] worker 21 working on config_maps task.
I0310 08:38:22.121611       1 tasks_processing.go:71] worker 23 working on operators_pods_and_events task.
I0310 08:38:22.121687       1 tasks_processing.go:71] worker 24 working on node_logs task.
I0310 08:38:22.121446       1 tasks_processing.go:71] worker 7 working on crds task.
I0310 08:38:22.121700       1 tasks_processing.go:71] worker 27 working on image_registries task.
I0310 08:38:22.121735       1 tasks_processing.go:71] worker 25 working on authentication task.
I0310 08:38:22.121455       1 tasks_processing.go:71] worker 4 working on overlapping_namespace_uids task.
I0310 08:38:22.122075       1 tasks_processing.go:71] worker 28 working on mutating_webhook_configurations task.
I0310 08:38:22.121498       1 tasks_processing.go:71] worker 19 working on tsdb_status task.
W0310 08:38:22.122226       1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0310 08:38:22.122302       1 tasks_processing.go:71] worker 19 working on container_runtime_configs task.
I0310 08:38:22.121460       1 tasks_processing.go:71] worker 8 working on jaegers task.
I0310 08:38:22.121456       1 tasks_processing.go:71] worker 15 working on validating_webhook_configurations task.
I0310 08:38:22.122256       1 tasks_processing.go:71] worker 29 working on container_images task.
I0310 08:38:22.121470       1 tasks_processing.go:71] worker 9 working on machine_healthchecks task.
I0310 08:38:22.121475       1 tasks_processing.go:71] worker 10 working on storage_cluster task.
I0310 08:38:22.121475       1 tasks_processing.go:71] worker 22 working on monitoring_persistent_volumes task.
I0310 08:38:22.121481       1 tasks_processing.go:71] worker 11 working on operators task.
I0310 08:38:22.121483       1 tasks_processing.go:71] worker 16 working on oauths task.
I0310 08:38:22.121486       1 tasks_processing.go:71] worker 12 working on image task.
I0310 08:38:22.121489       1 tasks_processing.go:71] worker 17 working on openshift_machine_api_events task.
I0310 08:38:22.121461       1 tasks_processing.go:71] worker 5 working on cluster_apiserver task.
I0310 08:38:22.121492       1 tasks_processing.go:71] worker 13 working on image_pruners task.
I0310 08:38:22.121494       1 tasks_processing.go:71] worker 18 working on feature_gates task.
I0310 08:38:22.121497       1 tasks_processing.go:71] worker 14 working on pdbs task.
I0310 08:38:22.121508       1 tasks_processing.go:71] worker 20 working on service_accounts task.
I0310 08:38:22.121763       1 tasks_processing.go:71] worker 2 working on number_of_pods_and_netnamespaces_with_sdn_annotations task.
I0310 08:38:22.122745       1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 85.561µs to process 0 records
I0310 08:38:22.121467       1 tasks_processing.go:71] worker 1 working on aggregated_monitoring_cr_names task.
I0310 08:38:22.127190       1 tasks_processing.go:71] worker 30 working on nodes task.
I0310 08:38:22.127245       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 6.053591ms to process 0 records
I0310 08:38:22.127300       1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 5.71612ms to process 0 records
I0310 08:38:22.127326       1 tasks_processing.go:71] worker 26 working on ingress task.
I0310 08:38:22.127331       1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 5.834417ms to process 0 records
I0310 08:38:22.127341       1 tasks_processing.go:71] worker 0 working on sap_datahubs task.
I0310 08:38:22.134402       1 tasks_processing.go:71] worker 19 working on pod_network_connectivity_checks task.
I0310 08:38:22.134430       1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 12.065993ms to process 0 records
I0310 08:38:22.134558       1 tasks_processing.go:71] worker 8 working on dvo_metrics task.
I0310 08:38:22.134597       1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 11.903968ms to process 0 records
E0310 08:38:22.134836       1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found
I0310 08:38:22.134863       1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z
I0310 08:38:22.134872       1 tasks_processing.go:71] worker 31 working on metrics task.
I0310 08:38:22.134884       1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0310 08:38:22.134890       1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready
I0310 08:38:22.134896       1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready
I0310 08:38:22.134866       1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 14.354459ms to process 0 records
E0310 08:38:22.134905       1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope
I0310 08:38:22.134911       1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 11.613952ms to process 0 records
I0310 08:38:22.134914       1 controller.go:458] The operator is still being initialized
I0310 08:38:22.134919       1 tasks_processing.go:71] worker 10 working on active_alerts task.
I0310 08:38:22.134923       1 controller.go:481] The operator is healthy
W0310 08:38:22.134930       1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0310 08:38:22.134936       1 tasks_processing.go:71] worker 9 working on nodenetworkstates task.
W0310 08:38:22.134895       1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0310 08:38:22.134916       1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 11.636172ms to process 0 records
I0310 08:38:22.135263       1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 12.215µs to process 0 records
I0310 08:38:22.135275       1 gather.go:177] gatherer "clusterconfig" function "metrics" took 120.292µs to process 0 records
I0310 08:38:22.135307       1 tasks_processing.go:71] worker 31 working on proxies task.
I0310 08:38:22.135526       1 tasks_processing.go:71] worker 10 working on openshift_logging task.
I0310 08:38:22.135571       1 tasks_processing.go:71] worker 25 working on silenced_alerts task.
W0310 08:38:22.135606       1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0310 08:38:22.135886       1 recorder.go:70] Recording config/authentication with fingerprint=0989fb448f024406620a5d43c7e34d0a242e7e1e0827556b44ba8171b6c8181c
I0310 08:38:22.135905       1 gather.go:177] gatherer "clusterconfig" function "authentication" took 13.779793ms to process 1 records
I0310 08:38:22.135966       1 tasks_processing.go:71] worker 12 working on openstack_version task.
I0310 08:38:22.136036       1 recorder.go:70] Recording config/image with fingerprint=904487721bde3a09fa0181b908afb2759dea6e15632119d1b8d4f6ff6ec0872e
I0310 08:38:22.136052       1 gather.go:177] gatherer "clusterconfig" function "image" took 12.283675ms to process 1 records
I0310 08:38:22.136063       1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 32.424µs to process 0 records
I0310 08:38:22.136069       1 tasks_processing.go:71] worker 25 working on clusterroles task.
I0310 08:38:22.137627       1 tasks_processing.go:71] worker 24 working on install_plans task.
I0310 08:38:22.137648       1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 15.921497ms to process 0 records
I0310 08:38:22.138028       1 tasks_processing.go:71] worker 16 working on machine_sets task.
I0310 08:38:22.138447       1 recorder.go:70] Recording config/oauth with fingerprint=567d9c17f14c1b806ccb2ed9891b8e8dfd458a31e990566094f78f6f483ef3ef
I0310 08:38:22.138475       1 gather.go:177] gatherer "clusterconfig" function "oauths" took 14.778126ms to process 1 records
I0310 08:38:22.141672       1 tasks_processing.go:71] worker 6 working on openstack_dataplanenodesets task.
I0310 08:38:22.142063       1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=1fc4217711f15ce99871904378d258cc601972e94e18f27cd47113d1b1917191
I0310 08:38:22.142127       1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=05387bd7a7a22b7146916e58f7af0ca5cea2ea3810e6824473ad75d23e747144
I0310 08:38:22.142157       1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 20.153859ms to process 2 records
I0310 08:38:22.142185       1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 14.483516ms to process 0 records
I0310 08:38:22.142212       1 tasks_processing.go:71] worker 0 working on version task.
I0310 08:38:22.142835       1 tasks_processing.go:71] worker 27 working on schedulers task.
I0310 08:38:22.143697       1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=67301c112c6e2a405ce03123756e4af09bcf1c4dc88ae95211e4a994cff9b487
I0310 08:38:22.143717       1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 21.116803ms to process 1 records
I0310 08:38:22.148523       1 tasks_processing.go:71] worker 17 working on machines task.
I0310 08:38:22.148604       1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 25.179093ms to process 0 records
I0310 08:38:22.148788       1 tasks_processing.go:71] worker 9 working on lokistack task.
I0310 08:38:22.148879       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 13.843874ms to process 0 records
E0310 08:38:22.148897       1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io)
I0310 08:38:22.148906       1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 14.447851ms to process 0 records
I0310 08:38:22.149011       1 tasks_processing.go:71] worker 19 working on sap_pods task.
I0310 08:38:22.149186       1 tasks_processing.go:71] worker 13 working on machine_autoscalers task.
I0310 08:38:22.149350       1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=c649ee6379cc921d0a41036cee89419a4bd0a3d91a5cd02c7f4542c5a3e90061
I0310 08:38:22.149368       1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 25.450788ms to process 1 records
I0310 08:38:22.149462       1 tasks_processing.go:71] worker 18 working on openstack_dataplanedeployments task.
I0310 08:38:22.149494       1 recorder.go:70] Recording config/featuregate with fingerprint=9885d5665dc736358154649e194882679f8aafbed50f4c93b63308c513bbd180
I0310 08:38:22.149624       1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 25.102999ms to process 1 records
I0310 08:38:22.151055       1 tasks_processing.go:71] worker 12 working on certificate_signing_requests task.
I0310 08:38:22.151066       1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 15.06553ms to process 0 records
I0310 08:38:22.151148       1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 15.544926ms to process 0 records
I0310 08:38:22.151159       1 tasks_processing.go:71] worker 10 working on machine_config_pools task.
I0310 08:38:22.156651       1 tasks_processing.go:71] worker 6 working on olm_operators task.
I0310 08:38:22.156989       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 14.92436ms to process 0 records
I0310 08:38:22.157010       1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 18.902037ms to process 0 records
I0310 08:38:22.157027       1 tasks_processing.go:71] worker 16 working on machine_configs task.
I0310 08:38:22.158293       1 tasks_processing.go:71] worker 15 working on ceph_cluster task.
I0310 08:38:22.158619       1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=8c1c2cc3fcf61c6553e06e04396a64c5b3fcc097d9aaf21d1161b2adeaee7aa1
I0310 08:38:22.158768       1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=67ac5f7358bbf03ca14240af3456fe5abce08946a5dc8fa2e1a3201072e42391
I0310 08:38:22.158802       1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=7a7d09467cb305cc1a8017bf55e54a1fd2d7b9dcbe82fb15b4389e6bbedc1823
I0310 08:38:22.158871       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=ca13a028a1b4744eaba36e9e475e7085dc35142836f7a8a134a903bc14d37ec3
I0310 08:38:22.158923       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=aa0d6e73c25ad7522211d54743d685728ca10baf7a6c376b2fb55df2f7ab999b
I0310 08:38:22.158976       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=dbd1594831ad408ee666f77b0359701f814fe06ad15e00a32c41bcf7bf48eee7
I0310 08:38:22.159046       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=99ffe342d0dc6f40d819617d9640b785e8bd4b01aa73f98d1a99c2e853ac9c67
I0310 08:38:22.159113       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=75242e4fa8427cbb48ccff1a2c540aefecae540902458edd7cc1828b695ed0e1
I0310 08:38:22.159166       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=0bc395e906042fc6ef49e189cca7098761b456c6034be51d4a13d088ab8a9bf7
I0310 08:38:22.159216       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=efa61e3b62ad57b000a22349c101151a8c3f79e95e3531c943ffbe5b0b63751f
I0310 08:38:22.159266       1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 35.508974ms to process 10 records
I0310 08:38:22.159536       1 recorder.go:70] Recording config/apiserver with fingerprint=0b09da31d0ea82f2af92e639873087e0f518f11245d3745ea223129767a0c075
I0310 08:38:22.159576       1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 34.98134ms to process 1 records
I0310 08:38:22.159600       1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
I0310 08:38:22.159622       1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 37.196227ms to process 1 records
I0310 08:38:22.159631       1 tasks_processing.go:71] worker 4 working on infrastructures task.
I0310 08:38:22.159537       1 tasks_processing.go:71] worker 5 working on openstack_controlplanes task.
I0310 08:38:22.163443       1 tasks_processing.go:71] worker 30 working on networks task.
W0310 08:38:22.164969       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0310 08:38:22.165230       1 recorder.go:70] Recording config/node/ip-10-0-0-113.ec2.internal with fingerprint=6782fe1588c8809c638e921568c964ad4225470cca84a56165e6c56936ecfcf1
I0310 08:38:22.165358       1 recorder.go:70] Recording config/node/ip-10-0-1-100.ec2.internal with fingerprint=5b518913c3c46da5d2aed4b2fcb9bb39ee359f0c85f180544c50dbb852aed06c
I0310 08:38:22.165376       1 gather.go:177] gatherer "clusterconfig" function "nodes" took 36.237289ms to process 2 records
I0310 08:38:22.165390       1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 40.598783ms to process 0 records
I0310 08:38:22.165398       1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 15.075559ms to process 0 records
I0310 08:38:22.165408       1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 14.819298ms to process 0 records
I0310 08:38:22.165650       1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=1bf473ada85eef414e528e9baf6df117ad0c5adbc60012dccb67244a2a26a1b8
I0310 08:38:22.165664       1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 20.707474ms to process 1 records
E0310 08:38:22.165673       1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope
I0310 08:38:22.165698       1 gather.go:177] gatherer "clusterconfig" function "machines" took 15.461619ms to process 0 records
I0310 08:38:22.165770       1 recorder.go:70] Recording config/proxy with fingerprint=50930ed2c6548483695fd3c9b287e89045123482c5c0a9b2a5b9ab4f35eb4dfb
I0310 08:38:22.165781       1 gather.go:177] gatherer "clusterconfig" function "proxies" took 28.816534ms to process 1 records
I0310 08:38:22.165935       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=fdfbae49bd0197da806ebdb901a379475deb90bd92cec45397d9e0fb46c5f6a7
I0310 08:38:22.165959       1 tasks_processing.go:74] worker 19 stopped.
I0310 08:38:22.166688       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=35d659e44dfee6e56c528dc9d4af0e30306987522b240d4163609b3c4f017b77
I0310 08:38:22.167671       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=02f92169010c151ba85480eac95b91b529328aa626959f9572606abc4aca8050
I0310 08:38:22.167754       1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 42.677494ms to process 3 records
I0310 08:38:22.165968       1 tasks_processing.go:74] worker 22 stopped.
I0310 08:38:22.165972       1 tasks_processing.go:74] worker 9 stopped.
I0310 08:38:22.165981       1 tasks_processing.go:74] worker 17 stopped.
I0310 08:38:22.165986       1 tasks_processing.go:74] worker 27 stopped.
I0310 08:38:22.165993       1 tasks_processing.go:74] worker 31 stopped.
I0310 08:38:22.166741       1 tasks_processing.go:74] worker 28 stopped.
I0310 08:38:22.167973       1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=9642bf7030c134ec6734f28a8fc8166800f198417520abe2c79ab89ddf4e4c01
W0310 08:38:22.168163       1 operator.go:287] started
I0310 08:38:22.168188       1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=12eb4fdc0a46ee9b48f94753e3faf1f06075aa8109da48f76a109ea288fb3d97
I0310 08:38:22.168370       1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=8301bb538eb943ec9e34634f085e7158ffc3d2a285eb16c15b6c0e9adb01f865
I0310 08:38:22.168402       1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 40.57474ms to process 3 records
I0310 08:38:22.168447       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 15.578093ms to process 0 records
I0310 08:38:22.168476       1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 15.933262ms to process 0 records
I0310 08:38:22.168515       1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 13.971463ms to process 0 records
I0310 08:38:22.168447       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
I0310 08:38:22.168014       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
I0310 08:38:22.169097       1 tasks_processing.go:74] worker 18 stopped.
I0310 08:38:22.169115       1 tasks_processing.go:74] worker 13 stopped.
I0310 08:38:22.169122       1 tasks_processing.go:74] worker 10 stopped.
I0310 08:38:22.167981       1 tasks_processing.go:74] worker 14 stopped.
I0310 08:38:22.168206       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
I0310 08:38:22.169824       1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=860e166b49a2e76b657b5e79bab4fc292c5cd01c8eb0189b33d6e447bcc2f7d0
I0310 08:38:22.170184       1 tasks_processing.go:74] worker 7 stopped.
I0310 08:38:22.170278       1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=d62aa853c1b0405537235f3ccd19440d1b82dc39609b326028daaf6c99ba86e9
I0310 08:38:22.170321       1 gather.go:177] gatherer "clusterconfig" function "crds" took 44.001693ms to process 2 records
I0310 08:38:22.170646       1 recorder.go:70] Recording config/ingress with fingerprint=0d6ef02ac437dbc9c0c90598618d6ce9d16a08adad933464c6d5673539ea8dc7
I0310 08:38:22.170684       1 gather.go:177] gatherer "clusterconfig" function "ingress" took 40.589448ms to process 1 records
I0310 08:38:22.170714       1 tasks_processing.go:74] worker 26 stopped.
I0310 08:38:22.170942       1 tasks_processing.go:74] worker 5 stopped.
I0310 08:38:22.170991       1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 11.05599ms to process 0 records
I0310 08:38:22.171382       1 tasks_processing.go:74] worker 15 stopped.
I0310 08:38:22.171404       1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 12.958069ms to process 0 records
I0310 08:38:22.173806       1 tasks_processing.go:74] worker 12 stopped.
I0310 08:38:22.173829       1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 22.682656ms to process 0 records
I0310 08:38:22.174045       1 tasks_processing.go:74] worker 16 stopped.
E0310 08:38:22.174063       1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io)
I0310 08:38:22.174150       1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499
I0310 08:38:22.174205       1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 17.009092ms to process 1 records
I0310 08:38:22.174989       1 tasks_processing.go:74] worker 29 stopped.
I0310 08:38:22.176636       1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-2t2kb with fingerprint=9e0666b3abf6d20755a084bb5f3f0ff7c035df43553f789e39f28b53a129d4b9
I0310 08:38:22.176714       1 recorder.go:70] Recording config/running_containers with fingerprint=b35f22bcdb61724a944676f9e72c2d19119512e4b45e5ba5fe248b5086272fec
I0310 08:38:22.176729       1 gather.go:177] gatherer "clusterconfig" function "container_images" took 52.159225ms to process 2 records
I0310 08:38:22.180478       1 tasks_processing.go:74] worker 2 stopped.
I0310 08:38:22.180551       1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 56.055096ms to process 0 records
I0310 08:38:22.180704       1 tasks_processing.go:74] worker 4 stopped.
I0310 08:38:22.181426       1 recorder.go:70] Recording config/infrastructure with fingerprint=2f23914a2cad1128b1509d67d79e069cd687e59fed545d574f44d4ee41be02e5
I0310 08:38:22.181445       1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 21.059702ms to process 1 records
I0310 08:38:22.184549       1 tasks_processing.go:74] worker 6 stopped.
I0310 08:38:22.184572       1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 27.87095ms to process 0 records
I0310 08:38:22.193136       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0310 08:38:22.193152       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0310 08:38:22.193170       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0310 08:38:22.195796       1 base_controller.go:82] Caches are synced for ConfigController 
I0310 08:38:22.195847       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
I0310 08:38:22.196274       1 tasks_processing.go:74] worker 30 stopped.
I0310 08:38:22.196450       1 prometheus_rules.go:88] Prometheus rules successfully created
I0310 08:38:22.196530       1 recorder.go:70] Recording config/network with fingerprint=0d6a27d0d4f7a5a8d7068fcbf6bf3b58b38d09f4ed36884b36954784fe8cd5ff
I0310 08:38:22.196543       1 gather.go:177] gatherer "clusterconfig" function "networks" took 32.8061ms to process 1 records
I0310 08:38:22.205882       1 tasks_processing.go:74] worker 0 stopped.
I0310 08:38:22.205984       1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0310 08:38:22.205999       1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready
I0310 08:38:22.206005       1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready
I0310 08:38:22.206012       1 controller.go:203] Source scaController *sca.Controller is not ready
I0310 08:38:22.206018       1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready
I0310 08:38:22.206038       1 controller.go:458] The operator is still being initialized
I0310 08:38:22.206048       1 controller.go:481] The operator is healthy
E0310 08:38:22.207637       1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%271f11ac3b-20a1-4737-9433-e62824bb841a%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.17:36003->172.30.0.10:53: read: connection refused
I0310 08:38:22.207656       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%271f11ac3b-20a1-4737-9433-e62824bb841a%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.17:36003->172.30.0.10:53: read: connection refused
I0310 08:38:22.210069       1 recorder.go:70] Recording config/version with fingerprint=932474bd30e59b65d9ca115999537fa2cc4580ad46f73c8f2a42a241c1371073
I0310 08:38:22.210088       1 recorder.go:70] Recording config/id with fingerprint=8d6b1c511116f44c4731a44a7e6f569090e42580f81a6e9ccd1caa4563af3db7
I0310 08:38:22.210095       1 gather.go:177] gatherer "clusterconfig" function "version" took 63.64096ms to process 2 records
I0310 08:38:22.210182       1 tasks_processing.go:74] worker 25 stopped.
I0310 08:38:22.210261       1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=777f117e0b6b4a84fc01371865e8f63736cf92c133a24e18be286900dc9a1f47
I0310 08:38:22.210343       1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=3ae2221d51b8aaa204cf66da1c12bb063234b515d21dcb5874501529f9c645df
I0310 08:38:22.210351       1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 69.924574ms to process 2 records
I0310 08:38:22.216670       1 configmapobserver.go:84] configmaps "insights-config" not found
I0310 08:38:22.216996       1 tasks_processing.go:74] worker 1 stopped.
I0310 08:38:22.217016       1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 92.199202ms to process 0 records
I0310 08:38:22.236302       1 tasks_processing.go:74] worker 21 stopped.
E0310 08:38:22.236316       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found
E0310 08:38:22.236323       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found
E0310 08:38:22.236329       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found
I0310 08:38:22.236339       1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17
I0310 08:38:22.236363       1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d
I0310 08:38:22.236371       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a
I0310 08:38:22.236376       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4
I0310 08:38:22.236381       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
I0310 08:38:22.236425       1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0
I0310 08:38:22.236435       1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d
I0310 08:38:22.236440       1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 114.771356ms to process 7 records
I0310 08:38:22.252082       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
W0310 08:38:22.256003       1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.17:40048->172.30.0.10:53: read: connection refused
I0310 08:38:22.256016       1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.17:40048->172.30.0.10:53: read: connection refused
I0310 08:38:22.270082       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0310 08:38:22.270096       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0310 08:38:22.294931       1 tasks_processing.go:74] worker 3 stopped.
E0310 08:38:22.294950       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found
E0310 08:38:22.294959       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ouo5qu1vug3m60q47qdv00tchhibtlh-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ouo5qu1vug3m60q47qdv00tchhibtlh-primary-cert-bundle-secret" not found
I0310 08:38:22.295039       1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=92260401143fe5a6fb104cdcb53d839bd949dfa7881e1c0d62596342028613cb
I0310 08:38:22.295057       1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 173.416517ms to process 1 records
I0310 08:38:22.568821       1 gather_cluster_operator_pods_and_events.go:121] Found 14 pods with 16 containers
I0310 08:38:22.568836       1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1572864 bytes
I0310 08:38:22.569104       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-22rsd pod in namespace openshift-dns (previous: false).
I0310 08:38:22.586601       1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes"
I0310 08:38:22.788605       1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes"
I0310 08:38:22.806390       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-22rsd pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-22rsd\" is waiting to start: ContainerCreating"
I0310 08:38:22.806408       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-22rsd\" is waiting to start: ContainerCreating"
I0310 08:38:22.806418       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-22rsd pod in namespace openshift-dns (previous: false).
I0310 08:38:22.974164       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-22rsd pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-22rsd\" is waiting to start: ContainerCreating"
I0310 08:38:22.974183       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-22rsd\" is waiting to start: ContainerCreating"
I0310 08:38:22.974195       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-j2rgd pod in namespace openshift-dns (previous: false).
W0310 08:38:23.163155       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0310 08:38:23.211912       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-j2rgd pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-j2rgd\" is waiting to start: ContainerCreating"
I0310 08:38:23.211925       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-j2rgd\" is waiting to start: ContainerCreating"
I0310 08:38:23.211933       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-j2rgd pod in namespace openshift-dns (previous: false).
I0310 08:38:23.371327       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-j2rgd pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-j2rgd\" is waiting to start: ContainerCreating"
I0310 08:38:23.371341       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-j2rgd\" is waiting to start: ContainerCreating"
I0310 08:38:23.371352       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-2gmgb pod in namespace openshift-dns (previous: false).
I0310 08:38:23.571328       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0310 08:38:23.571342       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-fmrkk pod in namespace openshift-dns (previous: false).
I0310 08:38:23.588701       1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found
I0310 08:38:23.770978       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0310 08:38:23.770998       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-56888c6d7b-bq92c pod in namespace openshift-image-registry (previous: false).
I0310 08:38:23.971508       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-56888c6d7b-bq92c pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-56888c6d7b-bq92c\" is waiting to start: ContainerCreating"
I0310 08:38:23.971526       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-56888c6d7b-bq92c\" is waiting to start: ContainerCreating"
I0310 08:38:23.971537       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-56888c6d7b-qt89w pod in namespace openshift-image-registry (previous: false).
I0310 08:38:23.990900       1 tasks_processing.go:74] worker 11 stopped.
I0310 08:38:23.990947       1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=2b325ed6fe6779a378fa51bac9e41fc97ed74acd4ecdc09be69601bcc8549218
I0310 08:38:23.990976       1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=d02f019a29a203194ee2f59f19d5033ad53802df2879831b675cc59daa53360a
I0310 08:38:23.991006       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e
I0310 08:38:23.991036       1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=5c0d9238d33d2f6eca4c8667d43d77c88c59c405d72c5f7a641bc8baab04010f
I0310 08:38:23.991058       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f
I0310 08:38:23.991085       1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=53b2b2dbcf1bcdb1817598a8df9fc7566dc1f4f2b83120aad8cbf99fcf0335a0
I0310 08:38:23.991130       1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=f2bf5528fb405e65149bd95a8ac88ef2fd179ba5d65f69dcbf00dd3e34d71b29
I0310 08:38:23.991163       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=33bb3cbf799df64fd40c503cd6199b884a8893301e2ce110de67183f1318dd47
I0310 08:38:23.991179       1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=eb0435ecdafb6c381fd385af857645bb43d8f021f42ef74533eeaf67c98a1927
I0310 08:38:23.991197       1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=a05113039edc7418383cf96aab76a6c577f172e67bc9fc5ed21a7f70126de04c
I0310 08:38:23.991208       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762
I0310 08:38:23.991225       1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=b8bbe3add0c842a98f23be1fd7fa66e6cd1fe1d7c733cd6b61f4eb9715b9910d
I0310 08:38:23.991237       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11
I0310 08:38:23.991253       1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=57ec1416b4e1aa6815b659949d66789e6419df78a5d6b4593ff2da0c32d37495
I0310 08:38:23.991264       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a
I0310 08:38:23.991279       1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=73eb01ae70ac9a557a942503f8b55c67454c12caa5fd38f2c1995b0985fea1f8
I0310 08:38:23.991290       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db
I0310 08:38:23.991307       1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=1a16ec490177da1e92cd40fc914b57484b90235a4167cb99d76a99c90c81053c
I0310 08:38:23.991422       1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=c4050abb02f9b4e9fc34b6d1054082f0bb2b6a609ae3beeef5dceaef2988c860
I0310 08:38:23.991447       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75
I0310 08:38:23.991469       1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=4518768293a060e14bfeda0f48d0577f015d685f642ba57c9db88b4f8a05843c
I0310 08:38:23.991493       1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=3d38e15d145c5eebcbe2bc0223080091d7b5ed0deff46e16ca01dfd4dccc01a9
I0310 08:38:23.991503       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76
I0310 08:38:23.991520       1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=f1a40c50831405ce03a1f2b44fa18a943459e139b1de61184ed235fd5aaa8546
I0310 08:38:23.991530       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7
I0310 08:38:23.991543       1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=f0a3e4b36a516453d22b184cae35da12f8a2a2fd467ef57e67242df1ad4d8e64
I0310 08:38:23.991560       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=0bf6b090d2df36cd89d13f1512d385400a27c410ff9dbdc7acb4336c00341654
I0310 08:38:23.991576       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=a4ea71361d7fbe0e3184db137d15d068e1f506733d7fd1d57de9a8227ebb072d
I0310 08:38:23.991592       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=9041341ac7d99b9b3840160a4bf01882cde2926bf4c82884cbb6ef366ad76f21
I0310 08:38:23.991608       1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=748fb35f632db05224bdf3b5e858a100fce480fd5739b2f9c65621a6cfbe2c6b
I0310 08:38:23.991634       1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=c28592e890a68208398087f0cada0673d65ccd2346cb584225bc87a9152984e1
I0310 08:38:23.991652       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e
I0310 08:38:23.991661       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad
I0310 08:38:23.991668       1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.867722925s to process 33 records
W0310 08:38:24.162707       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0310 08:38:24.165293       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0310 08:38:24.165306       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-668c7fb48c-rzp4n pod in namespace openshift-image-registry (previous: false).
I0310 08:38:24.370990       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-668c7fb48c-rzp4n pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-668c7fb48c-rzp4n\" is waiting to start: ContainerCreating"
I0310 08:38:24.371003       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-668c7fb48c-rzp4n\" is waiting to start: ContainerCreating"
I0310 08:38:24.371013       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-2h5sc pod in namespace openshift-image-registry (previous: false).
I0310 08:38:24.570830       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0310 08:38:24.570846       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-f7qpv pod in namespace openshift-image-registry (previous: false).
I0310 08:38:24.780352       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0310 08:38:24.780366       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-597c9d7bc-g6h8h pod in namespace openshift-ingress (previous: false).
I0310 08:38:24.970941       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-597c9d7bc-g6h8h pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-597c9d7bc-g6h8h\" is waiting to start: ContainerCreating"
I0310 08:38:24.970955       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-597c9d7bc-g6h8h\" is waiting to start: ContainerCreating"
I0310 08:38:24.970965       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-597c9d7bc-jpzpd pod in namespace openshift-ingress (previous: false).
W0310 08:38:25.163118       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0310 08:38:25.170568       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-597c9d7bc-jpzpd pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-597c9d7bc-jpzpd\" is waiting to start: ContainerCreating"
I0310 08:38:25.170582       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-597c9d7bc-jpzpd\" is waiting to start: ContainerCreating"
I0310 08:38:25.170595       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-67dc8b4757-k84rh pod in namespace openshift-ingress (previous: false).
I0310 08:38:25.371096       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-67dc8b4757-k84rh pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-67dc8b4757-k84rh\" is waiting to start: ContainerCreating"
I0310 08:38:25.371110       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-67dc8b4757-k84rh\" is waiting to start: ContainerCreating"
I0310 08:38:25.371123       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-pqpkg pod in namespace openshift-ingress-canary (previous: false).
I0310 08:38:25.583080       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-pqpkg pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-pqpkg\" is waiting to start: ContainerCreating"
I0310 08:38:25.583095       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-pqpkg\" is waiting to start: ContainerCreating"
I0310 08:38:25.583105       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-svbt7 pod in namespace openshift-ingress-canary (previous: false).
I0310 08:38:25.772285       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-svbt7 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-svbt7\" is waiting to start: ContainerCreating"
I0310 08:38:25.772302       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-svbt7\" is waiting to start: ContainerCreating"
I0310 08:38:25.772321       1 tasks_processing.go:74] worker 23 stopped.
I0310 08:38:25.772420       1 recorder.go:70] Recording events/openshift-dns with fingerprint=9b0329d771c90d34de5c035454fa8542c1cac969eaa924af757694dc6f5eb6d9
I0310 08:38:25.772523       1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=43221defe014511f22e6b29902f6d85a557d3b816b0475920f4036a812664df8
I0310 08:38:25.772562       1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=1bd61507abfe931920851efac62070fac2eadb85cb01dbcbf4c502f69b18e5ae
I0310 08:38:25.772622       1 recorder.go:70] Recording events/openshift-ingress with fingerprint=d954a4e802a0da7dc0f56e9cd1ecb3c1b513772ad17528f7e91d00845b57c02d
I0310 08:38:25.772645       1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=025674bac6204253576f5db1830cbf9bc6f649e2395100b1f94e82d5c7771251
I0310 08:38:25.772659       1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 3.650691914s to process 5 records
W0310 08:38:26.162526       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0310 08:38:27.162910       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0310 08:38:27.162934       1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0310 08:38:27.162949       1 tasks_processing.go:74] worker 8 stopped.
E0310 08:38:27.162959       1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0310 08:38:27.162970       1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
W0310 08:38:27.162985       1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics"
I0310 08:38:27.162997       1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.028320351s to process 1 records
I0310 08:38:34.348373       1 configmapobserver.go:84] configmaps "insights-config" not found
I0310 08:38:34.650884       1 tasks_processing.go:74] worker 24 stopped.
I0310 08:38:34.650924       1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b
I0310 08:38:34.650937       1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.513233297s to process 1 records
I0310 08:38:35.329631       1 tasks_processing.go:74] worker 20 stopped.
I0310 08:38:35.329942       1 recorder.go:70] Recording config/serviceaccounts with fingerprint=29ecf786211bc49b69ab0dc7a4cfc0a4d8b0e3c5cbe08dd4c30acd97b260957f
I0310 08:38:35.329959       1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.205281347s to process 1 records
E0310 08:38:35.330019       1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.209s with: function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error"
I0310 08:38:35.331121       1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error
I0310 08:38:35.331134       1 periodic.go:212] Running workloads gatherer
I0310 08:38:35.331150       1 tasks_processing.go:45] number of workers: 2
I0310 08:38:35.331160       1 tasks_processing.go:69] worker 1 listening for tasks.
I0310 08:38:35.331167       1 tasks_processing.go:71] worker 1 working on workload_info task.
I0310 08:38:35.331167       1 tasks_processing.go:69] worker 0 listening for tasks.
I0310 08:38:35.331238       1 tasks_processing.go:71] worker 0 working on helmchart_info task.
I0310 08:38:35.349892       1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 20s for image data
I0310 08:38:35.356118       1 tasks_processing.go:74] worker 0 stopped.
I0310 08:38:35.356130       1 gather.go:177] gatherer "workloads" function "helmchart_info" took 24.866379ms to process 0 records
I0310 08:38:35.360027       1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (11ms)
I0310 08:38:35.369416       1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (9ms)
I0310 08:38:35.378241       1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (9ms)
I0310 08:38:35.387031       1 gather_workloads_info.go:387] No image sha256:ce3d8211c0bde5788a4fd04c3eff31ae591437ceab2b3168dbbdfe408673c8b1 (9ms)
I0310 08:38:35.398417       1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (11ms)
I0310 08:38:35.407223       1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (9ms)
I0310 08:38:35.417452       1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (10ms)
I0310 08:38:35.426829       1 gather_workloads_info.go:387] No image sha256:c69559260f8b618abc6561da7b0327a2da59e6c09d27f249a14c4b2733ed0384 (9ms)
I0310 08:38:35.435592       1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (9ms)
I0310 08:38:35.444334       1 gather_workloads_info.go:387] No image sha256:f6e156f39b06d196b46d8ed3a03ca337e939dba0060e40de4455b4e77b90929e (9ms)
I0310 08:38:35.457993       1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (14ms)
I0310 08:38:35.559980       1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (102ms)
I0310 08:38:35.659114       1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (99ms)
I0310 08:38:35.759811       1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (101ms)
I0310 08:38:35.859374       1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (100ms)
I0310 08:38:35.959139       1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (100ms)
I0310 08:38:36.059922       1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (101ms)
I0310 08:38:36.159658       1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (100ms)
I0310 08:38:36.259927       1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (100ms)
I0310 08:38:36.359913       1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (100ms)
I0310 08:38:36.400903       1 configmapobserver.go:84] configmaps "insights-config" not found
I0310 08:38:36.460340       1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (100ms)
I0310 08:38:36.559348       1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (99ms)
I0310 08:38:36.600107       1 configmapobserver.go:84] configmaps "insights-config" not found
I0310 08:38:36.661181       1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (102ms)
I0310 08:38:36.758954       1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (98ms)
I0310 08:38:36.860062       1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (101ms)
I0310 08:38:36.959929       1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (100ms)
I0310 08:38:37.059847       1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (100ms)
I0310 08:38:37.158729       1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (99ms)
I0310 08:38:37.260365       1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (102ms)
I0310 08:38:37.359977       1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (100ms)
I0310 08:38:37.459711       1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (100ms)
I0310 08:38:37.559471       1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (100ms)
I0310 08:38:37.559502       1 tasks_processing.go:74] worker 1 stopped.
E0310 08:38:37.559513       1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset
I0310 08:38:37.559807       1 recorder.go:70] Recording config/workload_info with fingerprint=bf7046fdecb0b3365e3b9510e0845abeaa75a4d949181c695b7a8210f466e100
I0310 08:38:37.559821       1 gather.go:177] gatherer "workloads" function "workload_info" took 2.228327925s to process 1 records
E0310 08:38:37.559846       1 periodic.go:250] "Unhandled Error" err="workloads failed after 2.228s with: function \"workload_info\" failed with an error"
I0310 08:38:37.560967       1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error
I0310 08:38:37.560983       1 periodic.go:212] Running conditional gatherer
I0310 08:38:37.570574       1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules
I0310 08:38:37.584090       1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.17:52450->172.30.0.10:53: read: connection refused
E0310 08:38:37.584519       1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0310 08:38:37.584595       1 conditional_gatherer.go:382] updating version cache for conditional gatherer
I0310 08:38:37.593240       1 conditional_gatherer.go:390] cluster version is '4.19.9'
E0310 08:38:37.593261       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0310 08:38:37.593270       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0310 08:38:37.593275       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0310 08:38:37.593281       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0310 08:38:37.593286       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0310 08:38:37.593292       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0310 08:38:37.593297       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0310 08:38:37.593302       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0310 08:38:37.593307       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
I0310 08:38:37.593328       1 tasks_processing.go:45] number of workers: 3
I0310 08:38:37.593381       1 tasks_processing.go:69] worker 2 listening for tasks.
I0310 08:38:37.593399       1 tasks_processing.go:69] worker 0 listening for tasks.
I0310 08:38:37.593434       1 tasks_processing.go:71] worker 0 working on rapid_container_logs task.
I0310 08:38:37.593411       1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task.
I0310 08:38:37.593412       1 tasks_processing.go:69] worker 1 listening for tasks.
I0310 08:38:37.593577       1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406
I0310 08:38:37.593589       1 tasks_processing.go:74] worker 1 stopped.
I0310 08:38:37.593598       1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.418µs to process 1 records
I0310 08:38:37.593611       1 tasks_processing.go:71] worker 2 working on remote_configuration task.
I0310 08:38:37.593622       1 tasks_processing.go:74] worker 2 stopped.
I0310 08:38:37.593690       1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db
I0310 08:38:37.593709       1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.52µs to process 1 records
I0310 08:38:37.593790       1 tasks_processing.go:74] worker 0 stopped.
I0310 08:38:37.593807       1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 345.507µs to process 0 records
I0310 08:38:37.593835       1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.17:52450->172.30.0.10:53: read: connection refused
I0310 08:38:37.593872       1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1
I0310 08:38:37.617510       1 recorder.go:70] Recording insights-operator/gathers with fingerprint=726e2e6e1d496cc8c2acccf78e4b6b35dd652f1f146995a89e70f3f2a646a7b3
I0310 08:38:37.617631       1 diskrecorder.go:70] Writing 95 records to /var/lib/insights-operator/insights-2026-03-10-083837.tar.gz
I0310 08:38:37.625787       1 diskrecorder.go:51] Wrote 95 records to disk in 8ms
I0310 08:38:37.625871       1 periodic.go:281] Gathering cluster info every 2h0m0s
I0310 08:38:37.625895       1 periodic.go:282] Configuration is 
	dataReporting:
		interval: 2h0m0s,
		uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload,
		storagePath: /var/lib/insights-operator,
		downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, 
		conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules,
		obfuscation: []
	sca:
		disabled: false,
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates,
		interval: 8h0m0s
	alerting:
		disabled: false
	clusterTransfer:
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/,
		interval: 12h0m0s
	proxy:
		httpProxy: ,
		httpsProxy: ,
		noProxy: 
I0310 08:38:50.251522       1 configmapobserver.go:84] configmaps "insights-config" not found
I0310 08:39:31.733771       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="263b82f7f4cf84fcaf2811cec8879cf57063f87e289f23b1743e3f05c92372e7")
W0310 08:39:31.733811       1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created
I0310 08:39:31.733889       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="1abd9ce1981b797540991eb5e9c493816962f329410c8f6f49f3e58c59f1c433")
I0310 08:39:31.733897       1 base_controller.go:181] Shutting down ConfigController ...
I0310 08:39:31.733903       1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated"