I0311 14:02:08.445878       1 cmd.go:253] Using service-serving-cert provided certificates
I0311 14:02:08.446597       1 observer_polling.go:159] Starting file observer
W0311 14:02:08.469658       1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights"
I0311 14:02:08.781844       1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$
I0311 14:02:08.782171       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0311 14:02:08.783136       1 secure_serving.go:57] Forcing use of http/1.1 only
W0311 14:02:08.783161       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0311 14:02:08.783167       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0311 14:02:08.783173       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
W0311 14:02:08.783178       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
W0311 14:02:08.783182       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
I0311 14:02:08.783175       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
W0311 14:02:08.783188       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0311 14:02:08.787756       1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot]
I0311 14:02:08.787769       1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}}
I0311 14:02:08.790677       1 secure_serving.go:213] Serving securely on [::]:8443
I0311 14:02:08.790701       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0311 14:02:08.790931       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0311 14:02:08.790737       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key"
I0311 14:02:08.790742       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0311 14:02:08.791078       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0311 14:02:08.790770       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0311 14:02:08.791184       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0311 14:02:08.790770       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
E0311 14:02:08.792413       1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.189bce51beb63e7e  openshift-insights    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-03-11 14:02:08.787709566 +0000 UTC m=+0.386390228,LastTimestamp:2026-03-11 14:02:08.787709566 +0000 UTC m=+0.386390228,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}"
W0311 14:02:08.793654       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0311 14:02:08.793684       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0311 14:02:08.793793       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0311 14:02:08.799315       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0311 14:02:08.799337       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0311 14:02:08.805071       1 secretconfigobserver.go:119] support secret does not exist
I0311 14:02:08.817421       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0311 14:02:08.827857       1 secretconfigobserver.go:119] support secret does not exist
I0311 14:02:08.830506       1 recorder.go:156] Pruning old reports every 4h10m9s, max age is 288h0m0s
I0311 14:02:08.837691       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0311 14:02:08.837720       1 periodic.go:212] Running clusterconfig gatherer
I0311 14:02:08.837725       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s
I0311 14:02:08.837755       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0311 14:02:08.837763       1 insightsreport.go:296] Starting report retriever
I0311 14:02:08.837770       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0311 14:02:08.837778       1 tasks_processing.go:45] number of workers: 32
I0311 14:02:08.837821       1 tasks_processing.go:69] worker 1 listening for tasks.
I0311 14:02:08.837838       1 tasks_processing.go:69] worker 2 listening for tasks.
I0311 14:02:08.837841       1 tasks_processing.go:71] worker 1 working on machine_configs task.
I0311 14:02:08.837849       1 tasks_processing.go:71] worker 2 working on openstack_version task.
I0311 14:02:08.837955       1 tasks_processing.go:69] worker 16 listening for tasks.
I0311 14:02:08.837963       1 tasks_processing.go:69] worker 23 listening for tasks.
I0311 14:02:08.837969       1 tasks_processing.go:71] worker 16 working on nodenetworkstates task.
I0311 14:02:08.837977       1 tasks_processing.go:69] worker 17 listening for tasks.
I0311 14:02:08.837999       1 tasks_processing.go:69] worker 18 listening for tasks.
I0311 14:02:08.838006       1 tasks_processing.go:69] worker 19 listening for tasks.
I0311 14:02:08.838014       1 tasks_processing.go:69] worker 20 listening for tasks.
I0311 14:02:08.838022       1 tasks_processing.go:69] worker 21 listening for tasks.
I0311 14:02:08.838030       1 tasks_processing.go:69] worker 22 listening for tasks.
I0311 14:02:08.838039       1 tasks_processing.go:69] worker 9 listening for tasks.
I0311 14:02:08.838050       1 tasks_processing.go:69] worker 3 listening for tasks.
I0311 14:02:08.838066       1 tasks_processing.go:69] worker 7 listening for tasks.
I0311 14:02:08.838067       1 tasks_processing.go:69] worker 6 listening for tasks.
I0311 14:02:08.838074       1 tasks_processing.go:69] worker 8 listening for tasks.
I0311 14:02:08.838078       1 tasks_processing.go:69] worker 4 listening for tasks.
I0311 14:02:08.838085       1 tasks_processing.go:69] worker 5 listening for tasks.
I0311 14:02:08.838087       1 tasks_processing.go:69] worker 0 listening for tasks.
I0311 14:02:08.837830       1 tasks_processing.go:69] worker 31 listening for tasks.
I0311 14:02:08.838086       1 tasks_processing.go:69] worker 27 listening for tasks.
I0311 14:02:08.838095       1 tasks_processing.go:69] worker 14 listening for tasks.
I0311 14:02:08.838102       1 tasks_processing.go:69] worker 28 listening for tasks.
I0311 14:02:08.838104       1 tasks_processing.go:69] worker 13 listening for tasks.
I0311 14:02:08.838111       1 tasks_processing.go:69] worker 10 listening for tasks.
I0311 14:02:08.838109       1 tasks_processing.go:69] worker 12 listening for tasks.
I0311 14:02:08.838120       1 tasks_processing.go:69] worker 11 listening for tasks.
I0311 14:02:08.838115       1 tasks_processing.go:69] worker 24 listening for tasks.
I0311 14:02:08.838125       1 tasks_processing.go:69] worker 25 listening for tasks.
I0311 14:02:08.838129       1 tasks_processing.go:69] worker 15 listening for tasks.
I0311 14:02:08.838113       1 tasks_processing.go:69] worker 30 listening for tasks.
I0311 14:02:08.838125       1 tasks_processing.go:69] worker 26 listening for tasks.
I0311 14:02:08.838138       1 tasks_processing.go:71] worker 23 working on certificate_signing_requests task.
I0311 14:02:08.838140       1 tasks_processing.go:71] worker 18 working on silenced_alerts task.
I0311 14:02:08.838143       1 tasks_processing.go:71] worker 17 working on schedulers task.
I0311 14:02:08.838148       1 tasks_processing.go:71] worker 19 working on storage_cluster task.
I0311 14:02:08.838181       1 tasks_processing.go:71] worker 31 working on olm_operators task.
I0311 14:02:08.838227       1 tasks_processing.go:71] worker 27 working on pdbs task.
I0311 14:02:08.838255       1 tasks_processing.go:71] worker 3 working on operators_pods_and_events task.
I0311 14:02:08.838279       1 tasks_processing.go:71] worker 13 working on openstack_dataplanenodesets task.
I0311 14:02:08.838285       1 tasks_processing.go:71] worker 10 working on machine_config_pools task.
I0311 14:02:08.838144       1 tasks_processing.go:71] worker 26 working on openstack_controlplanes task.
I0311 14:02:08.838234       1 tasks_processing.go:71] worker 7 working on validating_webhook_configurations task.
I0311 14:02:08.838222       1 tasks_processing.go:71] worker 12 working on ingress task.
I0311 14:02:08.838238       1 tasks_processing.go:71] worker 28 working on cluster_apiserver task.
I0311 14:02:08.838240       1 tasks_processing.go:71] worker 20 working on monitoring_persistent_volumes task.
I0311 14:02:08.838246       1 tasks_processing.go:71] worker 21 working on sap_pods task.
I0311 14:02:08.838243       1 tasks_processing.go:71] worker 14 working on tsdb_status task.
I0311 14:02:08.838252       1 tasks_processing.go:71] worker 22 working on version task.
I0311 14:02:08.838256       1 tasks_processing.go:71] worker 11 working on openshift_logging task.
I0311 14:02:08.840518       1 tasks_processing.go:69] worker 29 listening for tasks.
I0311 14:02:08.840631       1 tasks_processing.go:71] worker 29 working on install_plans task.
I0311 14:02:08.838259       1 tasks_processing.go:71] worker 4 working on node_logs task.
I0311 14:02:08.838260       1 tasks_processing.go:71] worker 24 working on sap_config task.
I0311 14:02:08.838263       1 tasks_processing.go:71] worker 6 working on metrics task.
I0311 14:02:08.838265       1 tasks_processing.go:71] worker 25 working on mutating_webhook_configurations task.
I0311 14:02:08.838269       1 tasks_processing.go:71] worker 15 working on overlapping_namespace_uids task.
I0311 14:02:08.838267       1 tasks_processing.go:71] worker 8 working on aggregated_monitoring_cr_names task.
I0311 14:02:08.838273       1 tasks_processing.go:71] worker 30 working on pod_network_connectivity_checks task.
I0311 14:02:08.838273       1 tasks_processing.go:71] worker 5 working on cost_management_metrics_configs task.
I0311 14:02:08.838279       1 tasks_processing.go:71] worker 0 working on crds task.
I0311 14:02:08.838252       1 tasks_processing.go:71] worker 9 working on config_maps task.
I0311 14:02:08.841573       1 tasks_processing.go:71] worker 2 working on storage_classes task.
I0311 14:02:08.842167       1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 3.712679ms to process 0 records
I0311 14:02:08.843751       1 tasks_processing.go:71] worker 26 working on service_accounts task.
I0311 14:02:08.843808       1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 5.250251ms to process 0 records
I0311 14:02:08.843828       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 5.807537ms to process 0 records
I0311 14:02:08.843902       1 tasks_processing.go:71] worker 16 working on feature_gates task.
I0311 14:02:08.844467       1 tasks_processing.go:71] worker 13 working on image_registries task.
I0311 14:02:08.844629       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 6.17531ms to process 0 records
I0311 14:02:08.844660       1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 6.46784ms to process 0 records
I0311 14:02:08.844701       1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 6.405953ms to process 0 records
I0311 14:02:08.844782       1 tasks_processing.go:71] worker 10 working on machine_sets task.
I0311 14:02:08.844805       1 tasks_processing.go:71] worker 19 working on networks task.
I0311 14:02:08.845066       1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z
I0311 14:02:08.845086       1 controller.go:317] The initial operator extension status is healthy
I0311 14:02:08.845100       1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0311 14:02:08.845106       1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready
I0311 14:02:08.845111       1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready
I0311 14:02:08.845128       1 controller.go:458] The operator is still being initialized
I0311 14:02:08.845136       1 controller.go:481] The operator is healthy
I0311 14:02:08.845226       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
I0311 14:02:08.845349       1 tasks_processing.go:71] worker 11 working on proxies task.
I0311 14:02:08.845402       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
I0311 14:02:08.845357       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
I0311 14:02:08.845357       1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 5.86069ms to process 0 records
W0311 14:02:08.845379       1 operator.go:287] started
E0311 14:02:08.847891       1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.173.186:9094: connect: connection refused
I0311 14:02:08.847919       1 tasks_processing.go:71] worker 18 working on container_runtime_configs task.
E0311 14:02:08.847936       1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.173.186:9094: connect: connection refused
I0311 14:02:08.847960       1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 9.763373ms to process 0 records
E0311 14:02:08.848938       1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.186.85:9091: connect: connection refused
E0311 14:02:08.848946       1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.186.85:9091: connect: connection refused
I0311 14:02:08.848964       1 tasks_processing.go:71] worker 6 working on lokistack task.
E0311 14:02:08.848966       1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.186.85:9091: connect: connection refused
I0311 14:02:08.849002       1 gather.go:177] gatherer "clusterconfig" function "metrics" took 8.154176ms to process 0 records
E0311 14:02:08.849016       1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.186.85:9091: connect: connection refused
I0311 14:02:08.849022       1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 9.632604ms to process 0 records
I0311 14:02:08.849042       1 tasks_processing.go:71] worker 14 working on operators task.
I0311 14:02:08.853373       1 tasks_processing.go:71] worker 27 working on container_images task.
I0311 14:02:08.853641       1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=9dc52d7fcf47f16c7a56ad19e1fdcfe86dd0a2b93670f9a1046e7084141bcca5
I0311 14:02:08.853676       1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=f56f6f1bcfe745973adfbfcaad4de20a9b2e8aab9ca8e74c8c2347ad3af76033
I0311 14:02:08.853697       1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=bf02a23c350e9c6b5246c1947fbae04aa4fa0ab92f083e2f36a83fa2e9ec8447
I0311 14:02:08.853719       1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=f90e40b0a4b1fbf55b318d685f0a889f9229409d7e05703317dec760c6e7ee64
I0311 14:02:08.853748       1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=78c8858db812cfc21749df093ff7d1a7d3cbf7a23d6f683f3050ec6320331fa1
I0311 14:02:08.853775       1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=4d0b962b8cd7725940a726954a3b1eb8068a98d0f41a3b370976e5e971606f77
I0311 14:02:08.853803       1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=5d8c23736811237c4b34671035d682c40f1f8c750d4dacb008aa1097529751e6
I0311 14:02:08.853840       1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=45fcbee89a520cbe9f247d8ec1fe2a640319db78ecda46033d207adad644c548
I0311 14:02:08.853869       1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=041571a3cf7a2e8d36f22e6fd3da9cc13ddb0a94db132cd7fb2616855c6abcf4
I0311 14:02:08.853897       1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=57a37c248f32a14de82e594291a7e9f4e834d3bfaaeab0b3787020b2c9fd636a
I0311 14:02:08.853912       1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 15.095148ms to process 10 records
I0311 14:02:08.853996       1 tasks_processing.go:71] worker 28 working on machines task.
I0311 14:02:08.854161       1 recorder.go:70] Recording config/apiserver with fingerprint=28049e2f9424807bed29737b200b5b97ce0da0355a41ab21b55328ef19d08940
I0311 14:02:08.854179       1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 14.82845ms to process 1 records
I0311 14:02:08.854253       1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=cf3ab574f37fe39e443f80e12b060cf75f10e9189238bce04da490834ade774c
I0311 14:02:08.854268       1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 15.725403ms to process 1 records
I0311 14:02:08.854271       1 tasks_processing.go:71] worker 17 working on ingress_certificates task.
I0311 14:02:08.854419       1 tasks_processing.go:71] worker 12 working on image task.
I0311 14:02:08.854423       1 recorder.go:70] Recording config/ingress with fingerprint=328a75ed3822e314884ed6303810402d35ba2b56a006b48b68b8b5126f705048
I0311 14:02:08.854538       1 gather.go:177] gatherer "clusterconfig" function "ingress" took 15.201754ms to process 1 records
I0311 14:02:08.861478       1 tasks_processing.go:71] worker 20 working on ceph_cluster task.
I0311 14:02:08.861613       1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 22.412072ms to process 0 records
E0311 14:02:08.861661       1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io)
I0311 14:02:08.861698       1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499
I0311 14:02:08.861714       1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 23.755028ms to process 1 records
E0311 14:02:08.861759       1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io)
I0311 14:02:08.861728       1 tasks_processing.go:71] worker 1 working on infrastructures task.
I0311 14:02:08.861776       1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 19.858553ms to process 0 records
I0311 14:02:08.861787       1 tasks_processing.go:71] worker 30 working on openshift_machine_api_events task.
I0311 14:02:08.861947       1 tasks_processing.go:71] worker 5 working on nodenetworkconfigurationpolicies task.
I0311 14:02:08.861965       1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 20.233796ms to process 0 records
I0311 14:02:08.862283       1 tasks_processing.go:71] worker 6 working on image_pruners task.
I0311 14:02:08.862285       1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 13.308061ms to process 0 records
I0311 14:02:08.862333       1 tasks_processing.go:71] worker 10 working on active_alerts task.
I0311 14:02:08.862642       1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 17.498533ms to process 0 records
I0311 14:02:08.863043       1 tasks_processing.go:71] worker 11 working on sap_datahubs task.
I0311 14:02:08.863487       1 recorder.go:70] Recording config/proxy with fingerprint=363d034a0fffc0cf5eb318a54b8cd866c1883c1401682b71b1625075cd677318
I0311 14:02:08.863562       1 gather.go:177] gatherer "clusterconfig" function "proxies" took 17.646629ms to process 1 records
I0311 14:02:08.863607       1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 24.103208ms to process 0 records
I0311 14:02:08.863634       1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 15.514036ms to process 0 records
I0311 14:02:08.863643       1 tasks_processing.go:71] worker 21 working on machine_autoscalers task.
I0311 14:02:08.863957       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=a652aad8d6b9dd9899fe0918b698fb1fe66258b737b94d82457a47e38c744abd
I0311 14:02:08.864077       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=466d0d5d39a9ef7fb43dbdac591359deecfd954e98ca25cf0036b9f121c0883a
I0311 14:02:08.864172       1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=37424313118bc10c3c5e16f5f7537d47184a0307ebb07b52e9f3e734f555a60e
I0311 14:02:08.864209       1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 22.527943ms to process 3 records
I0311 14:02:08.864241       1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 22.812743ms to process 0 records
I0311 14:02:08.864396       1 recorder.go:70] Recording config/featuregate with fingerprint=74f955ccd870701592d704345a19369fbb2cde0bf602707beae898b666092aef
I0311 14:02:08.864414       1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 20.308486ms to process 1 records
I0311 14:02:08.864425       1 tasks_processing.go:71] worker 16 working on machine_healthchecks task.
I0311 14:02:08.864518       1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 23.744834ms to process 0 records
I0311 14:02:08.864561       1 tasks_processing.go:71] worker 4 working on number_of_pods_and_netnamespaces_with_sdn_annotations task.
I0311 14:02:08.863650       1 tasks_processing.go:71] worker 18 working on jaegers task.
I0311 14:02:08.864972       1 tasks_processing.go:71] worker 19 working on clusterroles task.
I0311 14:02:08.864573       1 tasks_processing.go:71] worker 24 working on nodes task.
I0311 14:02:08.864568       1 tasks_processing.go:71] worker 25 working on authentication task.
I0311 14:02:08.865991       1 recorder.go:70] Recording config/network with fingerprint=5afdbbcd9731361cf21ef6fb3bbec482464c478b708fceaaec7e8748abbc8ec0
I0311 14:02:08.866049       1 gather.go:177] gatherer "clusterconfig" function "networks" took 20.087058ms to process 1 records
I0311 14:02:08.866284       1 tasks_processing.go:71] worker 13 working on openstack_dataplanedeployments task.
I0311 14:02:08.867349       1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=7396edbc10888832fd7260a8d53c4d1717024d556307f990a2ebc7b8b39f2d51
I0311 14:02:08.867417       1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 20.583653ms to process 1 records
I0311 14:02:08.867459       1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 28.368946ms to process 0 records
I0311 14:02:08.867487       1 tasks_processing.go:71] worker 23 working on support_secret task.
E0311 14:02:08.869697       1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.173.186:9094: connect: connection refused
I0311 14:02:08.869721       1 tasks_processing.go:71] worker 10 working on oauths task.
E0311 14:02:08.869743       1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.173.186:9094: connect: connection refused
I0311 14:02:08.869780       1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 7.367397ms to process 0 records
I0311 14:02:08.878387       1 tasks_processing.go:71] worker 20 working on dvo_metrics task.
I0311 14:02:08.878413       1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 16.891796ms to process 0 records
I0311 14:02:08.878641       1 tasks_processing.go:74] worker 28 stopped.
E0311 14:02:08.878657       1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope
I0311 14:02:08.878669       1 gather.go:177] gatherer "clusterconfig" function "machines" took 24.626032ms to process 0 records
I0311 14:02:08.878836       1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready
I0311 14:02:08.878849       1 controller.go:203] Source scaController *sca.Controller is not ready
I0311 14:02:08.878853       1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready
I0311 14:02:08.878857       1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0311 14:02:08.878861       1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready
I0311 14:02:08.878876       1 controller.go:458] The operator is still being initialized
I0311 14:02:08.878884       1 controller.go:481] The operator is healthy
I0311 14:02:08.880448       1 tasks_processing.go:74] worker 2 stopped.
I0311 14:02:08.880622       1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=22825fb1950e86b6ed4f5bdef5b3979209695d5c12cfe91c6466bdcbc233943a
I0311 14:02:08.880709       1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=9f5cb292aa92ca2cacc8daccc0e3be2d3715fb31c0c75446831865e3b4afb766
I0311 14:02:08.880786       1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 38.813423ms to process 2 records
I0311 14:02:08.880846       1 tasks_processing.go:74] worker 5 stopped.
I0311 14:02:08.880898       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 18.854733ms to process 0 records
I0311 14:02:08.881048       1 recorder.go:70] Recording config/image with fingerprint=efb7800af11ef009581a612f557b702e139a2fe5a8ed9a30ef413e2ad8eec4ac
I0311 14:02:08.881077       1 tasks_processing.go:74] worker 12 stopped.
I0311 14:02:08.881110       1 gather.go:177] gatherer "clusterconfig" function "image" took 26.47415ms to process 1 records
I0311 14:02:08.881140       1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 17.845291ms to process 0 records
I0311 14:02:08.881153       1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 19.212303ms to process 0 records
I0311 14:02:08.881161       1 tasks_processing.go:74] worker 30 stopped.
I0311 14:02:08.881165       1 tasks_processing.go:74] worker 11 stopped.
I0311 14:02:08.881239       1 tasks_processing.go:74] worker 18 stopped.
I0311 14:02:08.881282       1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 16.478347ms to process 0 records
I0311 14:02:08.881323       1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 17.516383ms to process 0 records
E0311 14:02:08.881375       1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope
I0311 14:02:08.881409       1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 16.834365ms to process 0 records
I0311 14:02:08.881429       1 tasks_processing.go:74] worker 16 stopped.
I0311 14:02:08.881436       1 tasks_processing.go:74] worker 21 stopped.
I0311 14:02:08.881465       1 tasks_processing.go:74] worker 1 stopped.
I0311 14:02:08.882463       1 recorder.go:70] Recording config/infrastructure with fingerprint=e57dfafa7fca3f606d1f58290fdc01a2dcb8659d389f50be909049595d37f7c6
I0311 14:02:08.882484       1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 19.683656ms to process 1 records
I0311 14:02:08.882576       1 tasks_processing.go:74] worker 6 stopped.
I0311 14:02:08.882661       1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=203fa48848874ebf86b6ca5f2a378f75cedec0c9f9ffcba45e937589057ee202
I0311 14:02:08.882702       1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 19.209254ms to process 1 records
I0311 14:02:08.883524       1 tasks_processing.go:74] worker 13 stopped.
I0311 14:02:08.883599       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 17.190663ms to process 0 records
I0311 14:02:08.884208       1 tasks_processing.go:74] worker 31 stopped.
I0311 14:02:08.884303       1 recorder.go:70] Recording config/olm_operators with fingerprint=e6d8da22bc74120deb887d57fc7c4985802554c05abc52455c177374236b53ec
I0311 14:02:08.884332       1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 45.947488ms to process 1 records
I0311 14:02:08.885224       1 tasks_processing.go:74] worker 23 stopped.
E0311 14:02:08.885273       1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found
I0311 14:02:08.885903       1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 17.709435ms to process 0 records
I0311 14:02:08.886377       1 tasks_processing.go:74] worker 25 stopped.
I0311 14:02:08.887391       1 recorder.go:70] Recording config/authentication with fingerprint=39adb4b94d57ea5e5d2e9c69f1158f876a5b51aee0245facea5368f9d5c95c83
I0311 14:02:08.887429       1 gather.go:177] gatherer "clusterconfig" function "authentication" took 20.654317ms to process 1 records
I0311 14:02:08.887566       1 tasks_processing.go:74] worker 10 stopped.
I0311 14:02:08.888481       1 recorder.go:70] Recording config/oauth with fingerprint=a93c0e16205fb2a425a617555f9e00cc4209f03d2af874038ffba3fa7b5bf45c
I0311 14:02:08.888505       1 gather.go:177] gatherer "clusterconfig" function "oauths" took 17.424214ms to process 1 records
I0311 14:02:08.888539       1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
I0311 14:02:08.888574       1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 46.245293ms to process 1 records
I0311 14:02:08.888586       1 tasks_processing.go:74] worker 15 stopped.
I0311 14:02:08.891057       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0311 14:02:08.891160       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0311 14:02:08.891256       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0311 14:02:08.894010       1 base_controller.go:82] Caches are synced for ConfigController 
I0311 14:02:08.894031       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
I0311 14:02:08.894517       1 tasks_processing.go:74] worker 0 stopped.
I0311 14:02:08.895413       1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=6c6a98a836f5627443538766c9bf7e63c5a6eb673df6f16e391d0705a0282054
I0311 14:02:08.895827       1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=f008fc9d0f512f4b76df60585b84e978b8424390bc260f6511fc7944cf8f5cbb
I0311 14:02:08.895881       1 gather.go:177] gatherer "clusterconfig" function "crds" took 52.595729ms to process 2 records
I0311 14:02:08.895917       1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 54.418127ms to process 0 records
I0311 14:02:08.895974       1 tasks_processing.go:74] worker 8 stopped.
I0311 14:02:08.896164       1 tasks_processing.go:74] worker 19 stopped.
I0311 14:02:08.896292       1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=54ed58fd0efe663598e0cdac5b2d488459cb645dc5a68e428fee437d180a3364
I0311 14:02:08.896435       1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=ccf978b12bc30441c433698a6c0956c4c9f0db5aeec245a10e9c41994298e779
I0311 14:02:08.896449       1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 30.692812ms to process 2 records
I0311 14:02:08.896573       1 tasks_processing.go:74] worker 22 stopped.
I0311 14:02:08.897207       1 recorder.go:70] Recording config/version with fingerprint=d4174ad3c3abdd23b7d7ff3771d4f5456ded27a96009efe271f203e1a4079fa4
I0311 14:02:08.897256       1 recorder.go:70] Recording config/id with fingerprint=88b33fbe93ffc06f1afc2db7b6e6372b9269045bba04ac7b02dfd4114c127a28
I0311 14:02:08.897285       1 gather.go:177] gatherer "clusterconfig" function "version" took 56.384024ms to process 2 records
I0311 14:02:08.897426       1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=ea33226ed26916e5bab28f9ff50db685be7df6678252965b32863b45cd233c59
I0311 14:02:08.897518       1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=cff26c71ecb427137e65c685ed9f1fc1f8849e3029b6ea5dae5ba8f352bde844
I0311 14:02:08.897644       1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=f148fdea119040510558bc26fb7b28757f7f4594f87f17251d3974fb48c8c8ba
I0311 14:02:08.897659       1 tasks_processing.go:74] worker 7 stopped.
I0311 14:02:08.897687       1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=096ebd612f04c1f391f200b5ea726cf2e75be0b651ad236b814c36e3982b2274
I0311 14:02:08.897722       1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=7b89f2c4b595a66803338829ff1678787a00ae540da4da9f2524f3f899d13858
I0311 14:02:08.897768       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=da0f2eca110fff79aa2946d463eb7dfe674addb59664de456debe526609e8ce9
I0311 14:02:08.898371       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=4f976788f2e99ac34bf31384081f1aa201936473a8c4baa101a4f9677a5f9f3d
I0311 14:02:08.900374       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=ba0d63c34117b4860513a7c1ac0c009f350bcd4d3190aed5ba2226185a30eac3
W0311 14:02:08.900288       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0311 14:02:08.900531       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=f01e8a0d0c88cc344be8110c82806e5659d21ccda97629398463dc871ed6e6ed
I0311 14:02:08.900604       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=28f43ab00d5b93fe9c48a993ec456a39c14dca8e64048f72f880dadcfaf07ae2
I0311 14:02:08.900648       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=4e5b0a7903aa360f4337fff9852f6d6f8ed7384d820ad1899d4882599dd44e44
I0311 14:02:08.900749       1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=3f43290baac3d6db1c754768dc276ef11e6a9faba83ca12778355edad7474812
I0311 14:02:08.900762       1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 57.253616ms to process 12 records
I0311 14:02:08.903362       1 configmapobserver.go:84] configmaps "insights-config" not found
I0311 14:02:08.909442       1 tasks_processing.go:74] worker 27 stopped.
I0311 14:02:08.913683       1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-r6dgx with fingerprint=668b011e663fc6607cd7aad6b6d0527a713cc7698401a737762886a70786a27c
I0311 14:02:08.913982       1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-sbjdd with fingerprint=184fead5b012c2808350ddfefeb87bfbbbda8813332e6084e6c2d6fb409f538b
I0311 14:02:08.914205       1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-t6lg2 with fingerprint=04b8f156d5d366c5688cf4e680d16997e8f1042e572bfe350acf5b97f3296159
I0311 14:02:08.914417       1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-wc7bb with fingerprint=70ef4052cb4daae406d35ad3fd2b2c49c853d06ec26e05d48be24c0b594a82cd
I0311 14:02:08.914489       1 recorder.go:70] Recording config/running_containers with fingerprint=94aac70666fa35a81204928efa04da9134f8b64ba3054a5b0bf0603b5eae6940
I0311 14:02:08.914504       1 gather.go:177] gatherer "clusterconfig" function "container_images" took 56.051195ms to process 5 records
E0311 14:02:08.914517       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found
E0311 14:02:08.914528       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found
E0311 14:02:08.914533       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found
I0311 14:02:08.914537       1 tasks_processing.go:74] worker 9 stopped.
I0311 14:02:08.914559       1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17
I0311 14:02:08.914624       1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d
I0311 14:02:08.914634       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a
I0311 14:02:08.914642       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4
I0311 14:02:08.914652       1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d
I0311 14:02:08.914692       1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0
I0311 14:02:08.914700       1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d
I0311 14:02:08.914706       1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 71.52729ms to process 7 records
I0311 14:02:08.917826       1 tasks_processing.go:74] worker 4 stopped.
I0311 14:02:08.917836       1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 53.194742ms to process 0 records
I0311 14:02:08.945966       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0311 14:02:08.945990       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0311 14:02:08.955646       1 tasks_processing.go:74] worker 24 stopped.
I0311 14:02:08.956046       1 recorder.go:70] Recording config/node/ip-10-0-0-195.ec2.internal with fingerprint=2ef58ed47b23c22f9820a29981d93adba29234cc35a685394561baae29be183a
I0311 14:02:08.956109       1 recorder.go:70] Recording config/node/ip-10-0-1-228.ec2.internal with fingerprint=73a4401e4fc4e8764d5acc99aa3553ddedef546ea52240475d97933d6ec87d08
I0311 14:02:08.956165       1 recorder.go:70] Recording config/node/ip-10-0-2-29.ec2.internal with fingerprint=35e31714d64bdc7723291b2a8e3c251c53117bcd738c04429c1258bd72fbc51d
I0311 14:02:08.956174       1 gather.go:177] gatherer "clusterconfig" function "nodes" took 90.631633ms to process 3 records
I0311 14:02:08.969870       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
I0311 14:02:09.003185       1 tasks_processing.go:74] worker 17 stopped.
E0311 14:02:09.003200       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found
E0311 14:02:09.003207       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ovi6kukph2dn9f582ta9gknbc93k080-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ovi6kukph2dn9f582ta9gknbc93k080-primary-cert-bundle-secret" not found
I0311 14:02:09.003331       1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=63c000c07c8a91c0f45f418753ca63f08b4db0c52ee25f3e8baf3f7bfe96cb53
I0311 14:02:09.003345       1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 148.898002ms to process 1 records
I0311 14:02:09.011581       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator"
I0311 14:02:09.014394       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress"
I0311 14:02:09.083227       1 cluster_transfer.go:102] no available accepted cluster transfer
I0311 14:02:09.083245       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer
I0311 14:02:09.085840       1 gather_cluster_operator_pods_and_events.go:121] Found 12 pods with 15 containers
I0311 14:02:09.085851       1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1677721 bytes
I0311 14:02:09.086335       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-nqqd8 pod in namespace openshift-dns (previous: false).
I0311 14:02:09.119508       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-nqqd8 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-nqqd8\" is waiting to start: ContainerCreating"
I0311 14:02:09.119529       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-nqqd8\" is waiting to start: ContainerCreating"
I0311 14:02:09.119566       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-nqqd8 pod in namespace openshift-dns (previous: false).
I0311 14:02:09.184691       1 sca.go:266] etc-pki-entitlement secret successfully created
I0311 14:02:09.184710       1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated
I0311 14:02:09.278287       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-nqqd8 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-nqqd8\" is waiting to start: ContainerCreating"
I0311 14:02:09.278306       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-nqqd8\" is waiting to start: ContainerCreating"
I0311 14:02:09.278334       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-pp6hg pod in namespace openshift-dns (previous: false).
I0311 14:02:09.493810       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-pp6hg pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-pp6hg\" is waiting to start: ContainerCreating"
I0311 14:02:09.493833       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-pp6hg\" is waiting to start: ContainerCreating"
I0311 14:02:09.493841       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-pp6hg pod in namespace openshift-dns (previous: false).
I0311 14:02:09.681989       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vg6pf pod in namespace openshift-dns (previous: false).
I0311 14:02:09.771583       1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes"
I0311 14:02:09.899324       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vg6pf pod in namespace openshift-dns (previous: false).
W0311 14:02:09.900768       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0311 14:02:09.972034       1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes"
I0311 14:02:10.078422       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-ch2b5 pod in namespace openshift-dns (previous: false).
I0311 14:02:10.277428       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-czc8b pod in namespace openshift-dns (previous: false).
I0311 14:02:10.481378       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-zlbgx pod in namespace openshift-dns (previous: false).
I0311 14:02:10.676952       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-58578866df-xglwn pod in namespace openshift-ingress (previous: false).
I0311 14:02:10.878571       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f994c6c84-85bjs pod in namespace openshift-ingress (previous: false).
W0311 14:02:10.900132       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0311 14:02:11.078357       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f994c6c84-xgqn7 pod in namespace openshift-ingress (previous: false).
I0311 14:02:11.280101       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-8nr9h pod in namespace openshift-ingress-canary (previous: false).
I0311 14:02:11.375838       1 tasks_processing.go:74] worker 14 stopped.
I0311 14:02:11.375969       1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=9301080b42b29275e2b5b965ee6ced95ad69d43b55e1df0d467ed8272bdf464a
I0311 14:02:11.376021       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1
I0311 14:02:11.376053       1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=bf7be1db71cbc7f0b72d3e44250a7586863a2a64799b5f1603113319ac1c6194
I0311 14:02:11.376065       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e
I0311 14:02:11.376087       1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=a48996c6187798f917bc34ddec8dfdd08f1bb5caccb507fdf3460a88ff9bdef6
I0311 14:02:11.376108       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f
I0311 14:02:11.376135       1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=18e0c483b6f6daeb497eca4c8e64c9e54d3f12667acd8fce7b5247c34cdb0919
I0311 14:02:11.376165       1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=4d492b86880e4d2c49ae26f6919873c65321a914a6c39aa81b83c99ba6a196f1
I0311 14:02:11.376198       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ad8fdd47d640ff6b0aea33ffa5cf7237fab9ab4dcf520b308857e93c59632a96
I0311 14:02:11.376230       1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=2c11d36cfdec2cac96e913beed066b887dd67d693d21e1d331571edaf4bb18af
I0311 14:02:11.376573       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=bd043cc04b63401e2b0d6de6223e584aa9a8872732139340212546f61d83a22e
I0311 14:02:11.376599       1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=b4d0fa0562e2cab91067646fc88b257d3dd628b9a6624356427d229c06b913bd
I0311 14:02:11.376610       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762
I0311 14:02:11.376629       1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=e367a8c787412f0d39bf9cc840394e9ef77b3bb235305331682d1c1290285d6e
I0311 14:02:11.376644       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11
I0311 14:02:11.376662       1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=e6db9bb58dca4974697219d36ce8075e8b574b66f210af35617fbe9fd85522b3
I0311 14:02:11.376674       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a
I0311 14:02:11.376695       1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=c26a02fb4092110553bca7e5a5acf45e87dcfb26a8cd9a2727d02656085f47cb
I0311 14:02:11.376705       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db
I0311 14:02:11.376735       1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=a96ffd88890550635db3f0d5522593bf179c7dde1833ffdd247b5db5d88f3a26
I0311 14:02:11.376845       1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=bf6e32cb2748e76c830fa70831f0582201ea06b5f23082ed91ca55627609130c
I0311 14:02:11.376874       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75
I0311 14:02:11.376899       1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=9f31c66fe2ecc56f3ed64b2acc9954a8ede03d910644866644738f8c47d34bd0
I0311 14:02:11.376925       1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=b4cf5bc3127cc85cbda8c3ef1201c8b8ad6b102cf377b1293a3a82bcb7fddb16
I0311 14:02:11.376935       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76
I0311 14:02:11.376956       1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=a91064280d0b788aff2d2357c2998738e1d8f0d3482ed771349cf5b9a1ad6bc2
I0311 14:02:11.376970       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7
I0311 14:02:11.376993       1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=19c763acd47da5b3e83dbdcc4915c5eabb839a639a9acd666bb1ec66c43ddac5
I0311 14:02:11.377004       1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd
I0311 14:02:11.377018       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=47b608c37568b8efb4ffcf50abdb01acca253662eb206fb5256fc347f4ba303c
I0311 14:02:11.377040       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=b7df4d2dcffb04b31b31d12bd0ecf67ef2972fb53858e02c4e8c8ff23e39e6af
I0311 14:02:11.377058       1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=8ddd450f9e59c51a3b2b749982c2c99fcb8d6f6cef3d50f32fd96b7a2a2fcdaf
I0311 14:02:11.377081       1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=a163660c051e61ba0f29a8643a099db5f55d7173ddc99d985436a17359dc6c31
I0311 14:02:11.377093       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa
I0311 14:02:11.377130       1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=c1c5ae7b9b13599ba21887fc4f0deaccfceafc75aeb389c9bef7d6835570a443
I0311 14:02:11.377153       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e
I0311 14:02:11.377163       1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad
I0311 14:02:11.377171       1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.526775827s to process 37 records
I0311 14:02:11.477049       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-jsrcf pod in namespace openshift-ingress-canary (previous: false).
I0311 14:02:11.678344       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-nrnzs pod in namespace openshift-ingress-canary (previous: false).
I0311 14:02:11.881687       1 tasks_processing.go:74] worker 3 stopped.
I0311 14:02:11.881783       1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=e0369810552dee54641a5ccd45a1039cc1f147287c213f17d1786598725ab409
I0311 14:02:11.881875       1 recorder.go:70] Recording events/openshift-dns with fingerprint=0ce56a114cf4b9cfd5553fb589bc1936aa457d619fe00d153b466606b1d6014f
I0311 14:02:11.881911       1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=b1528a71cbcac51f37285a9634e66b17bbaf1cdb85e3e9cae8b967d6738fefbb
I0311 14:02:11.882039       1 recorder.go:70] Recording events/openshift-ingress with fingerprint=41e6d627a701821dc5c0b2d89aa34369145ed5e2dba0e74c089b3855a08f3195
I0311 14:02:11.882104       1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=e2a7489a94010f289cda074142d34178429a32edcf9b45e370f85edbd63651de
I0311 14:02:11.882249       1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-nqqd8 with fingerprint=952f9892f5fa1a65a04d79354285c5eddd7937d57a632bb4e0599d8ec5f6367f
I0311 14:02:11.882335       1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-pp6hg with fingerprint=f5e97bf74f7449a1549dc4e2542e6191debb1defcad0fd9311e49aac750fda97
I0311 14:02:11.882348       1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-pp6hg/kube-rbac-proxy_current.log with fingerprint=1a45116ca6e65ec39454e3d4c0757724c74ee926559cc5d3faca0080678aee77
I0311 14:02:11.882359       1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-vg6pf/dns_current.log with fingerprint=8be81490f45aa20db81e7426018a7497e848b3d3f42e04bb5e09f9067988342c
I0311 14:02:11.882378       1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-vg6pf/kube-rbac-proxy_current.log with fingerprint=1a7dfcacfd290a545ca4159e826de81c13b839a2e53591312e2cc1075b2a6ae5
I0311 14:02:11.882390       1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-ch2b5/dns-node-resolver_current.log with fingerprint=cf122fa9009c7e364c4c8fb13af3610a33b6056413891431561cccae5ed5f1a3
I0311 14:02:11.882396       1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-czc8b/dns-node-resolver_current.log with fingerprint=5369d715b438fabc07081260c89eb97f4a3a5bf19256fa2bd4220ba6831d4d43
I0311 14:02:11.882402       1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-zlbgx/dns-node-resolver_current.log with fingerprint=668b52e0f53e29a0d354b0862c90c90291c03ed614fd24e41b3eb1be9497b2a6
I0311 14:02:11.882425       1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-58578866df-xglwn/router_current.log with fingerprint=7c46f1f8c6f0a0ce0b79528e24b6c02656ed760356c26435e7c9129cf5b2f82d
I0311 14:02:11.882496       1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-f994c6c84-85bjs/router_current.log with fingerprint=e5b24dcbe2b03332e2b90b1b519b9e27e4b5be33fb19e25f13047d7c17cc674d
I0311 14:02:11.882535       1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-f994c6c84-xgqn7/router_current.log with fingerprint=986aa9f643c9da7da85ca134d2958ca1abb294245e22e0ad664a393bfa61a894
I0311 14:02:11.882646       1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-8nr9h with fingerprint=207c3eb2b6ae7fe75a4ccbb093c616a63ab69f665b3254633203041bebb550f1
I0311 14:02:11.882659       1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-8nr9h/serve-healthcheck-canary_current.log with fingerprint=3c483fa6f8b612ba2ed5f4d5d71b1e76a600d9ddef6269fc8a1f109664009161
I0311 14:02:11.882667       1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-jsrcf/serve-healthcheck-canary_current.log with fingerprint=52d120a6bf562fd6d7003ac607f98ea04d701fe9e527b03d2b660cf15b8832c4
I0311 14:02:11.882734       1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-nrnzs with fingerprint=9f7b372c2c86de264781160a10953c3644dc4b8acaf98d606aa9067272038d54
I0311 14:02:11.882745       1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-nrnzs/serve-healthcheck-canary_current.log with fingerprint=6d18efae4a7d4bdfa069aa25508d2181bf1f2d847ba38aa3bbd3287188d721da
I0311 14:02:11.882758       1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 3.043391015s to process 21 records
W0311 14:02:11.900868       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0311 14:02:12.900539       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0311 14:02:13.900949       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0311 14:02:13.900977       1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0311 14:02:13.900994       1 tasks_processing.go:74] worker 20 stopped.
E0311 14:02:13.901005       1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0311 14:02:13.901016       1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
I0311 14:02:13.901026       1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.022585541s to process 1 records
I0311 14:02:21.695401       1 tasks_processing.go:74] worker 29 stopped.
I0311 14:02:21.695445       1 recorder.go:70] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539
I0311 14:02:21.695458       1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.854469025s to process 1 records
I0311 14:02:22.449485       1 tasks_processing.go:74] worker 26 stopped.
I0311 14:02:22.449787       1 recorder.go:70] Recording config/serviceaccounts with fingerprint=73582af525bf551f979ef96bfb3cbb0257826668d63659ccecb8b26ded60e307
I0311 14:02:22.449803       1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.605708148s to process 1 records
E0311 14:02:22.449866       1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.612s with: function \"silenced_alerts\" failed with an error, function \"metrics\" failed with an error, function \"tsdb_status\" failed with an error, function \"machine_configs\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"active_alerts\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error"
I0311 14:02:22.450976       1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "silenced_alerts" failed with an error, function "metrics" failed with an error, function "tsdb_status" failed with an error, function "machine_configs" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "active_alerts" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error
I0311 14:02:22.450991       1 periodic.go:212] Running workloads gatherer
I0311 14:02:22.451011       1 tasks_processing.go:45] number of workers: 2
I0311 14:02:22.451027       1 tasks_processing.go:69] worker 1 listening for tasks.
I0311 14:02:22.451034       1 tasks_processing.go:71] worker 1 working on workload_info task.
I0311 14:02:22.451038       1 tasks_processing.go:69] worker 0 listening for tasks.
I0311 14:02:22.451105       1 tasks_processing.go:71] worker 0 working on helmchart_info task.
I0311 14:02:22.458119       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-195.ec2.internal...
I0311 14:02:22.458130       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-29.ec2.internal...
I0311 14:02:22.458141       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-228.ec2.internal...
I0311 14:02:22.483733       1 tasks_processing.go:74] worker 0 stopped.
I0311 14:02:22.483748       1 gather.go:177] gatherer "workloads" function "helmchart_info" took 32.606286ms to process 0 records
I0311 14:02:27.592724       1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 5s
I0311 14:02:27.616616       1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 24s for image data
I0311 14:02:27.624820       1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (10ms)
I0311 14:02:27.633418       1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (9ms)
I0311 14:02:27.642793       1 gather_workloads_info.go:387] No image sha256:46c2c396ca651699738c3f26b79b10af2922123dd27c2e32382d2a31a87e92c7 (9ms)
I0311 14:02:27.651708       1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (9ms)
I0311 14:02:27.660262       1 gather_workloads_info.go:387] No image sha256:1cc2f3c83068c8c67d9070f67677e1bb6b4feff7ac5744cad08711893e56b55f (9ms)
I0311 14:02:27.668619       1 gather_workloads_info.go:387] No image sha256:e40bbab1e52f580ab471bd7ab19ae23a4bcbaf1893243a05238af6bede7ba9cc (8ms)
I0311 14:02:27.676570       1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (8ms)
I0311 14:02:27.684666       1 gather_workloads_info.go:387] No image sha256:7854174b4b98e9b10d9c8e9b43113df1217ab21db4b2395d9399af0c3d7911a3 (8ms)
I0311 14:02:27.692253       1 gather_workloads_info.go:387] No image sha256:ce3d8211c0bde5788a4fd04c3eff31ae591437ceab2b3168dbbdfe408673c8b1 (8ms)
I0311 14:02:27.700877       1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (9ms)
I0311 14:02:27.725311       1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (24ms)
I0311 14:02:27.824789       1 gather_workloads_info.go:387] No image sha256:a3d34d8f38a540ce79d34a5248b1965346155497db57b72cb4758d659418059c (99ms)
I0311 14:02:27.925120       1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (100ms)
I0311 14:02:28.026349       1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (101ms)
I0311 14:02:28.124822       1 gather_workloads_info.go:387] No image sha256:799f5628c18e77a49c08645c03179046b5200c8cbcfd65737fb59668132f393e (98ms)
I0311 14:02:28.225712       1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (101ms)
I0311 14:02:28.325932       1 gather_workloads_info.go:387] No image sha256:6c3c7f77d7a3815bbb69cad5f6f1742c17d9597bc135ba3d116c9736d98fae33 (100ms)
I0311 14:02:28.425429       1 gather_workloads_info.go:387] No image sha256:1f2aa1e1026570162984f7fbb634635bcf319e408cafa8f9034ee842a2f193ab (99ms)
I0311 14:02:28.526485       1 gather_workloads_info.go:387] No image sha256:5cba745f09f3bd6b8028c6773597cbb30bf3639a84f2b4b6493fe20642339a2c (101ms)
I0311 14:02:28.625187       1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (99ms)
I0311 14:02:28.731578       1 gather_workloads_info.go:387] No image sha256:270a7bac889ed64d75ce11ae26e8634a6209ff718b83fae2c888cfc758316aa3 (106ms)
I0311 14:02:28.826865       1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (95ms)
I0311 14:02:28.925092       1 gather_workloads_info.go:387] No image sha256:1d471ad866b8564b209214d7dd3a7363c47e9535211d660b63b46abb278af7ab (98ms)
I0311 14:02:29.025201       1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (100ms)
I0311 14:02:29.124297       1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (99ms)
I0311 14:02:29.225227       1 gather_workloads_info.go:387] No image sha256:00f977c2275f5bf03d423911159a39ca44fabc1862ecb7ae492198ec8c46c6bb (101ms)
I0311 14:02:29.324976       1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (100ms)
I0311 14:02:29.425524       1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (101ms)
I0311 14:02:29.524891       1 gather_workloads_info.go:387] No image sha256:6277dac65decba0ea094146bb99600f479eaf804696842e724de1f1b436f9a38 (99ms)
I0311 14:02:29.625144       1 gather_workloads_info.go:387] No image sha256:527ed405bf66234718321996dacf51f91c64c746de9f1509416ef6ce89c90a50 (100ms)
I0311 14:02:29.725573       1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms)
I0311 14:02:29.825581       1 gather_workloads_info.go:387] No image sha256:68d8e92046969bcfcbca2d2b3dcf4dcad5f6edc5fcb44861eb22f8079a43ea4d (100ms)
I0311 14:02:29.925065       1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (99ms)
I0311 14:02:30.025158       1 gather_workloads_info.go:387] No image sha256:bcca5c17371caa2dce7e28da4c9fe30163c340fa172187f94db90ea1bd6ab80d (100ms)
I0311 14:02:30.125971       1 gather_workloads_info.go:398] Found image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (101ms)
I0311 14:02:30.225539       1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (99ms)
I0311 14:02:30.326007       1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (100ms)
I0311 14:02:30.425568       1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (100ms)
I0311 14:02:30.525461       1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (100ms)
I0311 14:02:30.624949       1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (99ms)
I0311 14:02:30.725439       1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (100ms)
I0311 14:02:30.825602       1 gather_workloads_info.go:387] No image sha256:929a4a9c96a08b57fe4c315deca55c30d1990c83e34b8b5692f7646d29f715c8 (100ms)
I0311 14:02:30.925367       1 gather_workloads_info.go:398] Found image sha256:59db91eadf1e1e5343777be43ff25fb712f300f9341be48ba05f45270944536f (100ms)
I0311 14:02:31.024427       1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (99ms)
I0311 14:02:31.124480       1 gather_workloads_info.go:387] No image sha256:039479f355d6903e1018abf8427fece3465c4348d4de2144ec38114b51bec27e (100ms)
I0311 14:02:31.225213       1 gather_workloads_info.go:387] No image sha256:38dd36da63b1f01316a02daf6c18b821318c6ec313712147292d74abf955e0da (101ms)
I0311 14:02:31.225246       1 tasks_processing.go:74] worker 1 stopped.
I0311 14:02:31.225617       1 recorder.go:70] Recording config/workload_info with fingerprint=3793b6bd1eb1a06e18a4aa01e86223bc1f2c23b33e5c5b6a1a7c4bc45d5c5dbe
I0311 14:02:31.225634       1 gather.go:177] gatherer "workloads" function "workload_info" took 8.774203579s to process 1 records
I0311 14:02:31.225647       1 periodic.go:259] Periodic gather workloads completed in 8.774s
I0311 14:02:31.225656       1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message=
I0311 14:02:31.225661       1 periodic.go:212] Running conditional gatherer
I0311 14:02:31.234534       1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules
I0311 14:02:31.497057       1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer
E0311 14:02:31.499729       1 conditional_gatherer.go:322] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.186.85:9091: connect: connection refused
I0311 14:02:31.499807       1 conditional_gatherer.go:382] updating version cache for conditional gatherer
I0311 14:02:31.508057       1 conditional_gatherer.go:390] cluster version is '4.19.9'
E0311 14:02:31.508072       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0311 14:02:31.508077       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0311 14:02:31.508081       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0311 14:02:31.508084       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0311 14:02:31.508087       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0311 14:02:31.508090       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0311 14:02:31.508093       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0311 14:02:31.508096       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0311 14:02:31.508099       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
E0311 14:02:31.508103       1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing
I0311 14:02:31.508119       1 tasks_processing.go:45] number of workers: 3
I0311 14:02:31.508129       1 tasks_processing.go:69] worker 2 listening for tasks.
I0311 14:02:31.508134       1 tasks_processing.go:71] worker 2 working on rapid_container_logs task.
I0311 14:02:31.508139       1 tasks_processing.go:69] worker 0 listening for tasks.
I0311 14:02:31.508151       1 tasks_processing.go:69] worker 1 listening for tasks.
I0311 14:02:31.508215       1 tasks_processing.go:71] worker 1 working on conditional_gatherer_rules task.
I0311 14:02:31.508228       1 tasks_processing.go:74] worker 1 stopped.
I0311 14:02:31.508232       1 tasks_processing.go:71] worker 0 working on remote_configuration task.
I0311 14:02:31.508350       1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661
I0311 14:02:31.508367       1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.82µs to process 1 records
I0311 14:02:31.508422       1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d
I0311 14:02:31.508434       1 gather.go:177] gatherer "conditional" function "remote_configuration" took 2.366µs to process 1 records
I0311 14:02:31.508442       1 tasks_processing.go:74] worker 0 stopped.
I0311 14:02:31.508492       1 tasks_processing.go:74] worker 2 stopped.
I0311 14:02:31.508502       1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 347.86µs to process 0 records
I0311 14:02:31.508524       1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message=
I0311 14:02:31.508539       1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f
I0311 14:02:31.540519       1 recorder.go:70] Recording insights-operator/gathers with fingerprint=4bd12f2d23d4cad0eded553b9a0802c991170f6f7ea7731fe596daccadcdbe5e
I0311 14:02:31.540711       1 diskrecorder.go:70] Writing 129 records to /var/lib/insights-operator/insights-2026-03-11-140231.tar.gz
I0311 14:02:31.549648       1 diskrecorder.go:51] Wrote 129 records to disk in 9ms
I0311 14:02:31.549680       1 periodic.go:281] Gathering cluster info every 2h0m0s
I0311 14:02:31.549694       1 periodic.go:282] Configuration is 
	dataReporting:
		interval: 2h0m0s,
		uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload,
		storagePath: /var/lib/insights-operator,
		downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, 
		conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules,
		obfuscation: []
	sca:
		disabled: false,
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates,
		interval: 8h0m0s
	alerting:
		disabled: false
	clusterTransfer:
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/,
		interval: 12h0m0s
	proxy:
		httpProxy: ,
		httpsProxy: ,
		noProxy: 
I0311 14:03:38.838567       1 diskrecorder.go:223] Found files to send: insights-2026-03-11-140231.tar.gz
I0311 14:03:38.838595       1 insightsuploader.go:150] Checking archives to upload periodically every 15m38.811181556s
I0311 14:03:38.838605       1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z
I0311 14:03:38.851133       1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload
I0311 14:03:39.063568       1 requests.go:87] Successfully reported id=2026-03-11T14:03:38Z x-rh-insights-request-id=9a0d6a4bb1eb447d9c62bacb7ed6e46c, wrote=66079
I0311 14:03:39.063619       1 insightsuploader.go:187] Uploaded report successfully in 225.007928ms
I0311 14:03:39.063646       1 controller.go:119] Initializing last reported time to 2026-03-11T14:03:38Z
I0311 14:03:39.063708       1 insightsreport.go:304] Archive uploaded, starting pulling report...
I0311 14:03:39.063716       1 insightsreport.go:215] Starting retrieving report from Smart Proxy
I0311 14:03:39.063734       1 insightsreport.go:221] Initial delay for pulling: 1m0s
I0311 14:03:39.069538       1 controller.go:481] The operator is healthy
I0311 14:04:08.855204       1 controller.go:481] The operator is healthy
I0311 14:04:39.571575       1 insightsreport.go:137] Pulling report from smart-proxy
I0311 14:04:39.571601       1 insightsreport.go:149] Retrieving report
I0311 14:04:39.581159       1 requests.go:110] Retrieving report for cluster: 049f69fe-5f23-4f89-b77e-f572e32d3974
I0311 14:04:39.581171       1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/049f69fe-5f23-4f89-b77e-f572e32d3974/reports
I0311 14:04:39.584360       1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/049f69fe-5f23-4f89-b77e-f572e32d3974/reports
I0311 14:04:39.854128       1 insightsreport.go:184] Report retrieved
I0311 14:04:39.881137       1 insightsreport.go:239] Report retrieved correctly
I0311 14:06:09.088271       1 controller.go:481] The operator is healthy
I0311 14:07:08.828283       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0311 14:07:08.836791       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0311 14:07:08.836810       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0311 14:07:08.841462       1 secretconfigobserver.go:119] support secret does not exist
I0311 14:08:08.852854       1 controller.go:481] The operator is healthy
I0311 14:10:08.856102       1 controller.go:481] The operator is healthy
I0311 14:12:08.811656       1 configmapobserver.go:84] configmaps "insights-config" not found
I0311 14:12:08.816842       1 configmapobserver.go:84] configmaps "insights-config" not found
I0311 14:12:08.841934       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0311 14:12:08.847803       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0311 14:12:08.847822       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0311 14:12:08.852392       1 controller.go:481] The operator is healthy
I0311 14:12:08.852452       1 secretconfigobserver.go:119] support secret does not exist
I0311 14:14:08.856319       1 controller.go:481] The operator is healthy
I0311 14:16:08.856490       1 controller.go:481] The operator is healthy
I0311 14:17:08.853264       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0311 14:17:08.861146       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0311 14:17:08.861166       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0311 14:17:08.865810       1 secretconfigobserver.go:119] support secret does not exist
I0311 14:18:08.856292       1 controller.go:481] The operator is healthy
I0311 14:19:22.876454       1 insightsuploader.go:146] Nothing to report since 2026-03-11T14:03:38Z
I0311 14:20:08.853211       1 controller.go:481] The operator is healthy
I0311 14:22:08.812780       1 configmapobserver.go:84] configmaps "insights-config" not found
I0311 14:22:08.852761       1 controller.go:481] The operator is healthy
I0311 14:22:08.866644       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0311 14:22:08.872045       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0311 14:22:08.872063       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0311 14:22:08.877489       1 secretconfigobserver.go:119] support secret does not exist
I0311 14:24:08.852564       1 controller.go:481] The operator is healthy
I0311 14:26:08.852740       1 controller.go:481] The operator is healthy
I0311 14:27:08.878422       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0311 14:27:08.884720       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0311 14:27:08.884741       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0311 14:27:08.889483       1 secretconfigobserver.go:119] support secret does not exist
I0311 14:28:08.857134       1 controller.go:481] The operator is healthy
I0311 14:30:08.858006       1 controller.go:481] The operator is healthy
I0311 14:32:08.813295       1 configmapobserver.go:84] configmaps "insights-config" not found
I0311 14:32:08.818233       1 configmapobserver.go:84] configmaps "insights-config" not found
I0311 14:32:08.860018       1 controller.go:481] The operator is healthy
I0311 14:32:08.890029       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0311 14:32:08.895478       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0311 14:32:08.895495       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0311 14:32:08.900233       1 secretconfigobserver.go:119] support secret does not exist
I0311 14:34:08.855895       1 controller.go:481] The operator is healthy
I0311 14:35:52.821224       1 insightsuploader.go:146] Nothing to report since 2026-03-11T14:03:38Z
I0311 14:36:08.852762       1 controller.go:481] The operator is healthy
I0311 14:37:08.900900       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0311 14:37:08.907000       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0311 14:37:08.907025       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0311 14:37:08.911448       1 secretconfigobserver.go:119] support secret does not exist
I0311 14:38:08.857417       1 controller.go:481] The operator is healthy
I0311 14:40:08.852752       1 controller.go:481] The operator is healthy