I0330 15:11:20.695294       1 cmd.go:253] Using service-serving-cert provided certificates
I0330 15:11:20.695729       1 observer_polling.go:159] Starting file observer
I0330 15:11:21.001654       1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$
I0330 15:11:21.001856       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0330 15:11:21.002429       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
I0330 15:11:21.002432       1 secure_serving.go:57] Forcing use of http/1.1 only
W0330 15:11:21.002465       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0330 15:11:21.002470       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0330 15:11:21.002473       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
W0330 15:11:21.002476       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
W0330 15:11:21.002479       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
W0330 15:11:21.002481       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0330 15:11:21.005606       1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot]
I0330 15:11:21.005665       1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"43b45c05-b8da-452b-8817-31ea6a202e22", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}}
I0330 15:11:21.008097       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0330 15:11:21.008112       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0330 15:11:21.008127       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0330 15:11:21.008113       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0330 15:11:21.008144       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0330 15:11:21.008127       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0330 15:11:21.008399       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key"
I0330 15:11:21.008590       1 secure_serving.go:213] Serving securely on [::]:8443
I0330 15:11:21.008628       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
W0330 15:11:21.010407       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0330 15:11:21.010430       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0330 15:11:21.010536       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0330 15:11:21.015851       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0330 15:11:21.015870       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0330 15:11:21.019900       1 secretconfigobserver.go:119] support secret does not exist
I0330 15:11:21.023175       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0330 15:11:21.025940       1 secretconfigobserver.go:119] support secret does not exist
I0330 15:11:21.028617       1 recorder.go:161] Pruning old reports every 4h33m30s, max age is 288h0m0s
I0330 15:11:21.032346       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0330 15:11:21.032363       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s
I0330 15:11:21.032372       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0330 15:11:21.032381       1 insightsreport.go:296] Starting report retriever
I0330 15:11:21.032381       1 periodic.go:209] Running clusterconfig gatherer
I0330 15:11:21.032386       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0330 15:11:21.032424       1 tasks_processing.go:45] number of workers: 64
I0330 15:11:21.032449       1 tasks_processing.go:69] worker 1 listening for tasks.
I0330 15:11:21.032463       1 tasks_processing.go:69] worker 0 listening for tasks.
I0330 15:11:21.032465       1 tasks_processing.go:69] worker 2 listening for tasks.
I0330 15:11:21.032478       1 tasks_processing.go:69] worker 3 listening for tasks.
I0330 15:11:21.032524       1 tasks_processing.go:71] worker 3 working on active_alerts task.
I0330 15:11:21.032531       1 tasks_processing.go:69] worker 35 listening for tasks.
I0330 15:11:21.032536       1 tasks_processing.go:71] worker 35 working on machine_sets task.
I0330 15:11:21.032542       1 tasks_processing.go:69] worker 51 listening for tasks.
I0330 15:11:21.032549       1 tasks_processing.go:69] worker 59 listening for tasks.
I0330 15:11:21.032552       1 tasks_processing.go:69] worker 44 listening for tasks.
I0330 15:11:21.032557       1 tasks_processing.go:69] worker 45 listening for tasks.
I0330 15:11:21.032558       1 tasks_processing.go:69] worker 43 listening for tasks.
I0330 15:11:21.032563       1 tasks_processing.go:69] worker 46 listening for tasks.
I0330 15:11:21.032563       1 tasks_processing.go:69] worker 52 listening for tasks.
I0330 15:11:21.032568       1 tasks_processing.go:69] worker 36 listening for tasks.
I0330 15:11:21.032571       1 tasks_processing.go:69] worker 47 listening for tasks.
I0330 15:11:21.032570       1 tasks_processing.go:69] worker 53 listening for tasks.
I0330 15:11:21.032577       1 tasks_processing.go:69] worker 37 listening for tasks.
I0330 15:11:21.032577       1 tasks_processing.go:69] worker 54 listening for tasks.
I0330 15:11:21.032576       1 tasks_processing.go:69] worker 19 listening for tasks.
I0330 15:11:21.032581       1 tasks_processing.go:69] worker 48 listening for tasks.
I0330 15:11:21.032584       1 tasks_processing.go:69] worker 55 listening for tasks.
I0330 15:11:21.032585       1 tasks_processing.go:69] worker 49 listening for tasks.
I0330 15:11:21.032591       1 tasks_processing.go:69] worker 50 listening for tasks.
I0330 15:11:21.032593       1 tasks_processing.go:69] worker 56 listening for tasks.
I0330 15:11:21.032600       1 tasks_processing.go:69] worker 57 listening for tasks.
I0330 15:11:21.032603       1 tasks_processing.go:69] worker 40 listening for tasks.
I0330 15:11:21.032600       1 tasks_processing.go:69] worker 63 listening for tasks.
I0330 15:11:21.032611       1 tasks_processing.go:69] worker 58 listening for tasks.
I0330 15:11:21.032615       1 tasks_processing.go:69] worker 27 listening for tasks.
I0330 15:11:21.032618       1 tasks_processing.go:71] worker 58 working on openstack_dataplanenodesets task.
I0330 15:11:21.032616       1 tasks_processing.go:71] worker 63 working on pdbs task.
I0330 15:11:21.032624       1 tasks_processing.go:69] worker 61 listening for tasks.
I0330 15:11:21.032626       1 tasks_processing.go:69] worker 28 listening for tasks.
I0330 15:11:21.032682       1 tasks_processing.go:71] worker 51 working on version task.
I0330 15:11:21.032722       1 tasks_processing.go:71] worker 36 working on overlapping_namespace_uids task.
I0330 15:11:21.032736       1 tasks_processing.go:71] worker 2 working on networks task.
I0330 15:11:21.033357       1 tasks_processing.go:69] worker 62 listening for tasks.
I0330 15:11:21.032601       1 tasks_processing.go:69] worker 38 listening for tasks.
I0330 15:11:21.032831       1 tasks_processing.go:69] worker 32 listening for tasks.
I0330 15:11:21.032685       1 tasks_processing.go:71] worker 1 working on machine_configs task.
I0330 15:11:21.033433       1 tasks_processing.go:69] worker 20 listening for tasks.
I0330 15:11:21.033491       1 tasks_processing.go:71] worker 20 working on validating_webhook_configurations task.
I0330 15:11:21.033504       1 tasks_processing.go:69] worker 30 listening for tasks.
I0330 15:11:21.033635       1 tasks_processing.go:69] worker 8 listening for tasks.
I0330 15:11:21.033631       1 tasks_processing.go:69] worker 7 listening for tasks.
I0330 15:11:21.033515       1 tasks_processing.go:69] worker 5 listening for tasks.
I0330 15:11:21.033657       1 tasks_processing.go:69] worker 33 listening for tasks.
I0330 15:11:21.033457       1 tasks_processing.go:71] worker 59 working on openshift_machine_api_events task.
I0330 15:11:21.033672       1 tasks_processing.go:69] worker 14 listening for tasks.
I0330 15:11:21.033678       1 tasks_processing.go:71] worker 53 working on dvo_metrics task.
I0330 15:11:21.033672       1 tasks_processing.go:71] worker 47 working on certificate_signing_requests task.
I0330 15:11:21.033706       1 tasks_processing.go:69] worker 31 listening for tasks.
I0330 15:11:21.033724       1 tasks_processing.go:71] worker 43 working on nodenetworkconfigurationpolicies task.
I0330 15:11:21.033487       1 tasks_processing.go:69] worker 12 listening for tasks.
I0330 15:11:21.033462       1 tasks_processing.go:69] worker 42 listening for tasks.
I0330 15:11:21.032825       1 tasks_processing.go:69] worker 21 listening for tasks.
I0330 15:11:21.033751       1 tasks_processing.go:69] worker 18 listening for tasks.
I0330 15:11:21.033489       1 tasks_processing.go:69] worker 22 listening for tasks.
I0330 15:11:21.033766       1 tasks_processing.go:71] worker 18 working on nodenetworkstates task.
I0330 15:11:21.033769       1 tasks_processing.go:71] worker 22 working on authentication task.
I0330 15:11:21.033773       1 tasks_processing.go:69] worker 25 listening for tasks.
I0330 15:11:21.033785       1 tasks_processing.go:71] worker 33 working on operators_pods_and_events task.
I0330 15:11:21.033790       1 tasks_processing.go:69] worker 9 listening for tasks.
I0330 15:11:21.033536       1 tasks_processing.go:69] worker 41 listening for tasks.
I0330 15:11:21.033541       1 tasks_processing.go:69] worker 39 listening for tasks.
I0330 15:11:21.033552       1 tasks_processing.go:69] worker 17 listening for tasks.
I0330 15:11:21.033838       1 tasks_processing.go:71] worker 12 working on silenced_alerts task.
I0330 15:11:21.033551       1 tasks_processing.go:71] worker 32 working on clusterroles task.
I0330 15:11:21.033848       1 tasks_processing.go:71] worker 8 working on crds task.
I0330 15:11:21.033863       1 tasks_processing.go:69] worker 10 listening for tasks.
I0330 15:11:21.033898       1 tasks_processing.go:71] worker 14 working on openstack_version task.
I0330 15:11:21.033914       1 tasks_processing.go:71] worker 37 working on metrics task.
I0330 15:11:21.033982       1 tasks_processing.go:71] worker 61 working on aggregated_monitoring_cr_names task.
I0330 15:11:21.034016       1 tasks_processing.go:71] worker 10 working on sap_pods task.
I0330 15:11:21.034350       1 tasks_processing.go:71] worker 50 working on oauths task.
I0330 15:11:21.034391       1 tasks_processing.go:71] worker 49 working on storage_cluster task.
I0330 15:11:21.034405       1 tasks_processing.go:71] worker 57 working on sap_datahubs task.
I0330 15:11:21.034464       1 tasks_processing.go:71] worker 56 working on schedulers task.
I0330 15:11:21.033460       1 tasks_processing.go:71] worker 38 working on feature_gates task.
I0330 15:11:21.034590       1 tasks_processing.go:71] worker 7 working on node_logs task.
I0330 15:11:21.034659       1 tasks_processing.go:71] worker 5 working on number_of_pods_and_netnamespaces_with_sdn_annotations task.
I0330 15:11:21.034368       1 tasks_processing.go:71] worker 55 working on machine_healthchecks task.
I0330 15:11:21.033560       1 tasks_processing.go:69] worker 16 listening for tasks.
I0330 15:11:21.034822       1 tasks_processing.go:71] worker 16 working on openstack_controlplanes task.
I0330 15:11:21.034072       1 tasks_processing.go:71] worker 46 working on image_pruners task.
I0330 15:11:21.033583       1 tasks_processing.go:69] worker 13 listening for tasks.
I0330 15:11:21.033504       1 tasks_processing.go:69] worker 29 listening for tasks.
I0330 15:11:21.033668       1 tasks_processing.go:71] worker 48 working on monitoring_persistent_volumes task.
I0330 15:11:21.034392       1 tasks_processing.go:71] worker 40 working on infrastructures task.
I0330 15:11:21.033467       1 tasks_processing.go:71] worker 62 working on machine_config_pools task.
I0330 15:11:21.033630       1 tasks_processing.go:71] worker 45 working on openstack_dataplanedeployments task.
I0330 15:11:21.035070       1 tasks_processing.go:71] worker 29 working on cluster_apiserver task.
I0330 15:11:21.035077       1 tasks_processing.go:71] worker 13 working on tsdb_status task.
I0330 15:11:21.033570       1 tasks_processing.go:69] worker 23 listening for tasks.
I0330 15:11:21.035115       1 tasks_processing.go:71] worker 23 working on olm_operators task.
I0330 15:11:21.032681       1 tasks_processing.go:71] worker 0 working on ingress task.
I0330 15:11:21.034129       1 tasks_processing.go:71] worker 9 working on config_maps task.
I0330 15:11:21.033839       1 tasks_processing.go:69] worker 24 listening for tasks.
I0330 15:11:21.034139       1 tasks_processing.go:71] worker 39 working on container_images task.
I0330 15:11:21.034135       1 tasks_processing.go:71] worker 41 working on mutating_webhook_configurations task.
I0330 15:11:21.032763       1 tasks_processing.go:69] worker 4 listening for tasks.
I0330 15:11:21.035326       1 tasks_processing.go:71] worker 4 working on jaegers task.
I0330 15:11:21.034145       1 tasks_processing.go:71] worker 17 working on image task.
I0330 15:11:21.032618       1 tasks_processing.go:69] worker 60 listening for tasks.
I0330 15:11:21.034202       1 tasks_processing.go:69] worker 26 listening for tasks.
I0330 15:11:21.034205       1 tasks_processing.go:71] worker 30 working on machine_autoscalers task.
I0330 15:11:21.035424       1 tasks_processing.go:69] worker 15 listening for tasks.
I0330 15:11:21.034196       1 tasks_processing.go:71] worker 31 working on ingress_certificates task.
I0330 15:11:21.034216       1 tasks_processing.go:71] worker 42 working on container_runtime_configs task.
I0330 15:11:21.034228       1 tasks_processing.go:71] worker 54 working on pod_network_connectivity_checks task.
I0330 15:11:21.034251       1 tasks_processing.go:71] worker 27 working on machines task.
I0330 15:11:21.034271       1 tasks_processing.go:71] worker 19 working on service_accounts task.
I0330 15:11:21.036015       1 tasks_processing.go:71] worker 15 working on support_secret task.
I0330 15:11:21.034277       1 tasks_processing.go:69] worker 6 listening for tasks.
I0330 15:11:21.036253       1 tasks_processing.go:71] worker 6 working on cost_management_metrics_configs task.
I0330 15:11:21.034324       1 tasks_processing.go:71] worker 28 working on lokistack task.
I0330 15:11:21.033623       1 tasks_processing.go:71] worker 44 working on operators task.
I0330 15:11:21.036379       1 tasks_processing.go:71] worker 60 working on proxies task.
I0330 15:11:21.035207       1 tasks_processing.go:71] worker 24 working on ceph_cluster task.
I0330 15:11:21.034128       1 tasks_processing.go:71] worker 52 working on openshift_logging task.
I0330 15:11:21.034122       1 tasks_processing.go:71] worker 25 working on sap_config task.
I0330 15:11:21.034179       1 tasks_processing.go:69] worker 34 listening for tasks.
I0330 15:11:21.035421       1 tasks_processing.go:71] worker 26 working on image_registries task.
I0330 15:11:21.036571       1 tasks_processing.go:71] worker 34 working on qemu_kubevirt_launcher_logs task.
I0330 15:11:21.035420       1 tasks_processing.go:69] worker 11 listening for tasks.
I0330 15:11:21.034210       1 tasks_processing.go:71] worker 21 working on nodes task.
I0330 15:11:21.036634       1 tasks_processing.go:71] worker 11 working on install_plans task.
I0330 15:11:21.038337       1 tasks_processing.go:71] worker 43 working on storage_classes task.
I0330 15:11:21.038377       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 4.601728ms to process 0 records
I0330 15:11:21.038393       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 4.582679ms to process 0 records
I0330 15:11:21.038473       1 tasks_processing.go:74] worker 18 stopped.
I0330 15:11:21.038523       1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z
I0330 15:11:21.038542       1 controller.go:326] The initial operator extension status is healthy
I0330 15:11:21.038551       1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0330 15:11:21.038557       1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready
I0330 15:11:21.038560       1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready
I0330 15:11:21.038577       1 controller.go:489] The operator is still being initialized
I0330 15:11:21.038589       1 controller.go:512] The operator is healthy
I0330 15:11:21.038671       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
I0330 15:11:21.038671       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
W0330 15:11:21.038957       1 operator.go:288] started
I0330 15:11:21.038982       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
E0330 15:11:21.041296       1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.128.0.12:55409->172.30.0.10:53: read: connection refused
I0330 15:11:21.041313       1 tasks_processing.go:74] worker 12 stopped.
E0330 15:11:21.041320       1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.128.0.12:55409->172.30.0.10:53: read: connection refused
I0330 15:11:21.041330       1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 7.466848ms to process 0 records
E0330 15:11:21.041355       1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.128.0.12:55409->172.30.0.10:53: read: connection refused
I0330 15:11:21.041374       1 tasks_processing.go:74] worker 3 stopped.
E0330 15:11:21.041381       1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.128.0.12:55409->172.30.0.10:53: read: connection refused
I0330 15:11:21.041391       1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 8.841679ms to process 0 records
E0330 15:11:21.041424       1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.128.0.12:54020->172.30.0.10:53: read: connection refused
I0330 15:11:21.041438       1 tasks_processing.go:74] worker 13 stopped.
E0330 15:11:21.041444       1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.128.0.12:54020->172.30.0.10:53: read: connection refused
I0330 15:11:21.041453       1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 6.353126ms to process 0 records
E0330 15:11:21.041490       1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.128.0.12:54020->172.30.0.10:53: read: connection refused
I0330 15:11:21.041513       1 tasks_processing.go:74] worker 37 stopped.
E0330 15:11:21.041523       1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.128.0.12:54020->172.30.0.10:53: read: connection refused
I0330 15:11:21.041540       1 gather.go:177] gatherer "clusterconfig" function "metrics" took 7.58735ms to process 0 records
I0330 15:11:21.045531       1 tasks_processing.go:74] worker 59 stopped.
I0330 15:11:21.045542       1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 11.8559ms to process 0 records
I0330 15:11:21.045548       1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 11.14212ms to process 0 records
I0330 15:11:21.045553       1 tasks_processing.go:74] worker 49 stopped.
I0330 15:11:21.045591       1 tasks_processing.go:74] worker 58 stopped.
I0330 15:11:21.045609       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 12.960683ms to process 0 records
I0330 15:11:21.045622       1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 11.187897ms to process 0 records
I0330 15:11:21.045633       1 tasks_processing.go:74] worker 57 stopped.
I0330 15:11:21.045705       1 tasks_processing.go:74] worker 63 stopped.
I0330 15:11:21.045865       1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=c6ef9b5f909800d44221967f23e2b7a34fc31aea629cee500b01bb8a045c43c9
I0330 15:11:21.045893       1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=0d6576ba461b5acfe45bedd2bbbfd6730e58961bf8ba2f9e794dc63dda8a8439
I0330 15:11:21.045917       1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=fde747bb3c7ae09b1a61b7d7349d22a1fb9f2c80b65dea58faba4b2b9f26d03b
I0330 15:11:21.045942       1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=d4d12cc392d5de98960526eafa02a7e6846b62a56c2e6896d99543a982f54548
I0330 15:11:21.045970       1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=53b58027edd94133b7d1e8af4a98678e2bc2504b763392d053d3fc48904d41e6
I0330 15:11:21.045995       1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=73582e0109793fc422c1afe6bc0b3be76bab2e9a83699e26b18ff2821a227448
I0330 15:11:21.046020       1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=aa080e6397426cb7e0217ca0e81447d6a3f941ca351f97eac76b4a6f8fed6254
I0330 15:11:21.046044       1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=37303db18011d4d68a94270f6ca9a16067c0a97eb6c856b8d516c1c6348b030f
I0330 15:11:21.046071       1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=bf0c58193156b72777fd46057ce4aeaf4de5c9296f41a42039a803e370cfd3f6
I0330 15:11:21.046100       1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=9772cb9b8847a8f7a3e9df03325f3d3c89e053e087cb6d39df2989dfce6ba4a0
I0330 15:11:21.046112       1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 13.000145ms to process 10 records
I0330 15:11:21.046194       1 tasks_processing.go:74] worker 22 stopped.
I0330 15:11:21.046386       1 recorder.go:75] Recording config/authentication with fingerprint=3677ffc23909ef1607b0e8e2f1e39175eef9dbe2476891a69e3ae2ca9ed53ffc
I0330 15:11:21.046399       1 gather.go:177] gatherer "clusterconfig" function "authentication" took 11.991737ms to process 1 records
I0330 15:11:21.048565       1 tasks_processing.go:74] worker 14 stopped.
I0330 15:11:21.048579       1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 14.653ms to process 0 records
I0330 15:11:21.049009       1 tasks_processing.go:74] worker 30 stopped.
I0330 15:11:21.049023       1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 13.576648ms to process 0 records
I0330 15:11:21.053408       1 tasks_processing.go:74] worker 47 stopped.
I0330 15:11:21.053428       1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 19.70903ms to process 0 records
I0330 15:11:21.053663       1 tasks_processing.go:74] worker 20 stopped.
W0330 15:11:21.053719       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0330 15:11:21.053833       1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=05c8cfa0a1089c201c2eb475a78fcf104636fab24fd4d2091ff42858031cbe2f
I0330 15:11:21.053893       1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=3fdb06b11ae18bd7a7f6cf2bb3f67abc9f040ae0ba7827d3cff9638bfc3fe45c
I0330 15:11:21.053969       1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=868ee6e87fcb38310bb154aaf6c7b6765b6143af5e6a66529e8f9b59bc9594e0
I0330 15:11:21.053999       1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=88e5440ed8b9ec3bff20fb7f8b24de1cce7c17631f23a9ef0a940707997964f3
I0330 15:11:21.054026       1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=de530825df9e283d5647fcb62da2e1c5be071f0baf3ec1647b3be9bf4e6ad294
I0330 15:11:21.054053       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=e007c72650d2f7429255e9612d92a575c808d48bc64fcf1c329ac1d07de58e3e
I0330 15:11:21.054080       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=182ad3da6452a2fff42dfb43859ff263d785fc6f51733c924631108477b51aec
I0330 15:11:21.054103       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=f0e0b460e9766ca961b81ebe6e046181c3e510dcc589bfb17320deea7601ff61
I0330 15:11:21.054128       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=6a66d9b9d3062c6002883215385ce80897fe136b0e27565af081029b60e8e148
I0330 15:11:21.054165       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=0df5f08fbb7ba6ee0dfe57ab754731fbf850f68b4db825dbdaac51f19d64ad45
I0330 15:11:21.054188       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=2bff8ce6ec48cc90a8c8d1b72ab913d4ac344df13d489238e129432945929e57
I0330 15:11:21.054216       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=3305994088e4be05d43dfaf83aca957b8cc10106b10755be268c596dc2486173
I0330 15:11:21.054240       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=b3fcb358a3ebd3da6f24790eaf04a4d3b7294be41e8b9a31c52d48706c30add2
I0330 15:11:21.054248       1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 20.130088ms to process 13 records
I0330 15:11:21.059839       1 tasks_processing.go:74] worker 56 stopped.
I0330 15:11:21.059902       1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=8db4b5125c12ef55de583124c04ca2161c1478721ee5e0a4c04256f36a28c567
I0330 15:11:21.059913       1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 25.354953ms to process 1 records
I0330 15:11:21.059976       1 tasks_processing.go:74] worker 50 stopped.
I0330 15:11:21.060216       1 recorder.go:75] Recording config/oauth with fingerprint=6e30fb6bc39bb52aa857c905753d4a2edf8e79ca6c0cc139c7476a9d33bb3975
I0330 15:11:21.060229       1 gather.go:177] gatherer "clusterconfig" function "oauths" took 25.574658ms to process 1 records
I0330 15:11:21.060317       1 tasks_processing.go:74] worker 40 stopped.
I0330 15:11:21.060647       1 recorder.go:75] Recording config/infrastructure with fingerprint=33db57d4a1f23926bb2c37797f13ad2c4d7be7f66e2e869733af3b6513928193
I0330 15:11:21.060656       1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 25.006162ms to process 1 records
I0330 15:11:21.062941       1 tasks_processing.go:74] worker 27 stopped.
E0330 15:11:21.062951       1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope
I0330 15:11:21.062958       1 gather.go:177] gatherer "clusterconfig" function "machines" took 27.343966ms to process 0 records
I0330 15:11:21.068668       1 tasks_processing.go:74] worker 54 stopped.
E0330 15:11:21.068680       1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io)
I0330 15:11:21.068687       1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 33.083413ms to process 0 records
I0330 15:11:21.068789       1 tasks_processing.go:74] worker 42 stopped.
I0330 15:11:21.068822       1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 33.322753ms to process 0 records
I0330 15:11:21.068844       1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 33.747825ms to process 0 records
I0330 15:11:21.068854       1 tasks_processing.go:74] worker 62 stopped.
I0330 15:11:21.068887       1 tasks_processing.go:74] worker 17 stopped.
I0330 15:11:21.068986       1 recorder.go:75] Recording config/image with fingerprint=e3aa62a0ed90be03beb9229ecf3b5eb93412ef7e9282430a2af671209451b399
I0330 15:11:21.068997       1 gather.go:177] gatherer "clusterconfig" function "image" took 33.534259ms to process 1 records
I0330 15:11:21.069080       1 tasks_processing.go:74] worker 29 stopped.
I0330 15:11:21.069107       1 recorder.go:75] Recording config/apiserver with fingerprint=47c2010dfef89694b47deb311d2b093e27fc83587652cd19022f5d854820d874
I0330 15:11:21.069122       1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 33.90203ms to process 1 records
I0330 15:11:21.075944       1 tasks_processing.go:74] worker 35 stopped.
I0330 15:11:21.075962       1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 43.397215ms to process 0 records
I0330 15:11:21.075999       1 tasks_processing.go:74] worker 2 stopped.
I0330 15:11:21.076222       1 recorder.go:75] Recording config/network with fingerprint=c8b4ab745aaa54915507bdaf4134a26ae7f7e41eecd5058e366dedbe072a8602
I0330 15:11:21.076238       1 gather.go:177] gatherer "clusterconfig" function "networks" took 43.237791ms to process 1 records
I0330 15:11:21.076247       1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 41.324453ms to process 0 records
I0330 15:11:21.076261       1 tasks_processing.go:74] worker 16 stopped.
I0330 15:11:21.076366       1 tasks_processing.go:74] worker 38 stopped.
I0330 15:11:21.076464       1 recorder.go:75] Recording config/featuregate with fingerprint=bf5658aec4022ed684c9f833b5660e17375f7f3fe648aa5b207468ffc51bd6e9
I0330 15:11:21.076475       1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 41.77424ms to process 1 records
I0330 15:11:21.076485       1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 40.174671ms to process 0 records
I0330 15:11:21.076490       1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 40.177269ms to process 0 records
E0330 15:11:21.076495       1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope
I0330 15:11:21.076501       1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 41.733141ms to process 0 records
I0330 15:11:21.076507       1 tasks_processing.go:74] worker 55 stopped.
I0330 15:11:21.076510       1 tasks_processing.go:74] worker 6 stopped.
I0330 15:11:21.076513       1 tasks_processing.go:74] worker 28 stopped.
I0330 15:11:21.076521       1 tasks_processing.go:74] worker 0 stopped.
I0330 15:11:21.076683       1 recorder.go:75] Recording config/ingress with fingerprint=3a90b11ee4e8a75611c556dab2c0aefe283bc63ffa55c38c2127b3e16a065fd9
I0330 15:11:21.076700       1 gather.go:177] gatherer "clusterconfig" function "ingress" took 41.365272ms to process 1 records
I0330 15:11:21.076714       1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 41.614411ms to process 0 records
I0330 15:11:21.076719       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 41.565666ms to process 0 records
E0330 15:11:21.076724       1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found
I0330 15:11:21.076729       1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 40.616646ms to process 0 records
I0330 15:11:21.076729       1 tasks_processing.go:74] worker 48 stopped.
I0330 15:11:21.076734       1 tasks_processing.go:74] worker 15 stopped.
I0330 15:11:21.076737       1 tasks_processing.go:74] worker 45 stopped.
I0330 15:11:21.080081       1 tasks_processing.go:74] worker 24 stopped.
I0330 15:11:21.080097       1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 43.6428ms to process 0 records
I0330 15:11:21.080106       1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 43.624033ms to process 0 records
I0330 15:11:21.080113       1 tasks_processing.go:74] worker 52 stopped.
I0330 15:11:21.080222       1 tasks_processing.go:74] worker 7 stopped.
I0330 15:11:21.080238       1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 45.583591ms to process 0 records
I0330 15:11:21.080267       1 tasks_processing.go:74] worker 10 stopped.
I0330 15:11:21.080278       1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 45.932036ms to process 0 records
I0330 15:11:21.080403       1 tasks_processing.go:74] worker 25 stopped.
I0330 15:11:21.080415       1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 43.890363ms to process 0 records
I0330 15:11:21.080502       1 tasks_processing.go:74] worker 46 stopped.
I0330 15:11:21.080785       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=446838b5a11a47f2b1fd5d10779672208d68d29678d4612d496c5b07a34b9c3d
I0330 15:11:21.080832       1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 45.584505ms to process 1 records
I0330 15:11:21.080846       1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 45.495459ms to process 0 records
I0330 15:11:21.080911       1 tasks_processing.go:74] worker 4 stopped.
I0330 15:11:21.080937       1 tasks_processing.go:74] worker 41 stopped.
I0330 15:11:21.081650       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=21c1eeba4ad4e2be7a3679869ad71bffd2e8885bad57eee23d913007955d9f0a
I0330 15:11:21.081792       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=755e3801c43fb0b4c603849ef30cf6d180dc4c52daf19ec2b65fbac0efa1c9cf
I0330 15:11:21.081905       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=4ca7f2bd10cd702773640221b9327e9ad9ed0da2b1eb4e45fbff41ac4f735e92
I0330 15:11:21.081954       1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 45.620895ms to process 3 records
I0330 15:11:21.084063       1 tasks_processing.go:74] worker 8 stopped.
I0330 15:11:21.084588       1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=4c662c81bf76deb3694bc52c3888714a1e3acdfe68e160e0e55a5d837d7fcdf0
I0330 15:11:21.084769       1 gather_logs.go:145] no pods in  namespace were found
I0330 15:11:21.084845       1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=cfcc3637580b1436b6365949afcabdb69aa4787016ad16246f52ae8c725ae7f4
I0330 15:11:21.084856       1 gather.go:177] gatherer "clusterconfig" function "crds" took 50.205246ms to process 2 records
I0330 15:11:21.084938       1 tasks_processing.go:74] worker 21 stopped.
I0330 15:11:21.085138       1 recorder.go:75] Recording config/node/ip-10-0-0-16.ec2.internal with fingerprint=f5caeb94d292e0d0cdf7bfd63e62471314cf27e74b547354aecf4abf6eb59d06
I0330 15:11:21.085205       1 recorder.go:75] Recording config/node/ip-10-0-1-70.ec2.internal with fingerprint=be29bc5eb42200d4ddd55c27099a6b782846c6f9d95756cdf2b81fa5f4a5e50f
I0330 15:11:21.085391       1 recorder.go:75] Recording config/node/ip-10-0-2-205.ec2.internal with fingerprint=0cdaa05ea7fe58cc58008bc0465556394d72d4aaec51f9703a891689b1db3247
I0330 15:11:21.085409       1 gather.go:177] gatherer "clusterconfig" function "nodes" took 47.810295ms to process 3 records
I0330 15:11:21.085444       1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0330 15:11:21.085462       1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready
I0330 15:11:21.085467       1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready
I0330 15:11:21.085472       1 controller.go:212] Source scaController *sca.Controller is not ready
I0330 15:11:21.085477       1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready
I0330 15:11:21.085494       1 recorder.go:75] Recording config/proxy with fingerprint=f7d669840f179fdd42858d5eecb96e40cb4bfa1138ca6fe32d210878fb836e44
I0330 15:11:21.085512       1 gather.go:177] gatherer "clusterconfig" function "proxies" took 48.151504ms to process 1 records
I0330 15:11:21.085517       1 tasks_processing.go:74] worker 60 stopped.
I0330 15:11:21.085526       1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
I0330 15:11:21.085531       1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 51.894739ms to process 1 records
I0330 15:11:21.085536       1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 48.20544ms to process 0 records
I0330 15:11:21.085499       1 controller.go:489] The operator is still being initialized
I0330 15:11:21.085773       1 tasks_processing.go:74] worker 43 stopped.
I0330 15:11:21.086002       1 tasks_processing.go:74] worker 36 stopped.
I0330 15:11:21.086056       1 tasks_processing.go:74] worker 34 stopped.
I0330 15:11:21.086460       1 controller.go:512] The operator is healthy
I0330 15:11:21.086934       1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=e03af25c0a035cf75dff03700ee5f76c7217284bde5aeb81e2a09b0c6caebc33
I0330 15:11:21.087294       1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=74d86df236078ebbae4fcce7c69f47fba49cadbad0c498ac0b8f4c73a5ba8b9e
I0330 15:11:21.087312       1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 47.062382ms to process 2 records
I0330 15:11:21.087364       1 tasks_processing.go:74] worker 26 stopped.
I0330 15:11:21.088229       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=8c653cd10c29d9c140bd188a60632982a713e274b5d6eedf2d441693b84fc3d9
I0330 15:11:21.088250       1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 49.540958ms to process 1 records
I0330 15:11:21.088298       1 recorder.go:75] Recording config/olm_operators with fingerprint=4ac2901ffe4349c8895ce3604810aad49c54a51c3cc3c60f9538514284d2fc09
I0330 15:11:21.088306       1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 51.266842ms to process 1 records
I0330 15:11:21.088314       1 tasks_processing.go:74] worker 23 stopped.
I0330 15:11:21.089186       1 tasks_processing.go:74] worker 32 stopped.
I0330 15:11:21.089446       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=564e1cec252464bbc244e1c5d99bb3cba6ec1bec46fe095b434c9c659003981c
I0330 15:11:21.089612       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=77401abb193c4878e19515cac59ff0ad453d3e5d284d8e1c4dfb6f93a19a9398
I0330 15:11:21.089626       1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 55.333852ms to process 2 records
E0330 15:11:21.094177       1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%278aa0bc5a-5e81-4f4d-b60f-5de2f984448e%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:55069->172.30.0.10:53: read: connection refused
I0330 15:11:21.094191       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%278aa0bc5a-5e81-4f4d-b60f-5de2f984448e%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:55069->172.30.0.10:53: read: connection refused
I0330 15:11:21.094672       1 tasks_processing.go:74] worker 1 stopped.
I0330 15:11:21.094697       1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499
I0330 15:11:21.094708       1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 61.278753ms to process 1 records
I0330 15:11:21.098011       1 tasks_processing.go:74] worker 51 stopped.
I0330 15:11:21.098248       1 recorder.go:75] Recording config/version with fingerprint=02f65220549e95ef806d9addfed6d9220bce15eab7150f7a17ce53597e5f8aab
I0330 15:11:21.098259       1 recorder.go:75] Recording config/id with fingerprint=3dd2388e93fcbcf4f5a2eb31c24bbf700e23fc36b34162684cba1c348742be37
I0330 15:11:21.098265       1 gather.go:177] gatherer "clusterconfig" function "version" took 65.295208ms to process 2 records
I0330 15:11:21.099508       1 tasks_processing.go:74] worker 61 stopped.
I0330 15:11:21.099581       1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 65.514248ms to process 0 records
I0330 15:11:21.103283       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
I0330 15:11:21.108189       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0330 15:11:21.108210       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0330 15:11:21.108314       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
W0330 15:11:21.108897       1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:44137->172.30.0.10:53: read: connection refused
I0330 15:11:21.108919       1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:44137->172.30.0.10:53: read: connection refused
I0330 15:11:21.110648       1 base_controller.go:82] Caches are synced for ConfigController 
I0330 15:11:21.110660       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
I0330 15:11:21.111092       1 tasks_processing.go:74] worker 31 stopped.
E0330 15:11:21.111278       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found
E0330 15:11:21.111309       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pc3u5acg13brr2ait49j6ehs236k2o5-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pc3u5acg13brr2ait49j6ehs236k2o5-primary-cert-bundle-secret" not found
I0330 15:11:21.111413       1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=ccf9b58c02c7eca8e782dca9bda57c3886d1a874b64c0b9d481240eea1907702
I0330 15:11:21.111454       1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 75.644213ms to process 1 records
I0330 15:11:21.113524       1 tasks_processing.go:74] worker 5 stopped.
I0330 15:11:21.113540       1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 78.844842ms to process 0 records
I0330 15:11:21.113950       1 tasks_processing.go:74] worker 39 stopped.
I0330 15:11:21.115019       1 configmapobserver.go:84] configmaps "insights-config" not found
I0330 15:11:21.115321       1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-ptf2j with fingerprint=682441cc629ce9b3fa1923fb3bf2a852ffc8e8699523af47f2eefd2a40f3b992
I0330 15:11:21.115399       1 recorder.go:75] Recording config/running_containers with fingerprint=1e77999e4987c3853870ee3b9b183ae95bffa65f631d6ae39634b60575286041
I0330 15:11:21.115409       1 gather.go:177] gatherer "clusterconfig" function "container_images" took 78.750364ms to process 2 records
I0330 15:11:21.117012       1 tasks_processing.go:74] worker 9 stopped.
E0330 15:11:21.117025       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found
E0330 15:11:21.117031       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found
E0330 15:11:21.117035       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found
I0330 15:11:21.117044       1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018
I0330 15:11:21.117069       1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d
I0330 15:11:21.117090       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a
I0330 15:11:21.117096       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0
I0330 15:11:21.117105       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d
I0330 15:11:21.117144       1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0
I0330 15:11:21.117151       1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d
I0330 15:11:21.117156       1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 81.853163ms to process 7 records
I0330 15:11:21.139969       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0330 15:11:21.139982       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0330 15:11:21.147334       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found
I0330 15:11:21.151133       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found
W0330 15:11:22.052830       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0330 15:11:22.913887       1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found
W0330 15:11:23.052598       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0330 15:11:23.093072       1 gather_cluster_operator_pods_and_events.go:121] Found 48 pods with 98 containers
I0330 15:11:23.093088       1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 256794 bytes
I0330 15:11:23.093141       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:23.314226       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for alertmanager container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:23.498661       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:23.517011       1 tasks_processing.go:74] worker 44 stopped.
I0330 15:11:23.517167       1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=8a6a4aeadcecffd81051b1e06531a0c197e68b081541eb19a53496356ea6b7a6
I0330 15:11:23.517220       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1
I0330 15:11:23.517246       1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=4abeda629d8e8d36f5deba55b72f90e17e8107ba806c8029fe2951a17e777b71
I0330 15:11:23.517256       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e
I0330 15:11:23.517279       1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=83a2211887676d0abbe173d79fa05ac909e509840652546e67f56e44533d265f
I0330 15:11:23.517300       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f
I0330 15:11:23.517327       1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=428ffb15a425ff8925f066cc3d99137220bd77f80c9ac00221cfee1f4c28665d
I0330 15:11:23.517354       1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=0c0f5758b252cb5a6ff115a34cc59ac87bb4c46f04185d3eff03f10eee1de429
I0330 15:11:23.517384       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=760408971649507b9f8235823c7551567b828c09a49265c3c0328f53246f5ea5
I0330 15:11:23.517416       1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=776dc141e09b25d94a3420b429e88a9544db24ba04e3a21068f3e8625866be2c
I0330 15:11:23.517702       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=afe4dcb31d2695ac13fc1e376da1351f8a61089301901e9301ca531cc992959f
I0330 15:11:23.517723       1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=bb4eeb938bde475577640691d390e6db2a984d9092e24338001a41d892ae4a8f
I0330 15:11:23.517732       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762
I0330 15:11:23.517748       1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=779a509938ac225ffa799abe370304720dea4bb23fd6fc49cdefb16010316538
I0330 15:11:23.517763       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11
I0330 15:11:23.517779       1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=910a8a5294775673b01e429930c912f79f7a27703b4ae5b6f37c38294111bf4b
I0330 15:11:23.517788       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a
I0330 15:11:23.517826       1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=a2855465f8587d9758816f83716e3cf08df824f10c867cb45b3edf23e931f3f2
I0330 15:11:23.517837       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db
I0330 15:11:23.517857       1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=98d5bad4087cd577ab9cce3794533f46c7dd875b7eb780b5da1b4de6df97183e
I0330 15:11:23.517974       1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=89af6601d480cde4270c56106e672f11b5fffa58c8b524e94a505354c696c6da
I0330 15:11:23.517984       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab
I0330 15:11:23.517990       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d
I0330 15:11:23.518010       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75
I0330 15:11:23.518034       1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=e9718e6dba71969b6b20562e39c88933f3b35186ecfe92df08ad4b68b30850dd
I0330 15:11:23.518064       1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=b5dc08b867f7fd16510a68de05e9d9d8b7257334857692585f120e3d65da798e
I0330 15:11:23.518075       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76
I0330 15:11:23.518099       1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=06382069388831c8db7d48f1c816ea878528c70c9dffd81c5fb4c16c2dbc0ae7
I0330 15:11:23.518110       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7
I0330 15:11:23.518129       1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=6ae933e734c52148f93b21836fae6432d6ae55bbad554fc109476d99cbd587a3
I0330 15:11:23.518145       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=7c14a27254cd57f04343d8eec2c65611b0ce5f7174583bf2040ed78116dacc69
I0330 15:11:23.518159       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=90f7d5147bce8c6203ca5b2a793c3dea325bcd2cc7d6f8895ac7d1e79a1627bd
I0330 15:11:23.518175       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=c6458528c510eac84a165f68833b7307fec827138566986089a12293e73c2c29
I0330 15:11:23.518201       1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=50e8e76248a7efca9c40623d22d80c9aa3ebd0743f1b4e7f475c724e1ae7af08
I0330 15:11:23.518212       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa
I0330 15:11:23.518240       1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=1ffd84d15f55272d4816f91971d72282e9e039f86ef35a3427c61160b2fe9e8b
I0330 15:11:23.518257       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e
I0330 15:11:23.518266       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad
I0330 15:11:23.518274       1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.480631468s to process 38 records
I0330 15:11:23.705523       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:23.903695       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false).
W0330 15:11:24.053327       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0330 15:11:24.099078       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metric container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:24.298302       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container alertmanager-main-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:24.497992       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:24.717456       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for alertmanager container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:24.898738       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false).
W0330 15:11:25.053353       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0330 15:11:25.098042       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:25.297905       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:25.498077       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metric container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:25.697935       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container alertmanager-main-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:25.898113       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for cluster-monitoring-operator container cluster-monitoring-operator-698978dbbf-k5st9 pod in namespace openshift-monitoring (previous: false).
W0330 15:11:26.049043       1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0330 15:11:26.049069       1 tasks_processing.go:74] worker 53 stopped.
E0330 15:11:26.049080       1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0330 15:11:26.049090       1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
I0330 15:11:26.049100       1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.015376774s to process 1 records
I0330 15:11:26.115863       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-state-metrics container kube-state-metrics-7c87d874d5-tlvss pod in namespace openshift-monitoring (previous: false).
I0330 15:11:26.298445       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-main container kube-state-metrics-7c87d874d5-tlvss pod in namespace openshift-monitoring (previous: false).
I0330 15:11:26.499100       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-self container kube-state-metrics-7c87d874d5-tlvss pod in namespace openshift-monitoring (previous: false).
I0330 15:11:26.698742       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for metrics-server container metrics-server-c5f8ccb67-h47gm pod in namespace openshift-monitoring (previous: false).
I0330 15:11:26.897755       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for metrics-server container metrics-server-c5f8ccb67-wq676 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:27.099118       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for monitoring-plugin container monitoring-plugin-67788f859f-5mgjs pod in namespace openshift-monitoring (previous: false).
I0330 15:11:27.298918       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for monitoring-plugin container monitoring-plugin-67788f859f-drwgp pod in namespace openshift-monitoring (previous: false).
I0330 15:11:27.499418       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-textfile container node-exporter-9h9xl pod in namespace openshift-monitoring (previous: false).
I0330 15:11:27.698122       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0330 15:11:27.698138       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-exporter container node-exporter-9h9xl pod in namespace openshift-monitoring (previous: false).
I0330 15:11:27.898389       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container node-exporter-9h9xl pod in namespace openshift-monitoring (previous: false).
I0330 15:11:28.097973       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-textfile container node-exporter-jbgqx pod in namespace openshift-monitoring (previous: false).
I0330 15:11:28.298855       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0330 15:11:28.298876       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-exporter container node-exporter-jbgqx pod in namespace openshift-monitoring (previous: false).
I0330 15:11:28.499114       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container node-exporter-jbgqx pod in namespace openshift-monitoring (previous: false).
I0330 15:11:28.697853       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-textfile container node-exporter-jglqr pod in namespace openshift-monitoring (previous: false).
I0330 15:11:28.897996       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0330 15:11:28.898013       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-exporter container node-exporter-jglqr pod in namespace openshift-monitoring (previous: false).
I0330 15:11:29.099496       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container node-exporter-jglqr pod in namespace openshift-monitoring (previous: false).
I0330 15:11:29.297403       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-main container openshift-state-metrics-6cb79d4dbd-nngdg pod in namespace openshift-monitoring (previous: false).
I0330 15:11:29.497393       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-self container openshift-state-metrics-6cb79d4dbd-nngdg pod in namespace openshift-monitoring (previous: false).
I0330 15:11:29.698782       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for openshift-state-metrics container openshift-state-metrics-6cb79d4dbd-nngdg pod in namespace openshift-monitoring (previous: false).
I0330 15:11:29.897536       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:30.098829       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:30.300453       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:30.498130       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-sidecar container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:30.698060       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:30.898528       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:31.097723       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-thanos container prometheus-k8s-0 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:31.298041       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for init-config-reloader container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:31.499594       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:31.700033       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for config-reloader container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:31.898388       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-sidecar container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:32.098386       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:32.298271       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:32.498066       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-thanos container prometheus-k8s-1 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:32.698679       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus-operator container prometheus-operator-5df5b8bf6d-6m6gd pod in namespace openshift-monitoring (previous: false).
I0330 15:11:32.900189       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container prometheus-operator-5df5b8bf6d-6m6gd pod in namespace openshift-monitoring (previous: false).
I0330 15:11:33.097557       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus-operator-admission-webhook container prometheus-operator-admission-webhook-68c48fd977-hrgk9 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:33.297823       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prometheus-operator-admission-webhook container prometheus-operator-admission-webhook-68c48fd977-t99gr pod in namespace openshift-monitoring (previous: false).
I0330 15:11:33.498039       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for telemeter-client container telemeter-client-5c759bb4d-z2mmp pod in namespace openshift-monitoring (previous: false).
I0330 15:11:33.697989       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for reload container telemeter-client-5c759bb4d-z2mmp pod in namespace openshift-monitoring (previous: false).
I0330 15:11:33.890998       1 tasks_processing.go:74] worker 11 stopped.
I0330 15:11:33.891069       1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539
I0330 15:11:33.891083       1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.854341554s to process 1 records
I0330 15:11:33.898287       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container telemeter-client-5c759bb4d-z2mmp pod in namespace openshift-monitoring (previous: false).
I0330 15:11:34.109703       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-query container thanos-querier-9bd489f75-2flm5 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:34.298580       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container thanos-querier-9bd489f75-2flm5 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:34.498739       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container thanos-querier-9bd489f75-2flm5 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:34.641731       1 tasks_processing.go:74] worker 19 stopped.
I0330 15:11:34.642031       1 recorder.go:75] Recording config/serviceaccounts with fingerprint=4aff5860ec073ddfdf1bec96303c96ef7753a0d476f8315de0a2062bde3a2fd5
I0330 15:11:34.642048       1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.605729363s to process 1 records
I0330 15:11:34.698232       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container thanos-querier-9bd489f75-2flm5 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:34.897315       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-rules container thanos-querier-9bd489f75-2flm5 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:35.098079       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metrics container thanos-querier-9bd489f75-2flm5 pod in namespace openshift-monitoring (previous: false).
I0330 15:11:35.298444       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for thanos-query container thanos-querier-9bd489f75-v4jdw pod in namespace openshift-monitoring (previous: false).
I0330 15:11:35.498541       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-web container thanos-querier-9bd489f75-v4jdw pod in namespace openshift-monitoring (previous: false).
I0330 15:11:35.699555       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container thanos-querier-9bd489f75-v4jdw pod in namespace openshift-monitoring (previous: false).
I0330 15:11:35.898126       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for prom-label-proxy container thanos-querier-9bd489f75-v4jdw pod in namespace openshift-monitoring (previous: false).
I0330 15:11:36.098426       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-rules container thanos-querier-9bd489f75-v4jdw pod in namespace openshift-monitoring (previous: false).
I0330 15:11:36.298637       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy-metrics container thanos-querier-9bd489f75-v4jdw pod in namespace openshift-monitoring (previous: false).
I0330 15:11:36.498635       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for networking-console-plugin container networking-console-plugin-6ddbfdf749-9bnxr pod in namespace openshift-network-console (previous: false).
I0330 15:11:36.698262       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for networking-console-plugin container networking-console-plugin-6ddbfdf749-j2phh pod in namespace openshift-network-console (previous: false).
I0330 15:11:36.897832       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-575cd97545-ptf2j pod in namespace openshift-console-operator (previous: true).
I0330 15:11:37.097408       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-575cd97545-ptf2j pod in namespace openshift-console-operator (previous: false).
I0330 15:11:37.300629       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-56896f7559-4jf5m pod in namespace openshift-console (previous: false).
I0330 15:11:37.498890       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-57f5ff68d4-v5qjr pod in namespace openshift-console (previous: false).
I0330 15:11:37.693323       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for console-57f5ff68d4-v5qjr pod in namespace openshift-console for failing operator console (previous: false): "pods \"console-57f5ff68d4-v5qjr\" not found"
I0330 15:11:37.693340       1 gather_cluster_operator_pods_and_events.go:280] Error: "pods \"console-57f5ff68d4-v5qjr\" not found"
I0330 15:11:37.693351       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-5b84b55cb5-mqg47 pod in namespace openshift-console (previous: false).
I0330 15:11:37.897965       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-5b84b55cb5-pvctt pod in namespace openshift-console (previous: false).
I0330 15:11:38.097928       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-5f4f58ff85-b7h85 pod in namespace openshift-console (previous: false).
I0330 15:11:38.292935       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for console-5f4f58ff85-b7h85 pod in namespace openshift-console for failing operator console (previous: false): "pods \"console-5f4f58ff85-b7h85\" not found"
I0330 15:11:38.292953       1 gather_cluster_operator_pods_and_events.go:280] Error: "pods \"console-5f4f58ff85-b7h85\" not found"
I0330 15:11:38.292962       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-56cb7c9577-ksvlk pod in namespace openshift-console (previous: false).
I0330 15:11:38.499123       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-56cb7c9577-zvmlc pod in namespace openshift-console (previous: false).
I0330 15:11:38.701818       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-8mtnv pod in namespace openshift-dns (previous: false).
I0330 15:11:38.898428       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-8mtnv pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-8mtnv\" is waiting to start: ContainerCreating"
I0330 15:11:38.898446       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-8mtnv\" is waiting to start: ContainerCreating"
I0330 15:11:38.898457       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-8mtnv pod in namespace openshift-dns (previous: false).
I0330 15:11:39.098421       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-8mtnv pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-8mtnv\" is waiting to start: ContainerCreating"
I0330 15:11:39.098440       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-8mtnv\" is waiting to start: ContainerCreating"
I0330 15:11:39.098469       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-sbhtq pod in namespace openshift-dns (previous: false).
I0330 15:11:39.298093       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-sbhtq pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-sbhtq\" is waiting to start: ContainerCreating"
I0330 15:11:39.298111       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-sbhtq\" is waiting to start: ContainerCreating"
I0330 15:11:39.298122       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-sbhtq pod in namespace openshift-dns (previous: false).
I0330 15:11:39.498181       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-sbhtq pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-sbhtq\" is waiting to start: ContainerCreating"
I0330 15:11:39.498198       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-sbhtq\" is waiting to start: ContainerCreating"
I0330 15:11:39.498231       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-td6nn pod in namespace openshift-dns (previous: false).
I0330 15:11:39.697427       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-td6nn pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-td6nn\" is waiting to start: ContainerCreating"
I0330 15:11:39.697445       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-td6nn\" is waiting to start: ContainerCreating"
I0330 15:11:39.697454       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-td6nn pod in namespace openshift-dns (previous: false).
I0330 15:11:39.897939       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-td6nn pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-td6nn\" is waiting to start: ContainerCreating"
I0330 15:11:39.897957       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-td6nn\" is waiting to start: ContainerCreating"
I0330 15:11:39.897969       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-d689g pod in namespace openshift-dns (previous: false).
I0330 15:11:40.098020       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0330 15:11:40.098042       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-j2kwk pod in namespace openshift-dns (previous: false).
I0330 15:11:40.298286       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0330 15:11:40.298305       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-x6fdl pod in namespace openshift-dns (previous: false).
I0330 15:11:40.497443       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0330 15:11:40.497462       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7f7746c7d4-v2w2r pod in namespace openshift-image-registry (previous: false).
I0330 15:11:40.698655       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7f7746c7d4-vjtcp pod in namespace openshift-image-registry (previous: false).
I0330 15:11:40.899096       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-8f55956f4-rshfr pod in namespace openshift-image-registry (previous: false).
I0330 15:11:41.097906       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-8f55956f4-rshfr pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-8f55956f4-rshfr\" is waiting to start: ContainerCreating"
I0330 15:11:41.097925       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-8f55956f4-rshfr\" is waiting to start: ContainerCreating"
I0330 15:11:41.097934       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-6s4q6 pod in namespace openshift-image-registry (previous: false).
I0330 15:11:41.298214       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-hv6mc pod in namespace openshift-image-registry (previous: false).
I0330 15:11:41.498548       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0330 15:11:41.498573       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-z5xhg pod in namespace openshift-image-registry (previous: false).
I0330 15:11:41.698637       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7bd58c987f-f2glg pod in namespace openshift-ingress (previous: false).
I0330 15:11:41.898702       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-84859f585-7sjf9 pod in namespace openshift-ingress (previous: false).
I0330 15:11:42.099917       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-84859f585-jc2nc pod in namespace openshift-ingress (previous: false).
I0330 15:11:42.299255       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-7ftkc pod in namespace openshift-ingress-canary (previous: false).
I0330 15:11:42.497555       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-7ftkc pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-7ftkc\" is waiting to start: ContainerCreating"
I0330 15:11:42.497578       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-7ftkc\" is waiting to start: ContainerCreating"
I0330 15:11:42.497617       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-mvfxk pod in namespace openshift-ingress-canary (previous: false).
I0330 15:11:42.698542       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-mvfxk pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mvfxk\" is waiting to start: ContainerCreating"
I0330 15:11:42.698562       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-mvfxk\" is waiting to start: ContainerCreating"
I0330 15:11:42.698590       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-rn9sx pod in namespace openshift-ingress-canary (previous: false).
I0330 15:11:42.897671       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-rn9sx pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-rn9sx\" is waiting to start: ContainerCreating"
I0330 15:11:42.897689       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-rn9sx\" is waiting to start: ContainerCreating"
I0330 15:11:42.897710       1 tasks_processing.go:74] worker 33 stopped.
I0330 15:11:42.898431       1 recorder.go:75] Recording events/openshift-monitoring with fingerprint=21bcce33ef1c41e9a86024043fa1502ada556e957bd8edf17181beb59d7cfdcd
I0330 15:11:42.898475       1 recorder.go:75] Recording events/openshift-network-console with fingerprint=22f2b81a7bbb8a7e0173885ce19c51dcfe25a059ac7b1b290a49e7678f76cccc
I0330 15:11:42.898590       1 recorder.go:75] Recording events/openshift-console-operator with fingerprint=2c611fa750ac54c5c92fed86799cd16e1f040db7f2ed01704e0d67e9fba63dd6
I0330 15:11:42.898693       1 recorder.go:75] Recording events/openshift-console with fingerprint=b4893bbe8a724242f9d3d13c635fa5a5999c6d25f6bf74662881e286ac3a1952
I0330 15:11:42.898717       1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=31cc0eb0453f2bd1f5d6a338effebd3059adcb4dbaf2cbfdfe75990789de1bc2
I0330 15:11:42.898778       1 recorder.go:75] Recording events/openshift-dns with fingerprint=e70bd1d32b418a797ee70e3b477f631ccb09131c1375192920f560a04de73117
I0330 15:11:42.898923       1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=23f0980857e8bb5b63f8d4497be2454587470a7664f16e1325b1ebe2b0cff648
I0330 15:11:42.898950       1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=19512e7ace56258b77a145b95f7f848eca0685576de78fdd6b3d4cee8b115ad4
I0330 15:11:42.899015       1 recorder.go:75] Recording events/openshift-ingress with fingerprint=abae575ca227313aa4340b094303dd17f1728d6481aa6db6333d68aed864ef67
I0330 15:11:42.899032       1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=6715eb03aec4f235c94df887115cd9033e2ebe10e138c8373dce68d9c8093bcd
I0330 15:11:42.899067       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/init-config-reloader_current.log with fingerprint=2118ce353c38ef79e1a2e4a534373115ae3df242a01cb74e9bf6fe58a9ef5587
I0330 15:11:42.899087       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/alertmanager_current.log with fingerprint=c10d4c625a48f56c8418571fff957b0c22878a19caf3ed818e5195ad229f0d28
I0330 15:11:42.899102       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/config-reloader_current.log with fingerprint=ade9654495661d19180e21bc5bb34bf31877035353d5035865819729b5b9b54a
I0330 15:11:42.899110       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/kube-rbac-proxy-web_current.log with fingerprint=ee5fbb34b70f2e57f56a8738f732e74d9d5d948496197fcd4ea97261d5cf662a
I0330 15:11:42.899117       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/kube-rbac-proxy_current.log with fingerprint=cdfd633be80f13120e6d6e578e2376c14b7990dfb147e2597f22b91980f78657
I0330 15:11:42.899123       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/kube-rbac-proxy-metric_current.log with fingerprint=b55be2bdbed058c56c68fe35a04d2572eee4abcda4639e72a5b10c6322c067cc
I0330 15:11:42.899129       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-0/prom-label-proxy_current.log with fingerprint=a76405686c5bc5412b33f9470d2e720bbcb9fbf86fc2fc55b57bc72e6c9fe1e0
I0330 15:11:42.899136       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/init-config-reloader_current.log with fingerprint=55ad0ac1aec2d728ded3da94c70b28fbe2fc560555b84ca251b33a58f44994cf
I0330 15:11:42.899155       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/alertmanager_current.log with fingerprint=e6528fe52ea19004c84e91a57c7f805412d0768e9a490d75ba2c8edb66d1aba2
I0330 15:11:42.899170       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/config-reloader_current.log with fingerprint=bda20e1f120632d151db44f7c5907103b2a0e11a46c2d7289ef8644a4e372d1b
I0330 15:11:42.899179       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/kube-rbac-proxy-web_current.log with fingerprint=c2adc419acbd9113abd45a11c6e6a16482d323c87be22d729d36a6c8d6faeee9
I0330 15:11:42.899184       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/kube-rbac-proxy_current.log with fingerprint=b6eab91b14e9deed61b6bf997f260cd282d70aa669f1411927cb8231de814ddf
I0330 15:11:42.899192       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/kube-rbac-proxy-metric_current.log with fingerprint=afd70054c72f317317c28516c1d7739aaddb0f8cc7ab3858e3a656076372687f
I0330 15:11:42.899196       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/alertmanager-main-1/prom-label-proxy_current.log with fingerprint=079ffa04179ea7a86501c63b2f6161836a3c78f788940d85dc4b4095c7b59ba2
I0330 15:11:42.899315       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/cluster-monitoring-operator-698978dbbf-k5st9/cluster-monitoring-operator_current.log with fingerprint=632f8813f01d573bfc253c2f542488b54bff8a067ad14b359fea258856e08af4
I0330 15:11:42.899335       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/kube-state-metrics-7c87d874d5-tlvss/kube-state-metrics_current.log with fingerprint=2825c6d652cb8824b0c515f6c9d58be5e60ed4cfb445d67e9400268e861ec5be
I0330 15:11:42.899345       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/kube-state-metrics-7c87d874d5-tlvss/kube-rbac-proxy-main_current.log with fingerprint=d7fa660986285e147354c262ca63db746c048c4a1faada93860c1569a4e5eb45
I0330 15:11:42.899351       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/kube-state-metrics-7c87d874d5-tlvss/kube-rbac-proxy-self_current.log with fingerprint=217261a0c7da4d7fc67d859f50cb5dcb8c01c6eb66ed16d4a791df56582299e7
I0330 15:11:42.899359       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/metrics-server-c5f8ccb67-h47gm/metrics-server_current.log with fingerprint=1b7b1b3f4836afc18a28296bb5c77b1022d456f53f6f3d0c739efead15826608
I0330 15:11:42.899369       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/metrics-server-c5f8ccb67-wq676/metrics-server_current.log with fingerprint=c8064c55a9c5e03598f493ef8ad88c1a5f6ee4fbba76b19f8f2dda55f007e073
I0330 15:11:42.899380       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/monitoring-plugin-67788f859f-5mgjs/monitoring-plugin_current.log with fingerprint=3d8ce4040af9daf6698768e62a4b245d3c1f100304a4685715875ba10cf3267b
I0330 15:11:42.899392       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/monitoring-plugin-67788f859f-drwgp/monitoring-plugin_current.log with fingerprint=3991beb7a88a02d666867e003bc2ec955c5a941a1820cfec5991365a8e9c7ceb
I0330 15:11:42.899418       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-9h9xl/node-exporter_current.log with fingerprint=bd29e37f7211cab39c33e1ed4d8387c0e208218a752492e0492ab8ba8936e9a9
I0330 15:11:42.899435       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-9h9xl/kube-rbac-proxy_current.log with fingerprint=a93605a99c659b3f1f007f27f9798abe892faa2624d4bb30f4b13f170ed74ee8
I0330 15:11:42.899465       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-jbgqx/node-exporter_current.log with fingerprint=a739c6d3ad389c77955f1811457ac7c9164519333948274ac46f783e093426c4
I0330 15:11:42.899474       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-jbgqx/kube-rbac-proxy_current.log with fingerprint=cc5038d132fc423b953e3fa1ab47795f45173a1ef990fd7dc5d35250c772753a
I0330 15:11:42.899500       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-jglqr/node-exporter_current.log with fingerprint=c1f08a00bbc869fbbfda7b2ccddd5480b5624e552ac91d81d7b5a7cefabf3f14
I0330 15:11:42.899508       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/node-exporter-jglqr/kube-rbac-proxy_current.log with fingerprint=d98e690bf6cd17abf49ef91b4f34b6c4d48bf47a8b9f0da49a406ef9f3bc0151
I0330 15:11:42.899515       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/openshift-state-metrics-6cb79d4dbd-nngdg/kube-rbac-proxy-main_current.log with fingerprint=95d457a9ecfe4e89481d7c5f4b5b711e61d37f9cbc9fe141991c13d62ddf5c92
I0330 15:11:42.899521       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/openshift-state-metrics-6cb79d4dbd-nngdg/kube-rbac-proxy-self_current.log with fingerprint=b393c7bd9118e9df7b51a2f0630baf70198c02fe072946bcc33d462c9be22fd4
I0330 15:11:42.899531       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/openshift-state-metrics-6cb79d4dbd-nngdg/openshift-state-metrics_current.log with fingerprint=d74edacc9c89d6dd0fbf75c18bbee6b403ca83586aa71a0514548982afe851cd
I0330 15:11:42.899537       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/init-config-reloader_current.log with fingerprint=e48e7551d906e86cba40964aad4c555d4cc690810611c3fe1bff97927b2abddc
I0330 15:11:42.899638       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/prometheus_current.log with fingerprint=fae0f5ad642c4d6d9c9d2503656042882118cea9ab93c13f99057adf07c10dee
I0330 15:11:42.899652       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/config-reloader_current.log with fingerprint=879c7e2285fd8b65bfb33b8dc2e9ed17b6a35580e409dcff43f229576d8f0516
I0330 15:11:42.899661       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/thanos-sidecar_current.log with fingerprint=a31f3403d644a9a036c61c6e96b778338217c01e26a991b4def40be142980af6
I0330 15:11:42.899671       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/kube-rbac-proxy-web_current.log with fingerprint=af7a93e215b617a4f0b2e49412cd088a57217b990e0f23ad767caaad01cc1bf6
I0330 15:11:42.899677       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/kube-rbac-proxy_current.log with fingerprint=e92b1fd5f01c5e4eebcb5a33a3adaf6c2ddc45f77e794f14b1b1cdbd5e601c30
I0330 15:11:42.899684       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-0/kube-rbac-proxy-thanos_current.log with fingerprint=505e592ab41f4c759485a98edce56a56b6e523858eee5fdd97dcce61509ec198
I0330 15:11:42.899690       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/init-config-reloader_current.log with fingerprint=64337869495223eb432060384678d8646d79998a70586e34164b207732540290
I0330 15:11:42.899779       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/prometheus_current.log with fingerprint=dd32e44457dfba52a7f1ab5abc844ca3dba7c340ba443021e5473ef41eace270
I0330 15:11:42.899793       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/config-reloader_current.log with fingerprint=47ac8ff3a3dc6237ac3e9e14239f63587877aeebf9ef8ac9461c865123f56f8c
I0330 15:11:42.899818       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/thanos-sidecar_current.log with fingerprint=7932f04c2800a14a7647ee5eb4f76c07a1ef3f6a6703c916e5dba19ad8ad3dc8
I0330 15:11:42.899828       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/kube-rbac-proxy-web_current.log with fingerprint=f75f81c9162b77b2e240371c3549b0b397d65ae3021f6f5698c338ab0abb5dc8
I0330 15:11:42.899834       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/kube-rbac-proxy_current.log with fingerprint=a6d51f8dce6576a8dcc89912ff0e1e3b036bc3433dce560f3193e31e2c1effa3
I0330 15:11:42.899840       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-k8s-1/kube-rbac-proxy-thanos_current.log with fingerprint=3aa4a2d3ee39132892bdabd9e81ec66a0de851e782b1c18179d7b74e95ba81f6
I0330 15:11:42.899919       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-5df5b8bf6d-6m6gd/prometheus-operator_current.log with fingerprint=c22ced28b265a983e53d98b27d489efd3e2aa3efae7009d00abe8dc972b58674
I0330 15:11:42.899928       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-5df5b8bf6d-6m6gd/kube-rbac-proxy_current.log with fingerprint=327384886587bec2b4a194b17812b86619f75584aa5f9d76a1c952f5cde963fb
I0330 15:11:42.899935       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-admission-webhook-68c48fd977-hrgk9/prometheus-operator-admission-webhook_current.log with fingerprint=aeb1b63bb773b93e161918376e93ae9a7757fb2f79f0a5cfd36b43ca3406cc23
I0330 15:11:42.899944       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/prometheus-operator-admission-webhook-68c48fd977-t99gr/prometheus-operator-admission-webhook_current.log with fingerprint=5d2be0ec036cc680ccc5f0bc03c87d0ab3e6130bcbe7d09f46b8cfcad14301ca
I0330 15:11:42.900017       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/telemeter-client-5c759bb4d-z2mmp/telemeter-client_current.log with fingerprint=cb0aa6ec80f46325835b02898df0bde998ee0b5bbd4a8531b2d7329bd1af515b
I0330 15:11:42.900032       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/telemeter-client-5c759bb4d-z2mmp/reload_current.log with fingerprint=45d6c9457247713f95a4641aa855ed77a4e443364a954523923e3bf0723bc6fb
I0330 15:11:42.900038       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/telemeter-client-5c759bb4d-z2mmp/kube-rbac-proxy_current.log with fingerprint=75d09699d0dcd5e4a9c756310e8e0dacba8f9d331fc27101e791d61d628105a0
I0330 15:11:42.900061       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-2flm5/thanos-query_current.log with fingerprint=cef363bbee38db52cd372f7476d262ba7a385b86b6e1ad4ea868488b7fb2866e
I0330 15:11:42.900070       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-2flm5/kube-rbac-proxy-web_current.log with fingerprint=d5b443c55ac6e75cd3685d102658ed72e71700f74e3f1dd89b6f38629a3ceaed
I0330 15:11:42.900076       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-2flm5/kube-rbac-proxy_current.log with fingerprint=1ca66f2dfe6e3cb0a0eb5371ef052a90d93d8a309d449127791cb915764fed7e
I0330 15:11:42.900081       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-2flm5/prom-label-proxy_current.log with fingerprint=db422c315ccd96b5a6265979600ab28c4e144eda0ba18d042ebb4f58403add3a
I0330 15:11:42.900086       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-2flm5/kube-rbac-proxy-rules_current.log with fingerprint=c8e89999b3dbd00400cb4ebee697cec4c6afdf81a63fdbfa7f095304638d5158
I0330 15:11:42.900092       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-2flm5/kube-rbac-proxy-metrics_current.log with fingerprint=bf71f31b3831e13e77ef218856356f3a0b201ce69c4e1f94f4bf92d12cf5aefc
I0330 15:11:42.900114       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-v4jdw/thanos-query_current.log with fingerprint=0cf554e4a725c82b21f3090b8710e5e549bf509778058732a8ecf3e74cf1b324
I0330 15:11:42.900123       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-v4jdw/kube-rbac-proxy-web_current.log with fingerprint=81dbc1ef3974c9f680345cfb13bb6e34189ada1f9bebeac6774dbff661bf59e5
I0330 15:11:42.900128       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-v4jdw/kube-rbac-proxy_current.log with fingerprint=32bbf6ea61ce98d5ef2638b3cf2f92500f2a70e09a7987831d9163c0dbf2f909
I0330 15:11:42.900132       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-v4jdw/prom-label-proxy_current.log with fingerprint=9e6aac10065bdf691623b46293eebfa81a062a10da746159a84e69a6a43ebfa5
I0330 15:11:42.900137       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-v4jdw/kube-rbac-proxy-rules_current.log with fingerprint=836e58610c717905a50213388eb3fa1d4dae09bf7eff450285ba2a2f3a096bad
I0330 15:11:42.900143       1 recorder.go:75] Recording config/pod/openshift-monitoring/logs/thanos-querier-9bd489f75-v4jdw/kube-rbac-proxy-metrics_current.log with fingerprint=679a8c0df9cfcf09a665028d1fdb01d3fdc118e7830671aa2596240dd27d86d6
I0330 15:11:42.900149       1 recorder.go:75] Recording config/pod/openshift-network-console/logs/networking-console-plugin-6ddbfdf749-9bnxr/networking-console-plugin_current.log with fingerprint=3c03645dba6ec3e4b5184981fef11df5d115a5d374b007ffd69fcfca8fc6568d
I0330 15:11:42.900155       1 recorder.go:75] Recording config/pod/openshift-network-console/logs/networking-console-plugin-6ddbfdf749-j2phh/networking-console-plugin_current.log with fingerprint=ff9e9f8086d69ede0435beb433bd3d601b37387eaddfa58dfb62663e42646b20
I0330 15:11:42.900300       1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-ptf2j with fingerprint=682441cc629ce9b3fa1923fb3bf2a852ffc8e8699523af47f2eefd2a40f3b992
E0330 15:11:42.900318       1 gather.go:161] error recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-575cd97545-ptf2j.json" because of the error: the record with the same name "config/pod/openshift-console-operator/console-operator-575cd97545-ptf2j.json" was already recorded and had the fingerprint "682441cc629ce9b3fa1923fb3bf2a852ffc8e8699523af47f2eefd2a40f3b992", overwriting with the record having fingerprint "682441cc629ce9b3fa1923fb3bf2a852ffc8e8699523af47f2eefd2a40f3b992"
W0330 15:11:42.900332       1 gather.go:155] issue recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-575cd97545-ptf2j.json" because of the warning: warning: the record with the same fingerprint "682441cc629ce9b3fa1923fb3bf2a852ffc8e8699523af47f2eefd2a40f3b992" was already recorded at path "config/pod/openshift-console-operator/console-operator-575cd97545-ptf2j.json", recording another one with a different path "config/pod/openshift-console-operator/console-operator-575cd97545-ptf2j.json"
I0330 15:11:42.900342       1 recorder.go:75] Recording config/pod/openshift-console-operator/logs/console-operator-575cd97545-ptf2j/console-operator_previous.log with fingerprint=c28ba64ead4dd6862e419eafebb49af5cf84324c75cda59f0ff6478c39ed35ed
I0330 15:11:42.900525       1 recorder.go:75] Recording config/pod/openshift-console-operator/logs/console-operator-575cd97545-ptf2j/console-operator_current.log with fingerprint=ec40c7ff182b5cd87b894563bfe85aee57156ee0141b675cb0ed04150d2d2ef4
I0330 15:11:42.900539       1 recorder.go:75] Recording config/pod/openshift-console/logs/console-56896f7559-4jf5m/console_current.log with fingerprint=415dfb3e10b7fb32238b142570381d08160b2227985ab46185a88243dabd7b7a
I0330 15:11:42.900549       1 recorder.go:75] Recording config/pod/openshift-console/logs/console-5b84b55cb5-mqg47/console_current.log with fingerprint=bb21b09012730231fec25efec5a793143216e158df64da606071610d3fc46e47
I0330 15:11:42.900564       1 recorder.go:75] Recording config/pod/openshift-console/logs/console-5b84b55cb5-pvctt/console_current.log with fingerprint=b614b1db14827e1f69afa801cd1ebc76eb4d6ceebae791734bf5055f71f2abc0
I0330 15:11:42.900570       1 recorder.go:75] Recording config/pod/openshift-console/logs/downloads-56cb7c9577-ksvlk/download-server_current.log with fingerprint=99a05ecd6a1fe42bf136bf31bde841e177edecc5449d65d71d860fa64c219b39
I0330 15:11:42.900576       1 recorder.go:75] Recording config/pod/openshift-console/logs/downloads-56cb7c9577-zvmlc/download-server_current.log with fingerprint=a840bc4cdad0e31c9b2f4e1b2e3edeb344848965ff2cafd3e97a90ab65c3ce0f
I0330 15:11:42.900676       1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-8mtnv with fingerprint=3cfcc0cffc6fe22c2b10c3cf367376d02091bbdee0494407637be29c1a8f15b4
I0330 15:11:42.900751       1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-sbhtq with fingerprint=84a07f0f8c089c7da7160e9e06cd0b700bb6a787cbd1f03f13caf21f6b7501c8
I0330 15:11:42.900847       1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-td6nn with fingerprint=961d1325e1d9907404e74da7ce7ed1dd29bae6e4e5ed0a9f56f275a9921ece3d
I0330 15:11:42.900880       1 recorder.go:75] Recording config/pod/openshift-image-registry/logs/image-registry-7f7746c7d4-v2w2r/registry_current.log with fingerprint=75859e2abc83ed724976f4507e9204b1699ec7710942bd191486285723ae6722
I0330 15:11:42.900912       1 recorder.go:75] Recording config/pod/openshift-image-registry/logs/image-registry-7f7746c7d4-vjtcp/registry_current.log with fingerprint=b4792f113c7a2bca0672148f04a19248fa04a234d9b8d262a34ae3d7ee2f55d8
I0330 15:11:42.901014       1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-8f55956f4-rshfr with fingerprint=7b8df60c624d6c55280c7442de9bed1a7299a97b8212d8be0c91c6ae947f1420
I0330 15:11:42.901022       1 recorder.go:75] Recording config/pod/openshift-image-registry/logs/node-ca-6s4q6/node-ca_current.log with fingerprint=72d04f70288e0794350357e85c03e0011eea852a30fb6060efc59e237c8101e3
I0330 15:11:42.901027       1 recorder.go:75] Recording config/pod/openshift-image-registry/logs/node-ca-z5xhg/node-ca_current.log with fingerprint=5c5b7156d006a66197e78168260c1f2f0460c84d4056636d5e82263b6dd4d2c6
I0330 15:11:42.901053       1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-7bd58c987f-f2glg/router_current.log with fingerprint=d41808a65d38c9e34c775e17b211a56131a754a13380d369473026120172793a
I0330 15:11:42.901095       1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-84859f585-7sjf9/router_current.log with fingerprint=fd4adfdfd5b4f2260026051e14e85087886a28103818a8d5cb85410065b0bdc0
I0330 15:11:42.901151       1 recorder.go:75] Recording config/pod/openshift-ingress/logs/router-default-84859f585-jc2nc/router_current.log with fingerprint=80b3239493da92287f23beb6c78eb1941e48076ea61af35074205b6129171e6e
I0330 15:11:42.901222       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-7ftkc with fingerprint=549b1aa281d6fa1596273409a2a1ac45ca7394032d8988b5e88bad48637ad018
I0330 15:11:42.901278       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-mvfxk with fingerprint=fccec4665254ad2d274dc494a403d6e3ed66ce6bdaeeed69855648424445ddc8
I0330 15:11:42.901333       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/ingress-canary-rn9sx with fingerprint=ed7222a8319d88200c17e5aade60e98d656547dc347fb73cd97a26ca9a35a528
I0330 15:11:42.901341       1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 21.863885098s to process 98 records
E0330 15:11:42.901409       1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 21.869s with: function \"silenced_alerts\" failed with an error, function \"active_alerts\" failed with an error, function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error, function \"dvo_metrics\" failed with an error, unable to record function \"operators_pods_and_events\" record \"config/pod/openshift-console-operator/console-operator-575cd97545-ptf2j.json\""
I0330 15:11:42.902513       1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "silenced_alerts" failed with an error, function "active_alerts" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error, function "dvo_metrics" failed with an error, unable to record function "operators_pods_and_events" record "config/pod/openshift-console-operator/console-operator-575cd97545-ptf2j.json"
I0330 15:11:42.902528       1 periodic.go:209] Running workloads gatherer
I0330 15:11:42.902545       1 tasks_processing.go:45] number of workers: 2
I0330 15:11:42.902554       1 tasks_processing.go:69] worker 1 listening for tasks.
I0330 15:11:42.902558       1 tasks_processing.go:71] worker 1 working on workload_info task.
I0330 15:11:42.902566       1 tasks_processing.go:69] worker 0 listening for tasks.
I0330 15:11:42.902612       1 tasks_processing.go:71] worker 0 working on helmchart_info task.
I0330 15:11:42.908568       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-70.ec2.internal...
I0330 15:11:42.908573       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-16.ec2.internal...
I0330 15:11:42.908588       1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-205.ec2.internal...
I0330 15:11:42.928672       1 tasks_processing.go:74] worker 0 stopped.
I0330 15:11:42.928693       1 gather.go:177] gatherer "workloads" function "helmchart_info" took 26.033873ms to process 0 records
I0330 15:11:48.911118       1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 6s
I0330 15:11:48.935311       1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 25s for image data
I0330 15:11:48.943428       1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (10ms)
I0330 15:11:48.951057       1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (8ms)
I0330 15:11:48.958782       1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (8ms)
I0330 15:11:48.966034       1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (7ms)
I0330 15:11:48.973117       1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (7ms)
I0330 15:11:48.980536       1 gather_workloads_info.go:387] No image sha256:7bd3e88d6d3f878a89203df590b684c5a77bf08df4717451d3197ab74683a80e (7ms)
I0330 15:11:48.987838       1 gather_workloads_info.go:387] No image sha256:513b1166e376feca472fdd5174f6abf0abf02925d6a21b7b4d89a2ff2fc67bed (7ms)
I0330 15:11:48.994680       1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (7ms)
I0330 15:11:49.001648       1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (7ms)
I0330 15:11:49.008651       1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (7ms)
I0330 15:11:49.043354       1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (35ms)
I0330 15:11:49.143404       1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms)
I0330 15:11:49.243384       1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (100ms)
I0330 15:11:49.344527       1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (101ms)
I0330 15:11:49.443423       1 gather_workloads_info.go:387] No image sha256:1e65f9f5490fbc930d2dce96f03ddcb28990b839d7dc011ef5de5bec6c5095bf (99ms)
I0330 15:11:49.543755       1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms)
I0330 15:11:49.643951       1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (100ms)
I0330 15:11:49.743433       1 gather_workloads_info.go:387] No image sha256:b99613494e9d6a4a8207323872d63cc02b830fc80a8bf972e62c64381aa4cd17 (99ms)
I0330 15:11:49.844174       1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (101ms)
I0330 15:11:49.943160       1 gather_workloads_info.go:387] No image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (99ms)
I0330 15:11:50.042924       1 gather_workloads_info.go:387] No image sha256:6e5df2aab9ce759e8f957341a11c087c233307e3c8f8760d21270efc19ccd3ce (100ms)
I0330 15:11:50.143036       1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (100ms)
I0330 15:11:50.244158       1 gather_workloads_info.go:387] No image sha256:90bdf9e678fe18e35401e34e1cb0912d822e9cb32b9e41cc545870540e9a87f2 (101ms)
I0330 15:11:50.344862       1 gather_workloads_info.go:387] No image sha256:3d6ea9e1633f38070718a1357fcb80e6cb3932aafcc4d65e659795b186c5da15 (101ms)
I0330 15:11:50.443839       1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (99ms)
I0330 15:11:50.543936       1 gather_workloads_info.go:387] No image sha256:1477f3287cc75352305274f248f781c1b7c2a8696f4f7bc450c45a4a5f5b10ea (100ms)
I0330 15:11:50.643503       1 gather_workloads_info.go:387] No image sha256:09e27b3a67ebeda04d3e597e0561bfb40550de78bdecb53f2f9ff3dfb1cfe7ea (100ms)
I0330 15:11:50.744115       1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (101ms)
I0330 15:11:50.858763       1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (115ms)
I0330 15:11:50.949725       1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (91ms)
I0330 15:11:51.044481       1 gather_workloads_info.go:387] No image sha256:76cc47f3775560477ec548c7b6fddbd99112ad6604f790697eef546576051fb7 (95ms)
I0330 15:11:51.144813       1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (100ms)
I0330 15:11:51.243895       1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (99ms)
I0330 15:11:51.342829       1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (99ms)
I0330 15:11:51.443303       1 gather_workloads_info.go:387] No image sha256:32d4561d4bf1b3c4e3a7878f918f9c1422bab85bdf8711fbdf905d59692fee81 (100ms)
I0330 15:11:51.543795       1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (100ms)
I0330 15:11:51.642945       1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (99ms)
I0330 15:11:51.743248       1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms)
I0330 15:11:51.843838       1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (101ms)
I0330 15:11:51.942510       1 gather_workloads_info.go:387] No image sha256:0092c6ff139f8698c91349d507eb3182bc5d6c4ae040f672e347ff504accdea2 (99ms)
I0330 15:11:52.043758       1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (101ms)
I0330 15:11:52.143813       1 gather_workloads_info.go:387] No image sha256:101993f6e65d6fda8b90c583b718b720809182961f69bc777295f47e6df4d7ce (100ms)
I0330 15:11:52.243655       1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (100ms)
I0330 15:11:52.344223       1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (101ms)
I0330 15:11:52.443489       1 gather_workloads_info.go:387] No image sha256:74713675d580a47a56b628469c4c05c41e114e0b935960d718ff0cf7e72f613d (99ms)
I0330 15:11:52.542832       1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (99ms)
I0330 15:11:52.643328       1 gather_workloads_info.go:387] No image sha256:0af73ad7a47c9ff53269ae2bc5163bf9e389085220c34e4bd42c92c4e7a85f6d (100ms)
I0330 15:11:52.743676       1 gather_workloads_info.go:387] No image sha256:3612c5a433effd17b7aff7ff6edf4fb27b61153908e3a0294158e4886a1d600d (100ms)
I0330 15:11:52.743711       1 tasks_processing.go:74] worker 1 stopped.
I0330 15:11:52.744038       1 recorder.go:75] Recording config/workload_info with fingerprint=15ec3f06aaedf69dd602e1e6d6f9e320d7ca4d86467335a5c80bcc3c752ba39f
I0330 15:11:52.744059       1 gather.go:177] gatherer "workloads" function "workload_info" took 9.841147019s to process 1 records
I0330 15:11:52.744085       1 periodic.go:256] Periodic gather workloads completed in 9.841s
I0330 15:11:52.744096       1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message=
I0330 15:11:52.744100       1 periodic.go:209] Running conditional gatherer
I0330 15:11:52.749695       1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules
I0330 15:11:52.757159       1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:49713->172.30.0.10:53: read: connection refused
I0330 15:11:52.757437       1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer
E0330 15:11:52.760878       1 conditional_gatherer.go:324] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: read udp 10.128.0.12:44489->172.30.0.10:53: read: connection refused
I0330 15:11:52.760949       1 conditional_gatherer.go:384] updating version cache for conditional gatherer
I0330 15:11:52.765998       1 conditional_gatherer.go:392] cluster version is '4.20.8'
E0330 15:11:52.766014       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0330 15:11:52.766020       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0330 15:11:52.766023       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0330 15:11:52.766026       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0330 15:11:52.766029       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0330 15:11:52.766033       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0330 15:11:52.766036       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0330 15:11:52.766039       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0330 15:11:52.766042       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
I0330 15:11:52.766057       1 tasks_processing.go:45] number of workers: 3
I0330 15:11:52.766065       1 tasks_processing.go:69] worker 2 listening for tasks.
I0330 15:11:52.766069       1 tasks_processing.go:71] worker 2 working on remote_configuration task.
I0330 15:11:52.766128       1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db
I0330 15:11:52.766132       1 tasks_processing.go:69] worker 1 listening for tasks.
I0330 15:11:52.766138       1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task.
I0330 15:11:52.766141       1 gather.go:177] gatherer "conditional" function "remote_configuration" took 926ns to process 1 records
I0330 15:11:52.766144       1 tasks_processing.go:71] worker 1 working on rapid_container_logs task.
I0330 15:11:52.766155       1 tasks_processing.go:69] worker 0 listening for tasks.
I0330 15:11:52.766168       1 tasks_processing.go:74] worker 0 stopped.
I0330 15:11:52.766201       1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406
I0330 15:11:52.766209       1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 927ns to process 1 records
I0330 15:11:52.766215       1 tasks_processing.go:74] worker 2 stopped.
I0330 15:11:52.766403       1 tasks_processing.go:74] worker 1 stopped.
I0330 15:11:52.766416       1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 247.786µs to process 0 records
I0330 15:11:52.766435       1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:49713->172.30.0.10:53: read: connection refused
I0330 15:11:52.766452       1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1
I0330 15:11:52.788869       1 recorder.go:75] Recording insights-operator/gathers with fingerprint=06ef7e453b8f07cbeaaa774458a0d94673eca202d1e94eeb20326b8c0385f9f1
I0330 15:11:52.789025       1 diskrecorder.go:70] Writing 204 records to /var/lib/insights-operator/insights-2026-03-30-151152.tar.gz
I0330 15:11:52.803467       1 diskrecorder.go:51] Wrote 204 records to disk in 14ms
I0330 15:11:52.803521       1 periodic.go:278] Gathering cluster info every 2h0m0s
I0330 15:11:52.803537       1 periodic.go:279] Configuration is 
	dataReporting:
		interval: 2h0m0s,
		uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload,
		storagePath: /var/lib/insights-operator,
		downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, 
		conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules,
		obfuscation: []
	sca:
		disabled: false,
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates,
		interval: 8h0m0s
	alerting:
		disabled: false
	clusterTransfer:
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/,
		interval: 12h0m0s
	proxy:
		httpProxy: ,
		httpsProxy: ,
		noProxy: 
I0330 15:12:51.033421       1 diskrecorder.go:223] Found files to send: insights-2026-03-30-151152.tar.gz
I0330 15:12:51.033458       1 insightsuploader.go:150] Checking archives to upload periodically every 15m30.541911841s
I0330 15:12:51.033469       1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z
I0330 15:12:51.043298       1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload
I0330 15:12:51.396633       1 requests.go:87] Successfully reported id=2026-03-30T15:12:51Z x-rh-insights-request-id=09b494b46508486ca7dbc0cc59179fe7, wrote=106336
I0330 15:12:51.396697       1 insightsuploader.go:187] Uploaded report successfully in 363.218151ms
I0330 15:12:51.396724       1 controller.go:128] Initializing last reported time to 2026-03-30T15:12:51Z
I0330 15:12:51.396740       1 insightsreport.go:304] Archive uploaded, starting pulling report...
I0330 15:12:51.396748       1 insightsreport.go:215] Starting retrieving report from Smart Proxy
I0330 15:12:51.396755       1 insightsreport.go:221] Initial delay for pulling: 1m0s
I0330 15:12:51.401623       1 controller.go:512] The operator is healthy
I0330 15:13:21.046564       1 controller.go:512] The operator is healthy
I0330 15:13:51.611423       1 insightsreport.go:137] Pulling report from smart-proxy
I0330 15:13:51.611455       1 insightsreport.go:149] Retrieving report
I0330 15:13:51.617562       1 requests.go:110] Retrieving report for cluster: 8aa0bc5a-5e81-4f4d-b60f-5de2f984448e
I0330 15:13:51.617573       1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/8aa0bc5a-5e81-4f4d-b60f-5de2f984448e/reports
I0330 15:13:51.620313       1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/8aa0bc5a-5e81-4f4d-b60f-5de2f984448e/reports
I0330 15:13:51.865770       1 insightsreport.go:184] Report retrieved
I0330 15:13:51.894025       1 insightsreport.go:239] Report retrieved correctly
I0330 15:15:21.046465       1 controller.go:512] The operator is healthy
I0330 15:16:21.026625       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0330 15:16:21.033316       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0330 15:16:21.033337       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0330 15:16:21.037060       1 secretconfigobserver.go:119] support secret does not exist
I0330 15:17:21.064886       1 controller.go:512] The operator is healthy
I0330 15:19:21.056247       1 controller.go:512] The operator is healthy
I0330 15:21:21.026791       1 configmapobserver.go:84] configmaps "insights-config" not found
I0330 15:21:21.037909       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0330 15:21:21.041966       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0330 15:21:21.041990       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0330 15:21:21.044339       1 controller.go:512] The operator is healthy
I0330 15:21:21.047341       1 secretconfigobserver.go:119] support secret does not exist
I0330 15:23:21.045214       1 controller.go:512] The operator is healthy
I0330 15:25:21.046203       1 controller.go:512] The operator is healthy
I0330 15:26:21.047822       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0330 15:26:21.053306       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0330 15:26:21.053331       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0330 15:26:21.056731       1 secretconfigobserver.go:119] support secret does not exist
I0330 15:27:21.044965       1 controller.go:512] The operator is healthy
I0330 15:28:26.939973       1 insightsuploader.go:146] Nothing to report since 2026-03-30T15:12:51Z
I0330 15:29:21.046042       1 controller.go:512] The operator is healthy
I0330 15:31:21.026553       1 configmapobserver.go:84] configmaps "insights-config" not found
I0330 15:31:21.029998       1 configmapobserver.go:84] configmaps "insights-config" not found
I0330 15:31:21.044574       1 controller.go:512] The operator is healthy
I0330 15:31:21.057405       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0330 15:31:21.061502       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0330 15:31:21.061523       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0330 15:31:21.064816       1 secretconfigobserver.go:119] support secret does not exist
I0330 15:33:21.045273       1 controller.go:512] The operator is healthy
I0330 15:35:21.044970       1 controller.go:512] The operator is healthy
I0330 15:36:21.065298       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0330 15:36:21.070356       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0330 15:36:21.070376       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0330 15:36:21.073946       1 secretconfigobserver.go:119] support secret does not exist
I0330 15:37:21.044390       1 controller.go:512] The operator is healthy
I0330 15:39:21.047049       1 controller.go:512] The operator is healthy
I0330 15:41:21.027378       1 configmapobserver.go:84] configmaps "insights-config" not found
I0330 15:41:21.031032       1 configmapobserver.go:84] configmaps "insights-config" not found
I0330 15:41:21.044457       1 controller.go:512] The operator is healthy
I0330 15:41:21.074308       1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret
I0330 15:41:21.078393       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0330 15:41:21.078410       1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret
I0330 15:41:21.081750       1 secretconfigobserver.go:119] support secret does not exist
I0330 15:43:21.045420       1 controller.go:512] The operator is healthy
I0330 15:44:19.646568       1 insightsuploader.go:146] Nothing to report since 2026-03-30T15:12:51Z
I0330 15:45:21.046124       1 controller.go:512] The operator is healthy