W0327 10:43:53.512745       1 cmd.go:257] Using insecure, self-signed certificates
I0327 10:43:54.277502       1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0327 10:43:54.277822       1 observer_polling.go:159] Starting file observer
I0327 10:43:54.685012       1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$
I0327 10:43:54.685254       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0327 10:43:54.685785       1 secure_serving.go:57] Forcing use of http/1.1 only
W0327 10:43:54.685807       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0327 10:43:54.685812       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0327 10:43:54.685816       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
W0327 10:43:54.685821       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
W0327 10:43:54.685823       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
W0327 10:43:54.685825       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0327 10:43:54.685837       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
I0327 10:43:54.689283       1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot]
I0327 10:43:54.689295       1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"4a70d9eb-dfd5-4045-be15-f38be78b694e", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
I0327 10:43:54.692023       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0327 10:43:54.692040       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0327 10:43:54.692039       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0327 10:43:54.692053       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0327 10:43:54.692040       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0327 10:43:54.692066       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0327 10:43:54.692324       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3442349225/tls.crt::/tmp/serving-cert-3442349225/tls.key"
I0327 10:43:54.692551       1 secure_serving.go:213] Serving securely on [::]:8443
I0327 10:43:54.692581       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
W0327 10:43:54.694829       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0327 10:43:54.694849       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0327 10:43:54.694960       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0327 10:43:54.700694       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0327 10:43:54.700717       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0327 10:43:54.705524       1 secretconfigobserver.go:119] support secret does not exist
I0327 10:43:54.710411       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0327 10:43:54.715118       1 secretconfigobserver.go:119] support secret does not exist
I0327 10:43:54.717864       1 recorder.go:176] Pruning old reports every 5h29m11s, max age is 288h0m0s
I0327 10:43:54.722771       1 periodic.go:216] Running clusterconfig gatherer
I0327 10:43:54.722825       1 tasks_processing.go:45] number of workers: 64
I0327 10:43:54.722837       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0327 10:43:54.722849       1 tasks_processing.go:69] worker 6 listening for tasks.
I0327 10:43:54.722852       1 insightsreport.go:296] Starting report retriever
I0327 10:43:54.722861       1 tasks_processing.go:69] worker 0 listening for tasks.
I0327 10:43:54.722862       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0327 10:43:54.722867       1 tasks_processing.go:69] worker 1 listening for tasks.
I0327 10:43:54.722773       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0327 10:43:54.722877       1 tasks_processing.go:71] worker 1 working on openstack_dataplanenodesets task.
I0327 10:43:54.722878       1 tasks_processing.go:69] worker 5 listening for tasks.
I0327 10:43:54.722881       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s
I0327 10:43:54.722885       1 tasks_processing.go:69] worker 16 listening for tasks.
I0327 10:43:54.722894       1 tasks_processing.go:69] worker 12 listening for tasks.
I0327 10:43:54.722901       1 tasks_processing.go:69] worker 9 listening for tasks.
I0327 10:43:54.722905       1 tasks_processing.go:71] worker 9 working on metrics task.
I0327 10:43:54.722891       1 tasks_processing.go:69] worker 4 listening for tasks.
I0327 10:43:54.722913       1 tasks_processing.go:69] worker 25 listening for tasks.
I0327 10:43:54.722883       1 tasks_processing.go:71] worker 5 working on config_maps task.
I0327 10:43:54.722918       1 tasks_processing.go:69] worker 14 listening for tasks.
I0327 10:43:54.722916       1 tasks_processing.go:69] worker 23 listening for tasks.
I0327 10:43:54.722928       1 tasks_processing.go:69] worker 26 listening for tasks.
I0327 10:43:54.722930       1 tasks_processing.go:69] worker 10 listening for tasks.
I0327 10:43:54.722936       1 tasks_processing.go:71] worker 10 working on sap_pods task.
I0327 10:43:54.722936       1 tasks_processing.go:69] worker 17 listening for tasks.
I0327 10:43:54.722939       1 tasks_processing.go:71] worker 4 working on schedulers task.
W0327 10:43:54.722944       1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0327 10:43:54.722946       1 tasks_processing.go:69] worker 32 listening for tasks.
I0327 10:43:54.722874       1 tasks_processing.go:69] worker 2 listening for tasks.
I0327 10:43:54.722876       1 tasks_processing.go:69] worker 31 listening for tasks.
I0327 10:43:54.722945       1 tasks_processing.go:69] worker 27 listening for tasks.
I0327 10:43:54.722961       1 tasks_processing.go:69] worker 33 listening for tasks.
I0327 10:43:54.722963       1 tasks_processing.go:69] worker 20 listening for tasks.
I0327 10:43:54.722964       1 tasks_processing.go:69] worker 40 listening for tasks.
I0327 10:43:54.722894       1 tasks_processing.go:69] worker 8 listening for tasks.
I0327 10:43:54.722962       1 tasks_processing.go:69] worker 3 listening for tasks.
I0327 10:43:54.722971       1 tasks_processing.go:69] worker 21 listening for tasks.
I0327 10:43:54.722974       1 tasks_processing.go:69] worker 22 listening for tasks.
I0327 10:43:54.722970       1 tasks_processing.go:69] worker 41 listening for tasks.
I0327 10:43:54.722982       1 tasks_processing.go:69] worker 57 listening for tasks.
I0327 10:43:54.722885       1 tasks_processing.go:69] worker 7 listening for tasks.
I0327 10:43:54.722986       1 tasks_processing.go:71] worker 25 working on machine_sets task.
I0327 10:43:54.722994       1 tasks_processing.go:69] worker 47 listening for tasks.
I0327 10:43:54.722996       1 tasks_processing.go:69] worker 38 listening for tasks.
I0327 10:43:54.723000       1 tasks_processing.go:69] worker 52 listening for tasks.
I0327 10:43:54.722998       1 tasks_processing.go:69] worker 44 listening for tasks.
I0327 10:43:54.723005       1 tasks_processing.go:69] worker 39 listening for tasks.
I0327 10:43:54.723006       1 tasks_processing.go:71] worker 52 working on image task.
I0327 10:43:54.723009       1 tasks_processing.go:69] worker 49 listening for tasks.
I0327 10:43:54.723010       1 tasks_processing.go:71] worker 2 working on ceph_cluster task.
I0327 10:43:54.723014       1 tasks_processing.go:71] worker 27 working on container_runtime_configs task.
I0327 10:43:54.723016       1 tasks_processing.go:71] worker 21 working on authentication task.
I0327 10:43:54.723019       1 tasks_processing.go:69] worker 54 listening for tasks.
I0327 10:43:54.723019       1 tasks_processing.go:71] worker 40 working on machines task.
I0327 10:43:54.723022       1 tasks_processing.go:71] worker 8 working on nodenetworkstates task.
I0327 10:43:54.723026       1 tasks_processing.go:71] worker 54 working on cluster_apiserver task.
I0327 10:43:54.723028       1 tasks_processing.go:71] worker 39 working on overlapping_namespace_uids task.
I0327 10:43:54.723035       1 tasks_processing.go:71] worker 17 working on cost_management_metrics_configs task.
I0327 10:43:54.723039       1 tasks_processing.go:71] worker 44 working on sap_config task.
I0327 10:43:54.722923       1 tasks_processing.go:69] worker 29 listening for tasks.
I0327 10:43:54.723068       1 tasks_processing.go:69] worker 55 listening for tasks.
I0327 10:43:54.723106       1 tasks_processing.go:69] worker 59 listening for tasks.
I0327 10:43:54.723157       1 tasks_processing.go:71] worker 59 working on pdbs task.
I0327 10:43:54.722901       1 tasks_processing.go:71] worker 12 working on infrastructures task.
I0327 10:43:54.723021       1 tasks_processing.go:71] worker 32 working on pod_network_connectivity_checks task.
I0327 10:43:54.723001       1 tasks_processing.go:71] worker 38 working on version task.
I0327 10:43:54.723079       1 tasks_processing.go:69] worker 56 listening for tasks.
I0327 10:43:54.723264       1 tasks_processing.go:71] worker 56 working on feature_gates task.
I0327 10:43:54.722876       1 tasks_processing.go:69] worker 15 listening for tasks.
I0327 10:43:54.723115       1 tasks_processing.go:71] worker 55 working on active_alerts task.
W0327 10:43:54.723368       1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0327 10:43:54.722996       1 tasks_processing.go:71] worker 7 working on ingress task.
I0327 10:43:54.722905       1 tasks_processing.go:69] worker 24 listening for tasks.
I0327 10:43:54.722889       1 tasks_processing.go:69] worker 11 listening for tasks.
I0327 10:43:54.722896       1 tasks_processing.go:71] worker 16 working on crds task.
I0327 10:43:54.722910       1 tasks_processing.go:69] worker 13 listening for tasks.
I0327 10:43:54.722920       1 tasks_processing.go:69] worker 28 listening for tasks.
I0327 10:43:54.722930       1 tasks_processing.go:69] worker 30 listening for tasks.
I0327 10:43:54.722936       1 tasks_processing.go:71] worker 26 working on jaegers task.
I0327 10:43:54.722938       1 tasks_processing.go:69] worker 48 listening for tasks.
I0327 10:43:54.722947       1 tasks_processing.go:69] worker 18 listening for tasks.
I0327 10:43:54.722955       1 tasks_processing.go:69] worker 19 listening for tasks.
I0327 10:43:54.722955       1 gather.go:177] gatherer "clusterconfig" function "metrics" took 41.1µs to process 0 records
I0327 10:43:54.723605       1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 52.261µs to process 0 records
I0327 10:43:54.722975       1 tasks_processing.go:69] worker 34 listening for tasks.
I0327 10:43:54.722979       1 tasks_processing.go:69] worker 35 listening for tasks.
I0327 10:43:54.722979       1 tasks_processing.go:69] worker 42 listening for tasks.
I0327 10:43:54.722979       1 tasks_processing.go:71] worker 23 working on nodes task.
I0327 10:43:54.723715       1 tasks_processing.go:71] worker 42 working on support_secret task.
I0327 10:43:54.723738       1 tasks_processing.go:71] worker 30 working on container_images task.
I0327 10:43:54.723751       1 tasks_processing.go:71] worker 11 working on image_registries task.
I0327 10:43:54.723757       1 tasks_processing.go:71] worker 13 working on tsdb_status task.
W0327 10:43:54.723775       1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0327 10:43:54.723789       1 tasks_processing.go:71] worker 13 working on dvo_metrics task.
I0327 10:43:54.722976       1 tasks_processing.go:71] worker 14 working on certificate_signing_requests task.
I0327 10:43:54.723886       1 tasks_processing.go:71] worker 15 working on node_features task.
I0327 10:43:54.724004       1 tasks_processing.go:71] worker 24 working on storage_cluster task.
I0327 10:43:54.724012       1 tasks_processing.go:71] worker 19 working on machine_healthchecks task.
I0327 10:43:54.724015       1 tasks_processing.go:71] worker 28 working on openshift_logging task.
I0327 10:43:54.724058       1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 25.509µs to process 0 records
I0327 10:43:54.724072       1 tasks_processing.go:71] worker 48 working on silenced_alerts task.
W0327 10:43:54.724087       1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0327 10:43:54.724092       1 tasks_processing.go:71] worker 48 working on install_plans task.
I0327 10:43:54.724175       1 tasks_processing.go:71] worker 18 working on openstack_controlplanes task.
I0327 10:43:54.724207       1 tasks_processing.go:71] worker 34 working on machine_configs task.
I0327 10:43:54.722985       1 tasks_processing.go:69] worker 36 listening for tasks.
I0327 10:43:54.722987       1 tasks_processing.go:69] worker 43 listening for tasks.
I0327 10:43:54.722989       1 tasks_processing.go:69] worker 45 listening for tasks.
I0327 10:43:54.722990       1 tasks_processing.go:69] worker 37 listening for tasks.
I0327 10:43:54.722993       1 tasks_processing.go:69] worker 46 listening for tasks.
I0327 10:43:54.723001       1 tasks_processing.go:69] worker 50 listening for tasks.
I0327 10:43:54.723002       1 tasks_processing.go:71] worker 47 working on operators_pods_and_events task.
I0327 10:43:54.724415       1 tasks_processing.go:71] worker 45 working on storage_classes task.
I0327 10:43:54.724424       1 tasks_processing.go:71] worker 46 working on machine_config_pools task.
I0327 10:43:54.724424       1 tasks_processing.go:71] worker 37 working on qemu_kubevirt_launcher_logs task.
I0327 10:43:54.723007       1 tasks_processing.go:71] worker 33 working on aggregated_monitoring_cr_names task.
I0327 10:43:54.724508       1 tasks_processing.go:71] worker 43 working on clusterroles task.
I0327 10:43:54.724414       1 tasks_processing.go:71] worker 50 working on networks task.
I0327 10:43:54.723000       1 tasks_processing.go:71] worker 57 working on nodenetworkconfigurationpolicies task.
I0327 10:43:54.723011       1 tasks_processing.go:71] worker 3 working on ingress_certificates task.
I0327 10:43:54.723011       1 tasks_processing.go:71] worker 22 working on openshift_machine_api_events task.
I0327 10:43:54.723011       1 tasks_processing.go:69] worker 53 listening for tasks.
I0327 10:43:54.723015       1 tasks_processing.go:71] worker 20 working on lokistack task.
I0327 10:43:54.725540       1 tasks_processing.go:71] worker 53 working on machine_autoscalers task.
I0327 10:43:54.723013       1 tasks_processing.go:71] worker 31 working on sap_datahubs task.
I0327 10:43:54.723013       1 tasks_processing.go:71] worker 41 working on monitoring_persistent_volumes task.
I0327 10:43:54.723022       1 tasks_processing.go:71] worker 49 working on oauths task.
I0327 10:43:54.723082       1 tasks_processing.go:71] worker 29 working on openstack_dataplanedeployments task.
I0327 10:43:54.723092       1 tasks_processing.go:69] worker 61 listening for tasks.
I0327 10:43:54.726330       1 tasks_processing.go:71] worker 61 working on olm_operators task.
I0327 10:43:54.723091       1 tasks_processing.go:69] worker 63 listening for tasks.
I0327 10:43:54.723099       1 tasks_processing.go:69] worker 58 listening for tasks.
I0327 10:43:54.723100       1 tasks_processing.go:69] worker 62 listening for tasks.
I0327 10:43:54.723119       1 tasks_processing.go:69] worker 60 listening for tasks.
I0327 10:43:54.723127       1 tasks_processing.go:71] worker 0 working on validating_webhook_configurations task.
I0327 10:43:54.723123       1 tasks_processing.go:71] worker 9 working on operators task.
I0327 10:43:54.723128       1 tasks_processing.go:71] worker 6 working on openstack_version task.
I0327 10:43:54.726497       1 tasks_processing.go:71] worker 58 working on mutating_webhook_configurations task.
I0327 10:43:54.726504       1 tasks_processing.go:74] worker 60 stopped.
I0327 10:43:54.724302       1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 15.334µs to process 0 records
I0327 10:43:54.724312       1 tasks_processing.go:71] worker 35 working on node_logs task.
I0327 10:43:54.724318       1 tasks_processing.go:71] worker 55 working on service_accounts task.
I0327 10:43:54.724418       1 tasks_processing.go:71] worker 36 working on proxies task.
I0327 10:43:54.723004       1 tasks_processing.go:69] worker 51 listening for tasks.
I0327 10:43:54.726527       1 tasks_processing.go:74] worker 51 stopped.
I0327 10:43:54.726536       1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 3.423406ms to process 0 records
I0327 10:43:54.726554       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 3.55252ms to process 0 records
I0327 10:43:54.726567       1 tasks_processing.go:74] worker 1 stopped.
I0327 10:43:54.726570       1 tasks_processing.go:71] worker 62 working on image_pruners task.
I0327 10:43:54.726588       1 tasks_processing.go:74] worker 25 stopped.
I0327 10:43:54.727072       1 tasks_processing.go:71] worker 63 working on number_of_pods_and_netnamespaces_with_sdn_annotations task.
I0327 10:43:54.727240       1 tasks_processing.go:74] worker 2 stopped.
I0327 10:43:54.727258       1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 4.216727ms to process 0 records
I0327 10:43:54.727270       1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 4.229722ms to process 0 records
I0327 10:43:54.727278       1 tasks_processing.go:74] worker 27 stopped.
I0327 10:43:54.727355       1 tasks_processing.go:74] worker 17 stopped.
I0327 10:43:54.727372       1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 4.308769ms to process 0 records
I0327 10:43:54.728883       1 tasks_processing.go:74] worker 10 stopped.
I0327 10:43:54.728899       1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 5.936943ms to process 0 records
I0327 10:43:54.729112       1 tasks_processing.go:74] worker 26 stopped.
I0327 10:43:54.729127       1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 5.57381ms to process 0 records
I0327 10:43:54.729134       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 6.084959ms to process 0 records
I0327 10:43:54.729141       1 tasks_processing.go:74] worker 8 stopped.
I0327 10:43:54.729357       1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z
I0327 10:43:54.729373       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0327 10:43:54.729378       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0327 10:43:54.729381       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0327 10:43:54.729395       1 controller.go:531] The operator is still being initialized
I0327 10:43:54.729401       1 controller.go:554] The operator is healthy
E0327 10:43:54.733439       1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed)
I0327 10:43:54.733458       1 tasks_processing.go:74] worker 15 stopped.
I0327 10:43:54.733466       1 gather.go:177] gatherer "clusterconfig" function "node_features" took 9.555781ms to process 0 records
I0327 10:43:54.742507       1 tasks_processing.go:74] worker 24 stopped.
I0327 10:43:54.742530       1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 18.48285ms to process 0 records
I0327 10:43:54.742541       1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 18.494229ms to process 0 records
I0327 10:43:54.742548       1 tasks_processing.go:74] worker 28 stopped.
I0327 10:43:54.742700       1 tasks_processing.go:74] worker 52 stopped.
I0327 10:43:54.742827       1 recorder.go:75] Recording config/image with fingerprint=529c1aa8c2c47232e9ba9e0506b8c3149da4217ba5ccaab6eced0f350d8dccf5
I0327 10:43:54.742847       1 gather.go:177] gatherer "clusterconfig" function "image" took 19.682405ms to process 1 records
I0327 10:43:54.742900       1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=d2fd10ec2768e9212176712fe72ea0762bf4876277730d5e4871282bbe705a06
I0327 10:43:54.742909       1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 19.790008ms to process 1 records
I0327 10:43:54.742940       1 tasks_processing.go:74] worker 4 stopped.
I0327 10:43:54.743010       1 tasks_processing.go:74] worker 54 stopped.
I0327 10:43:54.743034       1 recorder.go:75] Recording config/apiserver with fingerprint=2ebb1803c49736d5fcb0bd2227d7eda2052f58be60c7418e17bcf964a3eb3c55
I0327 10:43:54.743042       1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 19.721653ms to process 1 records
I0327 10:43:54.743122       1 tasks_processing.go:74] worker 7 stopped.
I0327 10:43:54.743162       1 recorder.go:75] Recording config/ingress with fingerprint=56e189e8faa9073d7a631f3a89383598932f1bfe447d59ff151afadeae85c8af
I0327 10:43:54.743170       1 gather.go:177] gatherer "clusterconfig" function "ingress" took 19.440558ms to process 1 records
I0327 10:43:54.745041       1 tasks_processing.go:74] worker 46 stopped.
I0327 10:43:54.745057       1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 20.609388ms to process 0 records
I0327 10:43:54.745068       1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 19.475252ms to process 0 records
I0327 10:43:54.745075       1 tasks_processing.go:74] worker 53 stopped.
I0327 10:43:54.745088       1 tasks_processing.go:74] worker 18 stopped.
I0327 10:43:54.745101       1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 20.899157ms to process 0 records
I0327 10:43:54.745320       1 tasks_processing.go:74] worker 40 stopped.
E0327 10:43:54.745330       1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope
I0327 10:43:54.745337       1 gather.go:177] gatherer "clusterconfig" function "machines" took 22.287155ms to process 0 records
I0327 10:43:54.745353       1 tasks_processing.go:74] worker 42 stopped.
E0327 10:43:54.745362       1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found
I0327 10:43:54.745368       1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 21.625982ms to process 0 records
I0327 10:43:54.745505       1 tasks_processing.go:74] worker 20 stopped.
I0327 10:43:54.745521       1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 20.002186ms to process 0 records
I0327 10:43:54.745559       1 tasks_processing.go:74] worker 44 stopped.
I0327 10:43:54.745573       1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 22.501801ms to process 0 records
I0327 10:43:54.745628       1 tasks_processing.go:74] worker 19 stopped.
E0327 10:43:54.745637       1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope
I0327 10:43:54.745644       1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 21.607246ms to process 0 records
I0327 10:43:54.745914       1 tasks_processing.go:74] worker 56 stopped.
I0327 10:43:54.746077       1 recorder.go:75] Recording config/featuregate with fingerprint=37d80d506c48abf467c0ca85d0bdbc91e3088678c7bad957bd74bcaa70900bcc
I0327 10:43:54.746097       1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 22.640863ms to process 1 records
I0327 10:43:54.746112       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 20.828051ms to process 0 records
I0327 10:43:54.746131       1 tasks_processing.go:74] worker 57 stopped.
I0327 10:43:54.746234       1 tasks_processing.go:74] worker 12 stopped.
I0327 10:43:54.746879       1 recorder.go:75] Recording config/infrastructure with fingerprint=c9d276bdbcad0199b8751995cf9dd93e84a6efad7a3c2545087b056a598612a0
I0327 10:43:54.746897       1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 22.915389ms to process 1 records
I0327 10:43:54.746914       1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
I0327 10:43:54.746924       1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 23.695176ms to process 1 records
I0327 10:43:54.746933       1 tasks_processing.go:74] worker 39 stopped.
I0327 10:43:54.746979       1 tasks_processing.go:74] worker 11 stopped.
I0327 10:43:54.747514       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=f7ae0101ecf65e02a382112acce8407e5b76e23bad5d01c033dc04445c2ae723
I0327 10:43:54.747536       1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 23.219079ms to process 1 records
I0327 10:43:54.747578       1 tasks_processing.go:74] worker 14 stopped.
I0327 10:43:54.747592       1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 23.744923ms to process 0 records
I0327 10:43:54.747952       1 tasks_processing.go:74] worker 21 stopped.
I0327 10:43:54.748166       1 recorder.go:75] Recording config/authentication with fingerprint=5ebb7bb25766641762c7d7e91e32a1a787b9b833dba6b8a3c7f9c652c9daa82e
I0327 10:43:54.748189       1 gather.go:177] gatherer "clusterconfig" function "authentication" took 24.917643ms to process 1 records
W0327 10:43:54.749723       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0327 10:43:54.756727       1 tasks_processing.go:74] worker 31 stopped.
I0327 10:43:54.756753       1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 31.105539ms to process 0 records
I0327 10:43:54.757937       1 tasks_processing.go:74] worker 50 stopped.
I0327 10:43:54.758499       1 recorder.go:75] Recording config/network with fingerprint=86e09461650cd9e7f2bd0037b30632b5a75f97a13a5eb3c29c536ae1cca2cb2d
I0327 10:43:54.758521       1 gather.go:177] gatherer "clusterconfig" function "networks" took 32.975567ms to process 1 records
I0327 10:43:54.760122       1 tasks_processing.go:74] worker 32 stopped.
E0327 10:43:54.760143       1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io)
I0327 10:43:54.760153       1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 36.912267ms to process 0 records
I0327 10:43:54.760196       1 tasks_processing.go:74] worker 59 stopped.
I0327 10:43:54.760365       1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=d69d79a132378983b67610d1280ceb50e98298c43967f4c2e1ae5f98ab4b993d
I0327 10:43:54.760409       1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=2d471650791cae8f4b0e347194aa3a09c271dddfe95a9ca8caf41b029bdf5812
I0327 10:43:54.760436       1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=eb02e96bd515fa072138091c3a02ce9f9369886140ab599d5757c2153f510b5a
I0327 10:43:54.760449       1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 37.02682ms to process 3 records
I0327 10:43:54.760553       1 tasks_processing.go:74] worker 23 stopped.
I0327 10:43:54.760950       1 recorder.go:75] Recording config/node/ip-10-0-0-12.ec2.internal with fingerprint=27f7ac863676bab961dc53bd5ead3f20adc01639bc4fa6823c1228722fff18df
I0327 10:43:54.761043       1 recorder.go:75] Recording config/node/ip-10-0-1-188.ec2.internal with fingerprint=a56604a542c7d9a0d590592b85067483afc341f663c22de8aff329d98457fd57
I0327 10:43:54.761134       1 recorder.go:75] Recording config/node/ip-10-0-2-4.ec2.internal with fingerprint=89ac538a7912a2d7614bf026563f6fc0a3cf0e5faabca939677626636d650e18
I0327 10:43:54.761146       1 gather.go:177] gatherer "clusterconfig" function "nodes" took 36.909892ms to process 3 records
I0327 10:43:54.763526       1 tasks_processing.go:74] worker 49 stopped.
I0327 10:43:54.763825       1 recorder.go:75] Recording config/oauth with fingerprint=8f1324f028b3d2549cad3d23d213b00d0bcadcbff9be9bb5ee875f7480c5fb0a
I0327 10:43:54.763845       1 gather.go:177] gatherer "clusterconfig" function "oauths" took 37.528286ms to process 1 records
I0327 10:43:54.774768       1 tasks_processing.go:74] worker 30 stopped.
I0327 10:43:54.776122       1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-8777bd9bb-6jqfw with fingerprint=f3f90e320c526022180653983c96f73f63d4ac620b67ddcde80d0255aa8eed25
I0327 10:43:54.776195       1 recorder.go:75] Recording config/running_containers with fingerprint=b2a2c71ad4f9a0414385e313236d82e2aa4199c5014515214225127eb150f532
I0327 10:43:54.776206       1 gather.go:177] gatherer "clusterconfig" function "container_images" took 51.008227ms to process 2 records
I0327 10:43:54.790328       1 tasks_processing.go:74] worker 29 stopped.
I0327 10:43:54.790344       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 64.048952ms to process 0 records
I0327 10:43:54.790350       1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 63.869493ms to process 0 records
I0327 10:43:54.790363       1 tasks_processing.go:74] worker 6 stopped.
I0327 10:43:54.790654       1 tasks_processing.go:74] worker 36 stopped.
I0327 10:43:54.790718       1 gather_logs.go:145] no pods in  namespace were found
I0327 10:43:54.790731       1 recorder.go:75] Recording config/proxy with fingerprint=b6cdc75822265c008229ead03239720d81d6a3853515ee7d04fe3df4d9453919
I0327 10:43:54.790744       1 gather.go:177] gatherer "clusterconfig" function "proxies" took 64.065156ms to process 1 records
I0327 10:43:54.790819       1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=b9c53d1bc228d9e4738980d47f2fca89004625684760de3267ab351381177791
I0327 10:43:54.790827       1 tasks_processing.go:74] worker 45 stopped.
I0327 10:43:54.790832       1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=6cd31bb574aa492d2ab2977dd4791cb7e06810e4606022eb08dd0b9fa7f367fa
I0327 10:43:54.790838       1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 66.263905ms to process 2 records
I0327 10:43:54.790843       1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 65.293022ms to process 0 records
I0327 10:43:54.790847       1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 66.292972ms to process 0 records
I0327 10:43:54.790852       1 tasks_processing.go:74] worker 37 stopped.
I0327 10:43:54.790853       1 tasks_processing.go:74] worker 22 stopped.
I0327 10:43:54.792810       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0327 10:43:54.792798       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0327 10:43:54.792886       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0327 10:43:54.792983       1 tasks_processing.go:74] worker 35 stopped.
I0327 10:43:54.793003       1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 66.446255ms to process 0 records
E0327 10:43:54.793015       1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io)
I0327 10:43:54.793040       1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499
I0327 10:43:54.793057       1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 68.752804ms to process 1 records
I0327 10:43:54.793066       1 tasks_processing.go:74] worker 34 stopped.
I0327 10:43:54.793173       1 tasks_processing.go:74] worker 43 stopped.
I0327 10:43:54.793378       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=f636904069b50a78ca4a48be4ca4b82173a7e4740156abe4c92f3c3134cedfa7
I0327 10:43:54.793463       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=15c5c89f9d295d2040a55c9f55a52ca26ea66e30b181c8a48e89fa5d010fa2c6
I0327 10:43:54.793472       1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 68.637678ms to process 2 records
I0327 10:43:54.794419       1 tasks_processing.go:74] worker 38 stopped.
I0327 10:43:54.794619       1 recorder.go:75] Recording config/version with fingerprint=4cad581bc9895189c733a3eb9762a2146d859e012ea1151eeb6dc1f28b04d729
I0327 10:43:54.794630       1 recorder.go:75] Recording config/id with fingerprint=b6fcc2ebc84b820f6582a083f5540ecb66bc33455f5422cc395c95aa52239ecf
I0327 10:43:54.794637       1 gather.go:177] gatherer "clusterconfig" function "version" took 71.163495ms to process 2 records
I0327 10:43:54.795135       1 base_controller.go:82] Caches are synced for ConfigController 
I0327 10:43:54.795145       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
I0327 10:43:54.798310       1 tasks_processing.go:74] worker 16 stopped.
I0327 10:43:54.798503       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
I0327 10:43:54.798579       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
W0327 10:43:54.798615       1 operator.go:328] started
I0327 10:43:54.798638       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
I0327 10:43:54.798800       1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=47b3a00c6638e7e602198f1c478de0f02c3f56c01aaf1cd41be388d7fbe983bd
I0327 10:43:54.799001       1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=b72694e980aa55ab3dc2830242c4d24e4fd5c1bc8819fd6300d233a01596ce02
I0327 10:43:54.799018       1 gather.go:177] gatherer "clusterconfig" function "crds" took 74.787202ms to process 2 records
I0327 10:43:54.809188       1 tasks_processing.go:74] worker 41 stopped.
I0327 10:43:54.809207       1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 83.448052ms to process 0 records
I0327 10:43:54.809315       1 tasks_processing.go:74] worker 62 stopped.
I0327 10:43:54.809415       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=783dd4e2bc31193141ce80dbb3eb94a12778aecf25bae0c45b1d77b8db68cb10
I0327 10:43:54.809430       1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 82.731306ms to process 1 records
I0327 10:43:54.809437       1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 83.052808ms to process 0 records
I0327 10:43:54.809442       1 tasks_processing.go:74] worker 61 stopped.
I0327 10:43:54.813185       1 tasks_processing.go:74] worker 58 stopped.
I0327 10:43:54.813388       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=0f04f9c1ee61a5964baf78a83b8d03568ba4b2fa06eccee3d5490819fd49db06
I0327 10:43:54.813421       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=a9d541061cc23aa165b24b70baf0c007a7c789484fd9c879af1cfc6b53c19648
I0327 10:43:54.813446       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=9da2bf02edc535fd97493d05617b6898da3fed16a53275a8ed019585a1c6e94a
I0327 10:43:54.813455       1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 86.668639ms to process 3 records
I0327 10:43:54.813538       1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=d55b52b10250faa6f565a6470882c9515e0e41a673100607c2fbe7eefad77af7
I0327 10:43:54.813569       1 tasks_processing.go:74] worker 0 stopped.
I0327 10:43:54.813616       1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=93cdfebcdda677af3e2a8cbe0bdb7052361576d2e210fa38bfc443cd68a71a09
I0327 10:43:54.813634       1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=ae41db464f8b90594122f1c61a381c407cda5837e26aa9828658743280fb64ea
I0327 10:43:54.813656       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=dcf9effdd4e7778bb5e4010ebdd789aebbe4e3d0f2faa6471cda6f17aa426263
I0327 10:43:54.813679       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=a8e6d01aee4addaab4873dbb474940d472a0fd3edd74037099912a8d9975c1d4
I0327 10:43:54.813702       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=52b979c822dafd7b3d8c74274d9b4ad089e7d738c9c77215dba0f797e82bbc39
I0327 10:43:54.813740       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=adce2a2d9df4454ddc3d4a859b3492fb8a0ac3c96034de39f3438fd6464712e8
I0327 10:43:54.813774       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=dd275a3c890c3433ccefb40b75356f0e556a2bd7b4320fc91925e69c9b2e3fd6
I0327 10:43:54.813798       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=086661daec207ac3635e4506758b1eb4af0472d4d98be001de1fb5d8365e8bb4
I0327 10:43:54.813832       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=a759299c2340c8ab83295a4bf26ef0ea82051ac08e8d23edebdacb4c0b1169bb
I0327 10:43:54.813855       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=c01220baf3d99d117eed1ea5aee8813acf711aad3933f47e274b974f2b6fc72b
I0327 10:43:54.813861       1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 87.040339ms to process 11 records
I0327 10:43:54.813871       1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 89.126852ms to process 0 records
I0327 10:43:54.813877       1 tasks_processing.go:74] worker 33 stopped.
I0327 10:43:54.820460       1 controller.go:254] Source scaController *sca.Controller is not ready
I0327 10:43:54.820476       1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready
I0327 10:43:54.820480       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0327 10:43:54.820484       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0327 10:43:54.820486       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0327 10:43:54.820505       1 controller.go:531] The operator is still being initialized
I0327 10:43:54.820511       1 controller.go:554] The operator is healthy
I0327 10:43:54.822858       1 configmapobserver.go:84] configmaps "insights-config" not found
I0327 10:43:54.827176       1 prometheus_rules.go:88] Prometheus rules successfully created
I0327 10:43:54.829152       1 tasks_processing.go:74] worker 63 stopped.
I0327 10:43:54.829172       1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 102.061455ms to process 0 records
E0327 10:43:54.830485       1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%274a9e5341-cb4b-41b4-8190-06c334005d8a%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.11:47185->172.30.0.10:53: read: connection refused
I0327 10:43:54.830501       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%274a9e5341-cb4b-41b4-8190-06c334005d8a%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.11:47185->172.30.0.10:53: read: connection refused
I0327 10:43:54.838508       1 tasks_processing.go:74] worker 5 stopped.
E0327 10:43:54.838530       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found
E0327 10:43:54.838537       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found
E0327 10:43:54.838541       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found
I0327 10:43:54.838553       1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=7c953bef0cdbddb25a47a3c40772dfa7cbf73ae2ac9bb3dc97984dbf1bd43499
I0327 10:43:54.838591       1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d
I0327 10:43:54.838599       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a
I0327 10:43:54.838603       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=4bec6f0bfa45f0ccf5709371166150dcb9cf2703d04f5f6de4476d0277c477a6
I0327 10:43:54.838608       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
I0327 10:43:54.838646       1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0
I0327 10:43:54.838654       1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d
I0327 10:43:54.838659       1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 115.569102ms to process 7 records
I0327 10:43:54.870829       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
W0327 10:43:54.875491       1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.11:53338->172.30.0.10:53: read: connection refused
I0327 10:43:54.875510       1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.129.0.11:53338->172.30.0.10:53: read: connection refused
I0327 10:43:54.899201       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0327 10:43:54.899237       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0327 10:43:54.916109       1 tasks_processing.go:74] worker 3 stopped.
E0327 10:43:54.916133       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found
E0327 10:43:54.916142       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pa0ron8lulpu1e8444fbruk00uofggt-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pa0ron8lulpu1e8444fbruk00uofggt-primary-cert-bundle-secret" not found
I0327 10:43:54.916213       1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=808550eecb809e1535b8e62d44452f2dfab6733ec80cc08e1ddda5e0ef3d975a
I0327 10:43:54.916245       1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 190.83414ms to process 1 records
I0327 10:43:54.927182       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found
I0327 10:43:54.939550       1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found
W0327 10:43:55.749058       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0327 10:43:56.001679       1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers
I0327 10:43:56.001696       1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes
I0327 10:43:56.001941       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-7g89t pod in namespace openshift-dns (previous: false).
I0327 10:43:56.231610       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7g89t pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-7g89t\" is waiting to start: ContainerCreating"
I0327 10:43:56.231630       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-7g89t\" is waiting to start: ContainerCreating"
I0327 10:43:56.231639       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-7g89t pod in namespace openshift-dns (previous: false).
I0327 10:43:56.236813       1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found
I0327 10:43:56.407368       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-7g89t pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-7g89t\" is waiting to start: ContainerCreating"
I0327 10:43:56.407389       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-7g89t\" is waiting to start: ContainerCreating"
I0327 10:43:56.407403       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-mt6bq pod in namespace openshift-dns (previous: false).
I0327 10:43:56.606515       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mt6bq pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-mt6bq\" is waiting to start: ContainerCreating"
I0327 10:43:56.606537       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-mt6bq\" is waiting to start: ContainerCreating"
I0327 10:43:56.606546       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-mt6bq pod in namespace openshift-dns (previous: false).
I0327 10:43:56.639005       1 tasks_processing.go:74] worker 9 stopped.
I0327 10:43:56.639062       1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=112d0ff370dfc004e0b99c064365aa3760542ae978410424de6335a4250654e8
I0327 10:43:56.639104       1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=d14141b73126247c86a3e7efb508e5ff4a88b6f00f2cd840832d9e112e030faf
I0327 10:43:56.639135       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e
I0327 10:43:56.639160       1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=1c1ff24a858b0a7dda92f6c09ccf2c5404e8622b58688356ecd9dcc3bff445ea
I0327 10:43:56.639177       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f
I0327 10:43:56.639236       1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=9e3a001d03a607c965e02727891a413e761385142fbb045324d84509111ede8a
I0327 10:43:56.639267       1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=dcf37c382d6ca6dd1106d1f1268af1457e07bcb7e86fe8bb4d6cf989458880eb
I0327 10:43:56.639290       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ce0dd1a250de91fada16080a2eea5f32dc69cae339148ef860f6dc75da9e651b
I0327 10:43:56.639303       1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=0d4055f27f2216ed92cfc5e499d0709f96893ed8d0c1fa88ec40a0bbd2b43388
I0327 10:43:56.639321       1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=d9be034c37aa22799e23cbebeb1e3280117a46d7903618f7f67405b6283ea06a
I0327 10:43:56.639330       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762
I0327 10:43:56.639346       1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=d265bed956b2858b369da0468f62193c3e8891093589ea7c8e29442e5e8deb29
I0327 10:43:56.639357       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11
I0327 10:43:56.639374       1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=fb98e7bc98162763c23abf9680dadc31b5d3842f259cafe03ba3967c5b7cb14f
I0327 10:43:56.639382       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a
I0327 10:43:56.639404       1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=e40092f2e739c2da0181d4b01c51330fd52ddb2bbb3df6264d5d1496b77e6e98
I0327 10:43:56.639413       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db
I0327 10:43:56.639427       1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=048b03c68057655b8a2d72d2dea79d58497d3f8e94e1411e3133c4ccced94dab
I0327 10:43:56.639589       1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=b3b1734de7f5368e00cae6c0b7b6b464f9cb32e448bf34d744355966c7a65415
I0327 10:43:56.639600       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab
I0327 10:43:56.639607       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d
I0327 10:43:56.639631       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75
I0327 10:43:56.639653       1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=471d70139f98eee61f5a095e7cf6f8b70fc8c403fd1c906953f7d87841b44a57
I0327 10:43:56.639677       1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=26842bf6019125cd722dcee2bbf52c76cdb31f38b3c449de50449a1ee35b9318
I0327 10:43:56.639688       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76
I0327 10:43:56.639705       1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=c55a0cc64d41b7dedd2bad0ea4ed050fdfef112c4c2ca0dbc541be0863245ad0
I0327 10:43:56.639715       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7
I0327 10:43:56.639728       1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=c4f43fac96c97f64ff5886e9764c3312d9d97b352b2fe1e1d782978d5bf09c18
I0327 10:43:56.639741       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=f3c76ef11d3e91182c611e0ef93809b5319d7922738643c168924e9b12a2c5b2
I0327 10:43:56.639754       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=12ab5f8034c64266249f941d2db477687c14d55a40a4b1f21f3fa11d2f46363e
I0327 10:43:56.639770       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=ba666d9ebe5254ee69a4f949bd3bc6101f98ca0b2f7d616f5836b0380adccf31
I0327 10:43:56.639783       1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=c311a8dd55f338a864ace6ca6f283bb67da72564d023c5e381055d8001ace997
I0327 10:43:56.639807       1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=79cceef2830a67a6d2cd18798078ca43d27edf293fd271bb03a97970714acdb5
I0327 10:43:56.639824       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e
I0327 10:43:56.639831       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad
I0327 10:43:56.639837       1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.912560911s to process 35 records
W0327 10:43:56.749826       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0327 10:43:56.807169       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-mt6bq pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-mt6bq\" is waiting to start: ContainerCreating"
I0327 10:43:56.807188       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-mt6bq\" is waiting to start: ContainerCreating"
I0327 10:43:56.807199       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-nlrwr pod in namespace openshift-dns (previous: false).
I0327 10:43:57.023347       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0327 10:43:57.023368       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-t5km4 pod in namespace openshift-dns (previous: false).
I0327 10:43:57.208042       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0327 10:43:57.208061       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-wjnkl pod in namespace openshift-dns (previous: false).
I0327 10:43:57.415938       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0327 10:43:57.415960       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-747b8fcfd7-nsslh pod in namespace openshift-image-registry (previous: false).
I0327 10:43:57.601759       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0327 10:43:57.601778       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7d555f8896-77spw pod in namespace openshift-image-registry (previous: false).
W0327 10:43:57.749555       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0327 10:43:57.810536       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7d555f8896-77spw pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7d555f8896-77spw\" is waiting to start: ContainerCreating"
I0327 10:43:57.810557       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7d555f8896-77spw\" is waiting to start: ContainerCreating"
I0327 10:43:57.810569       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7d555f8896-kw7fv pod in namespace openshift-image-registry (previous: false).
I0327 10:43:58.006970       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7d555f8896-kw7fv pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7d555f8896-kw7fv\" is waiting to start: ContainerCreating"
I0327 10:43:58.006990       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7d555f8896-kw7fv\" is waiting to start: ContainerCreating"
I0327 10:43:58.007000       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-2kzqm pod in namespace openshift-image-registry (previous: false).
I0327 10:43:58.208055       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0327 10:43:58.208076       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-fx4hg pod in namespace openshift-image-registry (previous: false).
I0327 10:43:58.408298       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0327 10:43:58.408317       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-tjh5f pod in namespace openshift-image-registry (previous: false).
I0327 10:43:58.607284       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0327 10:43:58.607305       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-74dcd44967-jf8ds pod in namespace openshift-ingress (previous: false).
W0327 10:43:58.749174       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0327 10:43:58.810824       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-74dcd44967-jf8ds pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-74dcd44967-jf8ds\" is waiting to start: ContainerCreating"
I0327 10:43:58.810844       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-74dcd44967-jf8ds\" is waiting to start: ContainerCreating"
I0327 10:43:58.810857       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-74dcd44967-wtg8q pod in namespace openshift-ingress (previous: false).
I0327 10:43:59.008186       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-74dcd44967-wtg8q pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-74dcd44967-wtg8q\" is waiting to start: ContainerCreating"
I0327 10:43:59.008235       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-74dcd44967-wtg8q\" is waiting to start: ContainerCreating"
I0327 10:43:59.008247       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-76b469cc7f-gq7d4 pod in namespace openshift-ingress (previous: false).
I0327 10:43:59.212757       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-76b469cc7f-gq7d4 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-76b469cc7f-gq7d4\" is waiting to start: ContainerCreating"
I0327 10:43:59.212776       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-76b469cc7f-gq7d4\" is waiting to start: ContainerCreating"
I0327 10:43:59.212790       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-w8sv8 pod in namespace openshift-ingress-canary (previous: false).
I0327 10:43:59.408301       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-xtj7s pod in namespace openshift-ingress-canary (previous: false).
I0327 10:43:59.607446       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-854b5fb5c9-dsd66 pod in namespace openshift-kube-storage-version-migrator (previous: false).
W0327 10:43:59.749341       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0327 10:43:59.749370       1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0327 10:43:59.749388       1 tasks_processing.go:74] worker 13 stopped.
E0327 10:43:59.749399       1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0327 10:43:59.749411       1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
W0327 10:43:59.749425       1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics"
I0327 10:43:59.749433       1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.025587167s to process 1 records
I0327 10:43:59.807521       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-854b5fb5c9-dsd66 pod in namespace openshift-kube-storage-version-migrator (previous: false).
I0327 10:44:00.008562       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-6ff64bb8b6-4whrj pod in namespace openshift-kube-storage-version-migrator-operator (previous: false).
I0327 10:44:00.209316       1 tasks_processing.go:74] worker 47 stopped.
I0327 10:44:00.209429       1 recorder.go:75] Recording events/openshift-dns with fingerprint=09532dd39de739617f2a3f8637db21617dc1c6e870b88da83cee587e756eb89f
I0327 10:44:00.209531       1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=50436fefcd4db283a8f6844fccf33de98cc657c97f37dfe1914284174715ea65
I0327 10:44:00.209562       1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=838ab1d524b1c563a20df39405600fdfd03bb2ccca135adb813a8eee82a7bbb0
I0327 10:44:00.209609       1 recorder.go:75] Recording events/openshift-ingress with fingerprint=1c9487464f7deb2f88420b4a0aeea63242946f03b2b4ab1ff9363a66413a7133
I0327 10:44:00.209639       1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=06f1b0c0f0e2ddeeb1b99717d7cef4db879b3e81f2e1773a09e67875e0353012
I0327 10:44:00.209656       1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=5989b5bdc6b07c2fe02114334a8d4fecbe259def5334972b94305be066089974
I0327 10:44:00.209703       1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=11e1576213a67c2b08e9080b7d85ab6b6095d4d6db7215d91dc14cbe0f36dfa3
I0327 10:44:00.209710       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-w8sv8/serve-healthcheck-canary_current.log with fingerprint=3e56838b57725daa826ae696c6ec2a60052a93dffbaf0532ab922cb42d501a86
I0327 10:44:00.209715       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-xtj7s/serve-healthcheck-canary_current.log with fingerprint=da112c87f64290d09c538b929fba8ee2c39148f5cbc6ca5612356d780c02e893
I0327 10:44:00.209729       1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-854b5fb5c9-dsd66/migrator_current.log with fingerprint=0e7a9b00f327682b242aa9d0b1f346f24f1b95517fa184d7f85acbe2d0ca9bbf
I0327 10:44:00.209733       1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-854b5fb5c9-dsd66/graceful-termination_current.log with fingerprint=2a8181fc497a2e75d30d50b0026c4416afe7ed69d3f52ff5b5ffefe1d2fcbcf9
I0327 10:44:00.209797       1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-6ff64bb8b6-4whrj/kube-storage-version-migrator-operator_current.log with fingerprint=6065417e0d8dc48bbe823965ed91aea10940b92e585475be87f476cf8fcb9332
I0327 10:44:00.209806       1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 5.484945149s to process 12 records
I0327 10:44:06.808137       1 configmapobserver.go:84] configmaps "insights-config" not found
I0327 10:44:07.365694       1 tasks_processing.go:74] worker 48 stopped.
I0327 10:44:07.365735       1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b
I0327 10:44:07.365748       1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.641584745s to process 1 records
I0327 10:44:08.133983       1 tasks_processing.go:74] worker 55 stopped.
I0327 10:44:08.134285       1 recorder.go:75] Recording config/serviceaccounts with fingerprint=7ddf795073bc5395a95429a28409923bc71b328da94f586bee093d6f578708e6
I0327 10:44:08.134304       1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.407413373s to process 1 records
E0327 10:44:08.134380       1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.411s with: function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error"
I0327 10:44:08.135497       1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error
I0327 10:44:08.135516       1 periodic.go:216] Running workloads gatherer
I0327 10:44:08.135535       1 tasks_processing.go:45] number of workers: 2
I0327 10:44:08.135549       1 tasks_processing.go:69] worker 1 listening for tasks.
I0327 10:44:08.135553       1 tasks_processing.go:71] worker 1 working on workload_info task.
I0327 10:44:08.135566       1 tasks_processing.go:69] worker 0 listening for tasks.
I0327 10:44:08.135583       1 tasks_processing.go:71] worker 0 working on helmchart_info task.
I0327 10:44:08.160527       1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data
I0327 10:44:08.166348       1 tasks_processing.go:74] worker 0 stopped.
I0327 10:44:08.166367       1 gather.go:177] gatherer "workloads" function "helmchart_info" took 30.747078ms to process 0 records
I0327 10:44:08.170347       1 gather_workloads_info.go:387] No image sha256:72ae38682f25786aec18625cfed5d7831017d2f0f1304c3320c00ce0b7fb09c1 (11ms)
I0327 10:44:08.179740       1 gather_workloads_info.go:387] No image sha256:273930332d7b481bbca4521cf740507498a2a323a4010cd66e896806b299f85e (9ms)
I0327 10:44:08.188933       1 gather_workloads_info.go:387] No image sha256:0fd69333c121efd68919e731cd3ea01e976e00415bda6e987bf1e949ec224eda (9ms)
I0327 10:44:08.198009       1 gather_workloads_info.go:387] No image sha256:aa65d1c7fb8805b767fc4878faea280472f372010efadc66e5641a2e634a80c0 (9ms)
I0327 10:44:08.208371       1 gather_workloads_info.go:387] No image sha256:2e3661304917ce7f3be49974faacc60c24cbe2833d7b50c8c205c2f3f2467950 (10ms)
I0327 10:44:08.218130       1 gather_workloads_info.go:387] No image sha256:87de118dc29ca1b47d4768ec5ed4441bc1dada3fb2a78d53b1833249baa86dd4 (10ms)
I0327 10:44:08.227639       1 gather_workloads_info.go:387] No image sha256:2f26472542da4f89a2ac34a93fd438d385419dda16811bdfa7e679e0115abe56 (9ms)
I0327 10:44:08.237365       1 gather_workloads_info.go:387] No image sha256:31e175b644c6627779ca6b9f48d9426760dd449788ad671dd0277cce8fb822e8 (10ms)
I0327 10:44:08.246622       1 gather_workloads_info.go:387] No image sha256:6263faa8ef7759ec21f26df08314c5d64e52d967b49961cb9404c54532c03365 (9ms)
I0327 10:44:08.256271       1 gather_workloads_info.go:387] No image sha256:1e6d59867cbd750672bc9ccfb9c69c3d198174cd43dd6d71a0da358b4b766473 (10ms)
I0327 10:44:08.271434       1 gather_workloads_info.go:387] No image sha256:12448aad6e9050c2b2445035be818a490cef502d39b73dbd51cc0f5ea7d67d40 (15ms)
I0327 10:44:08.378004       1 gather_workloads_info.go:387] No image sha256:4c39dc633bf3560c2397281b74faf9d00500b0738dec6c1aad2cc8ce326be6fc (107ms)
I0327 10:44:08.478644       1 gather_workloads_info.go:387] No image sha256:3da5a449ace61cb7d002d8e7911c14905c74cf58a296527458d1af0f1abf0a72 (101ms)
I0327 10:44:08.571562       1 gather_workloads_info.go:387] No image sha256:66640a3f7bd65090345552611701a73e74bc44897b9d29e43b11f73b96598ac0 (93ms)
I0327 10:44:08.671339       1 gather_workloads_info.go:387] No image sha256:20a3e59566dd25058fff22e18569067fe6a12d8ac5ac62fa6508e0cee44d7897 (100ms)
I0327 10:44:08.770507       1 gather_workloads_info.go:387] No image sha256:ad0e262327997e8cdc4074a2373e67274d9b8a943aa274a2cd8ce98ffe1db4a0 (99ms)
I0327 10:44:08.871500       1 gather_workloads_info.go:387] No image sha256:5b51a4d9d3b7ecad110fb6eb00f71e9e9b854067d79b220df397a58d9fa50eb0 (101ms)
I0327 10:44:08.971032       1 gather_workloads_info.go:387] No image sha256:1b58ba57c10e2ba03a0d8dba1f3f8faa866e1dca6170725b6909c2cc2b96efa6 (100ms)
I0327 10:44:09.070919       1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms)
I0327 10:44:09.171011       1 gather_workloads_info.go:387] No image sha256:6ea0f19030ffc52a290e6eeb812ef2426c48a2f1083b1e415e0667998cbb7bf2 (100ms)
I0327 10:44:09.271627       1 gather_workloads_info.go:387] No image sha256:a20df9dd8819885aa431022c6f5e80b77b4431f268b719d71bec26f10521da0e (101ms)
I0327 10:44:09.370667       1 gather_workloads_info.go:387] No image sha256:185a95b130b6a27ad88fcf39803215b7bd998472b1e37225858435f4eb7c3c04 (99ms)
I0327 10:44:09.474518       1 gather_workloads_info.go:387] No image sha256:8f72efd51f564d8d3e4ecee6555d7bd5394d0776054d2112febea6b7c9e71225 (104ms)
I0327 10:44:09.571559       1 gather_workloads_info.go:387] No image sha256:4e62a2dcb8214491388d4c17f89fe699eb53cdb8039dcba6ab052edc28da3fbd (97ms)
I0327 10:44:09.671799       1 gather_workloads_info.go:387] No image sha256:3739c0c55f7f7ccc84309ae11eb23d3d9e5ad50a68e849a8a8dfda7f2f2bc137 (100ms)
I0327 10:44:09.771682       1 gather_workloads_info.go:387] No image sha256:a6b085cdad58db8529d99c22ec1ec79fe09ab00ab1c92ee38b29e7875dc0533c (100ms)
I0327 10:44:09.871771       1 gather_workloads_info.go:387] No image sha256:1c5b548d67e5c56e3297b2f8aa34428e544b5b5ac88bd8d0f465760375c501e6 (100ms)
I0327 10:44:09.972581       1 gather_workloads_info.go:387] No image sha256:cfcb0bd30c537e677ac6856c36c0c923b415f24d944c7aa1386489f511f6491d (101ms)
I0327 10:44:10.072516       1 gather_workloads_info.go:387] No image sha256:83344c7d1374cbc2607b4fcb837f094c035b32daf24f8b3ccba2c8df409a6d3c (100ms)
I0327 10:44:10.171660       1 gather_workloads_info.go:387] No image sha256:12aec97ddeb527881acf5949bea2b227baa1dbfccf30679e8d57ff0b82e42707 (99ms)
I0327 10:44:10.271702       1 gather_workloads_info.go:387] No image sha256:2ade6dfb5406ef3a4264dea95d455298f54e8ef4d458d9ee3e94c33d48676a9b (100ms)
I0327 10:44:10.374293       1 gather_workloads_info.go:387] No image sha256:51e1b5dc9fccbee5b7df78d0e8bbe379f75529232c102c9ed5b1ae134c4b9b4c (103ms)
I0327 10:44:10.374325       1 tasks_processing.go:74] worker 1 stopped.
E0327 10:44:10.374348       1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset
I0327 10:44:10.374617       1 recorder.go:75] Recording config/workload_info with fingerprint=2fac41ce31a59ae31e2cadbb03f7fce7f14b22b1eb3c0d58bca36f9ec3609cf7
I0327 10:44:10.374634       1 gather.go:177] gatherer "workloads" function "workload_info" took 2.238765763s to process 1 records
E0327 10:44:10.374658       1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.239s with: function \"workload_info\" failed with an error"
I0327 10:44:10.375762       1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error
I0327 10:44:10.375775       1 periodic.go:216] Running conditional gatherer
I0327 10:44:10.382691       1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.6/gathering_rules
I0327 10:44:10.391080       1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.6/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.11:54044->172.30.0.10:53: read: connection refused
E0327 10:44:10.391446       1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0327 10:44:10.391511       1 conditional_gatherer.go:384] updating version cache for conditional gatherer
I0327 10:44:10.398853       1 conditional_gatherer.go:392] cluster version is '4.21.6'
E0327 10:44:10.398872       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0327 10:44:10.398878       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0327 10:44:10.398881       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0327 10:44:10.398884       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0327 10:44:10.398887       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0327 10:44:10.398890       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0327 10:44:10.398894       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0327 10:44:10.398898       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0327 10:44:10.398902       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
I0327 10:44:10.398925       1 tasks_processing.go:45] number of workers: 3
I0327 10:44:10.398938       1 tasks_processing.go:69] worker 2 listening for tasks.
I0327 10:44:10.398941       1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task.
I0327 10:44:10.398949       1 tasks_processing.go:69] worker 0 listening for tasks.
I0327 10:44:10.398964       1 tasks_processing.go:71] worker 0 working on remote_configuration task.
I0327 10:44:10.398963       1 tasks_processing.go:69] worker 1 listening for tasks.
I0327 10:44:10.398974       1 tasks_processing.go:74] worker 1 stopped.
I0327 10:44:10.398987       1 tasks_processing.go:71] worker 2 working on rapid_container_logs task.
I0327 10:44:10.399055       1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406
I0327 10:44:10.399073       1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.41µs to process 1 records
I0327 10:44:10.399119       1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db
I0327 10:44:10.399130       1 gather.go:177] gatherer "conditional" function "remote_configuration" took 2.05µs to process 1 records
I0327 10:44:10.399138       1 tasks_processing.go:74] worker 0 stopped.
I0327 10:44:10.399340       1 tasks_processing.go:74] worker 2 stopped.
I0327 10:44:10.399360       1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 338.82µs to process 0 records
I0327 10:44:10.399400       1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.6/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.129.0.11:54044->172.30.0.10:53: read: connection refused
I0327 10:44:10.399420       1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1
I0327 10:44:10.424741       1 recorder.go:75] Recording insights-operator/gathers with fingerprint=d2a9376891ac595421821b204b90a52c2325e09abfac46333c1d8025b41a1960
I0327 10:44:10.424878       1 diskrecorder.go:70] Writing 106 records to /var/lib/insights-operator/insights-2026-03-27-104410.tar.gz
I0327 10:44:10.431483       1 diskrecorder.go:51] Wrote 106 records to disk in 6ms
I0327 10:44:10.431527       1 periodic.go:285] Gathering cluster info every 2h0m0s
I0327 10:44:10.431543       1 periodic.go:286] Configuration is 
	dataReporting:
		interval: 2h0m0s,
		uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload,
		storagePath: /var/lib/insights-operator,
		downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, 
		conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules,
		obfuscation: []
	sca:
		disabled: false,
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates,
		interval: 8h0m0s
	alerting:
		disabled: false
	clusterTransfer:
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/,
		interval: 12h0m0s
	proxy:
		httpProxy: ,
		httpsProxy: ,
		noProxy: 
I0327 10:44:11.249900       1 configmapobserver.go:84] configmaps "insights-config" not found
I0327 10:44:11.451859       1 configmapobserver.go:84] configmaps "insights-config" not found
I0327 10:44:17.613016       1 configmapobserver.go:84] configmaps "insights-config" not found
I0327 10:45:24.278682       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="1f5bce4a09c97cacf60c10343bc2010b9fae1425374fa82f2de34519e5163ffe")
W0327 10:45:24.278713       1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created
I0327 10:45:24.278756       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="1ff7e53e827d1602be00f1aac85167115a3031b2930181a05087a0a4dc94502a")
I0327 10:45:24.278786       1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated"
I0327 10:45:24.278818       1 base_controller.go:181] Shutting down ConfigController ...
I0327 10:45:24.278824       1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped"
I0327 10:45:24.278831       1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector
I0327 10:45:24.278843       1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="a7f8b577a12a812d609066aeb8f6e43598d9280e1a2fdde0f9ec921253a3b787")
I0327 10:45:24.278849       1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain"
I0327 10:45:24.278860       1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting"
I0327 10:45:24.278866       1 periodic.go:177] Shutting down
I0327 10:45:24.278886       1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0327 10:45:24.278886       1 base_controller.go:123] Shutting down worker of ConfigController controller ...
I0327 10:45:24.278895       1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController"
I0327 10:45:24.278901       1 base_controller.go:113] All ConfigController workers have been terminated
E0327 10:45:24.278908       1 controller.go:341] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled
I0327 10:45:24.278916       1 secure_serving.go:258] Stopped listening on [::]:8443
I0327 10:45:24.278918       1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ...
I0327 10:45:24.278926       1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0327 10:45:24.278934       1 genericapiserver.go:600] "[graceful-termination] shutdown event" name="HTTPServerStoppedListening"
I0327 10:45:24.278944       1 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/tmp/serving-cert-3442349225/tls.crt::/tmp/serving-cert-3442349225/tls.key"
E0327 10:45:24.278947       1 controller.go:341] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled
I0327 10:45:24.278916       1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController