W0320 12:40:34.105732       1 cmd.go:257] Using insecure, self-signed certificates
I0320 12:40:34.628392       1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0320 12:40:34.628772       1 observer_polling.go:159] Starting file observer
I0320 12:40:35.524297       1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$
I0320 12:40:35.524496       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0320 12:40:35.525032       1 secure_serving.go:57] Forcing use of http/1.1 only
W0320 12:40:35.525073       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0320 12:40:35.525084       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0320 12:40:35.525092       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
W0320 12:40:35.525096       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
W0320 12:40:35.525100       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
W0320 12:40:35.525103       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0320 12:40:35.525106       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
I0320 12:40:35.541323       1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot]
I0320 12:40:35.541343       1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"6c7e1aeb-0176-4bee-a645-795b44f0d4ae", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
I0320 12:40:35.543833       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0320 12:40:35.543853       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0320 12:40:35.543892       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0320 12:40:35.543908       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0320 12:40:35.543891       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0320 12:40:35.543926       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0320 12:40:35.544785       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3458849705/tls.crt::/tmp/serving-cert-3458849705/tls.key"
I0320 12:40:35.545004       1 secure_serving.go:213] Serving securely on [::]:8443
I0320 12:40:35.545027       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
W0320 12:40:35.557283       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0320 12:40:35.557309       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0320 12:40:35.557418       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0320 12:40:35.570782       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0320 12:40:35.570803       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0320 12:40:35.578250       1 secretconfigobserver.go:119] support secret does not exist
I0320 12:40:35.588664       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0320 12:40:35.597663       1 secretconfigobserver.go:119] support secret does not exist
I0320 12:40:35.597870       1 recorder.go:176] Pruning old reports every 7h35m12s, max age is 288h0m0s
I0320 12:40:35.607905       1 periodic.go:216] Running clusterconfig gatherer
I0320 12:40:35.607914       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0320 12:40:35.607932       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s
I0320 12:40:35.607945       1 tasks_processing.go:45] number of workers: 32
I0320 12:40:35.607958       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0320 12:40:35.607965       1 insightsreport.go:296] Starting report retriever
I0320 12:40:35.607971       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0320 12:40:35.607973       1 tasks_processing.go:69] worker 7 listening for tasks.
I0320 12:40:35.607980       1 tasks_processing.go:69] worker 31 listening for tasks.
I0320 12:40:35.607983       1 tasks_processing.go:69] worker 12 listening for tasks.
I0320 12:40:35.607990       1 tasks_processing.go:69] worker 18 listening for tasks.
I0320 12:40:35.607987       1 tasks_processing.go:69] worker 17 listening for tasks.
I0320 12:40:35.607997       1 tasks_processing.go:71] worker 18 working on infrastructures task.
I0320 12:40:35.608000       1 tasks_processing.go:69] worker 4 listening for tasks.
I0320 12:40:35.608001       1 tasks_processing.go:69] worker 8 listening for tasks.
I0320 12:40:35.608006       1 tasks_processing.go:69] worker 13 listening for tasks.
I0320 12:40:35.608011       1 tasks_processing.go:69] worker 9 listening for tasks.
I0320 12:40:35.608022       1 tasks_processing.go:69] worker 14 listening for tasks.
I0320 12:40:35.608024       1 tasks_processing.go:69] worker 5 listening for tasks.
I0320 12:40:35.608026       1 tasks_processing.go:69] worker 10 listening for tasks.
I0320 12:40:35.608031       1 tasks_processing.go:69] worker 15 listening for tasks.
I0320 12:40:35.608035       1 tasks_processing.go:69] worker 6 listening for tasks.
I0320 12:40:35.607983       1 tasks_processing.go:71] worker 7 working on container_images task.
I0320 12:40:35.608040       1 tasks_processing.go:69] worker 16 listening for tasks.
I0320 12:40:35.608048       1 tasks_processing.go:69] worker 29 listening for tasks.
I0320 12:40:35.608076       1 tasks_processing.go:69] worker 26 listening for tasks.
I0320 12:40:35.608084       1 tasks_processing.go:69] worker 27 listening for tasks.
I0320 12:40:35.608085       1 tasks_processing.go:69] worker 25 listening for tasks.
I0320 12:40:35.608092       1 tasks_processing.go:69] worker 19 listening for tasks.
I0320 12:40:35.608096       1 tasks_processing.go:69] worker 28 listening for tasks.
I0320 12:40:35.607990       1 tasks_processing.go:71] worker 12 working on cluster_apiserver task.
I0320 12:40:35.608105       1 tasks_processing.go:69] worker 20 listening for tasks.
I0320 12:40:35.608114       1 tasks_processing.go:69] worker 21 listening for tasks.
I0320 12:40:35.608123       1 tasks_processing.go:69] worker 22 listening for tasks.
I0320 12:40:35.608132       1 tasks_processing.go:69] worker 23 listening for tasks.
I0320 12:40:35.608143       1 tasks_processing.go:69] worker 24 listening for tasks.
I0320 12:40:35.608153       1 tasks_processing.go:69] worker 30 listening for tasks.
I0320 12:40:35.608162       1 tasks_processing.go:69] worker 1 listening for tasks.
I0320 12:40:35.608170       1 tasks_processing.go:69] worker 0 listening for tasks.
I0320 12:40:35.608183       1 tasks_processing.go:71] worker 0 working on qemu_kubevirt_launcher_logs task.
I0320 12:40:35.607990       1 tasks_processing.go:71] worker 31 working on silenced_alerts task.
W0320 12:40:35.608271       1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0320 12:40:35.608310       1 tasks_processing.go:71] worker 31 working on node_logs task.
I0320 12:40:35.608336       1 tasks_processing.go:71] worker 8 working on machines task.
I0320 12:40:35.608458       1 tasks_processing.go:69] worker 3 listening for tasks.
I0320 12:40:35.608471       1 tasks_processing.go:71] worker 3 working on olm_operators task.
I0320 12:40:35.608036       1 tasks_processing.go:69] worker 11 listening for tasks.
I0320 12:40:35.608328       1 tasks_processing.go:71] worker 17 working on oauths task.
I0320 12:40:35.608359       1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 56.81µs to process 0 records
I0320 12:40:35.608375       1 tasks_processing.go:69] worker 2 listening for tasks.
I0320 12:40:35.608322       1 tasks_processing.go:71] worker 29 working on image_registries task.
I0320 12:40:35.608333       1 tasks_processing.go:71] worker 4 working on config_maps task.
I0320 12:40:35.608735       1 tasks_processing.go:71] worker 11 working on support_secret task.
I0320 12:40:35.608388       1 tasks_processing.go:71] worker 26 working on mutating_webhook_configurations task.
I0320 12:40:35.608389       1 tasks_processing.go:71] worker 5 working on metrics task.
W0320 12:40:35.608963       1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0320 12:40:35.608979       1 tasks_processing.go:71] worker 5 working on dvo_metrics task.
I0320 12:40:35.608392       1 tasks_processing.go:71] worker 27 working on install_plans task.
I0320 12:40:35.609104       1 gather.go:177] gatherer "clusterconfig" function "metrics" took 41.559µs to process 0 records
I0320 12:40:35.608395       1 tasks_processing.go:71] worker 25 working on sap_config task.
I0320 12:40:35.608396       1 tasks_processing.go:71] worker 13 working on storage_classes task.
I0320 12:40:35.608399       1 tasks_processing.go:71] worker 19 working on machine_sets task.
I0320 12:40:35.608400       1 tasks_processing.go:71] worker 9 working on machine_configs task.
I0320 12:40:35.608403       1 tasks_processing.go:71] worker 28 working on monitoring_persistent_volumes task.
I0320 12:40:35.608405       1 tasks_processing.go:71] worker 14 working on lokistack task.
I0320 12:40:35.608409       1 tasks_processing.go:71] worker 15 working on sap_datahubs task.
I0320 12:40:35.608411       1 tasks_processing.go:71] worker 23 working on pdbs task.
I0320 12:40:35.608413       1 tasks_processing.go:71] worker 10 working on authentication task.
I0320 12:40:35.608415       1 tasks_processing.go:71] worker 21 working on version task.
I0320 12:40:35.608418       1 tasks_processing.go:71] worker 30 working on image_pruners task.
I0320 12:40:35.608419       1 tasks_processing.go:71] worker 22 working on certificate_signing_requests task.
I0320 12:40:35.608422       1 tasks_processing.go:71] worker 24 working on nodenetworkconfigurationpolicies task.
I0320 12:40:35.608428       1 tasks_processing.go:71] worker 6 working on jaegers task.
I0320 12:40:35.608430       1 tasks_processing.go:71] worker 1 working on openstack_dataplanedeployments task.
I0320 12:40:35.608433       1 tasks_processing.go:71] worker 16 working on overlapping_namespace_uids task.
I0320 12:40:35.608735       1 tasks_processing.go:71] worker 2 working on nodenetworkstates task.
I0320 12:40:35.608384       1 tasks_processing.go:71] worker 20 working on operators task.
I0320 12:40:35.614572       1 tasks_processing.go:71] worker 8 working on container_runtime_configs task.
E0320 12:40:35.614585       1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope
I0320 12:40:35.614598       1 gather.go:177] gatherer "clusterconfig" function "machines" took 6.114597ms to process 0 records
I0320 12:40:35.617028       1 tasks_processing.go:71] worker 25 working on schedulers task.
I0320 12:40:35.617067       1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 7.59491ms to process 0 records
I0320 12:40:35.618465       1 tasks_processing.go:71] worker 19 working on feature_gates task.
I0320 12:40:35.618480       1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 8.50782ms to process 0 records
I0320 12:40:35.618594       1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 6.880542ms to process 0 records
I0320 12:40:35.618603       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 5.900716ms to process 0 records
I0320 12:40:35.618607       1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 4.000493ms to process 0 records
I0320 12:40:35.618619       1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 5.924468ms to process 0 records
I0320 12:40:35.618623       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 5.706988ms to process 0 records
I0320 12:40:35.618628       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 5.821427ms to process 0 records
I0320 12:40:35.618628       1 tasks_processing.go:71] worker 24 working on node_features task.
I0320 12:40:35.618642       1 tasks_processing.go:71] worker 15 working on service_accounts task.
I0320 12:40:35.618650       1 tasks_processing.go:71] worker 8 working on openshift_logging task.
I0320 12:40:35.618666       1 tasks_processing.go:71] worker 14 working on validating_webhook_configurations task.
I0320 12:40:35.618696       1 tasks_processing.go:71] worker 2 working on pod_network_connectivity_checks task.
I0320 12:40:35.618738       1 tasks_processing.go:71] worker 6 working on cost_management_metrics_configs task.
I0320 12:40:35.618632       1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 6.915662ms to process 0 records
I0320 12:40:35.618775       1 tasks_processing.go:71] worker 1 working on ingress task.
I0320 12:40:35.620934       1 tasks_processing.go:71] worker 12 working on openstack_version task.
I0320 12:40:35.621165       1 recorder.go:75] Recording config/apiserver with fingerprint=82467fb4657fab7993424cc82b1d6b16abeb58cbea5b0f75d2bac01768b83722
I0320 12:40:35.621181       1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 12.823547ms to process 1 records
I0320 12:40:35.621335       1 tasks_processing.go:71] worker 18 working on image task.
I0320 12:40:35.621773       1 recorder.go:75] Recording config/infrastructure with fingerprint=dc36347d8e96217e81fdbe06ece33e993afba4cae4bf1fa68c0b7755dce1766b
I0320 12:40:35.621784       1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 13.325514ms to process 1 records
E0320 12:40:35.626636       1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed)
I0320 12:40:35.626656       1 tasks_processing.go:71] worker 9 working on openshift_machine_api_events task.
E0320 12:40:35.626651       1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io)
I0320 12:40:35.626739       1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499
I0320 12:40:35.626756       1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 16.5007ms to process 1 records
I0320 12:40:35.626767       1 gather.go:177] gatherer "clusterconfig" function "node_features" took 8.01159ms to process 0 records
E0320 12:40:35.626774       1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found
I0320 12:40:35.626781       1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 17.983085ms to process 0 records
I0320 12:40:35.626789       1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 8.123185ms to process 0 records
I0320 12:40:35.626798       1 tasks_processing.go:71] worker 8 working on tsdb_status task.
I0320 12:40:35.626809       1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 5.859099ms to process 0 records
W0320 12:40:35.626828       1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0320 12:40:35.626843       1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 36.888µs to process 0 records
I0320 12:40:35.626852       1 tasks_processing.go:71] worker 8 working on ingress_certificates task.
I0320 12:40:35.626895       1 tasks_processing.go:71] worker 24 working on number_of_pods_and_netnamespaces_with_sdn_annotations task.
I0320 12:40:35.627085       1 tasks_processing.go:71] worker 17 working on clusterroles task.
I0320 12:40:35.627177       1 tasks_processing.go:71] worker 12 working on machine_config_pools task.
I0320 12:40:35.627199       1 tasks_processing.go:71] worker 11 working on sap_pods task.
I0320 12:40:35.627436       1 recorder.go:75] Recording config/oauth with fingerprint=4244bdb3f23edc920d50ea1b62d9676a3ef53d46fd01e75328646249b6c817e6
I0320 12:40:35.627454       1 gather.go:177] gatherer "clusterconfig" function "oauths" took 18.567389ms to process 1 records
I0320 12:40:35.627669       1 tasks_processing.go:71] worker 30 working on ceph_cluster task.
I0320 12:40:35.627693       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=83776731085341481d6f98e2ae1abd756ff72ef133e5331350db0cf2cc8d1a03
I0320 12:40:35.627703       1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 14.814889ms to process 1 records
I0320 12:40:35.627781       1 tasks_processing.go:71] worker 10 working on storage_cluster task.
I0320 12:40:35.627918       1 recorder.go:75] Recording config/authentication with fingerprint=10533095d4fa4a26f4e8212b553ce95da45533bf081c9e35d06799e265837839
I0320 12:40:35.627935       1 gather.go:177] gatherer "clusterconfig" function "authentication" took 15.290146ms to process 1 records
I0320 12:40:35.628012       1 tasks_processing.go:71] worker 29 working on nodes task.
I0320 12:40:35.628140       1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z
I0320 12:40:35.628161       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0320 12:40:35.628168       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0320 12:40:35.628173       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0320 12:40:35.628190       1 controller.go:531] The operator is still being initialized
I0320 12:40:35.628201       1 controller.go:554] The operator is healthy
I0320 12:40:35.628388       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=ca0a16ae525526d60797b3ce9eae768c6b7b15453e88082dc53dc3943ba4b92b
I0320 12:40:35.628473       1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 18.702892ms to process 1 records
I0320 12:40:35.628561       1 tasks_processing.go:71] worker 19 working on active_alerts task.
W0320 12:40:35.628594       1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0320 12:40:35.628615       1 recorder.go:75] Recording config/featuregate with fingerprint=bbca107613f1196ea262fbcf794c704b465272c82efa2c2abf4bded6d8847852
I0320 12:40:35.628624       1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 9.274399ms to process 1 records
I0320 12:40:35.628635       1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 30.939µs to process 0 records
I0320 12:40:35.628640       1 tasks_processing.go:71] worker 19 working on machine_healthchecks task.
I0320 12:40:35.631283       1 tasks_processing.go:71] worker 2 working on machine_autoscalers task.
E0320 12:40:35.631296       1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io)
I0320 12:40:35.631309       1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 12.573119ms to process 0 records
I0320 12:40:35.631490       1 tasks_processing.go:71] worker 6 working on openstack_controlplanes task.
I0320 12:40:35.631541       1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 12.739986ms to process 0 records
I0320 12:40:35.631822       1 tasks_processing.go:71] worker 13 working on proxies task.
I0320 12:40:35.632224       1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=270cdd6ec66022d8edae1e195e5f5f16a96aefebb882f32e46beb6baf1828d89
I0320 12:40:35.632357       1 gather_logs.go:145] no pods in  namespace were found
I0320 12:40:35.632451       1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=97a3f5dfa484d68a4ece18f9e15701a28a7a1ef6cce85048ef9e0c571e5f52e1
I0320 12:40:35.632471       1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 22.016136ms to process 2 records
I0320 12:40:35.632481       1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 23.486219ms to process 0 records
I0320 12:40:35.632487       1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 20.408414ms to process 0 records
I0320 12:40:35.632505       1 tasks_processing.go:71] worker 3 working on crds task.
I0320 12:40:35.632574       1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=957e1947baac75e4f0ffee28af05dd2595f7f370b66dd4fd5aa357214b22ce66
I0320 12:40:35.632585       1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 15.187401ms to process 1 records
I0320 12:40:35.632689       1 tasks_processing.go:71] worker 23 working on aggregated_monitoring_cr_names task.
I0320 12:40:35.632749       1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=46bf71bf7a54db29b1aaaad1b4f9020a8cb8dd6ab63403dfac8ec4429d139f24
I0320 12:40:35.632792       1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=0edf047a109cc1417b3bcd4dffdca334d8850715e67156573e88b08811121a6b
I0320 12:40:35.632822       1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=e4459c1902091eeff321cc5a6b51e78e1175e8795282c65204335e58d5d62770
I0320 12:40:35.632847       1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 20.558104ms to process 3 records
I0320 12:40:35.633555       1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 24.184469ms to process 0 records
I0320 12:40:35.633680       1 tasks_processing.go:71] worker 0 working on networks task.
I0320 12:40:35.633962       1 tasks_processing.go:71] worker 25 working on openstack_dataplanenodesets task.
I0320 12:40:35.634459       1 tasks_processing.go:71] worker 28 working on operators_pods_and_events task.
I0320 12:40:35.634778       1 tasks_processing.go:74] worker 26 stopped.
I0320 12:40:35.635461       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=c310a66d1ae5c99aa3129e6dae8621377302e3610889f7dd7b62dbc94ade7d61
I0320 12:40:35.635609       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=bee47ec50784536f26e6d53e159a023ec19296a84cf1697bde637eb57a65f32a
I0320 12:40:35.635739       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=efa8826c5022e9d377da49109bd5f9d392bd47730feace43ad694e4fc0d56a79
I0320 12:40:35.635776       1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 25.928139ms to process 3 records
I0320 12:40:35.635806       1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 26.650374ms to process 0 records
I0320 12:40:35.635834       1 tasks_processing.go:74] worker 31 stopped.
I0320 12:40:35.635897       1 tasks_processing.go:74] worker 22 stopped.
I0320 12:40:35.635911       1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 23.39549ms to process 0 records
I0320 12:40:35.637161       1 tasks_processing.go:74] worker 11 stopped.
I0320 12:40:35.637180       1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 9.950824ms to process 0 records
I0320 12:40:35.637740       1 tasks_processing.go:74] worker 1 stopped.
I0320 12:40:35.637940       1 recorder.go:75] Recording config/ingress with fingerprint=8428187bc4ac3a6449d2b817bbbbf0063974eba1c94f5e12568c7aeef9d5b6ae
I0320 12:40:35.637960       1 gather.go:177] gatherer "clusterconfig" function "ingress" took 18.94809ms to process 1 records
W0320 12:40:35.639252       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0320 12:40:35.639426       1 tasks_processing.go:74] worker 30 stopped.
I0320 12:40:35.639442       1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 11.742632ms to process 0 records
I0320 12:40:35.639461       1 tasks_processing.go:74] worker 12 stopped.
I0320 12:40:35.639468       1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 12.270298ms to process 0 records
I0320 12:40:35.639522       1 tasks_processing.go:74] worker 18 stopped.
I0320 12:40:35.639614       1 recorder.go:75] Recording config/image with fingerprint=0f12dfb21c78d7efb3a0079ca74c455781fa5948367e2f332af02bf56b6370e7
I0320 12:40:35.639630       1 gather.go:177] gatherer "clusterconfig" function "image" took 18.175285ms to process 1 records
I0320 12:40:35.640089       1 tasks_processing.go:74] worker 10 stopped.
I0320 12:40:35.640108       1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 12.292615ms to process 0 records
I0320 12:40:35.641287       1 tasks_processing.go:74] worker 6 stopped.
I0320 12:40:35.641303       1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 9.781215ms to process 0 records
I0320 12:40:35.641316       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 7.25994ms to process 0 records
I0320 12:40:35.641323       1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 9.991324ms to process 0 records
E0320 12:40:35.641330       1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope
I0320 12:40:35.641349       1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 12.654461ms to process 0 records
I0320 12:40:35.641352       1 tasks_processing.go:74] worker 25 stopped.
I0320 12:40:35.641361       1 tasks_processing.go:74] worker 19 stopped.
I0320 12:40:35.641367       1 tasks_processing.go:74] worker 2 stopped.
I0320 12:40:35.641770       1 tasks_processing.go:74] worker 14 stopped.
I0320 12:40:35.642001       1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=ab93ccc83fff79a352bbeb5756f2297ede2f265e3f2187126ff5dbe77ad4ed09
I0320 12:40:35.642221       1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=4f081647adf129e932b82f3a806a096df7911944d9c1e2e88f756894ea097e91
I0320 12:40:35.642265       1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=5afafa0a5d2ca1b38fc8072d1df73cbb5abd0f7054e2ff4061f42b9cbf5867e1
I0320 12:40:35.642291       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=f6fef4a96ea7f67b666fb417542c86406663b0f8075b2bec897a4a1426d6d5c2
I0320 12:40:35.642315       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=3f06c081787968673ad9526f0398a3cc94b90b81f0c91561c90cc0acbfc11c9b
I0320 12:40:35.642357       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=4928aa1aa34e7714c2a934d14a2d69509975f1cf2f439b8c944610c6d7d0c3d8
I0320 12:40:35.642388       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=834a05bd2b38cfd128b7b3e50fee17f9dce1abc42274179901b252915a02b113
I0320 12:40:35.642433       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=12ac2dd7da056ca10553d1be7acc090d85a6275c9144b7596954778c40e169f5
I0320 12:40:35.642459       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=6a2fd0af5e0c3742b516e1581412bb2d0f4df498f9215f30d87a488d59d92215
I0320 12:40:35.642486       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=c63f97d402c6d25bf6f2e047a5a32ab1b9a3c9f79dc33a78bae43e5ea7bc4021
I0320 12:40:35.642515       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=7a98923a8839169b8b9b553959fd562cf8a02355126b073c253088c480fc2fbe
I0320 12:40:35.642524       1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 23.078189ms to process 11 records
I0320 12:40:35.642541       1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
I0320 12:40:35.642548       1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 29.45094ms to process 1 records
I0320 12:40:35.642556       1 tasks_processing.go:74] worker 16 stopped.
I0320 12:40:35.644359       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0320 12:40:35.644398       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0320 12:40:35.644435       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0320 12:40:35.647097       1 tasks_processing.go:74] worker 9 stopped.
I0320 12:40:35.647155       1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 20.428721ms to process 0 records
I0320 12:40:35.648857       1 tasks_processing.go:74] worker 7 stopped.
I0320 12:40:35.650881       1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-5b5d9b4544-686cs with fingerprint=f380c1a0ab24df4a8c8e9797cf8b497adfc9730eec5f0d53ddb16ffe1b35ccf8
I0320 12:40:35.651150       1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-w7mvs with fingerprint=21ee55883469dfb5cd5fa2e67ca4c5e163fbd5d4448396cafd8a6fb6ebab29e7
I0320 12:40:35.651205       1 recorder.go:75] Recording config/running_containers with fingerprint=3c3b36c008e2e8cb9092764ca02f0af785ff0b44a2c0bdc1d0d357fd34b6555a
I0320 12:40:35.651215       1 gather.go:177] gatherer "clusterconfig" function "container_images" took 40.806449ms to process 3 records
I0320 12:40:35.653677       1 tasks_processing.go:74] worker 0 stopped.
I0320 12:40:35.653844       1 recorder.go:75] Recording config/network with fingerprint=d6aa9376a16afa15812954326591985217bac7e43c4752e25aacda218dfeb618
I0320 12:40:35.653874       1 gather.go:177] gatherer "clusterconfig" function "networks" took 19.960971ms to process 1 records
I0320 12:40:35.654355       1 tasks_processing.go:74] worker 13 stopped.
I0320 12:40:35.654416       1 recorder.go:75] Recording config/proxy with fingerprint=8aa73932790004e3578b349402ebeee5733c75e4d038ddb7d7ab7b24f54eb8bd
I0320 12:40:35.654430       1 gather.go:177] gatherer "clusterconfig" function "proxies" took 22.51722ms to process 1 records
I0320 12:40:35.656647       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
I0320 12:40:35.656663       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
W0320 12:40:35.656853       1 operator.go:328] started
I0320 12:40:35.656874       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
I0320 12:40:35.657298       1 tasks_processing.go:74] worker 17 stopped.
I0320 12:40:35.657543       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=bfa5b21dbb8a15002b6c16e67abab2b351f4a0cb08ab95ebe1b2f5c52763ae06
I0320 12:40:35.657710       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=053e6ef1fb4367c86571ab5c871c7743f58005d9d788c11d941c6412fb527c86
I0320 12:40:35.657726       1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 30.195838ms to process 2 records
I0320 12:40:35.657751       1 base_controller.go:82] Caches are synced for ConfigController 
I0320 12:40:35.657761       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
I0320 12:40:35.663899       1 tasks_processing.go:74] worker 21 stopped.
I0320 12:40:35.664219       1 recorder.go:75] Recording config/version with fingerprint=a67b40791e860b131207beef17fc200835641c9af43a27434960634c66c7c88e
I0320 12:40:35.664236       1 recorder.go:75] Recording config/id with fingerprint=0c109ba90bf073c3b7203c1cf9ff91ebfb30339eb3997e2741411daf06af957a
I0320 12:40:35.664246       1 gather.go:177] gatherer "clusterconfig" function "version" took 51.668662ms to process 2 records
I0320 12:40:35.670042       1 prometheus_rules.go:88] Prometheus rules successfully created
I0320 12:40:35.670609       1 controller.go:254] Source scaController *sca.Controller is not ready
I0320 12:40:35.670623       1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready
I0320 12:40:35.670628       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0320 12:40:35.670633       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0320 12:40:35.670637       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0320 12:40:35.670658       1 controller.go:531] The operator is still being initialized
I0320 12:40:35.670674       1 controller.go:554] The operator is healthy
I0320 12:40:35.673165       1 tasks_processing.go:74] worker 3 stopped.
I0320 12:40:35.673941       1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=369ee133f54ede17587e7e06afae1833ad6f1641ac4fa9ce21e67eef91f33f96
I0320 12:40:35.674304       1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=0da6e614b7b10d9fb108c111ada56a4eed332fbbcd6c6a5c340766529faec59e
I0320 12:40:35.674321       1 gather.go:177] gatherer "clusterconfig" function "crds" took 40.642074ms to process 2 records
E0320 12:40:35.679511       1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%276d0aeff8-5003-450c-924a-9ce21390b8c4%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:37020->172.30.0.10:53: read: connection refused
I0320 12:40:35.679523       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%276d0aeff8-5003-450c-924a-9ce21390b8c4%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:37020->172.30.0.10:53: read: connection refused
I0320 12:40:35.680693       1 tasks_processing.go:74] worker 24 stopped.
I0320 12:40:35.680735       1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 53.784789ms to process 0 records
I0320 12:40:35.680792       1 configmapobserver.go:84] configmaps "insights-config" not found
I0320 12:40:35.681150       1 tasks_processing.go:74] worker 23 stopped.
I0320 12:40:35.681171       1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 48.409549ms to process 0 records
I0320 12:40:35.696386       1 tasks_processing.go:74] worker 4 stopped.
E0320 12:40:35.696401       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found
E0320 12:40:35.696412       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found
E0320 12:40:35.696415       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found
I0320 12:40:35.696425       1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=c8a9805405aae7d04b7f03c09c51097942070877009b6daebd5573ef8127446e
I0320 12:40:35.696460       1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d
I0320 12:40:35.696467       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a
I0320 12:40:35.696471       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=3b70b9787487b548204d806ebebf90b0c2d460145e34cb33c0d8d3a7a011d907
I0320 12:40:35.696475       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
I0320 12:40:35.696566       1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0
I0320 12:40:35.696577       1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d
I0320 12:40:35.696586       1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 87.675705ms to process 7 records
I0320 12:40:35.729215       1 tasks_processing.go:74] worker 29 stopped.
I0320 12:40:35.729668       1 recorder.go:75] Recording config/node/ip-10-0-0-209.ec2.internal with fingerprint=d99467fd6c2772a3b52793e5b46c62d355b2e1e6d8e3ff3bf4b250cffd9d8cd9
I0320 12:40:35.729796       1 recorder.go:75] Recording config/node/ip-10-0-1-246.ec2.internal with fingerprint=35b026788945ac375b6371b872fe4a51b90879e75fee6d0ac8e7c735ac16b301
I0320 12:40:35.729900       1 recorder.go:75] Recording config/node/ip-10-0-2-155.ec2.internal with fingerprint=c983f51374ad9e5cb37a61f97fc53783150fdfc78bae398db184e5190f61baa9
I0320 12:40:35.729915       1 gather.go:177] gatherer "clusterconfig" function "nodes" took 101.1788ms to process 3 records
I0320 12:40:35.742522       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
W0320 12:40:35.746017       1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:38127->172.30.0.10:53: read: connection refused
I0320 12:40:35.746031       1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:38127->172.30.0.10:53: read: connection refused
I0320 12:40:35.756926       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0320 12:40:35.756944       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0320 12:40:35.778009       1 tasks_processing.go:74] worker 8 stopped.
E0320 12:40:35.778025       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found
E0320 12:40:35.778032       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2p5etjbdo3k0bg4iueo4ra70s5l4l6pc-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2p5etjbdo3k0bg4iueo4ra70s5l4l6pc-primary-cert-bundle-secret" not found
I0320 12:40:35.778118       1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=47fa5f270c202650841f9f68dc5ad3063f08cf993d9c1b2c8325362e11549323
I0320 12:40:35.778132       1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 151.143015ms to process 1 records
I0320 12:40:36.066739       1 gather_cluster_operator_pods_and_events.go:121] Found 14 pods with 15 containers
I0320 12:40:36.066756       1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1677721 bytes
I0320 12:40:36.067262       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-x2vt9 pod in namespace openshift-dns (previous: false).
I0320 12:40:36.291952       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-x2vt9 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-x2vt9\" is waiting to start: ContainerCreating"
I0320 12:40:36.291969       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-x2vt9\" is waiting to start: ContainerCreating"
I0320 12:40:36.291977       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-x2vt9 pod in namespace openshift-dns (previous: false).
I0320 12:40:36.471197       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-x2vt9 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-x2vt9\" is waiting to start: ContainerCreating"
I0320 12:40:36.471218       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-x2vt9\" is waiting to start: ContainerCreating"
I0320 12:40:36.471230       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-6k7hv pod in namespace openshift-dns (previous: false).
W0320 12:40:36.636696       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0320 12:40:36.705300       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0320 12:40:36.705322       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-mspz5 pod in namespace openshift-dns (previous: false).
I0320 12:40:36.875782       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0320 12:40:36.875807       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-zw87r pod in namespace openshift-dns (previous: false).
I0320 12:40:37.054933       1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found
I0320 12:40:37.105424       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-resolver-zw87r pod in namespace openshift-dns for failing operator dns-node-resolver (previous: false): "container \"dns-node-resolver\" in pod \"node-resolver-zw87r\" is waiting to start: ContainerCreating"
I0320 12:40:37.105441       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns-node-resolver\" in pod \"node-resolver-zw87r\" is waiting to start: ContainerCreating"
I0320 12:40:37.105452       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7685b59c-4kffp pod in namespace openshift-image-registry (previous: false).
I0320 12:40:37.271535       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0320 12:40:37.271555       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-b669b9498-bkmnf pod in namespace openshift-image-registry (previous: false).
I0320 12:40:37.457622       1 tasks_processing.go:74] worker 20 stopped.
I0320 12:40:37.457671       1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=d82549bd3562c704cfd64fbdf4556faaf10fbad6437313faa8cc280f04255002
I0320 12:40:37.457708       1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=886aba238e52cd1b17be701daf3ea790d92e518962183748d7f2a98d95e58c0f
I0320 12:40:37.457735       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e
I0320 12:40:37.457759       1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=4050b822809250041363b91b05d261a722c3b64c85ba6b60aa314915b3ad9020
I0320 12:40:37.457790       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f
I0320 12:40:37.457813       1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=bea951ef5b54055ffa1c651fbd7c00da88d6d58173d4aa13249b16a5d3bcd6aa
I0320 12:40:37.457859       1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=245c642ca6d77db7a5d861cc7108d12098be04b115d0e310d9476f3fe311411b
I0320 12:40:37.457890       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=6562e339c683a741610a36006abf5b483a04178d7b8b1a77a594eed393dd01d9
I0320 12:40:37.457906       1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=9a74a8205530992c1e1b0ec87d8ec47c611ded2432e7d4d10dbc7d7bbde8763b
I0320 12:40:37.457924       1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=1a6234a194078e9a0d2a140ec35f832f962850ff80b68985b92e2aa92ff6060a
I0320 12:40:37.457934       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762
I0320 12:40:37.457951       1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=d550df24991d35ae47ff1f8221dea9eaf3bc52c3962f012d5368ccf35db58705
I0320 12:40:37.457962       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11
I0320 12:40:37.457977       1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=fa412b25dba811f88271170c89ceaa4b4c0806414dce200508325a39e336af28
I0320 12:40:37.457984       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a
I0320 12:40:37.458003       1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=43b6cfa59876142d301002582ff336cdd831e85ea8503bfe7b9d0c8d2dfd4952
I0320 12:40:37.458034       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db
I0320 12:40:37.458072       1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=8323c644b7cd9a5270eebee3e275be0674ceed6bf2e84021dcb4156326b7cbc7
I0320 12:40:37.458203       1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=ecb31091f0655bb99595e7d18af89152e178a67bfbd8f3357b7e9bcefc77fd4e
I0320 12:40:37.458214       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab
I0320 12:40:37.458221       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d
I0320 12:40:37.458240       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75
I0320 12:40:37.458263       1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=bb47c7e865824f7b9582b5b976699adb868c5684d798fc3fba9cab059dc8b4cb
I0320 12:40:37.458285       1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=883660e4be4fe90d0a36d8e7e902ffa53daf284d7f15d42622bfd9cbb76ea18a
I0320 12:40:37.458294       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76
I0320 12:40:37.458311       1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=76fc85f966e811f08c56efc5f583f14edc8cb59547af093602222ef364970435
I0320 12:40:37.458321       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7
I0320 12:40:37.458335       1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=909e527f562333175048f1e5fa5e58531f22649f7a06d83004549f77fafdfcb7
I0320 12:40:37.458348       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=d8b87fc56b345d9fb2447821b6a1d90fb75f1737a6ad6d65636e29819d26aa04
I0320 12:40:37.458362       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=af9dcb68f8ff32b79253fc049038cea732b64735e1f0d48280e9258ec13a9082
I0320 12:40:37.458379       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=f22b5dbf744a12f08d23219414ad79820ff8697ac7a07690c298fdbb8119e0c8
I0320 12:40:37.458390       1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=c27bf16a3740ef3f2bb3bea1f6d1b43a20cac56d9e8502b156b8d083e0726313
I0320 12:40:37.458414       1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=ec838845c3f5b3858e57cee976fd2ae79ce9d1ccce037d2a52d3bf07bb82013d
I0320 12:40:37.458430       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e
I0320 12:40:37.458436       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad
I0320 12:40:37.458442       1 gather.go:177] gatherer "clusterconfig" function "operators" took 1.84461965s to process 35 records
I0320 12:40:37.466134       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0320 12:40:37.466147       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-b669b9498-d9dhc pod in namespace openshift-image-registry (previous: false).
W0320 12:40:37.636785       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0320 12:40:37.673247       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-b669b9498-d9dhc pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-b669b9498-d9dhc\" is waiting to start: ContainerCreating"
I0320 12:40:37.673265       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-b669b9498-d9dhc\" is waiting to start: ContainerCreating"
I0320 12:40:37.673276       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-g7rww pod in namespace openshift-image-registry (previous: false).
I0320 12:40:37.871965       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for node-ca-g7rww pod in namespace openshift-image-registry for failing operator node-ca (previous: false): "container \"node-ca\" in pod \"node-ca-g7rww\" is waiting to start: ContainerCreating"
I0320 12:40:37.871983       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"node-ca\" in pod \"node-ca-g7rww\" is waiting to start: ContainerCreating"
I0320 12:40:37.871994       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-g7wdt pod in namespace openshift-image-registry (previous: false).
I0320 12:40:38.071712       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0320 12:40:38.071730       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-t9wcd pod in namespace openshift-image-registry (previous: false).
I0320 12:40:38.272244       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0320 12:40:38.272266       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5774cb4f57-7gvb5 pod in namespace openshift-ingress (previous: false).
I0320 12:40:38.472700       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5774cb4f57-7gvb5 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5774cb4f57-7gvb5\" is waiting to start: ContainerCreating"
I0320 12:40:38.472720       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5774cb4f57-7gvb5\" is waiting to start: ContainerCreating"
I0320 12:40:38.472731       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-86967b9448-9d4vz pod in namespace openshift-ingress (previous: false).
W0320 12:40:38.637162       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0320 12:40:38.665873       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0320 12:40:38.665892       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-86967b9448-fcfbs pod in namespace openshift-ingress (previous: false).
I0320 12:40:38.871754       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-86967b9448-fcfbs pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-86967b9448-fcfbs\" is waiting to start: ContainerCreating"
I0320 12:40:38.871776       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-86967b9448-fcfbs\" is waiting to start: ContainerCreating"
I0320 12:40:38.871786       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-bjlhf pod in namespace openshift-ingress-canary (previous: false).
I0320 12:40:39.072407       1 tasks_processing.go:74] worker 28 stopped.
I0320 12:40:39.072503       1 recorder.go:75] Recording events/openshift-dns with fingerprint=98c9f37177f529402cc11a801f6dfedc3a19937cddd34fb486052583e65109ae
I0320 12:40:39.072602       1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=42c0d20847ad0ac48a48a8efe2cb0c7f5aca4bf25012c644de9ac1f72a7b5a49
I0320 12:40:39.072632       1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=1e2ef370724c24753fdec60b66aa1173f2f61673a61115175cd78f0771b22a1a
I0320 12:40:39.072680       1 recorder.go:75] Recording events/openshift-ingress with fingerprint=d1cb810beda0caef855893ab34c64f8c5ce266c06fff0c048ead16e650028059
I0320 12:40:39.072702       1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=d14a2a8594f7f8383b2856b5b6d9d8f33c98941be1d10ed15d77821f3fa94cb3
I0320 12:40:39.072710       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-bjlhf/serve-healthcheck-canary_current.log with fingerprint=690b69a18baf10a0968722dd877a040952312426d2d671864b19478f09e9f83c
I0320 12:40:39.072717       1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 3.437881127s to process 6 records
W0320 12:40:39.636306       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0320 12:40:40.632102       1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0320 12:40:40.632129       1 tasks_processing.go:74] worker 5 stopped.
E0320 12:40:40.632143       1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0320 12:40:40.632158       1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
W0320 12:40:40.632178       1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics"
I0320 12:40:40.632191       1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.023140766s to process 1 records
I0320 12:40:48.249445       1 tasks_processing.go:74] worker 27 stopped.
I0320 12:40:48.249486       1 recorder.go:75] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b
I0320 12:40:48.249498       1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.640363902s to process 1 records
I0320 12:40:49.027711       1 tasks_processing.go:74] worker 15 stopped.
I0320 12:40:49.027973       1 recorder.go:75] Recording config/serviceaccounts with fingerprint=7ddf795073bc5395a95429a28409923bc71b328da94f586bee093d6f578708e6
I0320 12:40:49.027989       1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.409048964s to process 1 records
E0320 12:40:49.028047       1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.42s with: function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error"
I0320 12:40:49.029174       1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error
I0320 12:40:49.029188       1 periodic.go:216] Running workloads gatherer
I0320 12:40:49.029206       1 tasks_processing.go:45] number of workers: 2
I0320 12:40:49.029219       1 tasks_processing.go:69] worker 1 listening for tasks.
I0320 12:40:49.029224       1 tasks_processing.go:71] worker 1 working on workload_info task.
I0320 12:40:49.029233       1 tasks_processing.go:69] worker 0 listening for tasks.
I0320 12:40:49.029244       1 tasks_processing.go:71] worker 0 working on helmchart_info task.
I0320 12:40:49.054726       1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data
I0320 12:40:49.056273       1 tasks_processing.go:74] worker 0 stopped.
I0320 12:40:49.056289       1 gather.go:177] gatherer "workloads" function "helmchart_info" took 27.017101ms to process 0 records
I0320 12:40:49.064759       1 gather_workloads_info.go:387] No image sha256:1aabd00f813e1afccdab16a845e6346288f5cf7e320fa5bb97c683702191c575 (12ms)
I0320 12:40:49.074304       1 gather_workloads_info.go:387] No image sha256:bbb5af28bbed69e8189825fdc6665f4e8dbcd0c0c83fa479943ea102fe9452d6 (10ms)
I0320 12:40:49.086479       1 gather_workloads_info.go:387] No image sha256:5efa227ddac82e56eddc03761e220af1f2d6a4b22ee00b2baf426523f26c0319 (12ms)
I0320 12:40:49.095380       1 gather_workloads_info.go:387] No image sha256:0c90ca6acbe2f4fdbd253ae22f5b3286247c6940321f7d2b9801aea21ef5269f (9ms)
I0320 12:40:49.104986       1 gather_workloads_info.go:387] No image sha256:3e262d5207d5e2077e4a14f4fbddc70d4d2651dbaaf955147013feb58a18cddd (10ms)
I0320 12:40:49.113880       1 gather_workloads_info.go:387] No image sha256:41e0dcd2f91df9234249f168b3fbe6d55cfdb3ebd2e598d5edfa47f905c046cb (9ms)
I0320 12:40:49.123646       1 gather_workloads_info.go:387] No image sha256:11a864539ae77a94afcf8d2e1abf9168081c5081a1bc06088f4be5206cdc02df (10ms)
I0320 12:40:49.134077       1 gather_workloads_info.go:387] No image sha256:04ee35aa6f87e954d386228808017cf2938c5a96a052059c6767078d5f3ad8d6 (10ms)
I0320 12:40:49.143315       1 gather_workloads_info.go:387] No image sha256:7ea1ff613255c1ee67b34ec82b68ec6f5a4a6d283620a8e0ad142d4a31eb9211 (9ms)
I0320 12:40:49.152775       1 gather_workloads_info.go:387] No image sha256:1c325fa866a794c56a7b30ca9d4fe225606566651bb12a2ecce8f60cbddb2809 (9ms)
I0320 12:40:49.163646       1 gather_workloads_info.go:387] No image sha256:9aee9be2da68239a2a559e3ca1211eb8988a7f83a4ff82b9bd7c21a436be9c22 (11ms)
I0320 12:40:49.264095       1 gather_workloads_info.go:387] No image sha256:dd6a017092d57ab3a6663f3822a0fa0e3bce4365859d9522dd173405276cd49a (100ms)
I0320 12:40:49.363766       1 gather_workloads_info.go:387] No image sha256:25d9148ea34149935323231c64952679727b6f7f235febc3be1df63e0bf18c5e (100ms)
I0320 12:40:49.431303       1 configmapobserver.go:84] configmaps "insights-config" not found
I0320 12:40:49.466637       1 gather_workloads_info.go:387] No image sha256:50b7c5185c4a6e63145753415c92723c59136d14b951ea0f4f06739b00893329 (103ms)
I0320 12:40:49.564858       1 gather_workloads_info.go:387] No image sha256:79fca57a4fd5ef00472a287218b84061b941905c61fcc55e89073dd93fa77648 (98ms)
I0320 12:40:49.631164       1 configmapobserver.go:84] configmaps "insights-config" not found
I0320 12:40:49.663442       1 gather_workloads_info.go:387] No image sha256:26e4f5b039a340bc1ae080fb9d92799700b57ae5df45120768f516682d6cc54b (99ms)
I0320 12:40:49.763862       1 gather_workloads_info.go:387] No image sha256:188e4e2d697e2ca3c7c16772c0ab12253f00bd8433d8691ed7058fe7bafbbbf4 (100ms)
I0320 12:40:49.864172       1 gather_workloads_info.go:387] No image sha256:17e68da37c74bdc95a4eb43b51ce671027807ee610a4ee5237324a8c0dc9d044 (100ms)
I0320 12:40:49.963673       1 gather_workloads_info.go:387] No image sha256:3e889ea85c9c4748c548b84ae135a8adc88f42026ce8073538ca2fe7d89b8004 (99ms)
I0320 12:40:50.064109       1 gather_workloads_info.go:387] No image sha256:07f14370b57046dc2ac49be933bb2248aaf5943e8fb56ce9703eaa7c673b999f (100ms)
I0320 12:40:50.164023       1 gather_workloads_info.go:387] No image sha256:a45c25e5322761a9268bbaf5bdf3436d4623f42b90cd15942df0e5c22755e3ac (100ms)
I0320 12:40:50.263446       1 gather_workloads_info.go:387] No image sha256:2a4f6a54cd5135c8121832236063419071fa5d00c10a051c197d3d01370e4d9c (99ms)
I0320 12:40:50.364941       1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (101ms)
I0320 12:40:50.464722       1 gather_workloads_info.go:387] No image sha256:77d8ddf2957025a39616328b5cf2b012de6cedce63fb79eebc5270d7b3401574 (100ms)
I0320 12:40:50.563614       1 gather_workloads_info.go:387] No image sha256:ff8a8892f37210c582b3e526cbd2652b02ef9007d57be12b404434374dd0116a (99ms)
I0320 12:40:50.664458       1 gather_workloads_info.go:387] No image sha256:ab32e70fb149ae7470c941ca73bcfe9eba540bd5058a3d697a3ddf96597d0132 (101ms)
I0320 12:40:50.764495       1 gather_workloads_info.go:387] No image sha256:1bf773bc4ec02bf6d68c82f32175366b01fb24f6da8c724b7621748692aec7dc (100ms)
I0320 12:40:50.841844       1 configmapobserver.go:84] configmaps "insights-config" not found
I0320 12:40:50.865525       1 gather_workloads_info.go:387] No image sha256:7dd9584d291967387f2a1ade991ad3bf8565bb59f49b013217951399e8273498 (101ms)
I0320 12:40:50.967167       1 gather_workloads_info.go:387] No image sha256:0b2cc6aadb1abc1d35a55da0c9884eb9426d7ff7a97174daeb09bb1e1a23cfae (102ms)
I0320 12:40:51.064615       1 gather_workloads_info.go:387] No image sha256:db40a3d4e50016c645fdb4a1f389dfcdbc9febc10c174816d681abe5c14153cd (97ms)
I0320 12:40:51.168029       1 gather_workloads_info.go:387] No image sha256:c85dd52f4140690eef0d762834ab8b9af2faedbbd3bd9dd5616d4cd0bebd4740 (103ms)
I0320 12:40:51.263470       1 gather_workloads_info.go:387] No image sha256:04c7a2673571e9069c934d86b4308c0f57b2715b45db500837b7708ae1f20ae7 (95ms)
I0320 12:40:51.363644       1 gather_workloads_info.go:387] No image sha256:862d5befeba504d5058264cf65f16fc307eea4eb3914fbbbf40fbe61714b0958 (100ms)
I0320 12:40:51.464519       1 gather_workloads_info.go:387] No image sha256:60648d27017709a420e43353f9a83d7c466017b3b771200672a4dbc3c3f7a3ae (101ms)
I0320 12:40:51.564740       1 gather_workloads_info.go:387] No image sha256:05376e7e2304d22dd866d8e25dd1e5ff8988b2232059fadfd12cb440af785635 (100ms)
I0320 12:40:51.564778       1 tasks_processing.go:74] worker 1 stopped.
E0320 12:40:51.564792       1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset
I0320 12:40:51.565040       1 recorder.go:75] Recording config/workload_info with fingerprint=0ea546298d6c30cd7b59a6c6db52f7af75232d2f622f3bd3192b8be8f2cd7522
I0320 12:40:51.565078       1 gather.go:177] gatherer "workloads" function "workload_info" took 2.535543901s to process 1 records
E0320 12:40:51.565125       1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.535s with: function \"workload_info\" failed with an error"
I0320 12:40:51.566239       1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error
I0320 12:40:51.566255       1 periodic.go:216] Running conditional gatherer
I0320 12:40:51.571098       1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.5/gathering_rules
I0320 12:40:51.578405       1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.5/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:34555->172.30.0.10:53: read: connection refused
E0320 12:40:51.578734       1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0320 12:40:51.578791       1 conditional_gatherer.go:384] updating version cache for conditional gatherer
I0320 12:40:51.583844       1 conditional_gatherer.go:392] cluster version is '4.21.5'
E0320 12:40:51.583858       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0320 12:40:51.583862       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0320 12:40:51.583865       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0320 12:40:51.583870       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0320 12:40:51.583873       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0320 12:40:51.583876       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0320 12:40:51.583879       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0320 12:40:51.583882       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0320 12:40:51.583884       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
I0320 12:40:51.583899       1 tasks_processing.go:45] number of workers: 3
I0320 12:40:51.583910       1 tasks_processing.go:69] worker 2 listening for tasks.
I0320 12:40:51.583915       1 tasks_processing.go:71] worker 2 working on remote_configuration task.
I0320 12:40:51.583921       1 tasks_processing.go:69] worker 0 listening for tasks.
I0320 12:40:51.583928       1 tasks_processing.go:69] worker 1 listening for tasks.
I0320 12:40:51.583934       1 tasks_processing.go:71] worker 0 working on rapid_container_logs task.
I0320 12:40:51.583935       1 tasks_processing.go:74] worker 1 stopped.
I0320 12:40:51.583952       1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task.
I0320 12:40:51.583963       1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db
I0320 12:40:51.583972       1 gather.go:177] gatherer "conditional" function "remote_configuration" took 852ns to process 1 records
I0320 12:40:51.584027       1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406
I0320 12:40:51.584035       1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.645µs to process 1 records
I0320 12:40:51.584041       1 tasks_processing.go:74] worker 2 stopped.
I0320 12:40:51.584212       1 tasks_processing.go:74] worker 0 stopped.
I0320 12:40:51.584224       1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 269.701µs to process 0 records
I0320 12:40:51.584242       1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.5/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:34555->172.30.0.10:53: read: connection refused
I0320 12:40:51.584260       1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1
I0320 12:40:51.605500       1 recorder.go:75] Recording insights-operator/gathers with fingerprint=c0acb1882755c6f11caa50a078523596dcb09faafaa3c2ac7026a96e66bd8341
I0320 12:40:51.605621       1 diskrecorder.go:70] Writing 101 records to /var/lib/insights-operator/insights-2026-03-20-124051.tar.gz
I0320 12:40:51.612529       1 diskrecorder.go:51] Wrote 101 records to disk in 6ms
I0320 12:40:51.612556       1 periodic.go:285] Gathering cluster info every 2h0m0s
I0320 12:40:51.612569       1 periodic.go:286] Configuration is 
	dataReporting:
		interval: 2h0m0s,
		uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload,
		storagePath: /var/lib/insights-operator,
		downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, 
		conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules,
		obfuscation: []
	sca:
		disabled: false,
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates,
		interval: 8h0m0s
	alerting:
		disabled: false
	clusterTransfer:
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/,
		interval: 12h0m0s
	proxy:
		httpProxy: ,
		httpsProxy: ,
		noProxy: 
I0320 12:41:01.251226       1 configmapobserver.go:84] configmaps "insights-config" not found
I0320 12:41:44.629349       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="6f6b5be2f55c29c9def5e9288d46c108bd77d291567fc9c670eaf8d00c174d91")
W0320 12:41:44.629389       1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created
I0320 12:41:44.629446       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="1dde1707e486c698c608e22e5b71e72b2755494697f161c8fb2988177d5a51fa")
I0320 12:41:44.629458       1 periodic.go:177] Shutting down