W0420 11:40:30.391911       1 cmd.go:257] Using insecure, self-signed certificates
I0420 11:40:31.051000       1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0420 11:40:31.051324       1 observer_polling.go:159] Starting file observer
I0420 11:40:31.806847       1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$
I0420 11:40:31.807070       1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"}
I0420 11:40:31.807616       1 secure_serving.go:57] Forcing use of http/1.1 only
W0420 11:40:31.807643       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected.
W0420 11:40:31.807650       1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected.
W0420 11:40:31.807656       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected.
W0420 11:40:31.807663       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected.
W0420 11:40:31.807667       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected.
W0420 11:40:31.807671       1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected.
I0420 11:40:31.807719       1 simple_featuregate_reader.go:171] Starting feature-gate-detector
I0420 11:40:31.811002       1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot]
I0420 11:40:31.811016       1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"26294ca6-94ef-4244-95ed-8ba8c702c649", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}}
I0420 11:40:31.813599       1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController
I0420 11:40:31.813614       1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0420 11:40:31.813622       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0420 11:40:31.813638       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0420 11:40:31.813634       1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0420 11:40:31.813650       1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0420 11:40:31.814302       1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-4004670063/tls.crt::/tmp/serving-cert-4004670063/tls.key"
I0420 11:40:31.814770       1 secure_serving.go:213] Serving securely on [::]:8443
I0420 11:40:31.814823       1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
W0420 11:40:31.816481       1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used.
I0420 11:40:31.816511       1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0420 11:40:31.816610       1 base_controller.go:76] Waiting for caches to sync for ConfigController
I0420 11:40:31.822830       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0420 11:40:31.822850       1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status
I0420 11:40:31.830316       1 secretconfigobserver.go:119] support secret does not exist
I0420 11:40:31.836049       1 secretconfigobserver.go:249] Found cloud.openshift.com token
I0420 11:40:31.841799       1 secretconfigobserver.go:119] support secret does not exist
I0420 11:40:31.845363       1 recorder.go:176] Pruning old reports every 6h7m11s, max age is 288h0m0s
I0420 11:40:31.850805       1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message=
I0420 11:40:31.850823       1 periodic.go:216] Running clusterconfig gatherer
I0420 11:40:31.850827       1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s
I0420 11:40:31.850866       1 controllerstatus.go:80] name=insightsreport healthy=true reason= message=
I0420 11:40:31.850875       1 tasks_processing.go:45] number of workers: 64
I0420 11:40:31.850879       1 insightsreport.go:296] Starting report retriever
I0420 11:40:31.850886       1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s
I0420 11:40:31.850913       1 tasks_processing.go:69] worker 9 listening for tasks.
I0420 11:40:31.850921       1 tasks_processing.go:69] worker 7 listening for tasks.
I0420 11:40:31.850922       1 tasks_processing.go:69] worker 6 listening for tasks.
I0420 11:40:31.850926       1 tasks_processing.go:69] worker 8 listening for tasks.
I0420 11:40:31.850929       1 tasks_processing.go:69] worker 1 listening for tasks.
I0420 11:40:31.850933       1 tasks_processing.go:69] worker 2 listening for tasks.
I0420 11:40:31.850929       1 tasks_processing.go:69] worker 3 listening for tasks.
I0420 11:40:31.850938       1 tasks_processing.go:71] worker 2 working on openshift_machine_api_events task.
I0420 11:40:31.850934       1 tasks_processing.go:69] worker 4 listening for tasks.
I0420 11:40:31.850942       1 tasks_processing.go:69] worker 0 listening for tasks.
I0420 11:40:31.850939       1 tasks_processing.go:71] worker 1 working on validating_webhook_configurations task.
I0420 11:40:31.850945       1 tasks_processing.go:69] worker 39 listening for tasks.
I0420 11:40:31.850952       1 tasks_processing.go:69] worker 53 listening for tasks.
I0420 11:40:31.850952       1 tasks_processing.go:69] worker 10 listening for tasks.
I0420 11:40:31.850958       1 tasks_processing.go:69] worker 55 listening for tasks.
I0420 11:40:31.850953       1 tasks_processing.go:69] worker 54 listening for tasks.
I0420 11:40:31.850960       1 tasks_processing.go:69] worker 25 listening for tasks.
I0420 11:40:31.850959       1 tasks_processing.go:69] worker 5 listening for tasks.
I0420 11:40:31.850969       1 tasks_processing.go:69] worker 26 listening for tasks.
I0420 11:40:31.850967       1 tasks_processing.go:69] worker 40 listening for tasks.
I0420 11:40:31.850969       1 tasks_processing.go:69] worker 56 listening for tasks.
I0420 11:40:31.850978       1 tasks_processing.go:69] worker 27 listening for tasks.
I0420 11:40:31.850980       1 tasks_processing.go:69] worker 58 listening for tasks.
I0420 11:40:31.850983       1 tasks_processing.go:69] worker 48 listening for tasks.
I0420 11:40:31.850974       1 tasks_processing.go:69] worker 24 listening for tasks.
I0420 11:40:31.850974       1 tasks_processing.go:69] worker 57 listening for tasks.
I0420 11:40:31.850992       1 tasks_processing.go:69] worker 59 listening for tasks.
I0420 11:40:31.850995       1 tasks_processing.go:71] worker 24 working on jaegers task.
I0420 11:40:31.850997       1 tasks_processing.go:71] worker 57 working on openshift_logging task.
I0420 11:40:31.851003       1 tasks_processing.go:69] worker 60 listening for tasks.
I0420 11:40:31.851004       1 tasks_processing.go:69] worker 12 listening for tasks.
I0420 11:40:31.851000       1 tasks_processing.go:69] worker 28 listening for tasks.
I0420 11:40:31.851000       1 tasks_processing.go:69] worker 32 listening for tasks.
I0420 11:40:31.851014       1 tasks_processing.go:69] worker 30 listening for tasks.
I0420 11:40:31.851017       1 tasks_processing.go:69] worker 62 listening for tasks.
I0420 11:40:31.851014       1 tasks_processing.go:69] worker 36 listening for tasks.
I0420 11:40:31.851022       1 tasks_processing.go:69] worker 37 listening for tasks.
I0420 11:40:31.851027       1 tasks_processing.go:69] worker 63 listening for tasks.
I0420 11:40:31.851029       1 tasks_processing.go:71] worker 4 working on image task.
I0420 11:40:31.851032       1 tasks_processing.go:69] worker 31 listening for tasks.
I0420 11:40:31.850988       1 tasks_processing.go:69] worker 46 listening for tasks.
I0420 11:40:31.851039       1 tasks_processing.go:69] worker 45 listening for tasks.
I0420 11:40:31.851042       1 tasks_processing.go:71] worker 39 working on machine_configs task.
I0420 11:40:31.851046       1 tasks_processing.go:71] worker 31 working on install_plans task.
I0420 11:40:31.851049       1 tasks_processing.go:71] worker 45 working on authentication task.
I0420 11:40:31.851047       1 tasks_processing.go:71] worker 8 working on nodenetworkstates task.
I0420 11:40:31.851038       1 tasks_processing.go:71] worker 5 working on container_runtime_configs task.
I0420 11:40:31.851064       1 tasks_processing.go:71] worker 40 working on support_secret task.
I0420 11:40:31.851034       1 tasks_processing.go:69] worker 15 listening for tasks.
I0420 11:40:31.851064       1 tasks_processing.go:71] worker 10 working on openstack_dataplanenodesets task.
I0420 11:40:31.851080       1 tasks_processing.go:69] worker 20 listening for tasks.
I0420 11:40:31.850945       1 tasks_processing.go:69] worker 38 listening for tasks.
I0420 11:40:31.851087       1 tasks_processing.go:69] worker 22 listening for tasks.
I0420 11:40:31.851092       1 tasks_processing.go:71] worker 32 working on monitoring_persistent_volumes task.
I0420 11:40:31.851097       1 tasks_processing.go:71] worker 38 working on storage_classes task.
I0420 11:40:31.851097       1 tasks_processing.go:69] worker 16 listening for tasks.
I0420 11:40:31.851100       1 tasks_processing.go:71] worker 22 working on schedulers task.
I0420 11:40:31.851106       1 tasks_processing.go:71] worker 37 working on operators task.
I0420 11:40:31.851106       1 tasks_processing.go:71] worker 30 working on service_accounts task.
I0420 11:40:31.850990       1 tasks_processing.go:69] worker 29 listening for tasks.
I0420 11:40:31.850995       1 tasks_processing.go:69] worker 34 listening for tasks.
I0420 11:40:31.851002       1 tasks_processing.go:69] worker 41 listening for tasks.
I0420 11:40:31.851026       1 tasks_processing.go:69] worker 14 listening for tasks.
I0420 11:40:31.851010       1 tasks_processing.go:71] worker 25 working on lokistack task.
I0420 11:40:31.851164       1 tasks_processing.go:69] worker 23 listening for tasks.
I0420 11:40:31.851012       1 tasks_processing.go:71] worker 27 working on silenced_alerts task.
I0420 11:40:31.851386       1 tasks_processing.go:69] worker 18 listening for tasks.
I0420 11:40:31.851401       1 tasks_processing.go:71] worker 18 working on machines task.
I0420 11:40:31.851427       1 tasks_processing.go:71] worker 63 working on machine_healthchecks task.
I0420 11:40:31.851465       1 tasks_processing.go:71] worker 23 working on ingress task.
I0420 11:40:31.851011       1 tasks_processing.go:69] worker 61 listening for tasks.
I0420 11:40:31.851508       1 tasks_processing.go:71] worker 20 working on oauths task.
I0420 11:40:31.851519       1 tasks_processing.go:71] worker 34 working on image_pruners task.
I0420 11:40:31.851520       1 tasks_processing.go:71] worker 41 working on container_images task.
I0420 11:40:31.851536       1 tasks_processing.go:71] worker 14 working on ingress_certificates task.
I0420 11:40:31.851635       1 tasks_processing.go:71] worker 61 working on nodes task.
I0420 11:40:31.851008       1 tasks_processing.go:69] worker 35 listening for tasks.
I0420 11:40:31.851043       1 tasks_processing.go:69] worker 49 listening for tasks.
I0420 11:40:31.852247       1 tasks_processing.go:71] worker 49 working on machine_config_pools task.
I0420 11:40:31.851431       1 tasks_processing.go:71] worker 46 working on sap_config task.
I0420 11:40:31.851016       1 tasks_processing.go:69] worker 13 listening for tasks.
I0420 11:40:31.852457       1 tasks_processing.go:71] worker 13 working on image_registries task.
I0420 11:40:31.851013       1 tasks_processing.go:71] worker 54 working on active_alerts task.
W0420 11:40:31.852716       1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0420 11:40:31.852766       1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 68.013µs to process 0 records
I0420 11:40:31.850994       1 tasks_processing.go:69] worker 11 listening for tasks.
I0420 11:40:31.851023       1 tasks_processing.go:69] worker 43 listening for tasks.
I0420 11:40:31.851024       1 tasks_processing.go:71] worker 3 working on version task.
I0420 11:40:31.850988       1 tasks_processing.go:69] worker 33 listening for tasks.
I0420 11:40:31.851031       1 tasks_processing.go:69] worker 44 listening for tasks.
I0420 11:40:31.851027       1 tasks_processing.go:71] worker 56 working on storage_cluster task.
I0420 11:40:31.851034       1 tasks_processing.go:71] worker 9 working on dvo_metrics task.
I0420 11:40:31.853453       1 tasks_processing.go:71] worker 12 working on openstack_dataplanedeployments task.
I0420 11:40:31.853596       1 tasks_processing.go:71] worker 44 working on sap_datahubs task.
I0420 11:40:31.853694       1 tasks_processing.go:71] worker 43 working on pod_network_connectivity_checks task.
I0420 11:40:31.853761       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 2.663592ms to process 0 records
I0420 11:40:31.853620       1 tasks_processing.go:71] worker 11 working on node_logs task.
I0420 11:40:31.851034       1 tasks_processing.go:69] worker 52 listening for tasks.
I0420 11:40:31.851038       1 tasks_processing.go:71] worker 0 working on node_features task.
I0420 11:40:31.853726       1 tasks_processing.go:71] worker 33 working on machine_autoscalers task.
I0420 11:40:31.851038       1 tasks_processing.go:71] worker 7 working on clusterroles task.
I0420 11:40:31.854566       1 tasks_processing.go:71] worker 24 working on machine_sets task.
I0420 11:40:31.854595       1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 3.559616ms to process 0 records
I0420 11:40:31.851043       1 tasks_processing.go:71] worker 6 working on networks task.
I0420 11:40:31.851051       1 tasks_processing.go:69] worker 50 listening for tasks.
I0420 11:40:31.854760       1 tasks_processing.go:71] worker 50 working on operators_pods_and_events task.
I0420 11:40:31.851048       1 tasks_processing.go:71] worker 48 working on openstack_controlplanes task.
I0420 11:40:31.851057       1 tasks_processing.go:71] worker 26 working on cost_management_metrics_configs task.
I0420 11:40:31.851060       1 tasks_processing.go:69] worker 51 listening for tasks.
I0420 11:40:31.851070       1 tasks_processing.go:69] worker 21 listening for tasks.
I0420 11:40:31.851081       1 tasks_processing.go:71] worker 55 working on aggregated_monitoring_cr_names task.
I0420 11:40:31.851091       1 tasks_processing.go:69] worker 17 listening for tasks.
I0420 11:40:31.851101       1 tasks_processing.go:71] worker 36 working on proxies task.
I0420 11:40:31.850973       1 tasks_processing.go:69] worker 47 listening for tasks.
I0420 11:40:31.851162       1 tasks_processing.go:71] worker 62 working on crds task.
I0420 11:40:31.851164       1 tasks_processing.go:71] worker 59 working on openstack_version task.
I0420 11:40:31.851169       1 tasks_processing.go:71] worker 28 working on qemu_kubevirt_launcher_logs task.
I0420 11:40:31.851171       1 tasks_processing.go:71] worker 60 working on tsdb_status task.
I0420 11:40:31.851068       1 tasks_processing.go:69] worker 19 listening for tasks.
I0420 11:40:31.851503       1 tasks_processing.go:71] worker 15 working on sap_pods task.
W0420 11:40:31.851499       1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0420 11:40:31.855027       1 tasks_processing.go:74] worker 27 stopped.
I0420 11:40:31.851015       1 tasks_processing.go:69] worker 42 listening for tasks.
I0420 11:40:31.855050       1 tasks_processing.go:74] worker 42 stopped.
I0420 11:40:31.851015       1 tasks_processing.go:71] worker 58 working on overlapping_namespace_uids task.
I0420 11:40:31.851651       1 tasks_processing.go:71] worker 16 working on number_of_pods_and_netnamespaces_with_sdn_annotations task.
I0420 11:40:31.851668       1 tasks_processing.go:71] worker 29 working on cluster_apiserver task.
I0420 11:40:31.851896       1 tasks_processing.go:71] worker 35 working on pdbs task.
W0420 11:40:31.855608       1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0420 11:40:31.855684       1 tasks_processing.go:71] worker 17 working on config_maps task.
I0420 11:40:31.855794       1 tasks_processing.go:71] worker 47 working on ceph_cluster task.
I0420 11:40:31.853621       1 tasks_processing.go:71] worker 54 working on metrics task.
W0420 11:40:31.855865       1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0420 11:40:31.853737       1 tasks_processing.go:71] worker 8 working on nodenetworkconfigurationpolicies task.
I0420 11:40:31.855932       1 tasks_processing.go:71] worker 21 working on feature_gates task.
I0420 11:40:31.853970       1 tasks_processing.go:71] worker 52 working on infrastructures task.
I0420 11:40:31.855932       1 tasks_processing.go:71] worker 51 working on olm_operators task.
I0420 11:40:31.851035       1 tasks_processing.go:71] worker 53 working on mutating_webhook_configurations task.
I0420 11:40:31.855944       1 tasks_processing.go:71] worker 19 working on certificate_signing_requests task.
I0420 11:40:31.855038       1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 3.64346ms to process 0 records
I0420 11:40:31.856402       1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 711.759µs to process 0 records
I0420 11:40:31.856415       1 gather.go:177] gatherer "clusterconfig" function "metrics" took 26.442µs to process 0 records
I0420 11:40:31.856421       1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 5.223722ms to process 0 records
I0420 11:40:31.856429       1 tasks_processing.go:74] worker 5 stopped.
I0420 11:40:31.856434       1 tasks_processing.go:74] worker 60 stopped.
I0420 11:40:31.856438       1 tasks_processing.go:74] worker 54 stopped.
I0420 11:40:31.857670       1 tasks_processing.go:74] worker 25 stopped.
I0420 11:40:31.857685       1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 6.328725ms to process 0 records
I0420 11:40:31.858353       1 tasks_processing.go:74] worker 18 stopped.
E0420 11:40:31.858365       1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope
I0420 11:40:31.858373       1 gather.go:177] gatherer "clusterconfig" function "machines" took 6.940348ms to process 0 records
I0420 11:40:31.867488       1 tasks_processing.go:74] worker 49 stopped.
I0420 11:40:31.867504       1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 15.194635ms to process 0 records
I0420 11:40:31.867570       1 tasks_processing.go:74] worker 63 stopped.
E0420 11:40:31.867584       1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope
I0420 11:40:31.867595       1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 16.128925ms to process 0 records
I0420 11:40:31.867603       1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 15.219296ms to process 0 records
I0420 11:40:31.867610       1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 13.022291ms to process 0 records
I0420 11:40:31.867616       1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 14.539295ms to process 0 records
I0420 11:40:31.867623       1 tasks_processing.go:74] worker 56 stopped.
I0420 11:40:31.867628       1 tasks_processing.go:74] worker 46 stopped.
I0420 11:40:31.867634       1 tasks_processing.go:74] worker 24 stopped.
I0420 11:40:31.867695       1 tasks_processing.go:74] worker 57 stopped.
E0420 11:40:31.867698       1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed)
I0420 11:40:31.867717       1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z
I0420 11:40:31.867740       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0420 11:40:31.867749       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0420 11:40:31.867757       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0420 11:40:31.867774       1 controller.go:531] The operator is still being initialized
I0420 11:40:31.867718       1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 16.688101ms to process 0 records
I0420 11:40:31.867782       1 controller.go:554] The operator is healthy
I0420 11:40:31.867792       1 gather.go:177] gatherer "clusterconfig" function "node_features" took 13.40246ms to process 0 records
E0420 11:40:31.867803       1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found
I0420 11:40:31.867809       1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 16.690266ms to process 0 records
I0420 11:40:31.867817       1 tasks_processing.go:74] worker 40 stopped.
I0420 11:40:31.867821       1 tasks_processing.go:74] worker 0 stopped.
I0420 11:40:31.867858       1 tasks_processing.go:74] worker 43 stopped.
E0420 11:40:31.867870       1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io)
I0420 11:40:31.867876       1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 14.103498ms to process 0 records
I0420 11:40:31.867882       1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 13.422344ms to process 0 records
E0420 11:40:31.867889       1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io)
I0420 11:40:31.867911       1 tasks_processing.go:74] worker 33 stopped.
I0420 11:40:31.867951       1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499
I0420 11:40:31.867965       1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 16.824512ms to process 1 records
I0420 11:40:31.867971       1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 14.232353ms to process 0 records
I0420 11:40:31.867974       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 16.806629ms to process 0 records
I0420 11:40:31.867978       1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 14.388983ms to process 0 records
I0420 11:40:31.867982       1 tasks_processing.go:74] worker 44 stopped.
I0420 11:40:31.867987       1 tasks_processing.go:74] worker 39 stopped.
I0420 11:40:31.867987       1 tasks_processing.go:74] worker 12 stopped.
I0420 11:40:31.867986       1 tasks_processing.go:74] worker 10 stopped.
I0420 11:40:31.868051       1 tasks_processing.go:74] worker 45 stopped.
I0420 11:40:31.868190       1 recorder.go:75] Recording config/authentication with fingerprint=fd0bf9036a3a5f5bb65ae32abcb57902ef1e2663219f2cc7319673936b7f9ea9
I0420 11:40:31.868200       1 gather.go:177] gatherer "clusterconfig" function "authentication" took 16.867604ms to process 1 records
I0420 11:40:31.868209       1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 17.001773ms to process 0 records
I0420 11:40:31.868225       1 tasks_processing.go:74] worker 2 stopped.
I0420 11:40:31.868287       1 tasks_processing.go:74] worker 23 stopped.
I0420 11:40:31.868326       1 recorder.go:75] Recording config/ingress with fingerprint=3f98900b9cdf2d50a036778b1a774f13c7bb290b89171ce06badc6634c078789
I0420 11:40:31.868335       1 gather.go:177] gatherer "clusterconfig" function "ingress" took 16.709308ms to process 1 records
I0420 11:40:31.868410       1 tasks_processing.go:74] worker 34 stopped.
I0420 11:40:31.868538       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=8afa1bae8212614b2e7c8d1d0b11511313db2047ef69e30ca3e04f70cbb2fcab
I0420 11:40:31.868549       1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 16.675015ms to process 1 records
I0420 11:40:31.868623       1 tasks_processing.go:74] worker 20 stopped.
I0420 11:40:31.868728       1 recorder.go:75] Recording config/oauth with fingerprint=91dd7f8886dda0ffb91b0c5053879437240e24ee7c2709f43c23f0a6435925e2
I0420 11:40:31.868736       1 gather.go:177] gatherer "clusterconfig" function "oauths" took 16.71229ms to process 1 records
I0420 11:40:31.873884       1 tasks_processing.go:74] worker 47 stopped.
I0420 11:40:31.873918       1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 18.066408ms to process 0 records
I0420 11:40:31.873948       1 tasks_processing.go:74] worker 32 stopped.
I0420 11:40:31.873961       1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 22.841888ms to process 0 records
I0420 11:40:31.881710       1 tasks_processing.go:74] worker 59 stopped.
I0420 11:40:31.881727       1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 26.76967ms to process 0 records
I0420 11:40:31.881888       1 tasks_processing.go:74] worker 48 stopped.
I0420 11:40:31.881916       1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 27.015276ms to process 0 records
I0420 11:40:31.881942       1 tasks_processing.go:74] worker 8 stopped.
I0420 11:40:31.881949       1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 26.063941ms to process 0 records
I0420 11:40:31.882330       1 tasks_processing.go:74] worker 38 stopped.
I0420 11:40:31.882465       1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=835bb8aaae4d3db071c3362308995924757ac2530e39cc95f13a024d12a0379f
I0420 11:40:31.882508       1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=90f7f8840468ef2b94f3a19e7fb66bb7c0a261570ed1270074ae8c6f758a567a
I0420 11:40:31.882525       1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 31.224934ms to process 2 records
I0420 11:40:31.882643       1 tasks_processing.go:74] worker 26 stopped.
I0420 11:40:31.882661       1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 27.759647ms to process 0 records
I0420 11:40:31.882758       1 tasks_processing.go:74] worker 15 stopped.
I0420 11:40:31.882768       1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 27.784998ms to process 0 records
I0420 11:40:31.882815       1 tasks_processing.go:74] worker 4 stopped.
I0420 11:40:31.882940       1 recorder.go:75] Recording config/image with fingerprint=9cd17d298124a9a7934604872b191719dc74846d0cc463b61cfeee290b28a3e2
I0420 11:40:31.882958       1 gather.go:177] gatherer "clusterconfig" function "image" took 31.774369ms to process 1 records
I0420 11:40:31.883452       1 tasks_processing.go:74] worker 29 stopped.
I0420 11:40:31.883658       1 recorder.go:75] Recording config/apiserver with fingerprint=e6a48d391dcbe2f27b798adfb2c22d106006d69badc2bc5a15eaf9e71857de0b
I0420 11:40:31.883691       1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 28.308013ms to process 1 records
I0420 11:40:31.883779       1 tasks_processing.go:74] worker 13 stopped.
I0420 11:40:31.884274       1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=ff20105eba3f81a9993f71245109d75e13d9560f3b585afcae0bf920106738dd
I0420 11:40:31.884298       1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 31.166283ms to process 1 records
I0420 11:40:31.887336       1 tasks_processing.go:74] worker 22 stopped.
I0420 11:40:31.887441       1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=312711f8323e2d3a4e2c15aaf7243058018df2981043955e2a525f18921279fb
I0420 11:40:31.887460       1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 36.226308ms to process 1 records
I0420 11:40:31.888467       1 tasks_processing.go:74] worker 11 stopped.
I0420 11:40:31.888534       1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 34.609793ms to process 0 records
I0420 11:40:31.888711       1 tasks_processing.go:74] worker 35 stopped.
I0420 11:40:31.888997       1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=6ad08e012b66bd2ab783169b74eaff859fef898fd3cc1e0ab247b6cbbf6b7513
I0420 11:40:31.889076       1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=0a9794522ed9820445438dcaeff768d90ead43022f48f60213b5e6f8b2cf16b1
I0420 11:40:31.889137       1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=4eb82e7d16675876d8d00929aa805b1a1775b8e5674ceec6f85fcd799662beb3
I0420 11:40:31.889153       1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 33.093423ms to process 3 records
I0420 11:40:31.889270       1 tasks_processing.go:74] worker 61 stopped.
I0420 11:40:31.889329       1 gather_logs.go:145] no pods in  namespace were found
I0420 11:40:31.890155       1 recorder.go:75] Recording config/node/ip-10-0-0-85.ec2.internal with fingerprint=36170bbb37082846294f517f2c19bcb1204ad1e21a73e89612f16ccb19025da8
I0420 11:40:31.890257       1 recorder.go:75] Recording config/node/ip-10-0-1-126.ec2.internal with fingerprint=20991f78d8a8241d4f4ee125e04c082a6b8c03dd41ac4aae16ae4bf41995ee2e
I0420 11:40:31.891056       1 recorder.go:75] Recording config/node/ip-10-0-2-190.ec2.internal with fingerprint=e52c514e961aabe395597a83af768b399dd66bb056b6cccff9acaaa3435c16f9
I0420 11:40:31.891077       1 gather.go:177] gatherer "clusterconfig" function "nodes" took 37.4688ms to process 3 records
I0420 11:40:31.891175       1 tasks_processing.go:74] worker 52 stopped.
I0420 11:40:31.891977       1 recorder.go:75] Recording config/infrastructure with fingerprint=a6c26cb4caf8274050ef567cd229c444b0639b0e295d380b8f9f2fa25feda56e
I0420 11:40:31.891998       1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 33.142518ms to process 1 records
I0420 11:40:31.892008       1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 34.401092ms to process 0 records
I0420 11:40:31.892019       1 tasks_processing.go:74] worker 28 stopped.
I0420 11:40:31.892082       1 tasks_processing.go:74] worker 36 stopped.
I0420 11:40:31.892098       1 recorder.go:75] Recording config/proxy with fingerprint=800a4f3da4124db221ece159539bb0cd6e0d658b64861c3a4bbe8248a23c22f7
I0420 11:40:31.892107       1 gather.go:177] gatherer "clusterconfig" function "proxies" took 34.494818ms to process 1 records
I0420 11:40:31.892189       1 tasks_processing.go:74] worker 53 stopped.
I0420 11:40:31.892358       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=18991b73144ed0f96a8c1a46159115be39b8530fa1c51bbb69eba3ff1b3389a1
I0420 11:40:31.892403       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=287f40177de53987b6bfb00a632f035242f34cbba536cb9aee04a796c7769d72
I0420 11:40:31.892447       1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=bfc7f3139ae73260a93781e52efa315ddb3f7328a7ac1c7a6bdd9e499bb67919
I0420 11:40:31.892459       1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 33.481697ms to process 3 records
I0420 11:40:31.892562       1 tasks_processing.go:74] worker 21 stopped.
I0420 11:40:31.892593       1 recorder.go:75] Recording config/featuregate with fingerprint=6a921e62af941f4ae29f7eb37616f5920caf8945a35045805a198271c16e5c21
I0420 11:40:31.892606       1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 34.169503ms to process 1 records
I0420 11:40:31.892715       1 tasks_processing.go:74] worker 6 stopped.
I0420 11:40:31.892766       1 recorder.go:75] Recording config/network with fingerprint=0b5b212786a1e226903384c955cb969bd86e50be256a5fce9c215bbe26f4ac08
I0420 11:40:31.892781       1 gather.go:177] gatherer "clusterconfig" function "networks" took 36.258018ms to process 1 records
I0420 11:40:31.893698       1 tasks_processing.go:74] worker 58 stopped.
I0420 11:40:31.893724       1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945
I0420 11:40:31.893737       1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 38.627937ms to process 1 records
W0420 11:40:31.894547       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0420 11:40:31.895344       1 operator.go:328] started
I0420 11:40:31.895377       1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer
I0420 11:40:31.895550       1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s
I0420 11:40:31.895556       1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s
I0420 11:40:31.896050       1 tasks_processing.go:74] worker 19 stopped.
I0420 11:40:31.896063       1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 39.785836ms to process 0 records
I0420 11:40:31.901259       1 tasks_processing.go:74] worker 41 stopped.
I0420 11:40:31.902523       1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-lwr79 with fingerprint=0a0abecfeab6c7253910cf2b38d624345a313c0a90e905329217b0698a047965
I0420 11:40:31.902780       1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-5t5cm with fingerprint=35c2cee8acfafe032760a602aa6c4a71fe959c723eaccca93dbbf9615a8650ef
I0420 11:40:31.902824       1 recorder.go:75] Recording config/running_containers with fingerprint=bbcc445403fc6ff510ca0df70be061b69eaaf5742793ebac31d2b56d95d1918a
I0420 11:40:31.902833       1 gather.go:177] gatherer "clusterconfig" function "container_images" took 49.721793ms to process 3 records
I0420 11:40:31.905625       1 tasks_processing.go:74] worker 62 stopped.
I0420 11:40:31.906144       1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=c0883d417dc6682425744b89f1c2d862ad2db123e0d913880f6210a9d7b23da8
I0420 11:40:31.906348       1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=c2b777a1f1c570e008e78be88b7834cc48aff77b96a391d2ac24ef7aa3fef4f8
I0420 11:40:31.906357       1 gather.go:177] gatherer "clusterconfig" function "crds" took 50.689997ms to process 2 records
I0420 11:40:31.906419       1 controller.go:254] Source scaController *sca.Controller is not ready
I0420 11:40:31.906435       1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready
I0420 11:40:31.906439       1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready
I0420 11:40:31.906441       1 tasks_processing.go:74] worker 7 stopped.
I0420 11:40:31.906444       1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready
I0420 11:40:31.906450       1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready
I0420 11:40:31.906471       1 controller.go:531] The operator is still being initialized
I0420 11:40:31.906482       1 controller.go:554] The operator is healthy
I0420 11:40:31.906504       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=d815905d70f9c7988a9a613df87217e3cd8a22913a1ff6ab71e2c26f0e30000f
I0420 11:40:31.906597       1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=72b4cf490345b5f0b25bbac04859adea734303d4ab850d28d966ded902c83732
I0420 11:40:31.906606       1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 51.065313ms to process 2 records
I0420 11:40:31.906770       1 tasks_processing.go:74] worker 3 stopped.
I0420 11:40:31.907204       1 recorder.go:75] Recording config/version with fingerprint=e3898a813cf4cdae02a278cd23b8a50d79b2adbc64a116d122b5893663fe8eba
I0420 11:40:31.907266       1 recorder.go:75] Recording config/id with fingerprint=4b9cdb9129de0b35745b7532c21d57b2b64c3b7d2cd8eb0b339e1bae9803d709
I0420 11:40:31.907296       1 gather.go:177] gatherer "clusterconfig" function "version" took 52.992744ms to process 2 records
I0420 11:40:31.907332       1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 51.356977ms to process 0 records
I0420 11:40:31.907437       1 recorder.go:75] Recording config/olm_operators with fingerprint=12d2124d9fefd7f28188653c689c199f4711602de6aa88ba0a56b685dabca0b8
I0420 11:40:31.907465       1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 50.215356ms to process 1 records
I0420 11:40:31.907492       1 tasks_processing.go:74] worker 51 stopped.
I0420 11:40:31.907521       1 tasks_processing.go:74] worker 55 stopped.
I0420 11:40:31.908636       1 tasks_processing.go:74] worker 16 stopped.
I0420 11:40:31.908652       1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 53.513859ms to process 0 records
I0420 11:40:31.910136       1 prometheus_rules.go:88] Prometheus rules successfully created
I0420 11:40:31.913654       1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0420 11:40:31.913667       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0420 11:40:31.913676       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0420 11:40:31.917319       1 base_controller.go:82] Caches are synced for ConfigController 
I0420 11:40:31.917331       1 base_controller.go:119] Starting #1 worker of ConfigController controller ...
E0420 11:40:31.921289       1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%277601a108-5dcf-4d40-9a00-51dccef3d790%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:56957->172.30.0.10:53: read: connection refused
I0420 11:40:31.921304       1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%277601a108-5dcf-4d40-9a00-51dccef3d790%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:56957->172.30.0.10:53: read: connection refused
I0420 11:40:31.922277       1 tasks_processing.go:74] worker 1 stopped.
I0420 11:40:31.922406       1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=83b9082bc247c9cb104f908672f811b6cac283e48ca8a66873842ff797032d8f
I0420 11:40:31.922504       1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=c0d890859046d55d2fe969d5be7e2a754d6f0616d257f58c14ba90b132116388
I0420 11:40:31.922524       1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=1c803700b7a3a9b8bbd50ff3c6ed3a317bae1e0337ad78e643d36a938a25a193
I0420 11:40:31.922553       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=a78e4503c16649e43ac2209d5be6094640206753a6303e7f383e1a971490e550
I0420 11:40:31.922581       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=8f6dcaf21a1cc9a6cba6d29ceea8c695389c10907d3e27e96d80f8bdd77f42f7
I0420 11:40:31.922603       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=d8aa2788003cfb47d5070e7bc2684b84b4fb5571d6edfbf9bb7a66e4696eeae8
I0420 11:40:31.922626       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=8f15049fccc70c973a423895fcec4716d632d32577250bd21f38ee7b0a23bd66
I0420 11:40:31.922662       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=c622ee00ce38b6ffdb750d599e312fb152c21254918035d397cbb03e2334e1c5
I0420 11:40:31.922691       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=75479f839b02e5e713e5f9dc9ab38062f63c90cdc12cb9c6ef927a4b3463125c
I0420 11:40:31.922720       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=e70b82404be913c48e831612c557be8d645c786b405b09e5d419db5e5679d012
I0420 11:40:31.922745       1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=2514938ccba280746b9064d81a01d09900a360c2e3db7ef536f1b56b438aa7f9
I0420 11:40:31.922752       1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 71.319204ms to process 11 records
I0420 11:40:31.935024       1 configmapobserver.go:84] configmaps "insights-config" not found
I0420 11:40:31.942106       1 tasks_processing.go:74] worker 17 stopped.
E0420 11:40:31.942124       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found
E0420 11:40:31.942134       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found
E0420 11:40:31.942138       1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found
I0420 11:40:31.942151       1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856
I0420 11:40:31.942196       1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d
I0420 11:40:31.942204       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a
I0420 11:40:31.942208       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b
I0420 11:40:31.942212       1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
I0420 11:40:31.942250       1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0
I0420 11:40:31.942257       1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d
I0420 11:40:31.942263       1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 86.362707ms to process 7 records
I0420 11:40:31.987010       1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload
W0420 11:40:31.990410       1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:40402->172.30.0.10:53: read: connection refused
I0420 11:40:31.990423       1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:40402->172.30.0.10:53: read: connection refused
I0420 11:40:31.995449       1 base_controller.go:82] Caches are synced for LoggingSyncer 
I0420 11:40:31.995461       1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ...
I0420 11:40:32.003806       1 tasks_processing.go:74] worker 14 stopped.
E0420 11:40:32.003820       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found
E0420 11:40:32.003825       1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pprst5nusibgq03117kjfn2t3hbbnqb-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pprst5nusibgq03117kjfn2t3hbbnqb-primary-cert-bundle-secret" not found
I0420 11:40:32.003877       1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=4902756337e2884a443ab0f1bd9fb7b36fc27d05116c3f1dc47721dfeb7bb03b
I0420 11:40:32.003889       1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 152.249041ms to process 1 records
W0420 11:40:32.891201       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0420 11:40:33.101136       1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers
I0420 11:40:33.101150       1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes
I0420 11:40:33.101821       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-l5dvc pod in namespace openshift-dns (previous: false).
I0420 11:40:33.305924       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-l5dvc pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-l5dvc\" is waiting to start: ContainerCreating"
I0420 11:40:33.305944       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-l5dvc\" is waiting to start: ContainerCreating"
I0420 11:40:33.305951       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-l5dvc pod in namespace openshift-dns (previous: false).
I0420 11:40:33.316369       1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found
I0420 11:40:33.507075       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-l5dvc pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-l5dvc\" is waiting to start: ContainerCreating"
I0420 11:40:33.507093       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-l5dvc\" is waiting to start: ContainerCreating"
I0420 11:40:33.507103       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-qt9jt pod in namespace openshift-dns (previous: false).
I0420 11:40:33.766833       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qt9jt pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-qt9jt\" is waiting to start: ContainerCreating"
I0420 11:40:33.766852       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-qt9jt\" is waiting to start: ContainerCreating"
I0420 11:40:33.766860       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-qt9jt pod in namespace openshift-dns (previous: false).
W0420 11:40:33.891046       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0420 11:40:33.910876       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-qt9jt pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-qt9jt\" is waiting to start: ContainerCreating"
I0420 11:40:33.910891       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-qt9jt\" is waiting to start: ContainerCreating"
I0420 11:40:33.910932       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-sk6n5 pod in namespace openshift-dns (previous: false).
I0420 11:40:33.918802       1 tasks_processing.go:74] worker 37 stopped.
I0420 11:40:33.918849       1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=8f2909b68d188f31162f8d6aea0589917d3ca5a058c964013183b2b89bdc2de4
I0420 11:40:33.918892       1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=78f56d23f8984538685c9ae03504616f12c36b3102827df31ed5a228270276f5
I0420 11:40:33.918937       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e
I0420 11:40:33.918982       1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=79f77063ad529fee62f91f0faf00e9829d3489f12c493fa5449c976c1ad0f7ad
I0420 11:40:33.918997       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f
I0420 11:40:33.919018       1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=23b7a03f3b26a1984d42e469ca9272524cda0a4ea89792da59ec0846ae8e884f
I0420 11:40:33.919050       1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=17c3e14c926bbed024429313cd6cb7eef8020ce218d40e7e89530af921ea951c
I0420 11:40:33.919074       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=2f0421e6c6226e5742db0b10aa262ef8620740df3088e465541f2e0b70b576c7
I0420 11:40:33.919089       1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=e5afbc0fbfc725766a20aafa42120af4aee0d570161263a4f700033363a85b86
I0420 11:40:33.919106       1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=6e27844a521e61ae1f8e5468a8edab62999d9e0681c135c20baecd02d4d70333
I0420 11:40:33.919116       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762
I0420 11:40:33.919132       1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=bb903693219e9b20e588a9cd10d7b8e73a21839664ff8531bd2442281a16daec
I0420 11:40:33.919142       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11
I0420 11:40:33.919158       1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=45a61e990025107ff6059ef2809e708a1067bdac819892a2afa80fb7af842e21
I0420 11:40:33.919176       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a
I0420 11:40:33.919200       1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=b58e2c279ddd9e0c950494229624ebf09130f6bec609826050e266a7eec75bcd
I0420 11:40:33.919209       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db
I0420 11:40:33.919224       1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=3e94fcfacc4d4c3a035a64d0a5aa702be4c8af121cb8896c0f37d4834a4049d5
I0420 11:40:33.919347       1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=026d86f5bb71dc3c6938ce20e640cb729a86cc04ae6e31537001ec8bbaccb318
I0420 11:40:33.919364       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab
I0420 11:40:33.919371       1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d
I0420 11:40:33.919393       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75
I0420 11:40:33.919417       1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=f5f87c95e022ca82ce3f16fd390e374709f0f42eae2ee59e693ea14070c47692
I0420 11:40:33.919440       1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=4cc26a605df70619aaea7aa4c2d88a1d5682668ad4b5e521cd2338379bda4898
I0420 11:40:33.919449       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76
I0420 11:40:33.919464       1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=aeff3d98d4a832e2578889ed32f336121df4cbde3ac48798ad9acfde7cfd7c2c
I0420 11:40:33.919473       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7
I0420 11:40:33.919485       1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=361e1a33c1a0619ee4dbd1ea305e30797614330b77dc0fca8e87f89f630a9830
I0420 11:40:33.919499       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=53bc9c6ee98ea6d464540bbf7e94e76232494fae69cfcfa5210b8d205fec4aaf
I0420 11:40:33.919512       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=7006f2ee7c318017881559a0c900b0f5db4322bc9831677e882c2097db9fa5cc
I0420 11:40:33.919526       1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=f2a16e3742a72ba2762cc9b4c9d4aaa2a7398b3b51305fa8a043f5b9d275c9ad
I0420 11:40:33.919544       1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=ad4cdf2de68f4f068a6bae115cb1128c8c73f85a0f865d30ff057885ee766252
I0420 11:40:33.919554       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa
I0420 11:40:33.919580       1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=63d852244644c039eed4f549a37fc53e9e7c90fd01ea9de4c9df50eb82e38a09
I0420 11:40:33.919598       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e
I0420 11:40:33.919607       1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad
I0420 11:40:33.919614       1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.067682305s to process 36 records
I0420 11:40:34.134881       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-sk6n5 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-sk6n5\" is waiting to start: ContainerCreating"
I0420 11:40:34.134911       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-sk6n5\" is waiting to start: ContainerCreating"
I0420 11:40:34.134921       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-sk6n5 pod in namespace openshift-dns (previous: false).
I0420 11:40:34.308420       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-sk6n5 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-sk6n5\" is waiting to start: ContainerCreating"
I0420 11:40:34.308436       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-sk6n5\" is waiting to start: ContainerCreating"
I0420 11:40:34.308446       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-268jw pod in namespace openshift-dns (previous: false).
I0420 11:40:34.508201       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0420 11:40:34.508217       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-bxhmb pod in namespace openshift-dns (previous: false).
I0420 11:40:34.708938       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0420 11:40:34.708957       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-tmb2r pod in namespace openshift-dns (previous: false).
W0420 11:40:34.890572       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0420 11:40:34.908525       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0420 11:40:34.908574       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5c66559854-bgrcm pod in namespace openshift-image-registry (previous: false).
I0420 11:40:35.107964       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5c66559854-bgrcm pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5c66559854-bgrcm\" is waiting to start: ContainerCreating"
I0420 11:40:35.107980       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5c66559854-bgrcm\" is waiting to start: ContainerCreating"
I0420 11:40:35.108052       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5c66559854-dmmkd pod in namespace openshift-image-registry (previous: false).
I0420 11:40:35.314042       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5c66559854-dmmkd pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5c66559854-dmmkd\" is waiting to start: ContainerCreating"
I0420 11:40:35.314059       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5c66559854-dmmkd\" is waiting to start: ContainerCreating"
I0420 11:40:35.314096       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6fb77b54c7-htcr8 pod in namespace openshift-image-registry (previous: false).
I0420 11:40:35.508009       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6fb77b54c7-htcr8 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6fb77b54c7-htcr8\" is waiting to start: ContainerCreating"
I0420 11:40:35.508025       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6fb77b54c7-htcr8\" is waiting to start: ContainerCreating"
I0420 11:40:35.508036       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-8lx2b pod in namespace openshift-image-registry (previous: false).
I0420 11:40:35.711437       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0420 11:40:35.711454       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-lchn5 pod in namespace openshift-image-registry (previous: false).
W0420 11:40:35.891075       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
I0420 11:40:35.907462       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0420 11:40:35.907477       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-t6x4p pod in namespace openshift-image-registry (previous: false).
I0420 11:40:36.109719       1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty"
I0420 11:40:36.109736       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-76d5dd5db5-b869k pod in namespace openshift-ingress (previous: false).
I0420 11:40:36.307930       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-76d5dd5db5-b869k pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-76d5dd5db5-b869k\" is waiting to start: ContainerCreating"
I0420 11:40:36.307946       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-76d5dd5db5-b869k\" is waiting to start: ContainerCreating"
I0420 11:40:36.307957       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-94f4ccbc7-hp4j9 pod in namespace openshift-ingress (previous: false).
I0420 11:40:36.506220       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-94f4ccbc7-hp4j9 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-94f4ccbc7-hp4j9\" is waiting to start: ContainerCreating"
I0420 11:40:36.506237       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-94f4ccbc7-hp4j9\" is waiting to start: ContainerCreating"
I0420 11:40:36.506247       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-94f4ccbc7-t5ww5 pod in namespace openshift-ingress (previous: false).
I0420 11:40:36.713558       1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-94f4ccbc7-t5ww5 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-94f4ccbc7-t5ww5\" is waiting to start: ContainerCreating"
I0420 11:40:36.713574       1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-94f4ccbc7-t5ww5\" is waiting to start: ContainerCreating"
I0420 11:40:36.713584       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-nn4xr pod in namespace openshift-ingress-canary (previous: false).
W0420 11:40:36.890888       1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again.
W0420 11:40:36.890924       1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0420 11:40:36.890941       1 tasks_processing.go:74] worker 9 stopped.
E0420 11:40:36.890950       1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded
I0420 11:40:36.890961       1 recorder.go:75] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
W0420 11:40:36.890975       1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics"
I0420 11:40:36.890991       1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.03754797s to process 1 records
I0420 11:40:36.924808       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-pc9r5 pod in namespace openshift-ingress-canary (previous: false).
I0420 11:40:37.108768       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-xprgg pod in namespace openshift-ingress-canary (previous: false).
I0420 11:40:37.310767       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-846d9b8bdc-rgf6p pod in namespace openshift-kube-storage-version-migrator (previous: false).
I0420 11:40:37.518755       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-846d9b8bdc-rgf6p pod in namespace openshift-kube-storage-version-migrator (previous: false).
I0420 11:40:37.708222       1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-74478b59c6-lcpgd pod in namespace openshift-kube-storage-version-migrator-operator (previous: false).
I0420 11:40:37.909056       1 tasks_processing.go:74] worker 50 stopped.
I0420 11:40:37.909158       1 recorder.go:75] Recording events/openshift-dns-operator with fingerprint=3d47b8f13381a9309b16b0dfb7626b6d9b5bbdc316d30202409d67c959271e60
I0420 11:40:37.909213       1 recorder.go:75] Recording events/openshift-dns with fingerprint=f513fd3d2cd66c8e3e57b3cbcd2ab3841b48261d88062444ff63ca44111f9747
I0420 11:40:37.909336       1 recorder.go:75] Recording events/openshift-image-registry with fingerprint=620884982725a0e286542819ed3c7deb805c424e56abee6ea8ca1f1247067775
I0420 11:40:37.909365       1 recorder.go:75] Recording events/openshift-ingress-operator with fingerprint=c55bd1a8309bbf300ed55de205e40c00320fb2c0bc5b250c34e4a9b2864a975e
I0420 11:40:37.909410       1 recorder.go:75] Recording events/openshift-ingress with fingerprint=c5e74b1f462f3387ac5f15393b9845b13194e13322ca4f9351105b7af1dda2f1
I0420 11:40:37.909448       1 recorder.go:75] Recording events/openshift-ingress-canary with fingerprint=ab089bdbe4414fc3d0e7a0b3ce4fcedf1e3bd846cef1818d1ee33d1fc0a00888
I0420 11:40:37.909461       1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator with fingerprint=104cecc7ea74524df15a4d5dbfe170458466503d1ea9fd041bd64776a0610a07
I0420 11:40:37.909507       1 recorder.go:75] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=bd4759154e3e27e0edd6e9cf3d41727f5576d6fa12624e675a0050f3eb67f53a
I0420 11:40:37.909641       1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-l5dvc with fingerprint=caee03d315b2b6c3fe53bb8f64443c22813a71f5839b53dcb509c7cc0331748c
I0420 11:40:37.909727       1 recorder.go:75] Recording config/pod/openshift-dns/dns-default-sk6n5 with fingerprint=551fdcca9591edcc68db112eaeeaec45110dfdb184aec6e4c7661d30f807c72d
I0420 11:40:37.909824       1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5c66559854-bgrcm with fingerprint=a15044aac10e513288843c36f1b1558e4472cc1542695f3647123fab67c27f68
I0420 11:40:37.909935       1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-5c66559854-dmmkd with fingerprint=79a1088b8c4ad613d784f0bd800af4faaed00cc69e69755cf730bbdfcbe336db
I0420 11:40:37.910022       1 recorder.go:75] Recording config/pod/openshift-image-registry/image-registry-6fb77b54c7-htcr8 with fingerprint=ce6875b8dfb08c76670853cccb44572945af5994e09c786c38fd13c9f5bd2097
I0420 11:40:37.910029       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-nn4xr/serve-healthcheck-canary_current.log with fingerprint=274d56f54b3eddf922aac3ed976ed5e0a4de546b2931d48a64d69f8b4d66c791
I0420 11:40:37.910034       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-pc9r5/serve-healthcheck-canary_current.log with fingerprint=64e0a1cefe20224fee42fbf4918b5a94ef02a18c3d5fc7f0f52bfe1cf91e4423
I0420 11:40:37.910038       1 recorder.go:75] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-xprgg/serve-healthcheck-canary_current.log with fingerprint=acf408dd8a023b9134c70e17049ab897bfe193a09cc732affb8b27ce7f6c8bb0
I0420 11:40:37.910051       1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-rgf6p/migrator_current.log with fingerprint=51413a3598f3a12444e526f64d94cfefd8ad4a9bceb11e6f3ffd20feea504ded
I0420 11:40:37.910057       1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-846d9b8bdc-rgf6p/graceful-termination_current.log with fingerprint=6c7e5ca411112e61aea18198d0ef024470c1abd015fe65bf2cc09150072e22ef
I0420 11:40:37.910125       1 recorder.go:75] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-74478b59c6-lcpgd/kube-storage-version-migrator-operator_current.log with fingerprint=b1e20f6c718669df8ba5d524f96b82134322edb6281a5e3a96cfbd077d934683
I0420 11:40:37.910134       1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 6.054272029s to process 19 records
I0420 11:40:44.279572       1 configmapobserver.go:84] configmaps "insights-config" not found
I0420 11:40:44.498469       1 tasks_processing.go:74] worker 31 stopped.
I0420 11:40:44.498510       1 recorder.go:75] Recording config/installplans with fingerprint=f17dbfacc3bfddf27ca3b213b39495434cd4c4e9e3dbd69566ffb3845bbcf539
I0420 11:40:44.498524       1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.647407336s to process 1 records
I0420 11:40:45.263319       1 tasks_processing.go:74] worker 30 stopped.
I0420 11:40:45.263577       1 recorder.go:75] Recording config/serviceaccounts with fingerprint=429c3d07cf3ba101c9fcb9f22318176a7c166ecd1506bdf2da650bbe8def5ef8
I0420 11:40:45.263594       1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.412192445s to process 1 records
E0420 11:40:45.263650       1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.412s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error"
I0420 11:40:45.264765       1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error
I0420 11:40:45.264780       1 periodic.go:216] Running workloads gatherer
I0420 11:40:45.264798       1 tasks_processing.go:45] number of workers: 2
I0420 11:40:45.264807       1 tasks_processing.go:69] worker 1 listening for tasks.
I0420 11:40:45.264812       1 tasks_processing.go:71] worker 1 working on workload_info task.
I0420 11:40:45.264817       1 tasks_processing.go:69] worker 0 listening for tasks.
I0420 11:40:45.264836       1 tasks_processing.go:71] worker 0 working on helmchart_info task.
I0420 11:40:45.294235       1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data
I0420 11:40:45.298310       1 tasks_processing.go:74] worker 0 stopped.
I0420 11:40:45.298326       1 gather.go:177] gatherer "workloads" function "helmchart_info" took 33.455463ms to process 0 records
I0420 11:40:45.302575       1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (9ms)
I0420 11:40:45.311346       1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (9ms)
I0420 11:40:45.322220       1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (11ms)
I0420 11:40:45.331827       1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (10ms)
I0420 11:40:45.340198       1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (8ms)
I0420 11:40:45.348126       1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (8ms)
I0420 11:40:45.357623       1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (9ms)
I0420 11:40:45.365384       1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (8ms)
I0420 11:40:45.373215       1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (8ms)
I0420 11:40:45.381365       1 gather_workloads_info.go:387] No image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (8ms)
I0420 11:40:45.403181       1 gather_workloads_info.go:387] No image sha256:4733236617781e3469ffffb15e4daaa1f14ea8e1c52b426a3787a4f1f2945424 (22ms)
I0420 11:40:45.504079       1 gather_workloads_info.go:387] No image sha256:ce138e8cf5b96557b1864ef6f27c2608bdca59be2611804366cef7169c36291e (101ms)
I0420 11:40:45.605055       1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (101ms)
I0420 11:40:45.705613       1 gather_workloads_info.go:387] No image sha256:e1ba458cf6f0b3606c90880da72db8ab99cd11040bae84baebe3ff2e0d1ea075 (101ms)
I0420 11:40:45.803190       1 gather_workloads_info.go:387] No image sha256:90a8ffd9643ebb16a6a8c04bb38cf9ed58903e9d3bf836c68f399193db5edaf6 (98ms)
I0420 11:40:45.850409       1 configmapobserver.go:84] configmaps "insights-config" not found
I0420 11:40:45.904192       1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (101ms)
I0420 11:40:46.005104       1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (101ms)
I0420 11:40:46.052248       1 configmapobserver.go:84] configmaps "insights-config" not found
I0420 11:40:46.104259       1 gather_workloads_info.go:387] No image sha256:e3732e356ae2324565c74cae57d5d016917314fa293ddaa3a68ee9ae030c6f07 (99ms)
I0420 11:40:46.204211       1 gather_workloads_info.go:387] No image sha256:d6fbe0075cbb12bfd287c973704fadf97154c7f73e370733d976a40835e9155a (100ms)
I0420 11:40:46.305094       1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (101ms)
I0420 11:40:46.404047       1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (99ms)
I0420 11:40:46.504949       1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (101ms)
I0420 11:40:46.603703       1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (99ms)
I0420 11:40:46.703208       1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (99ms)
I0420 11:40:46.803610       1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (100ms)
I0420 11:40:46.904847       1 gather_workloads_info.go:387] No image sha256:e8b96d9318b3b8c9ed0afe4e6381f635c6b0c2f20772044ac68001ed49af2c87 (101ms)
I0420 11:40:47.005264       1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (100ms)
I0420 11:40:47.104298       1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (99ms)
I0420 11:40:47.203772       1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (99ms)
I0420 11:40:47.303403       1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (100ms)
I0420 11:40:47.403491       1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (100ms)
I0420 11:40:47.503185       1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (100ms)
I0420 11:40:47.603808       1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (101ms)
I0420 11:40:47.603836       1 tasks_processing.go:74] worker 1 stopped.
E0420 11:40:47.603845       1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset
I0420 11:40:47.604105       1 recorder.go:75] Recording config/workload_info with fingerprint=2d408afb701db667e48e8d83271667cfd3f193aa35c7910ea58483133dd0ecbf
I0420 11:40:47.604137       1 gather.go:177] gatherer "workloads" function "workload_info" took 2.339018278s to process 1 records
E0420 11:40:47.604163       1 periodic.go:254] "Unhandled Error" err="workloads failed after 2.339s with: function \"workload_info\" failed with an error"
I0420 11:40:47.605263       1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error
I0420 11:40:47.605276       1 periodic.go:216] Running conditional gatherer
I0420 11:40:47.611399       1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules
I0420 11:40:47.617773       1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:50806->172.30.0.10:53: read: connection refused
E0420 11:40:47.618077       1 conditional_gatherer.go:322] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory
I0420 11:40:47.618133       1 conditional_gatherer.go:384] updating version cache for conditional gatherer
I0420 11:40:47.624808       1 conditional_gatherer.go:392] cluster version is '4.21.9'
E0420 11:40:47.624823       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0420 11:40:47.624830       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0420 11:40:47.624835       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0420 11:40:47.624840       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0420 11:40:47.624845       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0420 11:40:47.624849       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0420 11:40:47.624853       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0420 11:40:47.624857       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
E0420 11:40:47.624861       1 conditional_gatherer.go:209] error checking conditions for a gathering rule: alerts cache is missing
I0420 11:40:47.624887       1 tasks_processing.go:45] number of workers: 3
I0420 11:40:47.624916       1 tasks_processing.go:69] worker 2 listening for tasks.
I0420 11:40:47.624920       1 tasks_processing.go:69] worker 0 listening for tasks.
I0420 11:40:47.624929       1 tasks_processing.go:71] worker 0 working on conditional_gatherer_rules task.
I0420 11:40:47.624927       1 tasks_processing.go:69] worker 1 listening for tasks.
I0420 11:40:47.624922       1 tasks_processing.go:71] worker 2 working on remote_configuration task.
I0420 11:40:47.624940       1 tasks_processing.go:74] worker 0 stopped.
I0420 11:40:47.624947       1 tasks_processing.go:71] worker 1 working on rapid_container_logs task.
I0420 11:40:47.625008       1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406
I0420 11:40:47.625035       1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.407µs to process 1 records
I0420 11:40:47.625068       1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db
I0420 11:40:47.625075       1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.065µs to process 1 records
I0420 11:40:47.625082       1 tasks_processing.go:74] worker 2 stopped.
I0420 11:40:47.625193       1 tasks_processing.go:74] worker 1 stopped.
I0420 11:40:47.625211       1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 236.197µs to process 0 records
I0420 11:40:47.625237       1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:50806->172.30.0.10:53: read: connection refused
I0420 11:40:47.625256       1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1
I0420 11:40:47.649857       1 recorder.go:75] Recording insights-operator/gathers with fingerprint=f4669e02f83c588a3af01a344c7a852b84b560bf863aa1b78e2f80e85ac91456
I0420 11:40:47.649988       1 diskrecorder.go:70] Writing 116 records to /var/lib/insights-operator/insights-2026-04-20-114047.tar.gz
I0420 11:40:47.657620       1 diskrecorder.go:51] Wrote 116 records to disk in 7ms
I0420 11:40:47.657646       1 periodic.go:285] Gathering cluster info every 2h0m0s
I0420 11:40:47.657660       1 periodic.go:286] Configuration is 
	dataReporting:
		interval: 2h0m0s,
		uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload,
		storagePath: /var/lib/insights-operator,
		downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, 
		conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules,
		obfuscation: []
	sca:
		disabled: false,
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates,
		interval: 8h0m0s
	alerting:
		disabled: false
	clusterTransfer:
		endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/,
		interval: 12h0m0s
	proxy:
		httpProxy: ,
		httpsProxy: ,
		noProxy: 
I0420 11:40:52.901721       1 configmapobserver.go:84] configmaps "insights-config" not found
I0420 11:41:46.052207       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="82a52712fb813a5c14d9f454e68430d3d9b79dab6c8bd79f82a269941e50dcc7")
W0420 11:41:46.052241       1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created
I0420 11:41:46.052287       1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="c9fbe0ebd1e4d76ac91de7795c413e180bb64ed47d56df6e5f0be71cc88fed6d")
I0420 11:41:46.052312       1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated"
I0420 11:41:46.052323       1 base_controller.go:181] Shutting down LoggingSyncer ...
I0420 11:41:46.052339       1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped"
I0420 11:41:46.052355       1 periodic.go:177] Shutting down
I0420 11:41:46.052362       1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting"
I0420 11:41:46.052369       1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ...
I0420 11:41:46.052376       1 base_controller.go:113] All LoggingSyncer workers have been terminated
I0420 11:41:46.052386       1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="915d807c3d5406ac9ab3be6aff9a629c7c3e3207a7cc31c58c0689bdeb0a18a4")
I0420 11:41:46.052392       1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector
I0420 11:41:46.052393       1 base_controller.go:181] Shutting down ConfigController ...
I0420 11:41:46.052401       1 base_controller.go:123] Shutting down worker of ConfigController controller ...
I0420 11:41:46.052411       1 base_controller.go:113] All ConfigController workers have been terminated
I0420 11:41:46.052423       1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain"
I0420 11:41:46.052440       1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController
I0420 11:41:46.052438       1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController"