I0425 23:05:52.848634 1 cmd.go:253] Using service-serving-cert provided certificates I0425 23:05:52.849022 1 observer_polling.go:159] Starting file observer I0425 23:05:53.850814 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0425 23:05:53.851026 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0425 23:05:53.851562 1 secure_serving.go:57] Forcing use of http/1.1 only W0425 23:05:53.851582 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0425 23:05:53.851586 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0425 23:05:53.851590 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0425 23:05:53.851593 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0425 23:05:53.851595 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0425 23:05:53.851597 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0425 23:05:53.851610 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0425 23:05:53.855230 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0425 23:05:53.855255 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"b79994af-a0b7-4b7c-a318-c4caf953fb85", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0425 23:05:53.855792 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0425 23:05:53.855804 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0425 23:05:53.855831 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0425 23:05:53.855831 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0425 23:05:53.855872 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0425 23:05:53.855872 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0425 23:05:53.856117 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0425 23:05:53.856389 1 secure_serving.go:213] Serving securely on [::]:8443 I0425 23:05:53.856417 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0425 23:05:53.862849 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0425 23:05:53.862871 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0425 23:05:53.863151 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0425 23:05:53.868586 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0425 23:05:53.868603 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0425 23:05:53.872638 1 secretconfigobserver.go:119] support secret does not exist I0425 23:05:53.876639 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0425 23:05:53.880365 1 secretconfigobserver.go:119] support secret does not exist I0425 23:05:53.883152 1 recorder.go:176] Pruning old reports every 6h2m40s, max age is 288h0m0s I0425 23:05:53.887123 1 operator.go:356] The last pod state is unhealthy I0425 23:05:53.956182 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0425 23:05:53.956197 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0425 23:05:53.956212 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0425 23:05:53.963366 1 base_controller.go:82] Caches are synced for ConfigController I0425 23:05:53.963377 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0425 23:05:53.967172 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 23:06:13.892902 1 operator.go:356] The last pod state is unhealthy I0425 23:06:33.891157 1 operator.go:356] The last pod state is unhealthy I0425 23:06:53.891945 1 operator.go:356] The last pod state is unhealthy I0425 23:07:13.891679 1 operator.go:356] The last pod state is unhealthy I0425 23:07:33.893468 1 operator.go:356] The last pod state is unhealthy I0425 23:07:53.891372 1 operator.go:356] The last pod state is unhealthy I0425 23:08:13.891490 1 operator.go:356] The last pod state is unhealthy I0425 23:08:33.890714 1 operator.go:356] The last pod state is unhealthy I0425 23:08:53.892945 1 operator.go:356] The last pod state is unhealthy I0425 23:09:13.891476 1 operator.go:356] The last pod state is unhealthy I0425 23:09:33.891094 1 operator.go:356] The last pod state is unhealthy I0425 23:09:53.892897 1 operator.go:356] The last pod state is unhealthy I0425 23:10:13.892497 1 operator.go:356] The last pod state is unhealthy I0425 23:10:33.892004 1 operator.go:356] The last pod state is unhealthy I0425 23:10:53.888039 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0425 23:10:53.888570 1 operator.go:356] The last pod state is unhealthy I0425 23:10:53.891780 1 secretconfigobserver.go:119] support secret does not exist I0425 23:10:56.744400 1 operator.go:288] Unable to check insights-operator pod status. Setting initial delay to 11m42.220152687s I0425 23:10:56.744488 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0425 23:10:56.744507 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 13m12s I0425 23:10:56.744548 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0425 23:10:56.744566 1 insightsreport.go:296] Starting report retriever I0425 23:10:56.744574 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0425 23:10:56.750144 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0425 23:10:56.750162 1 controller.go:368] The initial operator extension status is healthy I0425 23:10:56.750170 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 23:10:56.750175 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0425 23:10:56.750178 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0425 23:10:56.750195 1 controller.go:531] The operator is still being initialized I0425 23:10:56.750205 1 controller.go:554] The operator is healthy I0425 23:10:56.750299 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0425 23:10:56.750325 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0425 23:10:56.750509 1 operator.go:328] started I0425 23:10:56.750532 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0425 23:10:56.757215 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0425 23:10:56.757225 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0425 23:10:56.757230 1 controller.go:254] Source scaController *sca.Controller is not ready I0425 23:10:56.757233 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0425 23:10:56.757236 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 23:10:56.757253 1 controller.go:531] The operator is still being initialized I0425 23:10:56.757260 1 controller.go:554] The operator is healthy I0425 23:10:56.767467 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0425 23:10:56.826679 1 cluster_transfer.go:102] no available accepted cluster transfer I0425 23:10:56.826705 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0425 23:10:56.850974 1 base_controller.go:82] Caches are synced for LoggingSyncer I0425 23:10:56.850986 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0425 23:10:56.987605 1 sca.go:266] etc-pki-entitlement secret successfully created I0425 23:10:56.987626 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0425 23:12:56.757917 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 23:12:56.757939 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0425 23:12:56.757943 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0425 23:12:56.757967 1 controller.go:531] The operator is still being initialized I0425 23:12:56.757973 1 controller.go:554] The operator is healthy I0425 23:14:56.757223 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 23:14:56.757245 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0425 23:14:56.757252 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0425 23:14:56.757285 1 controller.go:554] The operator is healthy I0425 23:15:53.883267 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 23:15:53.887473 1 configmapobserver.go:84] configmaps "insights-config" not found I0425 23:15:53.892583 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0425 23:15:53.896597 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0425 23:15:53.896614 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0425 23:15:53.900487 1 secretconfigobserver.go:119] support secret does not exist I0425 23:16:56.767734 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 23:16:56.767751 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0425 23:16:56.767755 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0425 23:16:56.767780 1 controller.go:554] The operator is healthy I0425 23:18:56.757449 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 23:18:56.757466 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0425 23:18:56.757470 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0425 23:18:56.757493 1 controller.go:554] The operator is healthy I0425 23:20:53.900982 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0425 23:20:53.906367 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0425 23:20:53.906385 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0425 23:20:53.910071 1 secretconfigobserver.go:119] support secret does not exist I0425 23:20:56.755903 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0425 23:20:56.755921 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0425 23:20:56.755925 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0425 23:20:56.755951 1 controller.go:554] The operator is healthy I0425 23:22:38.965175 1 periodic.go:216] Running clusterconfig gatherer I0425 23:22:38.965243 1 tasks_processing.go:45] number of workers: 64 I0425 23:22:38.965269 1 tasks_processing.go:69] worker 0 listening for tasks. I0425 23:22:38.965285 1 tasks_processing.go:69] worker 9 listening for tasks. I0425 23:22:38.965295 1 tasks_processing.go:69] worker 1 listening for tasks. I0425 23:22:38.965296 1 tasks_processing.go:69] worker 14 listening for tasks. I0425 23:22:38.965321 1 tasks_processing.go:69] worker 2 listening for tasks. I0425 23:22:38.965319 1 tasks_processing.go:69] worker 20 listening for tasks. I0425 23:22:38.965333 1 tasks_processing.go:69] worker 13 listening for tasks. I0425 23:22:38.965337 1 tasks_processing.go:71] worker 2 working on pdbs task. I0425 23:22:38.965341 1 tasks_processing.go:69] worker 5 listening for tasks. I0425 23:22:38.965336 1 tasks_processing.go:69] worker 11 listening for tasks. I0425 23:22:38.965349 1 tasks_processing.go:71] worker 5 working on monitoring_persistent_volumes task. I0425 23:22:38.965334 1 tasks_processing.go:69] worker 4 listening for tasks. I0425 23:22:38.965356 1 tasks_processing.go:69] worker 18 listening for tasks. I0425 23:22:38.965353 1 tasks_processing.go:69] worker 17 listening for tasks. I0425 23:22:38.965366 1 tasks_processing.go:69] worker 19 listening for tasks. I0425 23:22:38.965367 1 tasks_processing.go:69] worker 23 listening for tasks. I0425 23:22:38.965369 1 tasks_processing.go:69] worker 7 listening for tasks. I0425 23:22:38.965373 1 tasks_processing.go:69] worker 15 listening for tasks. I0425 23:22:38.965327 1 tasks_processing.go:69] worker 3 listening for tasks. I0425 23:22:38.965345 1 tasks_processing.go:69] worker 44 listening for tasks. I0425 23:22:38.965380 1 tasks_processing.go:69] worker 16 listening for tasks. I0425 23:22:38.965373 1 tasks_processing.go:69] worker 10 listening for tasks. I0425 23:22:38.965389 1 tasks_processing.go:69] worker 34 listening for tasks. I0425 23:22:38.965390 1 tasks_processing.go:69] worker 45 listening for tasks. I0425 23:22:38.965352 1 tasks_processing.go:69] worker 21 listening for tasks. I0425 23:22:38.965399 1 tasks_processing.go:69] worker 48 listening for tasks. I0425 23:22:38.965361 1 tasks_processing.go:69] worker 22 listening for tasks. I0425 23:22:38.965406 1 tasks_processing.go:69] worker 40 listening for tasks. I0425 23:22:38.965410 1 tasks_processing.go:69] worker 52 listening for tasks. I0425 23:22:38.965410 1 tasks_processing.go:69] worker 49 listening for tasks. I0425 23:22:38.965326 1 tasks_processing.go:69] worker 12 listening for tasks. I0425 23:22:38.965415 1 tasks_processing.go:69] worker 47 listening for tasks. I0425 23:22:38.965421 1 tasks_processing.go:69] worker 42 listening for tasks. I0425 23:22:38.965378 1 tasks_processing.go:69] worker 24 listening for tasks. I0425 23:22:38.965337 1 tasks_processing.go:71] worker 20 working on tsdb_status task. I0425 23:22:38.965427 1 tasks_processing.go:69] worker 32 listening for tasks. I0425 23:22:38.965426 1 tasks_processing.go:69] worker 55 listening for tasks. I0425 23:22:38.965432 1 tasks_processing.go:69] worker 36 listening for tasks. I0425 23:22:38.965385 1 tasks_processing.go:69] worker 25 listening for tasks. I0425 23:22:38.965345 1 tasks_processing.go:71] worker 13 working on storage_cluster task. I0425 23:22:38.965442 1 tasks_processing.go:69] worker 33 listening for tasks. I0425 23:22:38.965444 1 tasks_processing.go:69] worker 28 listening for tasks. I0425 23:22:38.965445 1 tasks_processing.go:69] worker 57 listening for tasks. I0425 23:22:38.965449 1 tasks_processing.go:69] worker 58 listening for tasks. I0425 23:22:38.965404 1 tasks_processing.go:69] worker 51 listening for tasks. I0425 23:22:38.965453 1 tasks_processing.go:69] worker 54 listening for tasks. I0425 23:22:38.965457 1 tasks_processing.go:69] worker 29 listening for tasks. I0425 23:22:38.965458 1 tasks_processing.go:69] worker 38 listening for tasks. I0425 23:22:38.965405 1 tasks_processing.go:69] worker 46 listening for tasks. I0425 23:22:38.965413 1 tasks_processing.go:69] worker 26 listening for tasks. I0425 23:22:38.965468 1 tasks_processing.go:69] worker 61 listening for tasks. I0425 23:22:38.965417 1 tasks_processing.go:69] worker 41 listening for tasks. I0425 23:22:38.965465 1 tasks_processing.go:69] worker 37 listening for tasks. I0425 23:22:38.965477 1 tasks_processing.go:71] worker 1 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0425 23:22:38.965481 1 tasks_processing.go:71] worker 4 working on node_logs task. I0425 23:22:38.965485 1 tasks_processing.go:71] worker 24 working on openshift_logging task. I0425 23:22:38.965489 1 tasks_processing.go:71] worker 7 working on openstack_dataplanedeployments task. I0425 23:22:38.965490 1 tasks_processing.go:69] worker 60 listening for tasks. I0425 23:22:38.965498 1 tasks_processing.go:71] worker 48 working on proxies task. I0425 23:22:38.965490 1 tasks_processing.go:71] worker 41 working on olm_operators task. I0425 23:22:38.965506 1 tasks_processing.go:71] worker 18 working on pod_network_connectivity_checks task. I0425 23:22:38.965504 1 tasks_processing.go:71] worker 60 working on machine_autoscalers task. I0425 23:22:38.965513 1 tasks_processing.go:69] worker 30 listening for tasks. I0425 23:22:38.965418 1 tasks_processing.go:69] worker 53 listening for tasks. I0425 23:22:38.965500 1 tasks_processing.go:69] worker 27 listening for tasks. I0425 23:22:38.965541 1 tasks_processing.go:71] worker 58 working on mutating_webhook_configurations task. I0425 23:22:38.965546 1 tasks_processing.go:71] worker 38 working on ceph_cluster task. I0425 23:22:38.965552 1 tasks_processing.go:71] worker 27 working on image task. I0425 23:22:38.965420 1 tasks_processing.go:69] worker 31 listening for tasks. I0425 23:22:38.965441 1 tasks_processing.go:69] worker 62 listening for tasks. I0425 23:22:38.965400 1 tasks_processing.go:69] worker 35 listening for tasks. I0425 23:22:38.965458 1 tasks_processing.go:69] worker 59 listening for tasks. I0425 23:22:38.965484 1 tasks_processing.go:71] worker 23 working on nodenetworkconfigurationpolicies task. I0425 23:22:38.965582 1 tasks_processing.go:71] worker 51 working on operators task. I0425 23:22:38.965590 1 tasks_processing.go:71] worker 46 working on ingress task. I0425 23:22:38.965753 1 tasks_processing.go:71] worker 3 working on sap_config task. I0425 23:22:38.965768 1 tasks_processing.go:71] worker 55 working on version task. I0425 23:22:38.965789 1 tasks_processing.go:71] worker 34 working on openstack_dataplanenodesets task. I0425 23:22:38.965810 1 tasks_processing.go:71] worker 26 working on authentication task. I0425 23:22:38.965470 1 tasks_processing.go:69] worker 63 listening for tasks. I0425 23:22:38.965476 1 tasks_processing.go:71] worker 15 working on dvo_metrics task. I0425 23:22:38.965453 1 tasks_processing.go:69] worker 39 listening for tasks. I0425 23:22:38.965493 1 tasks_processing.go:71] worker 17 working on openstack_version task. I0425 23:22:38.965886 1 tasks_processing.go:71] worker 61 working on crds task. I0425 23:22:38.965892 1 tasks_processing.go:71] worker 36 working on infrastructures task. I0425 23:22:38.965950 1 tasks_processing.go:71] worker 44 working on clusterroles task. I0425 23:22:38.965425 1 tasks_processing.go:69] worker 43 listening for tasks. I0425 23:22:38.965480 1 tasks_processing.go:71] worker 19 working on container_runtime_configs task. I0425 23:22:38.965397 1 tasks_processing.go:69] worker 56 listening for tasks. I0425 23:22:38.965385 1 tasks_processing.go:69] worker 50 listening for tasks. I0425 23:22:38.965535 1 tasks_processing.go:71] worker 11 working on aggregated_monitoring_cr_names task. I0425 23:22:38.966044 1 tasks_processing.go:69] worker 8 listening for tasks. I0425 23:22:38.966061 1 tasks_processing.go:71] worker 14 working on service_accounts task. I0425 23:22:38.966081 1 tasks_processing.go:71] worker 28 working on oauths task. I0425 23:22:38.966161 1 tasks_processing.go:71] worker 29 working on networks task. I0425 23:22:38.966181 1 tasks_processing.go:71] worker 57 working on install_plans task. I0425 23:22:38.966624 1 tasks_processing.go:69] worker 6 listening for tasks. I0425 23:22:38.966650 1 tasks_processing.go:71] worker 45 working on ingress_certificates task. I0425 23:22:38.965536 1 tasks_processing.go:71] worker 53 working on container_images task. I0425 23:22:38.965528 1 tasks_processing.go:71] worker 30 working on metrics task. I0425 23:22:38.966665 1 tasks_processing.go:71] worker 16 working on openstack_controlplanes task. I0425 23:22:38.966712 1 tasks_processing.go:71] worker 6 working on support_secret task. I0425 23:22:38.965463 1 tasks_processing.go:71] worker 9 working on image_registries task. I0425 23:22:38.966726 1 tasks_processing.go:71] worker 33 working on sap_datahubs task. I0425 23:22:38.965473 1 tasks_processing.go:71] worker 0 working on image_pruners task. I0425 23:22:38.966746 1 tasks_processing.go:71] worker 22 working on lokistack task. I0425 23:22:38.966761 1 tasks_processing.go:71] worker 63 working on nodenetworkstates task. I0425 23:22:38.966770 1 tasks_processing.go:71] worker 39 working on operators_pods_and_events task. I0425 23:22:38.966823 1 tasks_processing.go:71] worker 31 working on qemu_kubevirt_launcher_logs task. I0425 23:22:38.966870 1 tasks_processing.go:71] worker 21 working on machine_healthchecks task. I0425 23:22:38.966933 1 tasks_processing.go:71] worker 35 working on machine_configs task. I0425 23:22:38.966973 1 tasks_processing.go:71] worker 62 working on config_maps task. I0425 23:22:38.965759 1 tasks_processing.go:71] worker 25 working on sap_pods task. I0425 23:22:38.967030 1 tasks_processing.go:71] worker 56 working on cost_management_metrics_configs task. I0425 23:22:38.965486 1 tasks_processing.go:71] worker 37 working on node_features task. I0425 23:22:38.967152 1 tasks_processing.go:71] worker 50 working on jaegers task. I0425 23:22:38.967198 1 tasks_processing.go:71] worker 8 working on silenced_alerts task. I0425 23:22:38.966832 1 gather_lokistack.go:58] Start LokiStack gathering I0425 23:22:38.966838 1 tasks_processing.go:71] worker 40 working on certificate_signing_requests task. I0425 23:22:38.966842 1 tasks_processing.go:71] worker 52 working on cluster_apiserver task. I0425 23:22:38.966850 1 tasks_processing.go:71] worker 12 working on openshift_machine_api_events task. I0425 23:22:38.966846 1 tasks_processing.go:71] worker 49 working on feature_gates task. I0425 23:22:38.966858 1 tasks_processing.go:71] worker 42 working on nodes task. I0425 23:22:38.966854 1 tasks_processing.go:71] worker 47 working on storage_classes task. I0425 23:22:38.967219 1 tasks_processing.go:71] worker 59 working on validating_webhook_configurations task. I0425 23:22:38.966656 1 tasks_processing.go:71] worker 10 working on machine_config_pools task. I0425 23:22:38.965578 1 tasks_processing.go:71] worker 54 working on machine_sets task. I0425 23:22:38.967234 1 tasks_processing.go:71] worker 43 working on overlapping_namespace_uids task. I0425 23:22:38.965764 1 tasks_processing.go:71] worker 32 working on schedulers task. I0425 23:22:39.078362 1 tasks_processing.go:71] worker 13 working on active_alerts task. I0425 23:22:39.078422 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 112.911468ms to process 0 records I0425 23:22:39.078440 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 112.849894ms to process 0 records I0425 23:22:39.078463 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 112.875854ms to process 0 records I0425 23:22:39.078473 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 112.699586ms to process 0 records I0425 23:22:39.078482 1 tasks_processing.go:74] worker 3 stopped. I0425 23:22:39.078485 1 tasks_processing.go:74] worker 23 stopped. I0425 23:22:39.078491 1 tasks_processing.go:71] worker 60 working on machines task. I0425 23:22:39.078518 1 tasks_processing.go:74] worker 19 stopped. I0425 23:22:39.078536 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 112.531635ms to process 0 records I0425 23:22:39.078547 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 112.719368ms to process 0 records I0425 23:22:39.078555 1 tasks_processing.go:74] worker 34 stopped. I0425 23:22:39.078571 1 tasks_processing.go:74] worker 4 stopped. I0425 23:22:39.078583 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 113.078569ms to process 0 records I0425 23:22:39.078612 1 tasks_processing.go:74] worker 16 stopped. I0425 23:22:39.078625 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 111.934178ms to process 0 records I0425 23:22:39.078688 1 tasks_processing.go:74] worker 17 stopped. I0425 23:22:39.078702 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 112.795562ms to process 0 records I0425 23:22:39.078732 1 tasks_processing.go:74] worker 24 stopped. I0425 23:22:39.078745 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 113.238119ms to process 0 records I0425 23:22:39.079053 1 tasks_processing.go:74] worker 50 stopped. I0425 23:22:39.079068 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 111.842769ms to process 0 records I0425 23:22:39.079074 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 112.300074ms to process 0 records I0425 23:22:39.079079 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 112.044849ms to process 0 records I0425 23:22:39.079083 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 113.585161ms to process 0 records I0425 23:22:39.079086 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 112.044349ms to process 0 records I0425 23:22:39.079091 1 tasks_processing.go:74] worker 56 stopped. I0425 23:22:39.079094 1 tasks_processing.go:74] worker 25 stopped. I0425 23:22:39.079097 1 tasks_processing.go:74] worker 7 stopped. I0425 23:22:39.079097 1 tasks_processing.go:74] worker 22 stopped. I0425 23:22:39.079098 1 tasks_processing.go:74] worker 63 stopped. I0425 23:22:39.079104 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 112.334717ms to process 0 records E0425 23:22:39.079111 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0425 23:22:39.079118 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 112.179337ms to process 0 records I0425 23:22:39.079123 1 tasks_processing.go:74] worker 21 stopped. I0425 23:22:39.079161 1 tasks_processing.go:74] worker 54 stopped. I0425 23:22:39.079178 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 111.320422ms to process 0 records I0425 23:22:39.079217 1 gather_logs.go:145] no pods in namespace were found E0425 23:22:39.079218 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0425 23:22:39.079282 1 tasks_processing.go:74] worker 26 stopped. I0425 23:22:39.079539 1 recorder.go:75] Recording config/authentication with fingerprint=d4008598b4c5d5a8ebebd627b50943b858575593731ef037d56b123200912a17 I0425 23:22:39.079561 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 113.332267ms to process 1 records I0425 23:22:39.079574 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 111.547584ms to process 0 records I0425 23:22:39.079581 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 113.625513ms to process 0 records I0425 23:22:39.079587 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 112.483362ms to process 0 records I0425 23:22:39.079593 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 112.356521ms to process 0 records I0425 23:22:39.079598 1 tasks_processing.go:74] worker 38 stopped. I0425 23:22:39.079599 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 112.16075ms to process 0 records I0425 23:22:39.079605 1 tasks_processing.go:74] worker 37 stopped. I0425 23:22:39.079610 1 tasks_processing.go:74] worker 33 stopped. I0425 23:22:39.079614 1 tasks_processing.go:74] worker 31 stopped. I0425 23:22:39.079618 1 tasks_processing.go:74] worker 10 stopped. I0425 23:22:39.079697 1 tasks_processing.go:74] worker 36 stopped. I0425 23:22:39.080181 1 recorder.go:75] Recording config/infrastructure with fingerprint=591869b616dfb1465de92aede34d86bf7cf91cf57a134bccf66e88557f41570a I0425 23:22:39.080195 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 113.586053ms to process 1 records I0425 23:22:39.080267 1 recorder.go:75] Recording config/proxy with fingerprint=cb0ff934bd4b828ce128548cde690a8a2b2a09f06f47a0a73e27af83e2a0d07e I0425 23:22:39.080275 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 114.001281ms to process 1 records I0425 23:22:39.080275 1 tasks_processing.go:74] worker 48 stopped. I0425 23:22:39.080319 1 tasks_processing.go:74] worker 46 stopped. I0425 23:22:39.080449 1 recorder.go:75] Recording config/ingress with fingerprint=60cd4c00eaf7b7eb4e81e37c36afe472330c8e0b3cb07963cb60309e89b9fc81 I0425 23:22:39.080460 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 114.08378ms to process 1 records I0425 23:22:39.080522 1 recorder.go:75] Recording config/image with fingerprint=47528e7569f90336b4feaeae3166f0950c613aa95c7252866f014748d2957690 I0425 23:22:39.080530 1 gather.go:177] gatherer "clusterconfig" function "image" took 114.680001ms to process 1 records I0425 23:22:39.080536 1 tasks_processing.go:74] worker 27 stopped. I0425 23:22:39.081007 1 tasks_processing.go:74] worker 58 stopped. I0425 23:22:39.081161 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/annotation.operator.tekton.dev with fingerprint=b41de63f9416e1c87d3fba8fdd7ca2b28e816298b4905212d5e6d46c76dd9ad5 I0425 23:22:39.081221 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=e82688228b1a1d05c46a05c015b7d07e7879d02c5556f92e28de206f188347f2 I0425 23:22:39.081254 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/cert-manager-webhook with fingerprint=6521750cd88df6f5030f93747f367c4635e99dcf504cd532d36727997f1f2885 I0425 23:22:39.081299 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/integration-service-mutating-webhook-configuration with fingerprint=1334d13fe2dbd768519e8b9b35c4d125fb52af632d4d98f3b1f830c76166df5d I0425 23:22:39.081399 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/proxy.operator.tekton.dev with fingerprint=3777a41a84ce73b1d66763136c07b2a0ed8af0ac85b3bf7c0556c71e8166d1ba I0425 23:22:39.081473 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/release-service-mutating-webhook-configuration with fingerprint=2e30513930461acdc1595f9a8fe75b7c424678e69e6a33d751e897dc48357c55 I0425 23:22:39.081511 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=96a602ff7290c2d06aa3c7dd0b1ffffe6061f33db21cad846e537380dcca9577 I0425 23:22:39.081548 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=f5e280884c33bcfefd8f3c9a1dd38dda46bd7ac9527210314b0c30a06082a2e8 I0425 23:22:39.081592 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.operator.tekton.dev with fingerprint=d58f44afba928915461d9ec030008a74b48adb45e9cce8e3a287aaa013156634 I0425 23:22:39.081642 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.pipeline.tekton.dev with fingerprint=22956a552fbfa8b71ef359c8d8c86867e081ca17d0e48d5f416014f610fb99a2 I0425 23:22:39.081692 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.triggers.tekton.dev with fingerprint=f65685b66a38090122753243ec8766a09b36672328eeaa86db97e5a4de993263 I0425 23:22:39.081704 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 115.455488ms to process 11 records I0425 23:22:39.081792 1 tasks_processing.go:74] worker 2 stopped. I0425 23:22:39.081798 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=2aa3d94cf04138ae8957367e49641331dd018abce3e75a72993bc8f247ccaef0 I0425 23:22:39.081825 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=447222038af0fb0ae432caec1bb84d74b1b016e0ceb28dbf189f32ec44e61702 I0425 23:22:39.081845 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=9e0d9c6ed46b6c3ef8648e04367bdf74f8a2c28db1ea3baa978e216de48e553d I0425 23:22:39.081865 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=5ddd2dd98990f19cdadedcb421c7c430fb9eb46e40ff727c0fddda2db8ac3109 I0425 23:22:39.081889 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=75602314229dc402b4a4b60f42680ae6648bae7a70217b5e1750ba4054879d3c I0425 23:22:39.081915 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=156f3418debc6ffaeda61296c49b96be2ecaf3421615d3829d7c98559aa16724 I0425 23:22:39.081940 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=2a2ea66ebf87feff046294f81ff1417b948f87374620b421effdf002810c9a3f I0425 23:22:39.081969 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=7fe9ec1bbd741a5bee3c84b8e925072aad23c58f10a20516655976a116fe3ca2 I0425 23:22:39.081994 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=cf784f5842b326ff9d3e42090db63f40c9551e2a68d92a5594a1250db0e465df I0425 23:22:39.082019 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=514259014ed8bbd81ab5a7c23c521befcfe679b39b9064ae20713b61e9361dba I0425 23:22:39.082045 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=1cb188d6ccc9c3b5000f97a088fad9b4bdaa615dae43912a72e0ca853c742e23 I0425 23:22:39.082058 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 115.748553ms to process 11 records I0425 23:22:39.082086 1 recorder.go:75] Recording config/podnetworkconnectivitychecks with fingerprint=44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a I0425 23:22:39.082097 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 116.264282ms to process 1 records I0425 23:22:39.082105 1 tasks_processing.go:74] worker 18 stopped. I0425 23:22:39.083776 1 tasks_processing.go:74] worker 9 stopped. I0425 23:22:39.084170 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=c19e1b7fc7e5da8890696acf0c8e1b04626c083c35d55b4519360f6c45f6efea I0425 23:22:39.084189 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 117.03671ms to process 1 records I0425 23:22:39.095449 1 tasks_processing.go:74] worker 35 stopped. E0425 23:22:39.095466 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0425 23:22:39.095495 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0425 23:22:39.095507 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 128.496904ms to process 1 records I0425 23:22:39.099284 1 tasks_processing.go:74] worker 60 stopped. E0425 23:22:39.099321 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0425 23:22:39.099335 1 gather.go:177] gatherer "clusterconfig" function "machines" took 20.782197ms to process 0 records I0425 23:22:39.153484 1 tasks_processing.go:74] worker 29 stopped. I0425 23:22:39.153647 1 recorder.go:75] Recording config/network with fingerprint=d6b4a0a17906dac2fcda662065c0ea29035fe6b29eea666a5c2aedf3e4db7d26 I0425 23:22:39.153665 1 gather.go:177] gatherer "clusterconfig" function "networks" took 187.304382ms to process 1 records I0425 23:22:39.162671 1 tasks_processing.go:74] worker 49 stopped. I0425 23:22:39.162772 1 recorder.go:75] Recording config/featuregate with fingerprint=a98dc97a125d5bc3a4e8a2a7a5b1e7b543afea9719999cc47f77aaf4363bacd9 I0425 23:22:39.162789 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 195.137952ms to process 1 records I0425 23:22:39.164716 1 gather_cluster_operator_pods_and_events.go:121] Found 0 pods with 0 containers I0425 23:22:39.164736 1 tasks_processing.go:74] worker 39 stopped. I0425 23:22:39.164744 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 197.955015ms to process 0 records I0425 23:22:39.168723 1 tasks_processing.go:74] worker 42 stopped. I0425 23:22:39.168981 1 recorder.go:75] Recording config/node/ip-10-0-0-165.ec2.internal with fingerprint=e664fcef8e189fdd14a29582e8d4d814a6a67458d9cc3f95ad972c1e72780259 I0425 23:22:39.169039 1 recorder.go:75] Recording config/node/ip-10-0-1-217.ec2.internal with fingerprint=a65da5559eb895614b23c24e8b7abe95603d49532f6ccd2d025b55766f20a010 I0425 23:22:39.169102 1 recorder.go:75] Recording config/node/ip-10-0-2-186.ec2.internal with fingerprint=8a6ecf27e75e87ceb5720bcabd8c356c8780ed25b1f4381d6ef325bf4c2c1bf6 I0425 23:22:39.169111 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 201.173392ms to process 3 records I0425 23:22:39.173225 1 tasks_processing.go:74] worker 52 stopped. I0425 23:22:39.173548 1 recorder.go:75] Recording config/apiserver with fingerprint=9742a4214fb9cfed366b1f8ffb491bccc5b87c3642d6de73e2650b7096c54170 I0425 23:22:39.173572 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 205.816241ms to process 1 records I0425 23:22:39.174886 1 tasks_processing.go:74] worker 43 stopped. I0425 23:22:39.174912 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0425 23:22:39.174921 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 206.825364ms to process 1 records I0425 23:22:39.199368 1 tasks_processing.go:74] worker 28 stopped. I0425 23:22:39.199546 1 recorder.go:75] Recording config/oauth with fingerprint=741642f1d5b7bd55b83026db3e11c001800b0400922682d04125b7df79ede304 I0425 23:22:39.199558 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 233.266079ms to process 1 records I0425 23:22:39.207271 1 tasks_processing.go:74] worker 53 stopped. I0425 23:22:39.208526 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-5pptj with fingerprint=d8bd2d3b0f24ed2c1fba93887e1aff29a73d5f5f1590cdb4907713552f18c791 I0425 23:22:39.208665 1 recorder.go:75] Recording config/running_containers with fingerprint=c85ab162c339b5bb0b589afaeac90050080ab17c6e81e5d5d25cafce564d11e9 I0425 23:22:39.208677 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 240.598428ms to process 2 records I0425 23:22:39.244086 1 tasks_processing.go:74] worker 0 stopped. I0425 23:22:39.244194 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=a0a1098404adc16f4ab7a8bf6bf08af7464f325d5d9f0e54c1e8b526c8e1531a I0425 23:22:39.244213 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 277.336624ms to process 1 records I0425 23:22:39.244285 1 tasks_processing.go:74] worker 12 stopped. I0425 23:22:39.244320 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 276.84391ms to process 0 records I0425 23:22:39.247200 1 tasks_processing.go:74] worker 6 stopped. E0425 23:22:39.247213 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0425 23:22:39.247220 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 280.471708ms to process 0 records I0425 23:22:39.257273 1 tasks_processing.go:74] worker 61 stopped. I0425 23:22:39.257716 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=e865710209172439a79d898d81bed4491636bc3d73ea53839403804264ddc60f I0425 23:22:39.257912 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=5eebe7abd1163bc441e04bc5d3f060383f6476fa070dbb1c7e6e51d7f26ecb56 I0425 23:22:39.257921 1 gather.go:177] gatherer "clusterconfig" function "crds" took 291.371406ms to process 2 records I0425 23:22:39.291735 1 tasks_processing.go:74] worker 8 stopped. I0425 23:22:39.291749 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0425 23:22:39.291756 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 324.469964ms to process 1 records I0425 23:22:39.292145 1 tasks_processing.go:74] worker 13 stopped. I0425 23:22:39.292187 1 recorder.go:75] Recording config/alerts with fingerprint=a8ee610268e77950e11ff43a1a14d9fba0d4194e160d8aea77f8d62324fe5d8f I0425 23:22:39.292199 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 213.764262ms to process 1 records I0425 23:22:39.321911 1 tasks_processing.go:74] worker 32 stopped. I0425 23:22:39.321985 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=39b89b2a9b6977eaaa5a6541c28e0ed4a09c69215b452e90f6e2a31c4990879e I0425 23:22:39.322024 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 353.459511ms to process 1 records I0425 23:22:39.338070 1 tasks_processing.go:74] worker 1 stopped. I0425 23:22:39.338084 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 372.579712ms to process 0 records I0425 23:22:39.348958 1 tasks_processing.go:74] worker 59 stopped. I0425 23:22:39.349054 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=4e4cdaaa3117a718646d74e65390c999a7554f6b93aa5d849b9708040307de58 I0425 23:22:39.349090 1 recorder.go:75] Recording config/validatingwebhookconfigurations/cert-manager-webhook with fingerprint=b70f71a342f6bdd0e989d9b2356e935bfb60ddb310a04d98fb9e4aa46b3402f2 I0425 23:22:39.349117 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.operator.tekton.dev with fingerprint=36d56ac9f97b7ac81d24ec790c16c222d95d31502bd3898697e8c115960524a7 I0425 23:22:39.349132 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.pipeline.tekton.dev with fingerprint=ecda443506e0eb37920e168c5e7fd951d9031f75421f35d457a06eea74685f01 I0425 23:22:39.349147 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.triggers.tekton.dev with fingerprint=764902cd82ea22f4c491f5a83cdf2c0b9974e950c6936e3ff663a40cf0ab6b87 I0425 23:22:39.349188 1 recorder.go:75] Recording config/validatingwebhookconfigurations/integration-service-validating-webhook-configuration with fingerprint=a06fd764d0bfb542e7738adbd826f9d907067d272b425cb28e6f5abd30ad7002 I0425 23:22:39.349217 1 recorder.go:75] Recording config/validatingwebhookconfigurations/monitoringconfigmaps.openshift.io with fingerprint=ff32b4efed6e02691e90926f9584ea8483c6c8625afa547d866e57b8e2dce6de I0425 23:22:39.349267 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=aab92de7b23a04a28a04e3149bba0ddbc36fd728284130112311ad34416417ed I0425 23:22:39.349289 1 recorder.go:75] Recording config/validatingwebhookconfigurations/namespace.operator.tekton.dev with fingerprint=75a53d5f0b6db02fb405dbc8149d28fea69c209fc9f841708225cf2e30c4b9bb I0425 23:22:39.349387 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=26a985cfe92a7209b71024bea8ab249ae79d49930dc58cf110754d53a7b38ca0 I0425 23:22:39.349413 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=1f28b5c7545eda1f0bb3444997142a5e080679f8b3e23635c5cb20942b449a35 I0425 23:22:39.349450 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=058f0984ed313f4efcf23cc09fe180606b83187bdcdf186e667e79111a7ea2fa I0425 23:22:39.349490 1 recorder.go:75] Recording config/validatingwebhookconfigurations/release-service-validating-webhook-configuration with fingerprint=09f8340ebcdb939d5ee56041790970d3f90da521abc13c39fa6ecc56b2b8b247 I0425 23:22:39.349522 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=1651961c4393547d96549ac5f1d8e9321fef483cbd945d6f828701a15db19d99 I0425 23:22:39.349548 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=d0f10846d6c2263017177df670a641b316c75064fd5c71139a16c41737352237 I0425 23:22:39.349570 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=23085df7c05876a321b7838afc1663394889b6cd1a09640dfb1ac90475b33b60 I0425 23:22:39.349602 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=56566ea3f6907612bcce3a847a59a01d77a412ba9a59cea8de994c6044e42f35 I0425 23:22:39.349634 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=d87da50d7a1a5aab263c234661965f08a077cd749e1dbaa7a88c41b8cbdb2b4a I0425 23:22:39.349673 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=76f9751467ce1c1814f4c44a788f4aa683afa116902880a6f443831455257a0f I0425 23:22:39.349699 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=4cc60bf9d52cb31c0160a85ec859e9cd87582be7bcf2fb5db92e464605a03e7e I0425 23:22:39.349721 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=0bb1404bad5d8696da8c953d1002a16fd2767b7f3c6bd556cc119828c0cc10df I0425 23:22:39.349752 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.pipelinesascode.tekton.dev with fingerprint=4c925490f692c170a10b0f3c3aae9cd4336f2366403852ffb3cc62d6fb491d5a I0425 23:22:39.349788 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.operator.tekton.dev with fingerprint=77dec19388db62112b9bcc1439e42de5c411d0f3b01da8975a24baf6865d200a I0425 23:22:39.349824 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.pipeline.tekton.dev with fingerprint=c4565a3b3d861354c1d27065d9cb41b08ce79259bd86bfcfe28dfa3183e29b28 I0425 23:22:39.349868 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.triggers.tekton.dev with fingerprint=b13c6cd6249d9003d359e0d41f71c5bf97c0f58a8ea9026b7c3072ad3939d14e I0425 23:22:39.349876 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 381.365518ms to process 25 records I0425 23:22:39.354520 1 tasks_processing.go:74] worker 55 stopped. I0425 23:22:39.354714 1 recorder.go:75] Recording config/version with fingerprint=149cbd1f961000a372dc2d57de8bc97ba0f1d8389440f9336a0287852d1dffba I0425 23:22:39.354725 1 recorder.go:75] Recording config/id with fingerprint=c2ba64b5e6334f9f3671daa4f55beef20c78469c77b062e9707c79fe660c34a1 I0425 23:22:39.354731 1 gather.go:177] gatherer "clusterconfig" function "version" took 388.739427ms to process 2 records I0425 23:22:39.358271 1 tasks_processing.go:74] worker 47 stopped. I0425 23:22:39.358366 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=fd3bfd19868e6754480b542eb9bf59fff6c19581cd549c399b527e167f880717 I0425 23:22:39.358401 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=df0f21e6b57feb39c7fe35fdb6dbad508ced68c46a2a77f92d7cef602ab22c44 I0425 23:22:39.358411 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 390.702032ms to process 2 records I0425 23:22:39.405693 1 tasks_processing.go:74] worker 5 stopped. I0425 23:22:39.405710 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 440.332089ms to process 0 records I0425 23:22:39.408560 1 tasks_processing.go:74] worker 40 stopped. I0425 23:22:39.408579 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 441.151576ms to process 0 records I0425 23:22:39.453947 1 tasks_processing.go:74] worker 11 stopped. I0425 23:22:39.453966 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 487.937852ms to process 0 records I0425 23:22:39.505766 1 tasks_processing.go:74] worker 44 stopped. I0425 23:22:39.506146 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=73a166ef261dd2f9a21e1da3266a39a638f6ccb96e1b1ebc6701018f3d7aee6a I0425 23:22:39.506376 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=c2445cb7793366ebda747824c26e0ff519cf5b3271507648cfe436970e7a5c72 I0425 23:22:39.506387 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 539.794896ms to process 2 records I0425 23:22:39.535298 1 tasks_processing.go:74] worker 62 stopped. E0425 23:22:39.535335 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0425 23:22:39.535343 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0425 23:22:39.535350 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0425 23:22:39.535363 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0425 23:22:39.535400 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0425 23:22:39.535407 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0425 23:22:39.535412 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0425 23:22:39.535423 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0425 23:22:39.535459 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0425 23:22:39.535467 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0425 23:22:39.535472 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 568.304426ms to process 7 records I0425 23:22:39.567377 1 tasks_processing.go:74] worker 45 stopped. E0425 23:22:39.567395 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0425 23:22:39.567401 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2ptfd0doqkjckkqnviaqdhhsij5e416h-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2ptfd0doqkjckkqnviaqdhhsij5e416h-primary-cert-bundle-secret" not found I0425 23:22:39.567447 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=7b92e93d4d074ff20d4eceb19371a4075c2281c98d547ba101c3beaf6a4f6a77 I0425 23:22:39.567461 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 600.709689ms to process 1 records I0425 23:22:39.617075 1 tasks_processing.go:74] worker 41 stopped. I0425 23:22:39.617230 1 recorder.go:75] Recording config/olm_operators with fingerprint=943674dcad82310a3bbaf453ac2db21f21ca962ff443e89fa7dbcad3444a1867 I0425 23:22:39.617242 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 651.556747ms to process 1 records I0425 23:22:39.751512 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0425 23:22:39.755500 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0425 23:22:40.002929 1 tasks_processing.go:74] worker 30 stopped. I0425 23:22:40.003005 1 recorder.go:75] Recording config/metrics with fingerprint=20804a3ecd7182b8fa582bcd380948c424da2f5e3739f713f5870162dfcd7efc I0425 23:22:40.003020 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.036248142s to process 1 records I0425 23:22:40.008887 1 tasks_processing.go:74] worker 20 stopped. I0425 23:22:40.008912 1 recorder.go:75] Recording config/tsdb.json with fingerprint=bbed6d072e5fb47ca77c380d75a5dbd169b02338847ce1cf1b64d0c216b52bc0 I0425 23:22:40.008922 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.043446084s to process 1 records