I0331 03:52:37.719351 1 cmd.go:253] Using service-serving-cert provided certificates I0331 03:52:37.719811 1 observer_polling.go:159] Starting file observer I0331 03:52:38.825122 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0331 03:52:38.825311 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0331 03:52:38.825859 1 secure_serving.go:57] Forcing use of http/1.1 only W0331 03:52:38.825881 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0331 03:52:38.825885 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0331 03:52:38.825889 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0331 03:52:38.825891 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0331 03:52:38.825894 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0331 03:52:38.825896 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0331 03:52:38.826006 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0331 03:52:38.829090 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0331 03:52:38.829104 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"69b8f651-afe8-4c30-9b85-edd2a050a90f", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0331 03:52:38.831719 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0331 03:52:38.831734 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0331 03:52:38.831766 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0331 03:52:38.831778 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0331 03:52:38.831781 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0331 03:52:38.831796 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0331 03:52:38.832012 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0331 03:52:38.832219 1 secure_serving.go:213] Serving securely on [::]:8443 I0331 03:52:38.832245 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0331 03:52:38.834860 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0331 03:52:38.835032 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0331 03:52:38.835175 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0331 03:52:38.841270 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 03:52:38.841291 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0331 03:52:38.845698 1 secretconfigobserver.go:119] support secret does not exist I0331 03:52:38.849938 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 03:52:38.854209 1 secretconfigobserver.go:119] support secret does not exist I0331 03:52:38.857439 1 recorder.go:176] Pruning old reports every 7h25m48s, max age is 288h0m0s I0331 03:52:38.862207 1 operator.go:356] The last pod state is unhealthy I0331 03:52:38.932291 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0331 03:52:38.932300 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0331 03:52:38.932315 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0331 03:52:38.935510 1 base_controller.go:82] Caches are synced for ConfigController I0331 03:52:38.935522 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0331 03:52:38.940722 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 03:52:58.867972 1 operator.go:356] The last pod state is unhealthy I0331 03:53:18.866236 1 operator.go:356] The last pod state is unhealthy I0331 03:53:38.864305 1 operator.go:356] The last pod state is unhealthy I0331 03:53:58.868814 1 operator.go:356] The last pod state is unhealthy I0331 03:54:18.865168 1 operator.go:356] The last pod state is unhealthy I0331 03:54:38.865267 1 operator.go:356] The last pod state is unhealthy I0331 03:54:58.868502 1 operator.go:356] The last pod state is unhealthy I0331 03:55:18.869544 1 operator.go:356] The last pod state is unhealthy I0331 03:55:38.864446 1 operator.go:356] The last pod state is unhealthy I0331 03:55:58.868562 1 operator.go:356] The last pod state is unhealthy I0331 03:56:18.865270 1 operator.go:356] The last pod state is unhealthy I0331 03:56:38.866407 1 operator.go:356] The last pod state is unhealthy I0331 03:56:58.866156 1 operator.go:356] The last pod state is unhealthy I0331 03:57:18.865893 1 operator.go:356] The last pod state is unhealthy I0331 03:57:38.860903 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 03:57:38.863028 1 operator.go:356] The last pod state is unhealthy I0331 03:57:38.865110 1 secretconfigobserver.go:119] support secret does not exist I0331 03:57:55.539510 1 operator.go:288] Unable to check insights-operator pod status. Setting initial delay to 12m34.709596508s I0331 03:57:55.539590 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0331 03:57:55.539611 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 14m4s I0331 03:57:55.539642 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0331 03:57:55.539656 1 insightsreport.go:296] Starting report retriever I0331 03:57:55.539662 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0331 03:57:55.548248 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0331 03:57:55.548267 1 controller.go:368] The initial operator extension status is healthy I0331 03:57:55.548275 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0331 03:57:55.548281 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 03:57:55.548284 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0331 03:57:55.548299 1 controller.go:531] The operator is still being initialized I0331 03:57:55.548304 1 controller.go:554] The operator is healthy I0331 03:57:55.548372 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0331 03:57:55.548398 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0331 03:57:55.548593 1 operator.go:328] started I0331 03:57:55.548613 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0331 03:57:55.556004 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0331 03:57:55.556016 1 controller.go:254] Source scaController *sca.Controller is not ready I0331 03:57:55.556020 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0331 03:57:55.556023 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 03:57:55.556025 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0331 03:57:55.556040 1 controller.go:531] The operator is still being initialized I0331 03:57:55.556046 1 controller.go:554] The operator is healthy I0331 03:57:55.565321 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0331 03:57:55.636820 1 cluster_transfer.go:102] no available accepted cluster transfer I0331 03:57:55.636839 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0331 03:57:55.648966 1 base_controller.go:82] Caches are synced for LoggingSyncer I0331 03:57:55.648985 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0331 03:57:56.200238 1 sca.go:266] etc-pki-entitlement secret successfully created I0331 03:57:56.200256 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0331 03:59:55.555706 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 03:59:55.555723 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0331 03:59:55.555726 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0331 03:59:55.555746 1 controller.go:531] The operator is still being initialized I0331 03:59:55.555752 1 controller.go:554] The operator is healthy I0331 04:01:55.556979 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:01:55.556997 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:01:55.557001 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:01:55.557024 1 controller.go:554] The operator is healthy I0331 04:02:38.851899 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:02:38.856459 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:02:38.865554 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:02:38.870482 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:02:38.870499 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:02:38.875021 1 secretconfigobserver.go:119] support secret does not exist I0331 04:03:55.555323 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:03:55.555350 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:03:55.555356 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:03:55.555407 1 controller.go:554] The operator is healthy I0331 04:05:55.555413 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:05:55.555431 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:05:55.555444 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:05:55.555468 1 controller.go:554] The operator is healthy I0331 04:07:38.875421 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:07:38.880963 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:07:38.880985 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:07:38.885857 1 secretconfigobserver.go:119] support secret does not exist I0331 04:07:55.554937 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:07:55.554953 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:07:55.554956 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:07:55.554980 1 controller.go:554] The operator is healthy I0331 04:09:55.555857 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:09:55.555877 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:09:55.555880 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:09:55.555902 1 controller.go:554] The operator is healthy I0331 04:10:30.249613 1 periodic.go:216] Running clusterconfig gatherer I0331 04:10:30.249670 1 tasks_processing.go:45] number of workers: 64 I0331 04:10:30.249697 1 tasks_processing.go:69] worker 7 listening for tasks. I0331 04:10:30.249715 1 tasks_processing.go:69] worker 4 listening for tasks. I0331 04:10:30.249716 1 tasks_processing.go:71] worker 7 working on silenced_alerts task. I0331 04:10:30.249720 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 04:10:30.249729 1 tasks_processing.go:69] worker 6 listening for tasks. I0331 04:10:30.249734 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 04:10:30.249736 1 tasks_processing.go:71] worker 6 working on openstack_dataplanedeployments task. I0331 04:10:30.249723 1 tasks_processing.go:71] worker 4 working on pod_network_connectivity_checks task. I0331 04:10:30.249730 1 tasks_processing.go:69] worker 5 listening for tasks. I0331 04:10:30.249712 1 tasks_processing.go:69] worker 3 listening for tasks. I0331 04:10:30.249730 1 tasks_processing.go:71] worker 0 working on crds task. I0331 04:10:30.249750 1 tasks_processing.go:69] worker 2 listening for tasks. I0331 04:10:30.249768 1 tasks_processing.go:69] worker 21 listening for tasks. I0331 04:10:30.249774 1 tasks_processing.go:69] worker 15 listening for tasks. I0331 04:10:30.249780 1 tasks_processing.go:69] worker 16 listening for tasks. I0331 04:10:30.249783 1 tasks_processing.go:69] worker 35 listening for tasks. I0331 04:10:30.249789 1 tasks_processing.go:69] worker 17 listening for tasks. I0331 04:10:30.249791 1 tasks_processing.go:69] worker 14 listening for tasks. I0331 04:10:30.249796 1 tasks_processing.go:69] worker 18 listening for tasks. I0331 04:10:30.249800 1 tasks_processing.go:69] worker 8 listening for tasks. I0331 04:10:30.249809 1 tasks_processing.go:69] worker 19 listening for tasks. I0331 04:10:30.249812 1 tasks_processing.go:69] worker 30 listening for tasks. I0331 04:10:30.249812 1 tasks_processing.go:69] worker 9 listening for tasks. I0331 04:10:30.249806 1 tasks_processing.go:69] worker 29 listening for tasks. I0331 04:10:30.249815 1 tasks_processing.go:69] worker 10 listening for tasks. I0331 04:10:30.249820 1 tasks_processing.go:69] worker 20 listening for tasks. I0331 04:10:30.249822 1 tasks_processing.go:69] worker 49 listening for tasks. I0331 04:10:30.249823 1 tasks_processing.go:69] worker 11 listening for tasks. I0331 04:10:30.249824 1 tasks_processing.go:69] worker 13 listening for tasks. I0331 04:10:30.249829 1 tasks_processing.go:69] worker 32 listening for tasks. I0331 04:10:30.249831 1 tasks_processing.go:71] worker 35 working on aggregated_monitoring_cr_names task. I0331 04:10:30.249832 1 tasks_processing.go:71] worker 17 working on clusterroles task. I0331 04:10:30.249830 1 tasks_processing.go:69] worker 12 listening for tasks. I0331 04:10:30.249838 1 tasks_processing.go:69] worker 37 listening for tasks. I0331 04:10:30.249839 1 tasks_processing.go:71] worker 49 working on jaegers task. I0331 04:10:30.249844 1 tasks_processing.go:69] worker 34 listening for tasks. I0331 04:10:30.249848 1 tasks_processing.go:69] worker 38 listening for tasks. I0331 04:10:30.249847 1 tasks_processing.go:69] worker 26 listening for tasks. I0331 04:10:30.249856 1 tasks_processing.go:69] worker 43 listening for tasks. I0331 04:10:30.249860 1 tasks_processing.go:71] worker 26 working on cost_management_metrics_configs task. I0331 04:10:30.249863 1 tasks_processing.go:69] worker 60 listening for tasks. I0331 04:10:30.249869 1 tasks_processing.go:69] worker 39 listening for tasks. I0331 04:10:30.249870 1 tasks_processing.go:69] worker 57 listening for tasks. I0331 04:10:30.249871 1 tasks_processing.go:69] worker 27 listening for tasks. I0331 04:10:30.249878 1 tasks_processing.go:69] worker 24 listening for tasks. I0331 04:10:30.249882 1 tasks_processing.go:69] worker 59 listening for tasks. I0331 04:10:30.249862 1 tasks_processing.go:69] worker 25 listening for tasks. I0331 04:10:30.249886 1 tasks_processing.go:69] worker 41 listening for tasks. I0331 04:10:30.249890 1 tasks_processing.go:71] worker 19 working on node_logs task. I0331 04:10:30.249892 1 tasks_processing.go:69] worker 52 listening for tasks. I0331 04:10:30.249894 1 tasks_processing.go:71] worker 29 working on sap_datahubs task. I0331 04:10:30.249897 1 tasks_processing.go:69] worker 51 listening for tasks. I0331 04:10:30.249902 1 tasks_processing.go:71] worker 21 working on image task. I0331 04:10:30.249839 1 tasks_processing.go:71] worker 32 working on container_runtime_configs task. I0331 04:10:30.249906 1 tasks_processing.go:71] worker 15 working on operators_pods_and_events task. I0331 04:10:30.249911 1 tasks_processing.go:69] worker 45 listening for tasks. I0331 04:10:30.249911 1 tasks_processing.go:69] worker 53 listening for tasks. I0331 04:10:30.249915 1 tasks_processing.go:69] worker 62 listening for tasks. I0331 04:10:30.249920 1 tasks_processing.go:69] worker 46 listening for tasks. I0331 04:10:30.249914 1 tasks_processing.go:69] worker 56 listening for tasks. I0331 04:10:30.249930 1 tasks_processing.go:71] worker 16 working on machine_healthchecks task. I0331 04:10:30.249828 1 tasks_processing.go:71] worker 20 working on validating_webhook_configurations task. I0331 04:10:30.249936 1 tasks_processing.go:71] worker 56 working on schedulers task. I0331 04:10:30.249933 1 tasks_processing.go:69] worker 55 listening for tasks. I0331 04:10:30.249890 1 tasks_processing.go:71] worker 9 working on networks task. I0331 04:10:30.249896 1 tasks_processing.go:71] worker 2 working on mutating_webhook_configurations task. I0331 04:10:30.249948 1 tasks_processing.go:71] worker 60 working on version task. I0331 04:10:30.249941 1 tasks_processing.go:69] worker 48 listening for tasks. I0331 04:10:30.249856 1 tasks_processing.go:71] worker 38 working on metrics task. I0331 04:10:30.249879 1 tasks_processing.go:69] worker 40 listening for tasks. I0331 04:10:30.249845 1 tasks_processing.go:71] worker 12 working on openstack_version task. I0331 04:10:30.250087 1 tasks_processing.go:71] worker 40 working on machines task. I0331 04:10:30.250093 1 tasks_processing.go:71] worker 55 working on install_plans task. I0331 04:10:30.250096 1 tasks_processing.go:71] worker 48 working on openstack_controlplanes task. I0331 04:10:30.249831 1 tasks_processing.go:69] worker 36 listening for tasks. I0331 04:10:30.250162 1 tasks_processing.go:71] worker 36 working on machine_config_pools task. I0331 04:10:30.249831 1 tasks_processing.go:69] worker 22 listening for tasks. I0331 04:10:30.249834 1 tasks_processing.go:71] worker 13 working on ingress_certificates task. I0331 04:10:30.249833 1 tasks_processing.go:71] worker 11 working on sap_pods task. I0331 04:10:30.250320 1 tasks_processing.go:71] worker 22 working on config_maps task. I0331 04:10:30.249813 1 tasks_processing.go:69] worker 28 listening for tasks. I0331 04:10:30.250360 1 tasks_processing.go:71] worker 28 working on machine_sets task. I0331 04:10:30.249839 1 tasks_processing.go:69] worker 33 listening for tasks. I0331 04:10:30.250437 1 tasks_processing.go:71] worker 33 working on image_registries task. I0331 04:10:30.249839 1 tasks_processing.go:69] worker 23 listening for tasks. I0331 04:10:30.249824 1 tasks_processing.go:69] worker 31 listening for tasks. I0331 04:10:30.249852 1 tasks_processing.go:71] worker 34 working on nodenetworkconfigurationpolicies task. I0331 04:10:30.250607 1 tasks_processing.go:71] worker 31 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0331 04:10:30.250620 1 tasks_processing.go:71] worker 23 working on lokistack task. I0331 04:10:30.249851 1 tasks_processing.go:71] worker 37 working on olm_operators task. I0331 04:10:30.249877 1 tasks_processing.go:71] worker 14 working on qemu_kubevirt_launcher_logs task. I0331 04:10:30.250698 1 gather_lokistack.go:58] Start LokiStack gathering I0331 04:10:30.249878 1 tasks_processing.go:69] worker 58 listening for tasks. I0331 04:10:30.250739 1 tasks_processing.go:71] worker 58 working on feature_gates task. I0331 04:10:30.249881 1 tasks_processing.go:71] worker 18 working on nodes task. I0331 04:10:30.249886 1 tasks_processing.go:71] worker 8 working on monitoring_persistent_volumes task. I0331 04:10:30.249887 1 tasks_processing.go:71] worker 30 working on openstack_dataplanenodesets task. I0331 04:10:30.249896 1 tasks_processing.go:69] worker 47 listening for tasks. I0331 04:10:30.249899 1 tasks_processing.go:71] worker 1 working on sap_config task. I0331 04:10:30.251013 1 tasks_processing.go:71] worker 47 working on ingress task. I0331 04:10:30.249903 1 tasks_processing.go:69] worker 44 listening for tasks. I0331 04:10:30.249904 1 tasks_processing.go:69] worker 54 listening for tasks. I0331 04:10:30.249894 1 tasks_processing.go:69] worker 50 listening for tasks. I0331 04:10:30.249904 1 tasks_processing.go:71] worker 5 working on support_secret task. I0331 04:10:30.249896 1 tasks_processing.go:69] worker 42 listening for tasks. I0331 04:10:30.249913 1 tasks_processing.go:71] worker 3 working on operators task. I0331 04:10:30.251117 1 tasks_processing.go:71] worker 54 working on openshift_logging task. I0331 04:10:30.251119 1 tasks_processing.go:71] worker 50 working on pdbs task. I0331 04:10:30.251119 1 tasks_processing.go:71] worker 42 working on dvo_metrics task. I0331 04:10:30.251151 1 tasks_processing.go:71] worker 44 working on cluster_apiserver task. I0331 04:10:30.249923 1 tasks_processing.go:69] worker 63 listening for tasks. I0331 04:10:30.249926 1 tasks_processing.go:71] worker 53 working on infrastructures task. I0331 04:10:30.249925 1 tasks_processing.go:69] worker 61 listening for tasks. I0331 04:10:30.251306 1 tasks_processing.go:71] worker 61 working on node_features task. I0331 04:10:30.249932 1 tasks_processing.go:71] worker 43 working on tsdb_status task. I0331 04:10:30.249933 1 tasks_processing.go:71] worker 46 working on machine_configs task. I0331 04:10:30.249937 1 tasks_processing.go:71] worker 25 working on nodenetworkstates task. I0331 04:10:30.249941 1 tasks_processing.go:71] worker 51 working on container_images task. I0331 04:10:30.249940 1 tasks_processing.go:71] worker 52 working on active_alerts task. I0331 04:10:30.249942 1 tasks_processing.go:71] worker 59 working on ceph_cluster task. I0331 04:10:30.249946 1 tasks_processing.go:71] worker 45 working on storage_classes task. I0331 04:10:30.249947 1 tasks_processing.go:71] worker 27 working on openshift_machine_api_events task. I0331 04:10:30.249948 1 tasks_processing.go:71] worker 57 working on machine_autoscalers task. I0331 04:10:30.249947 1 tasks_processing.go:71] worker 41 working on oauths task. I0331 04:10:30.249952 1 tasks_processing.go:71] worker 24 working on storage_cluster task. I0331 04:10:30.249952 1 tasks_processing.go:71] worker 39 working on certificate_signing_requests task. I0331 04:10:30.249827 1 tasks_processing.go:71] worker 10 working on service_accounts task. I0331 04:10:30.249927 1 tasks_processing.go:71] worker 62 working on image_pruners task. I0331 04:10:30.251161 1 tasks_processing.go:71] worker 63 working on proxies task. I0331 04:10:30.255250 1 tasks_processing.go:71] worker 26 working on authentication task. I0331 04:10:30.255267 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 5.381434ms to process 0 records I0331 04:10:30.255282 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 5.080658ms to process 0 records E0331 04:10:30.255289 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0331 04:10:30.255297 1 gather.go:177] gatherer "clusterconfig" function "machines" took 5.181876ms to process 0 records I0331 04:10:30.255310 1 tasks_processing.go:71] worker 40 working on overlapping_namespace_uids task. E0331 04:10:30.255337 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0331 04:10:30.255351 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 5.396695ms to process 0 records I0331 04:10:30.255353 1 tasks_processing.go:74] worker 16 stopped. I0331 04:10:30.255360 1 tasks_processing.go:74] worker 36 stopped. I0331 04:10:30.255362 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 5.609658ms to process 0 records I0331 04:10:30.255366 1 tasks_processing.go:74] worker 6 stopped. I0331 04:10:30.255379 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 5.303446ms to process 0 records I0331 04:10:30.255400 1 tasks_processing.go:74] worker 12 stopped. I0331 04:10:30.259646 1 tasks_processing.go:74] worker 32 stopped. I0331 04:10:30.259662 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 9.731091ms to process 0 records I0331 04:10:30.259674 1 tasks_processing.go:74] worker 28 stopped. I0331 04:10:30.259683 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 9.298099ms to process 0 records I0331 04:10:30.259694 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 9.776642ms to process 0 records I0331 04:10:30.259699 1 tasks_processing.go:74] worker 29 stopped. I0331 04:10:30.272013 1 tasks_processing.go:74] worker 48 stopped. I0331 04:10:30.272029 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 21.904768ms to process 0 records I0331 04:10:30.272040 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 22.175436ms to process 0 records I0331 04:10:30.272044 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 21.557646ms to process 0 records I0331 04:10:30.272049 1 tasks_processing.go:74] worker 34 stopped. I0331 04:10:30.272052 1 tasks_processing.go:74] worker 49 stopped. I0331 04:10:30.272138 1 tasks_processing.go:74] worker 30 stopped. I0331 04:10:30.272148 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 21.159055ms to process 0 records I0331 04:10:30.272466 1 tasks_processing.go:74] worker 21 stopped. I0331 04:10:30.272663 1 recorder.go:75] Recording config/image with fingerprint=180668a8a7538d87d7418c3cda86d8187b46e5523eb7fb6c672e04b8a1885174 I0331 04:10:30.272682 1 gather.go:177] gatherer "clusterconfig" function "image" took 22.555104ms to process 1 records I0331 04:10:30.272759 1 tasks_processing.go:74] worker 9 stopped. I0331 04:10:30.272925 1 recorder.go:75] Recording config/network with fingerprint=49e8a274ba5f6dbe2756171c21474cbe5204462263569a054d2967aa45e77bd5 I0331 04:10:30.272943 1 gather.go:177] gatherer "clusterconfig" function "networks" took 22.543751ms to process 1 records I0331 04:10:30.272968 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 20.767584ms to process 0 records I0331 04:10:30.272975 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 20.654086ms to process 0 records I0331 04:10:30.272984 1 tasks_processing.go:74] worker 24 stopped. I0331 04:10:30.272989 1 tasks_processing.go:74] worker 57 stopped. I0331 04:10:30.274131 1 tasks_processing.go:74] worker 4 stopped. I0331 04:10:30.274269 1 recorder.go:75] Recording config/podnetworkconnectivitychecks with fingerprint=44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a I0331 04:10:30.274291 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 24.37858ms to process 1 records I0331 04:10:30.274343 1 tasks_processing.go:74] worker 27 stopped. I0331 04:10:30.274359 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 22.496439ms to process 0 records I0331 04:10:30.274583 1 tasks_processing.go:74] worker 63 stopped. I0331 04:10:30.275091 1 recorder.go:75] Recording config/proxy with fingerprint=b638a478fdf7d0974d9a07564af6b74aeff46357b60bed6c11fad4c3d54e0e31 I0331 04:10:30.275110 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 22.396515ms to process 1 records I0331 04:10:30.275273 1 tasks_processing.go:74] worker 62 stopped. I0331 04:10:30.275517 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=3505648755fff1f495e98d3df648d6fa60d0307ca7e36835bd3a5987dbf70c6c I0331 04:10:30.275531 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 23.116986ms to process 1 records E0331 04:10:30.281036 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0331 04:10:30.281051 1 tasks_processing.go:74] worker 61 stopped. I0331 04:10:30.281061 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 29.736128ms to process 0 records I0331 04:10:30.281220 1 tasks_processing.go:74] worker 56 stopped. I0331 04:10:30.281278 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=2406bef4906ec3105f1308fd9c863d436b73626ebbc42b1c2d2f50c2d0fb3c52 I0331 04:10:30.281289 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 31.276653ms to process 1 records I0331 04:10:30.283234 1 gather_cluster_operator_pods_and_events.go:121] Found 0 pods with 0 containers I0331 04:10:30.283253 1 tasks_processing.go:74] worker 15 stopped. I0331 04:10:30.283259 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 33.332873ms to process 0 records I0331 04:10:30.284056 1 tasks_processing.go:74] worker 1 stopped. I0331 04:10:30.284068 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 33.035586ms to process 0 records I0331 04:10:30.284121 1 tasks_processing.go:74] worker 19 stopped. I0331 04:10:30.284134 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 34.22337ms to process 0 records I0331 04:10:30.284458 1 tasks_processing.go:74] worker 20 stopped. I0331 04:10:30.284638 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=acdecc7979dec026461693ccd9ddb1d2af79dbc882f8c032a32c06e2a4719545 I0331 04:10:30.284667 1 recorder.go:75] Recording config/validatingwebhookconfigurations/cert-manager-webhook with fingerprint=498a82d342ca0ab86d7ef00cec80275e3a6da06c5016f4b817bb70b01060d02b I0331 04:10:30.284701 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.operator.tekton.dev with fingerprint=f78435f29b56f827c0e0b54873f14754af653e35bd11b38b15f9e22441c9b8a8 I0331 04:10:30.284724 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.pipeline.tekton.dev with fingerprint=a4bf0ec9da6c5903ae350775e3a01744e571161b3c7f1bfcc32f05759919d9ca I0331 04:10:30.284742 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.triggers.tekton.dev with fingerprint=3d7cd6365348b1386425c200c2392439130d7e4142f1a3de85a02d28dcb4218c I0331 04:10:30.284774 1 recorder.go:75] Recording config/validatingwebhookconfigurations/integration-service-validating-webhook-configuration with fingerprint=55b90d78605d2e86796e07696fdf6660141b796efd3a0e9535cf3bf55cc6cdd4 I0331 04:10:30.284803 1 recorder.go:75] Recording config/validatingwebhookconfigurations/monitoringconfigmaps.openshift.io with fingerprint=e42dd4c9ce65f6681eedf5b4fa57156c296382091f8194f12adc5dfa89ff4a9a I0331 04:10:30.284850 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=090ca8371242e98ed5ca5cf1eb6c61818b96e2567500ef737fc4df1971749aee I0331 04:10:30.284872 1 recorder.go:75] Recording config/validatingwebhookconfigurations/namespace.operator.tekton.dev with fingerprint=cbfd8f6f8c8a61e02a560b1caee8076a25ed73b49e3924879384928edb5ddc64 I0331 04:10:30.284947 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=8578bf1b57ab02f8b538d95663554b168b1c295cdc4ccfe9b96d547648ba98e9 I0331 04:10:30.284994 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=551367ac2d919d0fe214a10c9163a00cd663e62989b537ccbf93b50545ce3ea9 I0331 04:10:30.285017 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=28920866bf550304e2a2b1fd8ce91154be9789435cf4add3817113f8217811f1 I0331 04:10:30.285059 1 recorder.go:75] Recording config/validatingwebhookconfigurations/release-service-validating-webhook-configuration with fingerprint=45dccdd4a7b1892ba8fccc6c198e1f89894fa746cd94ae2372b3b0a7ae471eb4 I0331 04:10:30.285083 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=c2bb1974d4f628ee73b13b976fc7c815112899c5bb58cbf03dfc03a949e2f7d6 I0331 04:10:30.285106 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=133905be835e5bf2d1ba5ec6996708b0e22be3490af4965af54ec8bd1e6b4899 I0331 04:10:30.285129 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=cdceb87d6921d6fbd4e62027ee5d69590155092d28e5bb689888fa6a19cc64e1 I0331 04:10:30.285152 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=71979ecaaf6fbc570529923937c8c390fda97e5de32337662c79045854b923a9 I0331 04:10:30.285182 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=5667069e9db39e71b8c5937986e03ecede3945e556a32f01932a3ceb08e65d33 I0331 04:10:30.285205 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=3a0ad46fa9ccc5444bab8a1dca9bed28256eed9817f716c0793c16ed674824f6 I0331 04:10:30.285228 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=581047c191187ffa8b8d53f6e4d7e951282691a5428509c38e25e5a3812fae20 I0331 04:10:30.285251 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=b24564b70b89ac30de77db8c6c2a71f1d65481aabec31f68f5a74e8a93b8c48c I0331 04:10:30.285271 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.pipelinesascode.tekton.dev with fingerprint=9b87ba14676ba80dc85678a5fb661ca3795f4c69dd7831fed44e13e3a4418a1e I0331 04:10:30.285302 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.operator.tekton.dev with fingerprint=524a79c29ca06396b59fa8a3d5e80a22ab48e001c66dbdb83b7d666001209aad I0331 04:10:30.285354 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.pipeline.tekton.dev with fingerprint=caa88c81d4a9bdb27ce2353ffedff120d692f04d31487a254f79080e30696950 I0331 04:10:30.285404 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.triggers.tekton.dev with fingerprint=5bea93c177054bccafabf15fd5558b1eb2891833cd44d74d7e1b52292b767ce6 I0331 04:10:30.285413 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 34.513676ms to process 25 records I0331 04:10:30.285502 1 tasks_processing.go:74] worker 26 stopped. I0331 04:10:30.285589 1 recorder.go:75] Recording config/authentication with fingerprint=29453450e8136819e8a916be820a6962b577a43e22a8dbfef35f4828f89ee4f3 I0331 04:10:30.285599 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 29.199223ms to process 1 records I0331 04:10:30.285675 1 recorder.go:75] Recording config/featuregate with fingerprint=529c5e1be6590dd5f884197fb3be0f8126b3d13bd25119ad92e1dd6a32316ea5 I0331 04:10:30.285680 1 tasks_processing.go:74] worker 58 stopped. I0331 04:10:30.285684 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 33.779275ms to process 1 records I0331 04:10:30.285774 1 tasks_processing.go:74] worker 18 stopped. I0331 04:10:30.285936 1 recorder.go:75] Recording config/node/ip-10-0-0-143.ec2.internal with fingerprint=e7f36bdbf8e4f2c98fd7b9e648ea5ccd7622de93326c323ef6d30e668d99e3f3 I0331 04:10:30.285999 1 recorder.go:75] Recording config/node/ip-10-0-1-243.ec2.internal with fingerprint=382d8d776a0a9ab37480b4f0587ca7b66c5ae7c0b9e4d3f2707bea3773f39807 I0331 04:10:30.286053 1 recorder.go:75] Recording config/node/ip-10-0-2-160.ec2.internal with fingerprint=1b8fc7a551bd992b4b79f7e8b8ebe08a4d526d3a3d37f34fc48d2eb6aecb5b01 I0331 04:10:30.286059 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 34.07498ms to process 3 records I0331 04:10:30.286150 1 tasks_processing.go:74] worker 33 stopped. I0331 04:10:30.286335 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=f27d88d7b56f69cec94539c00249bb769a2a4203331dee5c1670fd113f6bdd69 I0331 04:10:30.286344 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 34.682329ms to process 1 records I0331 04:10:30.290716 1 tasks_processing.go:74] worker 23 stopped. I0331 04:10:30.290729 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 40.085174ms to process 0 records I0331 04:10:30.290753 1 tasks_processing.go:74] worker 54 stopped. I0331 04:10:30.290766 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 39.626782ms to process 0 records I0331 04:10:30.290808 1 tasks_processing.go:74] worker 59 stopped. I0331 04:10:30.290818 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 39.179844ms to process 0 records I0331 04:10:30.290823 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 39.325699ms to process 0 records I0331 04:10:30.290828 1 tasks_processing.go:74] worker 25 stopped. I0331 04:10:30.290857 1 tasks_processing.go:74] worker 2 stopped. I0331 04:10:30.290947 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/annotation.operator.tekton.dev with fingerprint=d6eadda72a662e332c2bab0ece6378d20759cc70f35987af18e2e4515b2d90bf I0331 04:10:30.290995 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=6b115b463fa03576255fe836d7bfe8e01ebe9e49dac89eaa537b2258c1debb26 I0331 04:10:30.291017 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/cert-manager-webhook with fingerprint=70ed4903476ec7128706cb03b3c823e1e57be0cc1f97ee8e2ca722946e5f15e4 I0331 04:10:30.291017 1 gather_logs.go:145] no pods in namespace were found I0331 04:10:30.291049 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/integration-service-mutating-webhook-configuration with fingerprint=46d35e91767ddb0dbb253c6ecbe06e9bf578fb8fc4872fc2f3f228207f539a44 I0331 04:10:30.291073 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/proxy.operator.tekton.dev with fingerprint=e84fa960bc63cd0f537d6d277eac48d83949fd3a774d00fbd870fa3cb3f9a62b I0331 04:10:30.291129 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/release-service-mutating-webhook-configuration with fingerprint=8cf17aefadb9744399db6ed61da972714ec0c38657de1d0fea32502513b2133f I0331 04:10:30.291153 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=40287c1c2b6ef7c08c6330ebea51d48a105d4776f71397d9d4683f17aaedfd99 I0331 04:10:30.291186 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=2483db8fd03672ea028df2104917ff3033299fdacd0c5fa10136a8ac8ead3651 I0331 04:10:30.291217 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.operator.tekton.dev with fingerprint=98a232ac4808397229a025f3961fdc47b1ed399305a95594d9384947bd062327 I0331 04:10:30.291254 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.pipeline.tekton.dev with fingerprint=eb79e4f23178c86844ac3e73b471be2b22a7db30b172ce3d0d15cefe903fe7c1 I0331 04:10:30.291288 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.triggers.tekton.dev with fingerprint=a5bddcbe079b16be950fb009c1bce6f20393b9d8c1dae9cc307364686a8f1dc1 I0331 04:10:30.291299 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 40.902244ms to process 11 records I0331 04:10:30.291312 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 40.324568ms to process 0 records I0331 04:10:30.291319 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 40.759659ms to process 0 records I0331 04:10:30.291333 1 tasks_processing.go:74] worker 14 stopped. I0331 04:10:30.291341 1 tasks_processing.go:74] worker 11 stopped. I0331 04:10:30.291335 1 tasks_processing.go:74] worker 47 stopped. I0331 04:10:30.291969 1 recorder.go:75] Recording config/ingress with fingerprint=3674e1c64abdde1a558bc58866d5e3408e61a763ba9e3cdc384d4c61ca609764 I0331 04:10:30.292029 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 40.241202ms to process 1 records I0331 04:10:30.292319 1 recorder.go:75] Recording config/apiserver with fingerprint=f3fe7b3148891c0c40eb5c0cfdb86c00f191377c67a9eab13d4d52860172f386 I0331 04:10:30.292355 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 40.10602ms to process 1 records I0331 04:10:30.292474 1 tasks_processing.go:74] worker 44 stopped. I0331 04:10:30.292612 1 tasks_processing.go:74] worker 41 stopped. I0331 04:10:30.292830 1 recorder.go:75] Recording config/oauth with fingerprint=48229f3f8ddc013e2e09493ef36a1612cf1983d439b6cd88a3ea7645ada10357 I0331 04:10:30.292872 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 39.884141ms to process 1 records I0331 04:10:30.293691 1 tasks_processing.go:74] worker 40 stopped. I0331 04:10:30.293718 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0331 04:10:30.293728 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 38.369447ms to process 1 records I0331 04:10:30.294983 1 tasks_processing.go:74] worker 53 stopped. I0331 04:10:30.295635 1 recorder.go:75] Recording config/infrastructure with fingerprint=7e34e72c1d481622a071be22c6b11d4432fe6331b9cea61395450bf795061d13 I0331 04:10:30.295651 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 43.810474ms to process 1 records I0331 04:10:30.295752 1 tasks_processing.go:74] worker 17 stopped. I0331 04:10:30.296006 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=c9f67d9bf9309ca267366a9b29fb8b4c9acd9cbdf55a6d1696a8890dd8779caf I0331 04:10:30.296248 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=c416b34fd4a06b7f3b47d3d3e1593ea730456cd3d13d3b9ee460a4f5876572c8 I0331 04:10:30.296260 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 45.588716ms to process 2 records I0331 04:10:30.301232 1 tasks_processing.go:74] worker 5 stopped. E0331 04:10:30.301246 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0331 04:10:30.301258 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 50.165292ms to process 0 records I0331 04:10:30.301332 1 tasks_processing.go:74] worker 8 stopped. I0331 04:10:30.301347 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 50.429725ms to process 0 records I0331 04:10:30.301364 1 tasks_processing.go:74] worker 45 stopped. I0331 04:10:30.301474 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=9925a8530deb54a72cbf533d732303bc5bf2e60197cc28bf5c15eaf4786e5383 I0331 04:10:30.301497 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=1d80ba0ba67f63f8d68664b4c367de4799978272980e0ff0a1edc8a45fcb3c4c I0331 04:10:30.301517 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 49.651735ms to process 2 records I0331 04:10:30.301604 1 tasks_processing.go:74] worker 50 stopped. I0331 04:10:30.301696 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=7faefb2227e4a7ba5b96dbe0b264634c8755e3d82bebf0254f9a774acce02e6f I0331 04:10:30.301718 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=dffab341046ec84854c8562554292f23b5f01e6c421f2eb25dbf509b922f5529 I0331 04:10:30.301737 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=1657c92fa3cf273bef7b470d81ab671f344fdc1f19a4432a3cf13c62001bcb1b I0331 04:10:30.301750 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=a79d8a5391dd31c1bfeb592cfb2bc604d140a0de347a09118a8ea6caea04a6ea I0331 04:10:30.301765 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=ca89683d6f689f053efbd1ad7c7e3e4a4bbba96b56cac7982c30696babe5d2af I0331 04:10:30.301780 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=19a5e95b24f281854298ec1e507344e1f268bf97bba59e5d02679eec0d84a1b3 I0331 04:10:30.301794 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=b1365bc15c99f27fac797229b31f209c938824d0bc3544251c968ea2a514b47a I0331 04:10:30.301815 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=b83acc35f1af4456842ae210a76c203cf890d53f5e9671080003d9b7c948d16d I0331 04:10:30.301831 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=b75432db4ab278c391c3d5a63af03669b69f7d2e765a08242ae1340c9fc55545 I0331 04:10:30.301844 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=8b253330562a1d47c7c128c3d8f73f0b5ee95d7203b9d7eae5aeaae5ae27f5d6 I0331 04:10:30.301860 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=a2a3f3e9aab5709b7495f82e247115ba0ab7f799e1aa8367e98ed63bca2be3e8 I0331 04:10:30.301866 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 50.474748ms to process 11 records E0331 04:10:30.301879 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0331 04:10:30.301944 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0331 04:10:30.301952 1 tasks_processing.go:74] worker 46 stopped. I0331 04:10:30.301960 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 50.169754ms to process 1 records I0331 04:10:30.302317 1 tasks_processing.go:74] worker 35 stopped. I0331 04:10:30.302332 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 52.472275ms to process 0 records I0331 04:10:30.304129 1 tasks_processing.go:74] worker 39 stopped. I0331 04:10:30.304144 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 52.099224ms to process 0 records I0331 04:10:30.316059 1 tasks_processing.go:74] worker 60 stopped. I0331 04:10:30.316319 1 recorder.go:75] Recording config/version with fingerprint=0044fde97f81109af074e68ff2b985bc281748f27010c01180a06089a609ab47 I0331 04:10:30.316336 1 recorder.go:75] Recording config/id with fingerprint=3881fc20288ed1e6a671cb7a2d8ed57d6bb9db8abc22cd1706bc71546884cc1a I0331 04:10:30.316345 1 gather.go:177] gatherer "clusterconfig" function "version" took 66.100606ms to process 2 records I0331 04:10:30.316583 1 tasks_processing.go:74] worker 0 stopped. I0331 04:10:30.317139 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=e14c80e0814635531be15defe5b2330ab7342068cdc9d911a5645c97bb8a4cea I0331 04:10:30.317878 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=9b2ab78a42fb32745c437c9d54ac5f06bdb0916ed4a304a59ac70f5860e7c61a I0331 04:10:30.317903 1 gather.go:177] gatherer "clusterconfig" function "crds" took 66.82217ms to process 2 records I0331 04:10:30.357172 1 tasks_processing.go:74] worker 31 stopped. I0331 04:10:30.357196 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 106.541395ms to process 0 records I0331 04:10:30.365753 1 tasks_processing.go:74] worker 22 stopped. E0331 04:10:30.365771 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0331 04:10:30.365778 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0331 04:10:30.365782 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0331 04:10:30.365792 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=7c953bef0cdbddb25a47a3c40772dfa7cbf73ae2ac9bb3dc97984dbf1bd43499 I0331 04:10:30.365829 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0331 04:10:30.365837 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0331 04:10:30.365841 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=4bec6f0bfa45f0ccf5709371166150dcb9cf2703d04f5f6de4476d0277c477a6 I0331 04:10:30.365851 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0331 04:10:30.365889 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0331 04:10:30.365897 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0331 04:10:30.365902 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 115.422127ms to process 7 records I0331 04:10:30.379165 1 tasks_processing.go:74] worker 51 stopped. I0331 04:10:30.380453 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-8777bd9bb-kn4dw with fingerprint=89d1050c5dbabd4e83227340167782ca3737b4941d3e478fa633857375bd39a4 I0331 04:10:30.380735 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-kq6qp with fingerprint=6ea3811b7f3e8499d3e3b517f63b576db1a3bd253e078c516dacc3b3dbce68ca I0331 04:10:30.380956 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-xzbq4 with fingerprint=2216524389ec0531c4b00a2ea6148d0793ec7538cf7971ade93b4af9f5473710 I0331 04:10:30.381086 1 recorder.go:75] Recording config/running_containers with fingerprint=58b140282f9d4bee971823ad7258468545b001451191d8560a08d020c26cad7e I0331 04:10:30.381097 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 127.626503ms to process 4 records I0331 04:10:30.414270 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0331 04:10:30.416759 1 tasks_processing.go:74] worker 13 stopped. E0331 04:10:30.416778 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0331 04:10:30.416787 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pcf4qvmb8c8ij76t9r5ocbboorpi5e4-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pcf4qvmb8c8ij76t9r5ocbboorpi5e4-primary-cert-bundle-secret" not found I0331 04:10:30.416857 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=ef799be0a0297923bcf9320181d02a973e00753ac0d74953c5f97fd3294212de I0331 04:10:30.416871 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 166.499539ms to process 1 records I0331 04:10:30.418782 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0331 04:10:30.428257 1 tasks_processing.go:74] worker 37 stopped. I0331 04:10:30.428496 1 recorder.go:75] Recording config/olm_operators with fingerprint=b405a3df05b5837706d2c9c20712d96aea1f0af3be673464275dd3e536a13ee7 I0331 04:10:30.428517 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 177.610693ms to process 1 records I0331 04:10:31.312673 1 tasks_processing.go:74] worker 38 stopped. I0331 04:10:31.312751 1 recorder.go:75] Recording config/metrics with fingerprint=4989551729cd5fb9c40b763c73562992b5070a1d98d67d29dfdb4053894f48c4 I0331 04:10:31.312764 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.062693516s to process 1 records I0331 04:10:31.313183 1 tasks_processing.go:74] worker 7 stopped. I0331 04:10:31.313200 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0331 04:10:31.313211 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.063451373s to process 1 records I0331 04:10:31.313655 1 tasks_processing.go:74] worker 52 stopped. I0331 04:10:31.313727 1 recorder.go:75] Recording config/alerts with fingerprint=70a08ff6fc6bf952695e28c6f21bbe761305a484475f7a6ce8e0dfa2dbb3190f I0331 04:10:31.313743 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.062034609s to process 1 records I0331 04:10:31.317856 1 tasks_processing.go:74] worker 43 stopped. I0331 04:10:31.317876 1 recorder.go:75] Recording config/tsdb.json with fingerprint=f24e192630e45d58e7a1c61ba0792ea555549fe4515908530b8b25980d74eae2 I0331 04:10:31.317884 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.0665308s to process 1 records I0331 04:10:32.748576 1 tasks_processing.go:74] worker 42 stopped. I0331 04:10:32.748947 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=1ea2410351deaeac22282693def4257b5662a267fa37022921487f330d023706 I0331 04:10:32.748962 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 2.497434579s to process 1 records I0331 04:10:32.777190 1 tasks_processing.go:74] worker 3 stopped. I0331 04:10:32.777261 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=b98d0eba928c1d91800ad8cca2aba9a1f0a5f2ce62301d1f95cc534371f11541 I0331 04:10:32.777317 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0331 04:10:32.777351 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=80ab9a86054f6ac16b7b122a67d928cdc570cd09be0afb3d09a31eb99f99ebfe I0331 04:10:32.777362 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0331 04:10:32.777405 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=c19e9a9c74129a885dcc39331cb7b9e40d8feb7e414551574125f886b758f683 I0331 04:10:32.777422 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0331 04:10:32.777443 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=f52429603da25eb913c91f31a2a14f1bf2390364b9400f3ae20b09399649a031 I0331 04:10:32.777471 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=95a24a17e680c32d4b89b7f8e82f9a0869d2b3b2bfb3e2f6f1c68b278ae14444 I0331 04:10:32.777494 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=3e6b0f313504f1c4beb70e994facc51c8122f6ba54c26baf1e9e838d23cc9fbd I0331 04:10:32.777525 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=bc9129cccf3c292ae4cdbe8e3e42b9d40312dfa449dd2a83f9c6145e9af319f4 I0331 04:10:32.777788 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=b5d8d6483f518a8a6f24aebab642a7d95594dd689fa7f0ddb31a87a233b4b517 I0331 04:10:32.777807 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=730548d389fd425526eed92a0685061c06fc1fb3aef62005232fc30b1c74e754 I0331 04:10:32.777815 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0331 04:10:32.777831 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=081af1b06165265048725a2599d2ca8e8aa6d36ff14f8b3cc4a1ac369187c0f5 I0331 04:10:32.777842 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0331 04:10:32.777858 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=7cbe2542c05f0d99617fcb3f7ad50cde54d81714ba67d23aafde32a851710b17 I0331 04:10:32.777867 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0331 04:10:32.777887 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=d5b634dc3602c2ae3875381e811d36ac322ca696697b73282a94ac09be76e164 I0331 04:10:32.777896 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0331 04:10:32.777919 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=58dfded4ff754f45f979a82c92cd08ba2a96b97ce4d0fe46dce1e570e74a2646 I0331 04:10:32.778022 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=260a8bd4da8425d000d8d2c21f84e4ef5bec3a1ec969bb0fbca58bf34c1950c8 I0331 04:10:32.778031 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0331 04:10:32.778066 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0331 04:10:32.778089 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0331 04:10:32.778112 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=f0d50594f83d05e11f25ca35193f3de75834e7ecbe1221a558d2b4a77cbd8c96 I0331 04:10:32.778136 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=d5c850574d4e1d8db7b20ed056cc2eccd9a32782b60e573e5d9c607c2f2d5c79 I0331 04:10:32.778145 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0331 04:10:32.778161 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=718aa34451cdf25644797661096d487d6b182e0a0add46d475c935900bd9ad7f I0331 04:10:32.778170 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0331 04:10:32.778187 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=c9dc105f8801d3db809b410eccc90197f4d14623419be5e11dc22294bc5d5f3e I0331 04:10:32.778196 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0331 04:10:32.778209 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=826031cc3f1e345fd7a79fdfa602881fe47d816004362d69f8d324edb9b95041 I0331 04:10:32.778224 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=f766bc5864650fc38068b0ccf5ae9ad16d5ff391a9a9f751feaa3f0f37974396 I0331 04:10:32.778237 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=7811b9c83244b3a579f042726f006cad28f9f2e18d20f08803cf9d8a6a48ebf2 I0331 04:10:32.778256 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=16cf66ca64ad74f59c76b15d89d32c5e608eb72b1c5bae9f655a2e1e336256fb I0331 04:10:32.778264 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0331 04:10:32.778291 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=112d8451ef9dba14509721cd8def270209ec43ed9efb0f2ae20b54a9c52c8f2c I0331 04:10:32.778307 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0331 04:10:32.778314 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0331 04:10:32.778320 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.526065064s to process 39 records I0331 04:10:43.298556 1 tasks_processing.go:74] worker 55 stopped. I0331 04:10:43.298621 1 recorder.go:75] Recording config/installplans with fingerprint=a5b6a5709edaa0451f27698816b5b95a2700db411a592b10d2f3fe3071ef5ef9 I0331 04:10:43.298635 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.048443312s to process 1 records I0331 04:10:44.059069 1 tasks_processing.go:74] worker 10 stopped. I0331 04:10:44.059432 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=74b727b232cc45b882d26cb89407f543533046358d1731eed12d9232af57da52 I0331 04:10:44.059451 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.806937183s to process 1 records E0331 04:10:44.059515 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.809s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error" I0331 04:10:44.060632 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0331 04:10:44.060649 1 periodic.go:216] Running workloads gatherer I0331 04:10:44.060665 1 tasks_processing.go:45] number of workers: 2 I0331 04:10:44.060672 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 04:10:44.060676 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I0331 04:10:44.060683 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 04:10:44.060752 1 tasks_processing.go:71] worker 0 working on workload_info task. I0331 04:10:44.068209 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-160.ec2.internal... I0331 04:10:44.068216 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-143.ec2.internal... I0331 04:10:44.068229 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-243.ec2.internal... I0331 04:10:44.083609 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak. I0331 04:10:44.083631 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak-pgsql. I0331 04:10:44.083638 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from server. I0331 04:10:44.083642 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from tpa-pgsql. I0331 04:10:44.091277 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-keycloak from keycloak-pgsql-bee. I0331 04:10:44.091291 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from importer. I0331 04:10:44.091296 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from server. I0331 04:10:44.091300 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from tpa-pgsql-bee. I0331 04:10:44.091309 1 tasks_processing.go:74] worker 1 stopped. I0331 04:10:44.091318 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 30.62374ms to process 0 records I0331 04:10:51.228027 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 7s I0331 04:10:51.268858 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 31s for image data I0331 04:10:51.277097 1 gather_workloads_info.go:387] No image sha256:57a1aea49d7cc275b37b8f52d602a3a9d1601ec6a21a3268dd4903566cb2e335 (10ms) I0331 04:10:51.286655 1 gather_workloads_info.go:387] No image sha256:09c857f0c20721d6b447f5f567182befc1ca6157128225849117a5c830feab23 (10ms) I0331 04:10:51.297051 1 gather_workloads_info.go:387] No image sha256:a18b7658b5cf078bcef30a1c752c42c46907714b589145c7c330cf7ba7db2715 (10ms) I0331 04:10:51.314995 1 gather_workloads_info.go:387] No image sha256:2ba73aa991da589b1ee1fa6903abcdd56387007f3d650d345fbc8458bc2baeac (18ms) I0331 04:10:51.324652 1 gather_workloads_info.go:387] No image sha256:00fa6a8075723e279b420c76d13105c1650b1d46db51c7018801c558c0a876c6 (10ms) I0331 04:10:51.334810 1 gather_workloads_info.go:398] Found image sha256:1c5b548d67e5c56e3297b2f8aa34428e544b5b5ac88bd8d0f465760375c501e6 (10ms) I0331 04:10:51.345154 1 gather_workloads_info.go:387] No image sha256:6263faa8ef7759ec21f26df08314c5d64e52d967b49961cb9404c54532c03365 (10ms) I0331 04:10:51.354376 1 gather_workloads_info.go:387] No image sha256:199df7c847c51c89b38ec42c4ac2b68156e1b24c02b60a01cfdfcbad6ea43489 (9ms) I0331 04:10:51.363940 1 gather_workloads_info.go:387] No image sha256:e4bb09dfe4513cdbe349507495c7f4044623a3c2aff866b7946d941e82a7a639 (10ms) I0331 04:10:51.373532 1 gather_workloads_info.go:387] No image sha256:d71caff0f67fe8d9665d39193d955fc9352224f647406a40e56428dd6cd24953 (10ms) I0331 04:10:51.382497 1 gather_workloads_info.go:387] No image sha256:2e3661304917ce7f3be49974faacc60c24cbe2833d7b50c8c205c2f3f2467950 (9ms) I0331 04:10:51.477865 1 gather_workloads_info.go:387] No image sha256:6d83c7e0e068178360998c815a3e0c729ca80a349954172aadafad5da5180d0c (95ms) I0331 04:10:51.578311 1 gather_workloads_info.go:387] No image sha256:f02c58838bf882d9b5d82a1a96e8ab29ce6033ae1b64418118fba43eb9151b41 (100ms) I0331 04:10:51.677683 1 gather_workloads_info.go:387] No image sha256:1ad039a130515504a258952cb18e67c3329da5182bb0623cc0891e6c15e2113a (99ms) I0331 04:10:51.778364 1 gather_workloads_info.go:387] No image sha256:61aeb8693f27b60dd35e3dd1961d14bd95988cae70d649b340045619e5de7acf (101ms) I0331 04:10:51.879491 1 gather_workloads_info.go:387] No image sha256:e476b4dafff885727b0057259c9df67a68e196f8cd92c21db2e4efe84a5f7a25 (101ms) I0331 04:10:51.977887 1 gather_workloads_info.go:387] No image sha256:1ca6fa787c621462fa2c67b9a42b1de67688883af90316475b0df35be3ed805d (98ms) I0331 04:10:52.078566 1 gather_workloads_info.go:387] No image sha256:27f3be442cf1d9f640657fb6d7cea6b133652226f9a80c3442df226b3cb3c2dc (101ms) I0331 04:10:52.177962 1 gather_workloads_info.go:387] No image sha256:1f4a37529de4f750099af18e113556bd995fe6922030c614b7d6d23eaa0bd318 (99ms) I0331 04:10:52.278940 1 gather_workloads_info.go:387] No image sha256:64dbe77583c8b23dc6852fc482ea5b4081490734944ec8b765d5450b3fdb30ed (101ms) I0331 04:10:52.377896 1 gather_workloads_info.go:387] No image sha256:185a95b130b6a27ad88fcf39803215b7bd998472b1e37225858435f4eb7c3c04 (99ms) I0331 04:10:52.481902 1 gather_workloads_info.go:387] No image sha256:3f586d6fd6139bbad131716168590b12db0cdfe4dcbb15ccee65b080d5594b6e (104ms) I0331 04:10:52.580349 1 gather_workloads_info.go:387] No image sha256:ce98d5d844bfc2ba8de1893866ad38166c95157d54abd8192b181e819bc50bb5 (98ms) I0331 04:10:52.677557 1 gather_workloads_info.go:387] No image sha256:6ca4eb17da6277b142a3353b675d735c106868f827243eaef70cd1ec01d36307 (97ms) I0331 04:10:52.778660 1 gather_workloads_info.go:387] No image sha256:3b9f60077c475f2baad0dd51ffc9d469f3a9b54c474bb86a35f93cb9b8fdc734 (101ms) I0331 04:10:52.878105 1 gather_workloads_info.go:387] No image sha256:51e1b5dc9fccbee5b7df78d0e8bbe379f75529232c102c9ed5b1ae134c4b9b4c (99ms) I0331 04:10:52.980086 1 gather_workloads_info.go:387] No image sha256:384e639f2ce3e75712a5ee1cc5520161342e9dd1e94444d134d7ad4a39dde279 (102ms) I0331 04:10:53.077238 1 gather_workloads_info.go:387] No image sha256:95801a943ba7d0ec4af53c3cd1177483e649bcd528b5a838a32ad2d860e6503a (97ms) I0331 04:10:53.177977 1 gather_workloads_info.go:387] No image sha256:4dcd0b18dea61968f20d49c4372eec43689eb52e823e1a6293e9b89c6e21e587 (101ms) I0331 04:10:53.278063 1 gather_workloads_info.go:387] No image sha256:d339ecf788d1681ba9945a2ea63ca675caec863ec75f497ef916103f4c898003 (100ms) I0331 04:10:53.378541 1 gather_workloads_info.go:387] No image sha256:66640a3f7bd65090345552611701a73e74bc44897b9d29e43b11f73b96598ac0 (100ms) I0331 04:10:53.477983 1 gather_workloads_info.go:387] No image sha256:3e8d51b4b12d970bf561f67d0fcd9c0966a6d49866e6466daa341ee43d95d6e2 (99ms) I0331 04:10:53.578682 1 gather_workloads_info.go:387] No image sha256:8ef614441b76914f5727f5bec23a9d8dc2785ca7fd6a2516f393529b7801da53 (101ms) I0331 04:10:53.678056 1 gather_workloads_info.go:387] No image sha256:a6b085cdad58db8529d99c22ec1ec79fe09ab00ab1c92ee38b29e7875dc0533c (99ms) I0331 04:10:53.778679 1 gather_workloads_info.go:387] No image sha256:5bd409efe77c6a126418be2c098dde9431c1a290cec885a7e37c0c8ddc2337a8 (101ms) I0331 04:10:53.877853 1 gather_workloads_info.go:387] No image sha256:1b58ba57c10e2ba03a0d8dba1f3f8faa866e1dca6170725b6909c2cc2b96efa6 (99ms) I0331 04:10:53.978339 1 gather_workloads_info.go:387] No image sha256:315260877c58d13e0511bbff7bdcc389bcd86deca48785023e28194b08c4c924 (100ms) I0331 04:10:54.077836 1 gather_workloads_info.go:387] No image sha256:120485f6d677cfeaae0509169f46df14f3ebfafd87b3d876dfa59b738f846c77 (99ms) I0331 04:10:54.177998 1 gather_workloads_info.go:387] No image sha256:12aec97ddeb527881acf5949bea2b227baa1dbfccf30679e8d57ff0b82e42707 (100ms) I0331 04:10:54.279466 1 gather_workloads_info.go:387] No image sha256:6a0d1f472283c686e438dbfbeec826db9d7d95f45f92842c4073f70704860d2f (101ms) I0331 04:10:54.378296 1 gather_workloads_info.go:387] No image sha256:3739c0c55f7f7ccc84309ae11eb23d3d9e5ad50a68e849a8a8dfda7f2f2bc137 (99ms) I0331 04:10:54.477983 1 gather_workloads_info.go:387] No image sha256:04156cd38c436fb6692930d18af59619b0669b2d80cd3590d0973c0e038c5d6d (100ms) I0331 04:10:54.578311 1 gather_workloads_info.go:387] No image sha256:92a731e25801365be0ad0916bec5bf24b2035e443ad1414a1631d1e0473ddf77 (100ms) I0331 04:10:54.677233 1 gather_workloads_info.go:387] No image sha256:cfcb0bd30c537e677ac6856c36c0c923b415f24d944c7aa1386489f511f6491d (99ms) I0331 04:10:54.777018 1 gather_workloads_info.go:387] No image sha256:46e034f706fdcd5f84f35a1250a064495f5f68c90fef13be9c01936904b07ed6 (100ms) I0331 04:10:54.877123 1 gather_workloads_info.go:387] No image sha256:aa65d1c7fb8805b767fc4878faea280472f372010efadc66e5641a2e634a80c0 (100ms) I0331 04:10:54.977364 1 gather_workloads_info.go:387] No image sha256:72f9394f6f1b36ca9eb80961eac8f196e81f215632d14375845fbbe5970f0701 (100ms) I0331 04:10:55.077756 1 gather_workloads_info.go:387] No image sha256:917de30c85816179b3f8db32b8c94bfed2a54adc65b1a8be7ea73e245fa88b55 (100ms) I0331 04:10:55.178225 1 gather_workloads_info.go:387] No image sha256:54440fa6cb1b01a6b8952f700677832d7b7d3b1b58934957f504ca885730844a (100ms) I0331 04:10:55.277629 1 gather_workloads_info.go:387] No image sha256:07a6c0a310270b830b96fcb8fca9cd11e45569276335bb5334b18b388d6eed51 (99ms) I0331 04:10:55.378439 1 gather_workloads_info.go:387] No image sha256:503831414ca09befa276fdffd836708f04d2d430b1fd428cb3b0e3cd5bd74eb3 (101ms) I0331 04:10:55.477662 1 gather_workloads_info.go:387] No image sha256:0fd69333c121efd68919e731cd3ea01e976e00415bda6e987bf1e949ec224eda (99ms) I0331 04:10:55.577669 1 gather_workloads_info.go:387] No image sha256:31e175b644c6627779ca6b9f48d9426760dd449788ad671dd0277cce8fb822e8 (100ms) I0331 04:10:55.677589 1 gather_workloads_info.go:387] No image sha256:4f86f5c692a497442b54c435e68b0cbf961591a00ebc3a73c364a19da673e34d (100ms) I0331 04:10:55.777579 1 gather_workloads_info.go:387] No image sha256:7e0a58aad44d5b09954f8261e3e428c8dfa076eb9c2b6ef46a91d27ac78ac17a (100ms) I0331 04:10:55.877924 1 gather_workloads_info.go:387] No image sha256:2f26472542da4f89a2ac34a93fd438d385419dda16811bdfa7e679e0115abe56 (100ms) I0331 04:10:55.977570 1 gather_workloads_info.go:387] No image sha256:9db50052057ad4ec94099bc3c9ab476f5ac7b00954c99cb0b26fe729abba3387 (100ms) I0331 04:10:56.078762 1 gather_workloads_info.go:387] No image sha256:59b844637eca688cc22c7841bc4480a26d1384444bf9b0161261a182f87a1262 (101ms) I0331 04:10:56.179642 1 gather_workloads_info.go:387] No image sha256:b336f6e44314dd23a21236118a604411522baf5e63732463f1d08daccb417f39 (101ms) I0331 04:10:56.277775 1 gather_workloads_info.go:387] No image sha256:5b51a4d9d3b7ecad110fb6eb00f71e9e9b854067d79b220df397a58d9fa50eb0 (98ms) I0331 04:10:56.377739 1 gather_workloads_info.go:387] No image sha256:3da5a449ace61cb7d002d8e7911c14905c74cf58a296527458d1af0f1abf0a72 (100ms) I0331 04:10:56.477811 1 gather_workloads_info.go:387] No image sha256:6ea0f19030ffc52a290e6eeb812ef2426c48a2f1083b1e415e0667998cbb7bf2 (100ms) I0331 04:10:56.577961 1 gather_workloads_info.go:387] No image sha256:12448aad6e9050c2b2445035be818a490cef502d39b73dbd51cc0f5ea7d67d40 (100ms) I0331 04:10:56.677602 1 gather_workloads_info.go:387] No image sha256:44ceafe5147680d58a5c2d3720932b972e6bc9639faadc19aa6b360af154e1a3 (100ms) I0331 04:10:56.777580 1 gather_workloads_info.go:387] No image sha256:20a3e59566dd25058fff22e18569067fe6a12d8ac5ac62fa6508e0cee44d7897 (100ms) I0331 04:10:56.879436 1 gather_workloads_info.go:387] No image sha256:72ae38682f25786aec18625cfed5d7831017d2f0f1304c3320c00ce0b7fb09c1 (102ms) I0331 04:10:56.977818 1 gather_workloads_info.go:387] No image sha256:ad0e262327997e8cdc4074a2373e67274d9b8a943aa274a2cd8ce98ffe1db4a0 (98ms) I0331 04:10:57.078076 1 gather_workloads_info.go:387] No image sha256:cc686a64f9ae83adecc7a0ffe8a6b82f0750dc39ad05654a8087cf780a1c3b3a (100ms) I0331 04:10:57.178133 1 gather_workloads_info.go:387] No image sha256:c59765325e6f286c067e555850b0d81f2de5e5ee8625ed83cdc2cea96f3a7ddb (100ms) I0331 04:10:57.277147 1 gather_workloads_info.go:387] No image sha256:07789f6e6e3c3a5a974c106b43c2e8bc60edb3321def1f0883f3fcd35a238ed0 (99ms) I0331 04:10:57.378083 1 gather_workloads_info.go:387] No image sha256:2a07c1b2ef06bbfa3a491b84f7410e24de7cb487f49bbbb3bfd7cb3510c8429a (101ms) I0331 04:10:57.477604 1 gather_workloads_info.go:398] Found image sha256:70dcc3c7d3a572ecacc7c838fd17d07ff21531e50a7ed9227a17c27437151bf4 (99ms) I0331 04:10:57.578304 1 gather_workloads_info.go:387] No image sha256:14e983ca10e1033822e1c4be0a1e4a40762951a5d6e4a77bf642891f291d32ae (101ms) I0331 04:10:57.677196 1 gather_workloads_info.go:387] No image sha256:4c39dc633bf3560c2397281b74faf9d00500b0738dec6c1aad2cc8ce326be6fc (99ms) I0331 04:10:57.777768 1 gather_workloads_info.go:387] No image sha256:273930332d7b481bbca4521cf740507498a2a323a4010cd66e896806b299f85e (101ms) I0331 04:10:57.878162 1 gather_workloads_info.go:387] No image sha256:2ade6dfb5406ef3a4264dea95d455298f54e8ef4d458d9ee3e94c33d48676a9b (100ms) I0331 04:10:57.977767 1 gather_workloads_info.go:387] No image sha256:865dd51e80034018400794d07edc0b546c6e4de7e2351dddc7f1f6378e1ffdd0 (100ms) I0331 04:10:58.077622 1 gather_workloads_info.go:387] No image sha256:d88f384ee9cf4475b16d9589e88b28c9f2407247fbedfa3d9bfcaed95753514e (100ms) I0331 04:10:58.178096 1 gather_workloads_info.go:387] No image sha256:24929612f2f0f2d4cd3ac163c04bbf4ac64cc47d3d0eef81db085d00c59058bd (100ms) I0331 04:10:58.277265 1 gather_workloads_info.go:387] No image sha256:2c4ec0dfd62375ed45d5758798b1069e16a0a6d1986439d23c61591c4dfb9297 (99ms) I0331 04:10:58.380232 1 gather_workloads_info.go:387] No image sha256:1e9a9f1b5ecdab7d074722c860daab977519123fe4385affdfd86d8c7f3c473c (103ms) I0331 04:10:58.477046 1 gather_workloads_info.go:387] No image sha256:050fe6fe1298c45a27982e3f4d0afe637ce01d9b394e85b7eb202309ecdd0731 (97ms) I0331 04:10:58.578210 1 gather_workloads_info.go:387] No image sha256:5f852f6127d27e6fc071afe58d80024370467cb2476f4d9f077f8ebca8600918 (101ms) I0331 04:10:58.677560 1 gather_workloads_info.go:387] No image sha256:87de118dc29ca1b47d4768ec5ed4441bc1dada3fb2a78d53b1833249baa86dd4 (99ms) I0331 04:10:58.777653 1 gather_workloads_info.go:387] No image sha256:0e5fa2595714628c16cf590efd28715bde790d2dc6b3a793b2a38dfb3ffb591a (100ms) I0331 04:10:58.877715 1 gather_workloads_info.go:387] No image sha256:38d71a4cf177f39a2bbe745183009943dbbf404de02aa5f879694aa024a4e6ac (100ms) I0331 04:10:58.978435 1 gather_workloads_info.go:387] No image sha256:43efa5a676666dd4ae039ad5518eaf636f5baf8d688d9a4b475822c32ad1ddfb (101ms) I0331 04:10:59.079375 1 gather_workloads_info.go:387] No image sha256:8f72efd51f564d8d3e4ecee6555d7bd5394d0776054d2112febea6b7c9e71225 (101ms) I0331 04:10:59.177457 1 gather_workloads_info.go:387] No image sha256:ada1a963ce2c45d2bba08051c1e0e2db88b200e9d616fab8fde10b698101fc69 (98ms) I0331 04:10:59.278034 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (101ms) I0331 04:10:59.378192 1 gather_workloads_info.go:387] No image sha256:1e6d59867cbd750672bc9ccfb9c69c3d198174cd43dd6d71a0da358b4b766473 (100ms) I0331 04:10:59.477509 1 gather_workloads_info.go:387] No image sha256:373050d2ded02b5acd0e5edf3ef9819fe65403b2f40b557e9077e4a57629cb97 (99ms) I0331 04:10:59.578244 1 gather_workloads_info.go:387] No image sha256:2f6f91dfd7b71cad1c6db82835d709d20f4153cf500d60ee32145712af922214 (101ms) I0331 04:10:59.677321 1 gather_workloads_info.go:387] No image sha256:5ffaf92fc557cb891a546ae2682d4e0259166ad6d935970dc958d255abc29a48 (99ms) I0331 04:10:59.778089 1 gather_workloads_info.go:387] No image sha256:0d70224d12e358b1a107a86e0a7e0845e1e8a4d30ce3a1423600f044e3fb28d2 (101ms) I0331 04:10:59.876977 1 gather_workloads_info.go:387] No image sha256:4e62a2dcb8214491388d4c17f89fe699eb53cdb8039dcba6ab052edc28da3fbd (99ms) I0331 04:10:59.978309 1 gather_workloads_info.go:387] No image sha256:b8d380990acb0184ab685b005e22fb8369139dd8cd6550b4521bd4bc3ca23b40 (101ms) I0331 04:10:59.978354 1 tasks_processing.go:74] worker 0 stopped. I0331 04:10:59.978816 1 recorder.go:75] Recording config/workload_info with fingerprint=2d7c59ac3ef0eee8dfdcca19da000ec181c0d64f4f02efc0654564c44ab0ec45 I0331 04:10:59.978833 1 gather.go:177] gatherer "workloads" function "workload_info" took 15.917585629s to process 1 records I0331 04:10:59.978847 1 periodic.go:263] Periodic gather workloads completed in 15.918s I0331 04:10:59.978855 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0331 04:10:59.978860 1 periodic.go:216] Running conditional gatherer I0331 04:10:59.984504 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.6/gathering_rules I0331 04:11:00.167504 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer I0331 04:11:00.169060 1 conditional_gatherer.go:374] alert "Watchdog" has state "firing" I0331 04:11:00.169072 1 conditional_gatherer.go:374] alert "PodSecurityViolation" has state "firing" I0331 04:11:00.169076 1 conditional_gatherer.go:374] alert "AlertmanagerReceiversNotConfigured" has state "firing" I0331 04:11:00.169136 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0331 04:11:00.176826 1 conditional_gatherer.go:392] cluster version is '4.21.6' I0331 04:11:00.176854 1 tasks_processing.go:45] number of workers: 3 I0331 04:11:00.176866 1 tasks_processing.go:69] worker 2 listening for tasks. I0331 04:11:00.176871 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0331 04:11:00.176876 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 04:11:00.176891 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0331 04:11:00.176898 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0331 04:11:00.176900 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 04:11:00.176915 1 tasks_processing.go:74] worker 1 stopped. I0331 04:11:00.176992 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0331 04:11:00.177007 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.492µs to process 1 records I0331 04:11:00.177041 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0331 04:11:00.177049 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.146µs to process 1 records I0331 04:11:00.177055 1 tasks_processing.go:74] worker 0 stopped. I0331 04:11:00.177163 1 tasks_processing.go:74] worker 2 stopped. I0331 04:11:00.177179 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 256.432µs to process 0 records I0331 04:11:00.177214 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0331 04:11:00.177242 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0331 04:11:00.203912 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=5f7b1182941f4aa7007c6d4f15bf870f3a6a1bd36d6071a95238aa583b6fc8d2 I0331 04:11:00.204046 1 diskrecorder.go:70] Writing 136 records to /var/lib/insights-operator/insights-2026-03-31-041100.tar.gz I0331 04:11:00.214113 1 diskrecorder.go:51] Wrote 136 records to disk in 10ms I0331 04:11:00.214143 1 periodic.go:285] Gathering cluster info every 2h0m0s I0331 04:11:00.214157 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0331 04:11:55.556194 1 controller.go:554] The operator is healthy I0331 04:12:00.250208 1 diskrecorder.go:223] Found files to send: insights-2026-03-31-041100.tar.gz I0331 04:12:00.250239 1 insightsuploader.go:150] Checking archives to upload periodically every 15m36.090326604s I0331 04:12:00.250247 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0331 04:12:00.259873 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0331 04:12:00.452941 1 requests.go:87] Successfully reported id=2026-03-31T04:12:00Z x-rh-insights-request-id=460426836fe54469868d3f56aeacd69d, wrote=75337 I0331 04:12:00.453007 1 insightsuploader.go:187] Uploaded report successfully in 202.752891ms I0331 04:12:00.453031 1 controller.go:129] Initializing last reported time to 2026-03-31T04:12:00Z I0331 04:12:00.453103 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0331 04:12:00.453115 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0331 04:12:00.453123 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0331 04:12:00.459637 1 controller.go:554] The operator is healthy I0331 04:12:38.852585 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:12:38.859222 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:12:38.886291 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:12:38.891185 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:12:38.891201 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:12:38.895584 1 secretconfigobserver.go:119] support secret does not exist I0331 04:13:04.383299 1 insightsreport.go:137] Pulling report from smart-proxy I0331 04:13:04.383323 1 insightsreport.go:149] Retrieving report I0331 04:13:04.392551 1 requests.go:110] Retrieving report for cluster: 85b07698-dffd-428c-8402-caa6e54d9299 I0331 04:13:04.392566 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/85b07698-dffd-428c-8402-caa6e54d9299/reports I0331 04:13:04.396529 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/85b07698-dffd-428c-8402-caa6e54d9299/reports I0331 04:13:04.593932 1 insightsreport.go:184] Report retrieved I0331 04:13:04.639544 1 insightsreport.go:239] Report retrieved correctly I0331 04:13:55.555298 1 controller.go:554] The operator is healthy I0331 04:15:55.555833 1 controller.go:554] The operator is healthy I0331 04:17:38.896560 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:17:38.904314 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:17:38.904333 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:17:38.908837 1 secretconfigobserver.go:119] support secret does not exist I0331 04:17:55.559422 1 controller.go:554] The operator is healthy I0331 04:19:55.555267 1 controller.go:554] The operator is healthy I0331 04:21:55.555351 1 controller.go:554] The operator is healthy