I0331 04:06:44.384984 1 cmd.go:253] Using service-serving-cert provided certificates I0331 04:06:44.385448 1 observer_polling.go:159] Starting file observer I0331 04:06:45.554362 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0331 04:06:45.554713 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0331 04:06:45.555280 1 secure_serving.go:57] Forcing use of http/1.1 only W0331 04:06:45.555307 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0331 04:06:45.555313 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0331 04:06:45.555317 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0331 04:06:45.555320 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0331 04:06:45.555322 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0331 04:06:45.555324 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0331 04:06:45.555642 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0331 04:06:45.559958 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0331 04:06:45.560009 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"b73c151a-01e9-43c3-a302-99323668a10b", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0331 04:06:45.560468 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0331 04:06:45.560498 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0331 04:06:45.560498 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0331 04:06:45.560498 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0331 04:06:45.560548 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0331 04:06:45.560549 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0331 04:06:45.560840 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0331 04:06:45.561339 1 secure_serving.go:213] Serving securely on [::]:8443 I0331 04:06:45.561378 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0331 04:06:45.565080 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0331 04:06:45.565108 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0331 04:06:45.565153 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0331 04:06:45.570055 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:06:45.570079 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0331 04:06:45.574584 1 secretconfigobserver.go:119] support secret does not exist I0331 04:06:45.582177 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:06:45.587056 1 secretconfigobserver.go:119] support secret does not exist I0331 04:06:45.589117 1 recorder.go:161] Pruning old reports every 5h14m39s, max age is 288h0m0s I0331 04:06:45.594035 1 operator.go:316] The last pod state is unhealthy I0331 04:06:45.661059 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0331 04:06:45.661068 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0331 04:06:45.661146 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0331 04:06:45.665301 1 base_controller.go:82] Caches are synced for ConfigController I0331 04:06:45.665320 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0331 04:06:45.670316 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:07:05.598232 1 operator.go:316] The last pod state is unhealthy I0331 04:07:25.597857 1 operator.go:316] The last pod state is unhealthy I0331 04:07:45.597206 1 operator.go:316] The last pod state is unhealthy I0331 04:08:05.597920 1 operator.go:316] The last pod state is unhealthy I0331 04:08:25.595921 1 operator.go:316] The last pod state is unhealthy I0331 04:08:45.597465 1 operator.go:316] The last pod state is unhealthy I0331 04:09:05.597156 1 operator.go:316] The last pod state is unhealthy I0331 04:09:25.597510 1 operator.go:316] The last pod state is unhealthy I0331 04:09:45.597254 1 operator.go:316] The last pod state is unhealthy I0331 04:10:05.597601 1 operator.go:316] The last pod state is unhealthy I0331 04:10:25.597983 1 operator.go:316] The last pod state is unhealthy I0331 04:10:45.596769 1 operator.go:316] The last pod state is unhealthy I0331 04:11:05.597869 1 operator.go:316] The last pod state is unhealthy I0331 04:11:25.597766 1 operator.go:316] The last pod state is unhealthy I0331 04:11:45.595189 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:11:45.595857 1 operator.go:316] The last pod state is unhealthy I0331 04:11:45.600569 1 secretconfigobserver.go:119] support secret does not exist I0331 04:12:05.598042 1 operator.go:316] The last pod state is unhealthy I0331 04:12:08.163647 1 operator.go:248] Unable to check insights-operator pod status. Setting initial delay to 11m48.757640294s I0331 04:12:08.163783 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0331 04:12:08.163819 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 13m18s I0331 04:12:08.163831 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0331 04:12:08.163844 1 insightsreport.go:296] Starting report retriever I0331 04:12:08.163852 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0331 04:12:08.170146 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0331 04:12:08.170170 1 controller.go:326] The initial operator extension status is healthy I0331 04:12:08.170178 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:12:08.170184 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:12:08.170187 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:12:08.170201 1 controller.go:489] The operator is still being initialized I0331 04:12:08.170207 1 controller.go:512] The operator is healthy I0331 04:12:08.170294 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0331 04:12:08.170369 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0331 04:12:08.170442 1 operator.go:288] started I0331 04:12:08.170479 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0331 04:12:08.180683 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:12:08.180702 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:12:08.180707 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:12:08.180712 1 controller.go:212] Source scaController *sca.Controller is not ready I0331 04:12:08.180717 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0331 04:12:08.180739 1 controller.go:489] The operator is still being initialized I0331 04:12:08.180746 1 controller.go:512] The operator is healthy I0331 04:12:08.190141 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0331 04:12:08.258684 1 cluster_transfer.go:102] no available accepted cluster transfer I0331 04:12:08.258705 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0331 04:12:08.270841 1 base_controller.go:82] Caches are synced for LoggingSyncer I0331 04:12:08.270862 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0331 04:12:08.363775 1 sca.go:266] etc-pki-entitlement secret successfully created I0331 04:12:08.363818 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0331 04:14:08.179988 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:14:08.180007 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:14:08.180011 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:14:08.180030 1 controller.go:489] The operator is still being initialized I0331 04:14:08.180036 1 controller.go:512] The operator is healthy I0331 04:16:08.186228 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:16:08.186247 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:16:08.186252 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:16:08.186284 1 controller.go:512] The operator is healthy I0331 04:16:45.582695 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:16:45.587599 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:16:45.600623 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:16:45.605070 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:16:45.605093 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:16:45.608936 1 secretconfigobserver.go:119] support secret does not exist I0331 04:18:08.180429 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:18:08.180447 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:18:08.180451 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:18:08.180483 1 controller.go:512] The operator is healthy I0331 04:20:08.180578 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:20:08.180598 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:20:08.180602 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:20:08.180627 1 controller.go:512] The operator is healthy I0331 04:21:45.609289 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:21:45.614579 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:21:45.614602 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:21:45.619002 1 secretconfigobserver.go:119] support secret does not exist I0331 04:22:08.179894 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:22:08.179911 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:22:08.179914 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:22:08.179939 1 controller.go:512] The operator is healthy I0331 04:23:56.921514 1 periodic.go:209] Running clusterconfig gatherer I0331 04:23:56.921579 1 tasks_processing.go:45] number of workers: 64 I0331 04:23:56.921602 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 04:23:56.921618 1 tasks_processing.go:69] worker 6 listening for tasks. I0331 04:23:56.921622 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 04:23:56.921626 1 tasks_processing.go:69] worker 2 listening for tasks. I0331 04:23:56.921624 1 tasks_processing.go:69] worker 12 listening for tasks. I0331 04:23:56.921635 1 tasks_processing.go:69] worker 3 listening for tasks. I0331 04:23:56.921635 1 tasks_processing.go:69] worker 34 listening for tasks. I0331 04:23:56.921639 1 tasks_processing.go:69] worker 4 listening for tasks. I0331 04:23:56.921642 1 tasks_processing.go:71] worker 34 working on openstack_controlplanes task. I0331 04:23:56.921643 1 tasks_processing.go:69] worker 5 listening for tasks. I0331 04:23:56.921642 1 tasks_processing.go:71] worker 3 working on machines task. I0331 04:23:56.921644 1 tasks_processing.go:69] worker 33 listening for tasks. I0331 04:23:56.921629 1 tasks_processing.go:71] worker 1 working on monitoring_persistent_volumes task. I0331 04:23:56.921663 1 tasks_processing.go:69] worker 13 listening for tasks. I0331 04:23:56.921670 1 tasks_processing.go:69] worker 14 listening for tasks. I0331 04:23:56.921676 1 tasks_processing.go:69] worker 15 listening for tasks. I0331 04:23:56.921669 1 tasks_processing.go:69] worker 9 listening for tasks. I0331 04:23:56.921682 1 tasks_processing.go:69] worker 25 listening for tasks. I0331 04:23:56.921677 1 tasks_processing.go:69] worker 7 listening for tasks. I0331 04:23:56.921688 1 tasks_processing.go:69] worker 26 listening for tasks. I0331 04:23:56.921649 1 tasks_processing.go:69] worker 10 listening for tasks. I0331 04:23:56.921691 1 tasks_processing.go:69] worker 8 listening for tasks. I0331 04:23:56.921695 1 tasks_processing.go:69] worker 27 listening for tasks. I0331 04:23:56.921699 1 tasks_processing.go:69] worker 28 listening for tasks. I0331 04:23:56.921698 1 tasks_processing.go:69] worker 24 listening for tasks. I0331 04:23:56.921709 1 tasks_processing.go:69] worker 19 listening for tasks. I0331 04:23:56.921704 1 tasks_processing.go:69] worker 30 listening for tasks. I0331 04:23:56.921712 1 tasks_processing.go:69] worker 29 listening for tasks. I0331 04:23:56.921713 1 tasks_processing.go:69] worker 32 listening for tasks. I0331 04:23:56.921717 1 tasks_processing.go:69] worker 20 listening for tasks. I0331 04:23:56.921708 1 tasks_processing.go:69] worker 31 listening for tasks. I0331 04:23:56.921724 1 tasks_processing.go:69] worker 17 listening for tasks. I0331 04:23:56.921720 1 tasks_processing.go:69] worker 50 listening for tasks. I0331 04:23:56.921731 1 tasks_processing.go:69] worker 35 listening for tasks. I0331 04:23:56.921735 1 tasks_processing.go:69] worker 52 listening for tasks. I0331 04:23:56.921733 1 tasks_processing.go:71] worker 0 working on active_alerts task. I0331 04:23:56.921738 1 tasks_processing.go:69] worker 63 listening for tasks. I0331 04:23:56.921731 1 tasks_processing.go:69] worker 62 listening for tasks. I0331 04:23:56.921723 1 tasks_processing.go:69] worker 42 listening for tasks. I0331 04:23:56.921746 1 tasks_processing.go:69] worker 44 listening for tasks. I0331 04:23:56.921654 1 tasks_processing.go:69] worker 11 listening for tasks. I0331 04:23:56.921718 1 tasks_processing.go:69] worker 16 listening for tasks. I0331 04:23:56.921728 1 tasks_processing.go:69] worker 51 listening for tasks. I0331 04:23:56.921752 1 tasks_processing.go:69] worker 23 listening for tasks. I0331 04:23:56.921755 1 tasks_processing.go:69] worker 61 listening for tasks. I0331 04:23:56.921731 1 tasks_processing.go:69] worker 21 listening for tasks. I0331 04:23:56.921764 1 tasks_processing.go:71] worker 61 working on storage_cluster task. I0331 04:23:56.921766 1 tasks_processing.go:69] worker 48 listening for tasks. I0331 04:23:56.921765 1 tasks_processing.go:69] worker 49 listening for tasks. I0331 04:23:56.921764 1 tasks_processing.go:71] worker 6 working on image_registries task. I0331 04:23:56.921772 1 tasks_processing.go:71] worker 30 working on pdbs task. I0331 04:23:56.921768 1 tasks_processing.go:69] worker 41 listening for tasks. I0331 04:23:56.921775 1 tasks_processing.go:69] worker 47 listening for tasks. I0331 04:23:56.921767 1 tasks_processing.go:71] worker 21 working on networks task. I0331 04:23:56.921780 1 tasks_processing.go:71] worker 49 working on container_images task. I0331 04:23:56.921785 1 tasks_processing.go:71] worker 52 working on machine_autoscalers task. I0331 04:23:56.921787 1 tasks_processing.go:71] worker 47 working on schedulers task. I0331 04:23:56.921819 1 tasks_processing.go:69] worker 39 listening for tasks. I0331 04:23:56.921828 1 tasks_processing.go:71] worker 39 working on node_logs task. I0331 04:23:56.921736 1 tasks_processing.go:69] worker 22 listening for tasks. I0331 04:23:56.921857 1 tasks_processing.go:71] worker 7 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0331 04:23:56.921740 1 tasks_processing.go:69] worker 43 listening for tasks. I0331 04:23:56.921741 1 tasks_processing.go:69] worker 59 listening for tasks. I0331 04:23:56.921748 1 tasks_processing.go:69] worker 36 listening for tasks. I0331 04:23:56.921750 1 tasks_processing.go:69] worker 60 listening for tasks. I0331 04:23:56.921753 1 tasks_processing.go:69] worker 45 listening for tasks. I0331 04:23:56.921630 1 tasks_processing.go:71] worker 2 working on version task. I0331 04:23:56.921878 1 tasks_processing.go:71] worker 51 working on ingress task. I0331 04:23:56.921851 1 tasks_processing.go:71] worker 25 working on nodenetworkconfigurationpolicies task. I0331 04:23:56.921886 1 tasks_processing.go:71] worker 20 working on oauths task. I0331 04:23:56.921878 1 tasks_processing.go:71] worker 32 working on jaegers task. I0331 04:23:56.921895 1 tasks_processing.go:71] worker 13 working on silenced_alerts task. I0331 04:23:56.921922 1 tasks_processing.go:71] worker 23 working on ingress_certificates task. I0331 04:23:56.921926 1 tasks_processing.go:71] worker 27 working on clusterroles task. I0331 04:23:56.921928 1 tasks_processing.go:69] worker 53 listening for tasks. I0331 04:23:56.921917 1 tasks_processing.go:71] worker 31 working on feature_gates task. I0331 04:23:56.921945 1 tasks_processing.go:69] worker 54 listening for tasks. I0331 04:23:56.921950 1 tasks_processing.go:71] worker 22 working on aggregated_monitoring_cr_names task. I0331 04:23:56.921956 1 tasks_processing.go:71] worker 54 working on sap_datahubs task. I0331 04:23:56.921997 1 tasks_processing.go:71] worker 14 working on machine_config_pools task. I0331 04:23:56.921636 1 tasks_processing.go:71] worker 12 working on cluster_apiserver task. I0331 04:23:56.922067 1 tasks_processing.go:71] worker 17 working on storage_classes task. I0331 04:23:56.921890 1 tasks_processing.go:69] worker 55 listening for tasks. I0331 04:23:56.921761 1 tasks_processing.go:69] worker 38 listening for tasks. I0331 04:23:56.921724 1 tasks_processing.go:69] worker 58 listening for tasks. I0331 04:23:56.921774 1 tasks_processing.go:71] worker 48 working on tsdb_status task. I0331 04:23:56.922123 1 tasks_processing.go:71] worker 29 working on crds task. I0331 04:23:56.922165 1 tasks_processing.go:71] worker 43 working on infrastructures task. I0331 04:23:56.922187 1 tasks_processing.go:71] worker 4 working on sap_pods task. I0331 04:23:56.921946 1 tasks_processing.go:71] worker 53 working on install_plans task. I0331 04:23:56.922210 1 tasks_processing.go:71] worker 33 working on sap_config task. I0331 04:23:56.922251 1 tasks_processing.go:71] worker 15 working on metrics task. I0331 04:23:56.922279 1 tasks_processing.go:71] worker 5 working on openshift_logging task. I0331 04:23:56.921782 1 tasks_processing.go:71] worker 41 working on authentication task. I0331 04:23:56.922377 1 tasks_processing.go:71] worker 9 working on olm_operators task. I0331 04:23:56.922382 1 tasks_processing.go:71] worker 50 working on lokistack task. I0331 04:23:56.922499 1 tasks_processing.go:71] worker 8 working on machine_sets task. I0331 04:23:56.922546 1 tasks_processing.go:69] worker 56 listening for tasks. I0331 04:23:56.922564 1 tasks_processing.go:71] worker 24 working on image task. I0331 04:23:56.922570 1 tasks_processing.go:71] worker 59 working on operators_pods_and_events task. I0331 04:23:56.922574 1 tasks_processing.go:71] worker 19 working on openshift_machine_api_events task. I0331 04:23:56.922622 1 tasks_processing.go:71] worker 56 working on machine_healthchecks task. I0331 04:23:56.922669 1 tasks_processing.go:71] worker 28 working on nodes task. I0331 04:23:56.921787 1 tasks_processing.go:69] worker 40 listening for tasks. I0331 04:23:56.921854 1 tasks_processing.go:71] worker 63 working on pod_network_connectivity_checks task. I0331 04:23:56.922931 1 tasks_processing.go:71] worker 38 working on certificate_signing_requests task. I0331 04:23:56.922964 1 tasks_processing.go:71] worker 60 working on ceph_cluster task. I0331 04:23:56.923463 1 tasks_processing.go:71] worker 58 working on openstack_dataplanenodesets task. I0331 04:23:56.922649 1 gather_lokistack.go:58] Start LokiStack gathering I0331 04:23:56.922566 1 tasks_processing.go:71] worker 36 working on overlapping_namespace_uids task. I0331 04:23:56.921866 1 tasks_processing.go:71] worker 42 working on image_pruners task. I0331 04:23:56.921862 1 tasks_processing.go:71] worker 62 working on mutating_webhook_configurations task. I0331 04:23:56.921872 1 tasks_processing.go:71] worker 11 working on qemu_kubevirt_launcher_logs task. I0331 04:23:56.921759 1 tasks_processing.go:69] worker 46 listening for tasks. I0331 04:23:56.922356 1 tasks_processing.go:71] worker 10 working on config_maps task. I0331 04:23:56.922365 1 tasks_processing.go:71] worker 26 working on validating_webhook_configurations task. I0331 04:23:56.921754 1 tasks_processing.go:69] worker 37 listening for tasks. I0331 04:23:56.922376 1 tasks_processing.go:71] worker 35 working on cost_management_metrics_configs task. I0331 04:23:56.922876 1 tasks_processing.go:71] worker 40 working on service_accounts task. I0331 04:23:56.922883 1 tasks_processing.go:71] worker 55 working on operators task. I0331 04:23:56.921758 1 tasks_processing.go:69] worker 18 listening for tasks. I0331 04:23:56.922767 1 tasks_processing.go:69] worker 57 listening for tasks. I0331 04:23:56.923444 1 tasks_processing.go:71] worker 45 working on openstack_dataplanedeployments task. I0331 04:23:56.921869 1 tasks_processing.go:71] worker 44 working on support_secret task. I0331 04:23:56.921875 1 tasks_processing.go:71] worker 16 working on container_runtime_configs task. I0331 04:23:56.925609 1 tasks_processing.go:71] worker 46 working on openstack_version task. I0331 04:23:56.925754 1 tasks_processing.go:71] worker 37 working on dvo_metrics task. I0331 04:23:56.925848 1 tasks_processing.go:71] worker 18 working on nodenetworkstates task. I0331 04:23:56.925867 1 tasks_processing.go:71] worker 57 working on machine_configs task. I0331 04:23:56.931327 1 tasks_processing.go:71] worker 33 working on proxies task. I0331 04:23:56.931345 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 9.103496ms to process 0 records I0331 04:23:56.931359 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 9.684857ms to process 0 records I0331 04:23:56.931364 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 9.044517ms to process 0 records I0331 04:23:56.931369 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 9.434905ms to process 0 records I0331 04:23:56.931368 1 tasks_processing.go:74] worker 34 stopped. I0331 04:23:56.931374 1 tasks_processing.go:74] worker 5 stopped. I0331 04:23:56.931373 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 8.821619ms to process 0 records I0331 04:23:56.931382 1 tasks_processing.go:74] worker 8 stopped. I0331 04:23:56.931383 1 tasks_processing.go:74] worker 32 stopped. E0331 04:23:56.931392 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0331 04:23:56.931401 1 gather.go:177] gatherer "clusterconfig" function "machines" took 9.719924ms to process 0 records I0331 04:23:56.931406 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 9.421409ms to process 0 records I0331 04:23:56.931413 1 tasks_processing.go:74] worker 54 stopped. I0331 04:23:56.931418 1 tasks_processing.go:74] worker 3 stopped. I0331 04:23:56.933062 1 tasks_processing.go:74] worker 52 stopped. I0331 04:23:56.933072 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 11.261687ms to process 0 records I0331 04:23:56.933080 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 11.171909ms to process 0 records I0331 04:23:56.933086 1 tasks_processing.go:74] worker 25 stopped. I0331 04:23:56.937099 1 tasks_processing.go:74] worker 60 stopped. I0331 04:23:56.937115 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 13.632324ms to process 0 records I0331 04:23:56.937124 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 14.911611ms to process 0 records I0331 04:23:56.937129 1 tasks_processing.go:74] worker 4 stopped. I0331 04:23:56.937348 1 tasks_processing.go:74] worker 31 stopped. I0331 04:23:56.937502 1 recorder.go:75] Recording config/featuregate with fingerprint=2f769ea0129287000ac4ca563a3b848e8c60b853226fd18cafabfbe478251fed I0331 04:23:56.937517 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 15.386528ms to process 1 records I0331 04:23:56.944077 1 tasks_processing.go:74] worker 58 stopped. I0331 04:23:56.944098 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 20.557298ms to process 0 records I0331 04:23:56.944190 1 tasks_processing.go:74] worker 18 stopped. I0331 04:23:56.944207 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 18.321682ms to process 0 records I0331 04:23:56.944218 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 21.793563ms to process 0 records E0331 04:23:56.944224 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0331 04:23:56.944226 1 tasks_processing.go:74] worker 50 stopped. I0331 04:23:56.944232 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 21.517466ms to process 0 records I0331 04:23:56.944239 1 tasks_processing.go:74] worker 56 stopped. I0331 04:23:56.944271 1 tasks_processing.go:74] worker 61 stopped. I0331 04:23:56.944283 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 22.499795ms to process 0 records I0331 04:23:56.944429 1 tasks_processing.go:74] worker 12 stopped. I0331 04:23:56.944631 1 recorder.go:75] Recording config/apiserver with fingerprint=7f13ed283f4300961e3905d713b1c9cd27649c8687c40e0fff82d6c03125a0e3 I0331 04:23:56.944646 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 22.358372ms to process 1 records I0331 04:23:56.944732 1 tasks_processing.go:74] worker 20 stopped. I0331 04:23:56.944850 1 recorder.go:75] Recording config/oauth with fingerprint=cbab622c08900d1c68a19c29d4828b09c92c019ff1c2ed38a53264eeb571ba27 I0331 04:23:56.944860 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 22.683856ms to process 1 records I0331 04:23:56.948332 1 tasks_processing.go:74] worker 47 stopped. I0331 04:23:56.948402 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=8626c88e89e990baa7de1d73eff490661fe5ab07e7c9328e5b379a5b3f6c9f2a I0331 04:23:56.948414 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 26.504927ms to process 1 records I0331 04:23:56.948421 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 23.438149ms to process 0 records I0331 04:23:56.948426 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 23.506273ms to process 0 records I0331 04:23:56.948429 1 tasks_processing.go:74] worker 16 stopped. I0331 04:23:56.948433 1 tasks_processing.go:74] worker 35 stopped. I0331 04:23:56.948461 1 tasks_processing.go:74] worker 43 stopped. I0331 04:23:56.949125 1 recorder.go:75] Recording config/infrastructure with fingerprint=a650cb9327a390f8b6d3e03e5c18a277afab3eb74284eeaa0107f9c345b6c85f I0331 04:23:56.949141 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 26.284694ms to process 1 records I0331 04:23:56.949148 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 25.871837ms to process 0 records I0331 04:23:56.949162 1 tasks_processing.go:74] worker 19 stopped. I0331 04:23:56.949225 1 tasks_processing.go:74] worker 30 stopped. I0331 04:23:56.949238 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=3002880555cb6c61103867c929885329265d5bb16ecebf06030a3a3747bc557c I0331 04:23:56.949252 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=85b4f29f3a4cdd86dcdead28a99379187c850c7b3d6df6a25d67eed7326db9a7 I0331 04:23:56.949267 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=e25614b5d5f6110bf50ed970da63a964aa316a77446aac2ecfc27e4ab917db99 I0331 04:23:56.949283 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=58b49778a9f883d9a845a707d13a56824e392f9ae50df7579149af871fd7188e I0331 04:23:56.949303 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=62e4f0a1e678c82f99e8a98731acfac80fe17945164ce39d1931de369134faaa I0331 04:23:56.949318 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=35deb63e999ca670cb6121ce83f4a9ac682dd597c40226e7d420c8a3f0ebbb01 I0331 04:23:56.949333 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=a8c6afc45c389b85a2b53325c014859837f5ca78a3faedae74b987de8c17402f I0331 04:23:56.949349 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=3e506fc32ebde05097233539a09c841e54933420768576952d82e6a3f3e52692 I0331 04:23:56.949365 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=97c69aacb59517cf2f9c12c2f43a4981a3463a593a43eae9d71c6773b99ccc63 I0331 04:23:56.949381 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=dc9c45268332aba605703cbc5caef71da6630200cbd2c16ad6b25706c2eaaa1d I0331 04:23:56.949399 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=1936e1ba0f378869e4e23dc1e18a2cab71359981dda6c0f6b185fbc1aba9e495 I0331 04:23:56.949407 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 26.75762ms to process 11 records I0331 04:23:56.949466 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=a39446e4461c617a65b76469a3e0a4d89d37efc99af07134096da219e483ea00 I0331 04:23:56.949482 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=90fd0cd5aa4f11e0f68fea88704d2731a6e5911eb3cc67e9411be4c5af5c0625 I0331 04:23:56.949487 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 26.540315ms to process 2 records I0331 04:23:56.949488 1 tasks_processing.go:74] worker 17 stopped. I0331 04:23:56.949556 1 tasks_processing.go:74] worker 41 stopped. I0331 04:23:56.949620 1 recorder.go:75] Recording config/authentication with fingerprint=b86320a3d2bbd1a66aa16be732ebe12a2f2a1ed3ce52f054610f353cbc082ca4 I0331 04:23:56.949628 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 26.365631ms to process 1 records I0331 04:23:56.949681 1 recorder.go:75] Recording config/image with fingerprint=31e003c727c6b6e81800a297155e99696c055b5b9f45a9e4e157e86898e01f27 I0331 04:23:56.949688 1 gather.go:177] gatherer "clusterconfig" function "image" took 26.257209ms to process 1 records I0331 04:23:56.949693 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 23.913473ms to process 0 records I0331 04:23:56.949697 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 26.925192ms to process 0 records I0331 04:23:56.949703 1 tasks_processing.go:74] worker 14 stopped. I0331 04:23:56.949707 1 tasks_processing.go:74] worker 24 stopped. I0331 04:23:56.949708 1 tasks_processing.go:74] worker 45 stopped. I0331 04:23:56.951108 1 tasks_processing.go:74] worker 46 stopped. I0331 04:23:56.951124 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 25.477333ms to process 0 records I0331 04:23:56.955160 1 tasks_processing.go:74] worker 1 stopped. I0331 04:23:56.955176 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 33.49407ms to process 0 records I0331 04:23:56.955394 1 tasks_processing.go:74] worker 33 stopped. I0331 04:23:56.955462 1 recorder.go:75] Recording config/proxy with fingerprint=2ed7cb753b7ab935f08a415e46739c9b7097407b5fe50f844de6729b12222187 I0331 04:23:56.955475 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 24.047876ms to process 1 records E0331 04:23:56.955482 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0331 04:23:56.955488 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 30.491996ms to process 0 records I0331 04:23:56.955493 1 tasks_processing.go:74] worker 44 stopped. I0331 04:23:56.955600 1 tasks_processing.go:74] worker 42 stopped. I0331 04:23:56.955891 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=5b1ab60e22ef4c627a5d7c9ab8297f09ad7172694b2534abf632b43a59629e7b I0331 04:23:56.955909 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 31.244956ms to process 1 records I0331 04:23:56.956002 1 tasks_processing.go:74] worker 51 stopped. I0331 04:23:56.956048 1 recorder.go:75] Recording config/ingress with fingerprint=c9bd7f617bc2bb145effbec28b553652b57765eca1bd8fefbdf69b03d7a9328f I0331 04:23:56.956062 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 33.742295ms to process 1 records I0331 04:23:56.956145 1 tasks_processing.go:74] worker 21 stopped. I0331 04:23:56.956193 1 recorder.go:75] Recording config/network with fingerprint=e6577e48f34d63c4ce413bbce0de68631acc942e879fc0cc5c0cdae4ac9590fb I0331 04:23:56.956205 1 gather.go:177] gatherer "clusterconfig" function "networks" took 34.094678ms to process 1 records I0331 04:23:56.956538 1 tasks_processing.go:74] worker 6 stopped. I0331 04:23:56.956848 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=a8892707c8c7ce9211485521be91ca903d2ec2b40872abcd03cf2e3d3e8cea03 I0331 04:23:56.956861 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 34.754025ms to process 1 records I0331 04:23:56.958026 1 gather_logs.go:145] no pods in namespace were found I0331 04:23:56.958082 1 tasks_processing.go:74] worker 11 stopped. I0331 04:23:56.958113 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 33.314524ms to process 0 records I0331 04:23:56.961234 1 tasks_processing.go:74] worker 38 stopped. I0331 04:23:56.961252 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 38.245171ms to process 0 records I0331 04:23:56.961494 1 gather_cluster_operator_pods_and_events.go:121] Found 0 pods with 0 containers I0331 04:23:56.961516 1 tasks_processing.go:74] worker 59 stopped. I0331 04:23:56.961524 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 38.931654ms to process 0 records I0331 04:23:56.964607 1 tasks_processing.go:74] worker 29 stopped. I0331 04:23:56.965141 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=49437b6f152ef7ab4afc7cb084ff35bd70a02e1c278711183ea4b1795da83d91 I0331 04:23:56.965343 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=ad4a083017dd8e6f1be5321f45abaa4d8df0f1939e9d99fef5f80b4b6a6dda5c I0331 04:23:56.965355 1 gather.go:177] gatherer "clusterconfig" function "crds" took 42.462782ms to process 2 records I0331 04:23:56.965382 1 recorder.go:75] Recording config/podnetworkconnectivitychecks with fingerprint=44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a I0331 04:23:56.965387 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 42.391008ms to process 1 records I0331 04:23:56.965396 1 tasks_processing.go:74] worker 63 stopped. I0331 04:23:56.965862 1 tasks_processing.go:74] worker 39 stopped. I0331 04:23:56.965883 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 44.02462ms to process 0 records I0331 04:23:56.965918 1 tasks_processing.go:74] worker 27 stopped. I0331 04:23:56.966342 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=bbd17feb277322404e521ed75890b7532be8430d3424f46ed99380307ae39e00 I0331 04:23:56.966652 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=a5834d1c1d9c94644ef3a6c132c58d57010d8cf27536ba9a01781c0973139ef4 I0331 04:23:56.966666 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 43.980477ms to process 2 records I0331 04:23:56.966739 1 tasks_processing.go:74] worker 2 stopped. I0331 04:23:56.966992 1 recorder.go:75] Recording config/version with fingerprint=520e1a91c37885bceb81388e9442a190dcc299b3d76e52bd21593bde94462865 I0331 04:23:56.967009 1 recorder.go:75] Recording config/id with fingerprint=ce52871151892d74299073e4d0bc3e5747c2df676a8b799eea7e683c76155943 I0331 04:23:56.967018 1 gather.go:177] gatherer "clusterconfig" function "version" took 44.199478ms to process 2 records I0331 04:23:56.967107 1 tasks_processing.go:74] worker 62 stopped. I0331 04:23:56.967178 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/annotation.operator.tekton.dev with fingerprint=4389d75a7a095c5187d1dec0e313d6b1135a0a26a99f51bcd0b3c805d4b403ae I0331 04:23:56.967358 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=13aa993f5de4421ac4d7c2a167da83e207f19e904f12eb2d4169f80e3b667fc4 I0331 04:23:56.967483 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/cert-manager-webhook with fingerprint=16fc6b203db918f7d72e94bab31b49d793d5b207498bfafa1ebd8f833294374a I0331 04:23:56.967545 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/integration-service-mutating-webhook-configuration with fingerprint=2bf55bdfc86748f436c111e01d5edbb0d3d3a0707925ba126e0fcae33ed015d4 I0331 04:23:56.967578 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/proxy.operator.tekton.dev with fingerprint=d5d001f7483df5ea434db58dab9f9f8a602eb5bc6121adf800730da3d0bd6de9 I0331 04:23:56.967652 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/release-service-mutating-webhook-configuration with fingerprint=1a8e2dc0ab1484b3923530bad2616d5adfb9804d84459ddd869e97533615cca0 I0331 04:23:56.967687 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=ee155f9e7a91b639032d5e6bfd7a6d85aba383d9aa0240e4d2e2a026a1b15df9 I0331 04:23:56.967722 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=d25e2e48b5acbeaac027fc372af69dc6a6761e7bdaf5e7d01604b38bb1a0cdd5 I0331 04:23:56.967770 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.operator.tekton.dev with fingerprint=65fa0a8389b2386617904a579bc2dd79d56f2248bdfa431e7528d88da70d1020 I0331 04:23:56.967849 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.pipeline.tekton.dev with fingerprint=753f6d77177db593b02b83e41a3b8bccb7f0dc74dc0e5ce1ca3f7921201709b6 I0331 04:23:56.967919 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.triggers.tekton.dev with fingerprint=c10950c96172aa72cbb8372c421426e1207771b7da4a6d9fc505c122cc0a66e7 I0331 04:23:56.967930 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 42.077464ms to process 11 records I0331 04:23:56.968022 1 tasks_processing.go:74] worker 28 stopped. I0331 04:23:56.969055 1 recorder.go:75] Recording config/node/ip-10-0-0-226.ec2.internal with fingerprint=aa4074b3c67eb41da0c57cbb850d122cd1a1503d983de74a8e024c838b3c3fbd I0331 04:23:56.969254 1 recorder.go:75] Recording config/node/ip-10-0-1-56.ec2.internal with fingerprint=767704959f0515ded9b672572b7789e0084292f95cc03d477e6b5fbd9b2a653f I0331 04:23:56.969488 1 recorder.go:75] Recording config/node/ip-10-0-2-47.ec2.internal with fingerprint=cf826f6c91fbd97dd45693f0a65502424f3cae2ab9f6825d27ad40a846ab29da I0331 04:23:56.969527 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 45.012653ms to process 3 records I0331 04:23:56.969698 1 tasks_processing.go:74] worker 26 stopped. I0331 04:23:56.970017 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=89c69efd996997597387fc5ad4a188ad34e07deee9cfb8eca1fa2cb922f24e0e I0331 04:23:56.970065 1 recorder.go:75] Recording config/validatingwebhookconfigurations/cert-manager-webhook with fingerprint=2e780fb2852ddf9f871c4ba4a6aadc6d5cd1f1fedad29441535357ae9e0c9c3f I0331 04:23:56.970103 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.operator.tekton.dev with fingerprint=4978203d7422d384aab5c6ac51fd5ab2bf99a104d583601cfa32f4decf12d98d I0331 04:23:56.970123 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.pipeline.tekton.dev with fingerprint=e637baf61fc6d417c33ba6594de8494d3833c9ad481790807bcc95922b41bc3c I0331 04:23:56.970174 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.triggers.tekton.dev with fingerprint=cde19f4b9ae16513d89e19c37af606c8a9fa1057aca001d878ea76ac4ac56f02 I0331 04:23:56.970219 1 recorder.go:75] Recording config/validatingwebhookconfigurations/integration-service-validating-webhook-configuration with fingerprint=f268c07fff3cb32d102374f3e8c6ca77690f287724f9edea885d12e369bb5636 I0331 04:23:56.970279 1 recorder.go:75] Recording config/validatingwebhookconfigurations/monitoringconfigmaps.openshift.io with fingerprint=08719f2a0a6f8a653b47897062f7472e2d6a224d5846708069fda28c499f5f42 I0331 04:23:56.970860 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=e714fc8f83ee7a2b8a438e0e3d15a46ea166b4337b3485a0b52525971a5d0ecf I0331 04:23:56.970895 1 recorder.go:75] Recording config/validatingwebhookconfigurations/namespace.operator.tekton.dev with fingerprint=3a6baa73641b748320dae5f37a99b9479886de93a7ec5ae306426ad1b1ea8bbf I0331 04:23:56.970972 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=4cf083ae4e014ad8dc3105ec7797a895957c6a62c73561150692580a4c827912 I0331 04:23:56.971000 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=4e9705b450cf212e728e3217a40975e68e5542a6fd47153d8501bcf73a9f4521 I0331 04:23:56.971037 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=91785471e3a551ca54cd39c71edd79ecdd18a75ec8db57761cb0f89f761bef10 I0331 04:23:56.971110 1 recorder.go:75] Recording config/validatingwebhookconfigurations/release-service-validating-webhook-configuration with fingerprint=560eb38e1bce6e2ea7957ff3e73f4db94d938b005b13d70cec30d15c97d6bc81 I0331 04:23:56.971136 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=df8fad4c64ad87d242783a2d7eaabbb2685a9bcad8cc792ae50b359c029c7045 I0331 04:23:56.971160 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=cbb9156e1a3dd2b6276e09a7ac52969ea1963502ebe148c487fd61c3fc75c8af I0331 04:23:56.971184 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=99dc74571ee6a7393512d2e2e198e59f2fd0e4fefc1dea3fd99ad85c3b351d64 I0331 04:23:56.971208 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=a566a6717c3b142538f16de853a44c251b3a2008be6db094bc6996e21eae747e I0331 04:23:56.971241 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=9e44a9ead7c5d32132cac07bff3468e613b5e19aabea0240665bdc901edacae4 I0331 04:23:56.971264 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=0052a8db1a4a760ab97008f7f85ea7bc1bd6e614ece86b45672b844f9684b8bb I0331 04:23:56.971289 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=52ce0dab9722f3f594ce397270c6f575069574efd891bc6612f8fc788b108c44 I0331 04:23:56.971312 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=6c4e047b53465c6b8a0a00008260479d6fd6e827d4e8a76b7365bd0fbf1fbe35 I0331 04:23:56.971332 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.pipelinesascode.tekton.dev with fingerprint=13806484b4269914ea1595b6000dbed00b34543c275016798b393e876f85f8c6 I0331 04:23:56.971364 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.operator.tekton.dev with fingerprint=32b1bc09919993547d8c37681ebb51b841227c335c3dd267f7b4815e547ac2b1 I0331 04:23:56.971404 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.pipeline.tekton.dev with fingerprint=328284300dea798c516c6cd44bbc8429170cb7a51deeea9ccb671a636536aee0 I0331 04:23:56.971445 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.triggers.tekton.dev with fingerprint=93334d82d95dde746ee4b15282cde4b717a4546f5de8b59f1f0a71ad103e7686 I0331 04:23:56.971454 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 44.791816ms to process 25 records I0331 04:23:56.971466 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 48.383303ms to process 0 records I0331 04:23:56.971472 1 tasks_processing.go:74] worker 22 stopped. I0331 04:23:56.971863 1 tasks_processing.go:74] worker 36 stopped. I0331 04:23:56.971894 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0331 04:23:56.971906 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 47.664995ms to process 1 records I0331 04:23:56.978063 1 tasks_processing.go:74] worker 57 stopped. I0331 04:23:56.978109 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0331 04:23:56.978123 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 52.178055ms to process 1 records I0331 04:23:56.994297 1 tasks_processing.go:74] worker 23 stopped. E0331 04:23:56.994324 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0331 04:23:56.994335 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pcf6mvjj6oql0vc3viou4mohmpb27f9-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pcf6mvjj6oql0vc3viou4mohmpb27f9-primary-cert-bundle-secret" not found I0331 04:23:56.994437 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=3533f62b7c8c1dec592eb955387ff72348b3e5245cd5ef07e50fd7a8cde30b25 I0331 04:23:56.994458 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 72.363073ms to process 1 records I0331 04:23:56.999982 1 tasks_processing.go:74] worker 10 stopped. E0331 04:23:57.000004 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0331 04:23:57.000014 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0331 04:23:57.000018 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0331 04:23:57.000029 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0331 04:23:57.000079 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0331 04:23:57.000087 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0331 04:23:57.000093 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0331 04:23:57.000101 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0331 04:23:57.000140 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0331 04:23:57.000150 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0331 04:23:57.000155 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 75.111573ms to process 7 records I0331 04:23:57.007074 1 tasks_processing.go:74] worker 7 stopped. I0331 04:23:57.007101 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 85.20021ms to process 0 records I0331 04:23:57.008000 1 tasks_processing.go:74] worker 49 stopped. I0331 04:23:57.009429 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-z6ckn with fingerprint=3a7902229b40a0cf50074b8417207632043d10cd8e85af42a8be5d8f9203a5cd I0331 04:23:57.009529 1 recorder.go:75] Recording config/pod/openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-1-56.ec2.internal with fingerprint=fa546e2296846db23532f7f236b9f0c0052f3e01af4b345a71602740d3a4677d I0331 04:23:57.009824 1 recorder.go:75] Recording config/pod/openshift-monitoring/prometheus-k8s-1 with fingerprint=1332ef9bfc3af3d0afd3f06370444fd90e38811094d71b7441ef68490bcf1b58 I0331 04:23:57.009948 1 recorder.go:75] Recording config/running_containers with fingerprint=3f85e12bfa47a7d1cbc25deed4702e52247f02e35e8d6fc8ce196c9deeadce3b I0331 04:23:57.009959 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 86.200474ms to process 4 records I0331 04:23:57.039398 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0331 04:23:57.043822 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0331 04:23:57.047851 1 tasks_processing.go:74] worker 9 stopped. I0331 04:23:57.048055 1 recorder.go:75] Recording config/olm_operators with fingerprint=903ae95bc9d242606da98f767f1888c42b019afa4dd0d24b4fcc2c4a1d22674d I0331 04:23:57.048071 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 125.449343ms to process 1 records I0331 04:23:57.950065 1 tasks_processing.go:74] worker 13 stopped. I0331 04:23:57.950095 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0331 04:23:57.950120 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.028134173s to process 1 records I0331 04:23:57.950268 1 tasks_processing.go:74] worker 0 stopped. I0331 04:23:57.950312 1 recorder.go:75] Recording config/alerts with fingerprint=c817b8d38384e27f27db1883e1fb3709a9e96d701c3fc27aec9590ed9284933d I0331 04:23:57.950323 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.028518925s to process 1 records I0331 04:23:57.960000 1 tasks_processing.go:74] worker 15 stopped. I0331 04:23:57.960098 1 recorder.go:75] Recording config/metrics with fingerprint=101a12bba05340279e8d67bd1a456cfc2d74961ce7b0fd4b5eb6a5e13c6d5a84 I0331 04:23:57.960125 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.037724465s to process 1 records I0331 04:23:57.965334 1 tasks_processing.go:74] worker 48 stopped. I0331 04:23:57.965360 1 recorder.go:75] Recording config/tsdb.json with fingerprint=0e7c5320c151dd7a303e5ddb658e5546b17ab83dfb360db8a00ffebefd82a31b I0331 04:23:57.965370 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.043226204s to process 1 records I0331 04:23:59.399868 1 tasks_processing.go:74] worker 55 stopped. I0331 04:23:59.399979 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=c33ca4289619724885a7a7ce802cdbd79226b15e1ca382bddc860723ef83a69c I0331 04:23:59.400046 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0331 04:23:59.400089 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=c5965611ee764c93c14d3a16e13307f89b4a99a8de5352ad567440de908df25c I0331 04:23:59.400107 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0331 04:23:59.400139 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=2100d34ccb8cbcd43c66bc6c6d6c4cd3d5304a882c765d1908ae02038a04d049 I0331 04:23:59.400164 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0331 04:23:59.400197 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=e526140abce472888fc5c8f366171d9a72b02f61094977946b3219d07172c55e I0331 04:23:59.400235 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=272926a9e024cbbc6817cda250c0aaafb30cc2e189e7151e3193904386233b06 I0331 04:23:59.400267 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=d34380879acaedf1a5c4273c775314aaa1335b24582e34ba7267945bcd3601b6 I0331 04:23:59.400310 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=26743f2149fc0cc017f94f5b09350861d27de15ec21efb152c6e6c4bfc0d7630 I0331 04:23:59.400594 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=c190aeec8fa6ac457733c935901fabedb2da73b50d4fdb2f9c2e0313364eb7c6 I0331 04:23:59.400626 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=1a4e7e1575fa67584f486239979b874153603c6ab864948efb0385e3f3b4902f I0331 04:23:59.400641 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0331 04:23:59.400666 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=0825b0673c6968400adda08ee94aea1ea7c7c487a16b48892c9a09f633cf467f I0331 04:23:59.400683 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0331 04:23:59.400708 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=2ffb0a470297dc962fde7d19a96a0cceaf71483c93bf4e9c3cf9a4ddaf376fb0 I0331 04:23:59.400722 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0331 04:23:59.400750 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=dfc5b5d8369401f76d7ac7192b67d3580251bec275fcce359ad231d2fff1fe97 I0331 04:23:59.400764 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0331 04:23:59.400822 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=6d74fb540d2c2987cfa2eff4f99902da0d21ea4e62312c3dda5bc25f7aae7e80 I0331 04:23:59.400947 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=26f0a189dbfc24a410ba2a20356d664df8efa427cececcaac27fa669a4eb32b1 I0331 04:23:59.400962 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0331 04:23:59.400976 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0331 04:23:59.401034 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0331 04:23:59.401071 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=c8d2e5db4071879908cc3273e71dc788c946fefe1dd76bd760875d567a3c8b2d I0331 04:23:59.401108 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=7b40f2afd8941cf120184f42e92216efb3fd2f679954a7bb9c37fe2551a0933b I0331 04:23:59.401122 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0331 04:23:59.401147 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=4d394e37461a9516b44ed20c3b19e6b93b9a9a3e6a0d11d9d75925627153efa5 I0331 04:23:59.401161 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0331 04:23:59.401187 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=819f36e05cd058901a62d0c3663caf78fd63c22668f3914df38676fb5fe1287d I0331 04:23:59.401201 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0331 04:23:59.401223 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=ac7e94a55936d97a68b647de5a85ad69f629e6970fee9820c4779cbdf73e833a I0331 04:23:59.401248 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=a443bd02fb515463f762dda7410fecb5a5fa581f5cbad8df91bf8c1f54ea81c5 I0331 04:23:59.401274 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=8672fcd708fe33fe6595e4d6c986db6b051b669fdb484bd0d8ab5f49cee6f87b I0331 04:23:59.401307 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=a686275cff7d3a141b61ce3f938cdf1281557410b4a0c545cd55a55e63b73c24 I0331 04:23:59.401321 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0331 04:23:59.401357 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=8c937999bb8a1791a6e3aed2322ad16335e5c5f88f53831f9c6a78035b4ada72 I0331 04:23:59.401383 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0331 04:23:59.401398 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0331 04:23:59.401409 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.474928824s to process 39 records I0331 04:23:59.505644 1 tasks_processing.go:74] worker 37 stopped. I0331 04:23:59.506038 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=2a3694690a29914c80c44950c62253c2ed1d9a6d1065011a2445c9024c425856 I0331 04:23:59.506055 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 2.57979001s to process 1 records I0331 04:24:08.176331 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0331 04:24:08.176351 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0331 04:24:08.176354 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0331 04:24:08.176380 1 controller.go:512] The operator is healthy I0331 04:24:09.974527 1 tasks_processing.go:74] worker 53 stopped. I0331 04:24:09.974576 1 recorder.go:75] Recording config/installplans with fingerprint=a141caf3b7ccce0ed9177a6b544856caea4879e2efb66c12f2429c93dca00dbb I0331 04:24:09.974591 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.052308359s to process 1 records I0331 04:24:10.733095 1 tasks_processing.go:74] worker 40 stopped. I0331 04:24:10.733441 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=83c19c77423a2fe16fa7e03dbb774dc709e24261efcedaa841c83e311ed4324b I0331 04:24:10.733458 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.808162102s to process 1 records E0331 04:24:10.733530 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 13.812s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error" I0331 04:24:10.734652 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error I0331 04:24:10.734670 1 periodic.go:209] Running workloads gatherer I0331 04:24:10.734688 1 tasks_processing.go:45] number of workers: 2 I0331 04:24:10.734697 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 04:24:10.734701 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I0331 04:24:10.734713 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 04:24:10.734792 1 tasks_processing.go:71] worker 0 working on workload_info task. I0331 04:24:10.742932 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-56.ec2.internal... I0331 04:24:10.742944 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-226.ec2.internal... I0331 04:24:10.742958 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-47.ec2.internal... I0331 04:24:10.758277 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak. I0331 04:24:10.758296 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak-pgsql. I0331 04:24:10.758301 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from server. I0331 04:24:10.758305 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from tpa-pgsql. I0331 04:24:10.767857 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-keycloak from keycloak-pgsql-bee. I0331 04:24:10.767884 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from importer. I0331 04:24:10.767892 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from server. I0331 04:24:10.767898 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from tpa-pgsql-bee. I0331 04:24:10.767915 1 tasks_processing.go:74] worker 1 stopped. I0331 04:24:10.767943 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 33.198921ms to process 0 records I0331 04:24:18.850718 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 8s I0331 04:24:18.889749 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 31s for image data I0331 04:24:18.898184 1 gather_workloads_info.go:387] No image sha256:00fa6a8075723e279b420c76d13105c1650b1d46db51c7018801c558c0a876c6 (10ms) I0331 04:24:18.907750 1 gather_workloads_info.go:387] No image sha256:57a1aea49d7cc275b37b8f52d602a3a9d1601ec6a21a3268dd4903566cb2e335 (10ms) I0331 04:24:18.917765 1 gather_workloads_info.go:387] No image sha256:2ba73aa991da589b1ee1fa6903abcdd56387007f3d650d345fbc8458bc2baeac (10ms) I0331 04:24:18.927690 1 gather_workloads_info.go:387] No image sha256:09c857f0c20721d6b447f5f567182befc1ca6157128225849117a5c830feab23 (10ms) I0331 04:24:18.937484 1 gather_workloads_info.go:387] No image sha256:a18b7658b5cf078bcef30a1c752c42c46907714b589145c7c330cf7ba7db2715 (10ms) I0331 04:24:18.946923 1 gather_workloads_info.go:387] No image sha256:27f3be442cf1d9f640657fb6d7cea6b133652226f9a80c3442df226b3cb3c2dc (9ms) I0331 04:24:18.955931 1 gather_workloads_info.go:387] No image sha256:d88f384ee9cf4475b16d9589e88b28c9f2407247fbedfa3d9bfcaed95753514e (9ms) I0331 04:24:18.965476 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (10ms) I0331 04:24:18.974974 1 gather_workloads_info.go:387] No image sha256:b99613494e9d6a4a8207323872d63cc02b830fc80a8bf972e62c64381aa4cd17 (9ms) I0331 04:24:18.984471 1 gather_workloads_info.go:387] No image sha256:6a0d1f472283c686e438dbfbeec826db9d7d95f45f92842c4073f70704860d2f (9ms) I0331 04:24:19.001841 1 gather_workloads_info.go:387] No image sha256:09e27b3a67ebeda04d3e597e0561bfb40550de78bdecb53f2f9ff3dfb1cfe7ea (17ms) I0331 04:24:19.098990 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (97ms) I0331 04:24:19.198849 1 gather_workloads_info.go:387] No image sha256:1e65f9f5490fbc930d2dce96f03ddcb28990b839d7dc011ef5de5bec6c5095bf (100ms) I0331 04:24:19.300003 1 gather_workloads_info.go:387] No image sha256:61aeb8693f27b60dd35e3dd1961d14bd95988cae70d649b340045619e5de7acf (101ms) I0331 04:24:19.398941 1 gather_workloads_info.go:387] No image sha256:315260877c58d13e0511bbff7bdcc389bcd86deca48785023e28194b08c4c924 (99ms) I0331 04:24:19.499437 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms) I0331 04:24:19.599251 1 gather_workloads_info.go:387] No image sha256:2c4ec0dfd62375ed45d5758798b1069e16a0a6d1986439d23c61591c4dfb9297 (100ms) I0331 04:24:19.699133 1 gather_workloads_info.go:387] No image sha256:4dcd0b18dea61968f20d49c4372eec43689eb52e823e1a6293e9b89c6e21e587 (100ms) I0331 04:24:19.799018 1 gather_workloads_info.go:387] No image sha256:3f586d6fd6139bbad131716168590b12db0cdfe4dcbb15ccee65b080d5594b6e (100ms) I0331 04:24:19.898736 1 gather_workloads_info.go:387] No image sha256:6e5df2aab9ce759e8f957341a11c087c233307e3c8f8760d21270efc19ccd3ce (100ms) I0331 04:24:20.000236 1 gather_workloads_info.go:387] No image sha256:cc686a64f9ae83adecc7a0ffe8a6b82f0750dc39ad05654a8087cf780a1c3b3a (101ms) I0331 04:24:20.101077 1 gather_workloads_info.go:387] No image sha256:ce98d5d844bfc2ba8de1893866ad38166c95157d54abd8192b181e819bc50bb5 (101ms) I0331 04:24:20.199317 1 gather_workloads_info.go:387] No image sha256:2f6f91dfd7b71cad1c6db82835d709d20f4153cf500d60ee32145712af922214 (98ms) I0331 04:24:20.299535 1 gather_workloads_info.go:387] No image sha256:4f86f5c692a497442b54c435e68b0cbf961591a00ebc3a73c364a19da673e34d (100ms) I0331 04:24:20.399265 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (100ms) I0331 04:24:20.499847 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (101ms) I0331 04:24:20.599458 1 gather_workloads_info.go:387] No image sha256:199df7c847c51c89b38ec42c4ac2b68156e1b24c02b60a01cfdfcbad6ea43489 (100ms) I0331 04:24:20.699635 1 gather_workloads_info.go:387] No image sha256:b8d380990acb0184ab685b005e22fb8369139dd8cd6550b4521bd4bc3ca23b40 (100ms) I0331 04:24:20.800184 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (101ms) I0331 04:24:20.899229 1 gather_workloads_info.go:387] No image sha256:04156cd38c436fb6692930d18af59619b0669b2d80cd3590d0973c0e038c5d6d (99ms) I0331 04:24:20.999450 1 gather_workloads_info.go:387] No image sha256:72f9394f6f1b36ca9eb80961eac8f196e81f215632d14375845fbbe5970f0701 (100ms) I0331 04:24:21.103017 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (104ms) I0331 04:24:21.198868 1 gather_workloads_info.go:387] No image sha256:7bd3e88d6d3f878a89203df590b684c5a77bf08df4717451d3197ab74683a80e (96ms) I0331 04:24:21.298504 1 gather_workloads_info.go:387] No image sha256:ada1a963ce2c45d2bba08051c1e0e2db88b200e9d616fab8fde10b698101fc69 (100ms) I0331 04:24:21.399945 1 gather_workloads_info.go:387] No image sha256:8ef614441b76914f5727f5bec23a9d8dc2785ca7fd6a2516f393529b7801da53 (101ms) I0331 04:24:21.499109 1 gather_workloads_info.go:387] No image sha256:54440fa6cb1b01a6b8952f700677832d7b7d3b1b58934957f504ca885730844a (99ms) I0331 04:24:21.600087 1 gather_workloads_info.go:387] No image sha256:1ca6fa787c621462fa2c67b9a42b1de67688883af90316475b0df35be3ed805d (101ms) I0331 04:24:21.699102 1 gather_workloads_info.go:387] No image sha256:3d6ea9e1633f38070718a1357fcb80e6cb3932aafcc4d65e659795b186c5da15 (99ms) I0331 04:24:21.799468 1 gather_workloads_info.go:387] No image sha256:050fe6fe1298c45a27982e3f4d0afe637ce01d9b394e85b7eb202309ecdd0731 (100ms) I0331 04:24:21.899541 1 gather_workloads_info.go:387] No image sha256:0d70224d12e358b1a107a86e0a7e0845e1e8a4d30ce3a1423600f044e3fb28d2 (100ms) I0331 04:24:21.999169 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (100ms) I0331 04:24:22.099634 1 gather_workloads_info.go:387] No image sha256:e4bb09dfe4513cdbe349507495c7f4044623a3c2aff866b7946d941e82a7a639 (100ms) I0331 04:24:22.199861 1 gather_workloads_info.go:387] No image sha256:9db50052057ad4ec94099bc3c9ab476f5ac7b00954c99cb0b26fe729abba3387 (100ms) I0331 04:24:22.300152 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0331 04:24:22.399593 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (99ms) I0331 04:24:22.499535 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (100ms) I0331 04:24:22.598831 1 gather_workloads_info.go:387] No image sha256:d71caff0f67fe8d9665d39193d955fc9352224f647406a40e56428dd6cd24953 (99ms) I0331 04:24:22.700355 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (101ms) I0331 04:24:22.799439 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (99ms) I0331 04:24:22.899484 1 gather_workloads_info.go:387] No image sha256:6ca4eb17da6277b142a3353b675d735c106868f827243eaef70cd1ec01d36307 (100ms) I0331 04:24:22.999576 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0331 04:24:23.099664 1 gather_workloads_info.go:387] No image sha256:513b1166e376feca472fdd5174f6abf0abf02925d6a21b7b4d89a2ff2fc67bed (100ms) I0331 04:24:23.199503 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (100ms) I0331 04:24:23.300309 1 gather_workloads_info.go:387] No image sha256:59b844637eca688cc22c7841bc4480a26d1384444bf9b0161261a182f87a1262 (101ms) I0331 04:24:23.399642 1 gather_workloads_info.go:387] No image sha256:43efa5a676666dd4ae039ad5518eaf636f5baf8d688d9a4b475822c32ad1ddfb (99ms) I0331 04:24:23.499256 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (100ms) I0331 04:24:23.599866 1 gather_workloads_info.go:387] No image sha256:38d71a4cf177f39a2bbe745183009943dbbf404de02aa5f879694aa024a4e6ac (101ms) I0331 04:24:23.710551 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (111ms) I0331 04:24:23.800139 1 gather_workloads_info.go:387] No image sha256:3612c5a433effd17b7aff7ff6edf4fb27b61153908e3a0294158e4886a1d600d (90ms) I0331 04:24:23.899422 1 gather_workloads_info.go:387] No image sha256:95801a943ba7d0ec4af53c3cd1177483e649bcd528b5a838a32ad2d860e6503a (99ms) I0331 04:24:23.999427 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0331 04:24:24.099502 1 gather_workloads_info.go:387] No image sha256:f02c58838bf882d9b5d82a1a96e8ab29ce6033ae1b64418118fba43eb9151b41 (100ms) I0331 04:24:24.200022 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (100ms) I0331 04:24:24.299891 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms) I0331 04:24:24.398997 1 gather_workloads_info.go:387] No image sha256:101993f6e65d6fda8b90c583b718b720809182961f69bc777295f47e6df4d7ce (99ms) I0331 04:24:24.499171 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (100ms) I0331 04:24:24.599765 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (101ms) I0331 04:24:24.700270 1 gather_workloads_info.go:387] No image sha256:46e034f706fdcd5f84f35a1250a064495f5f68c90fef13be9c01936904b07ed6 (100ms) I0331 04:24:24.800075 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (100ms) I0331 04:24:24.899093 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (99ms) I0331 04:24:25.000947 1 gather_workloads_info.go:387] No image sha256:1477f3287cc75352305274f248f781c1b7c2a8696f4f7bc450c45a4a5f5b10ea (102ms) I0331 04:24:25.099482 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (99ms) I0331 04:24:25.199018 1 gather_workloads_info.go:387] No image sha256:373050d2ded02b5acd0e5edf3ef9819fe65403b2f40b557e9077e4a57629cb97 (100ms) I0331 04:24:25.299674 1 gather_workloads_info.go:387] No image sha256:d339ecf788d1681ba9945a2ea63ca675caec863ec75f497ef916103f4c898003 (101ms) I0331 04:24:25.399877 1 gather_workloads_info.go:387] No image sha256:5ffaf92fc557cb891a546ae2682d4e0259166ad6d935970dc958d255abc29a48 (100ms) I0331 04:24:25.500461 1 gather_workloads_info.go:387] No image sha256:384e639f2ce3e75712a5ee1cc5520161342e9dd1e94444d134d7ad4a39dde279 (101ms) I0331 04:24:25.599139 1 gather_workloads_info.go:387] No image sha256:120485f6d677cfeaae0509169f46df14f3ebfafd87b3d876dfa59b738f846c77 (99ms) I0331 04:24:25.700620 1 gather_workloads_info.go:387] No image sha256:1e9a9f1b5ecdab7d074722c860daab977519123fe4385affdfd86d8c7f3c473c (101ms) I0331 04:24:25.800555 1 gather_workloads_info.go:387] No image sha256:0092c6ff139f8698c91349d507eb3182bc5d6c4ae040f672e347ff504accdea2 (100ms) I0331 04:24:25.899878 1 gather_workloads_info.go:387] No image sha256:1f4a37529de4f750099af18e113556bd995fe6922030c614b7d6d23eaa0bd318 (99ms) I0331 04:24:25.999535 1 gather_workloads_info.go:387] No image sha256:865dd51e80034018400794d07edc0b546c6e4de7e2351dddc7f1f6378e1ffdd0 (100ms) I0331 04:24:26.099486 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0331 04:24:26.199688 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0331 04:24:26.300011 1 gather_workloads_info.go:387] No image sha256:90bdf9e678fe18e35401e34e1cb0912d822e9cb32b9e41cc545870540e9a87f2 (100ms) I0331 04:24:26.399157 1 gather_workloads_info.go:398] Found image sha256:32d4561d4bf1b3c4e3a7878f918f9c1422bab85bdf8711fbdf905d59692fee81 (99ms) I0331 04:24:26.499209 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (100ms) I0331 04:24:26.599348 1 gather_workloads_info.go:387] No image sha256:07789f6e6e3c3a5a974c106b43c2e8bc60edb3321def1f0883f3fcd35a238ed0 (100ms) I0331 04:24:26.699666 1 gather_workloads_info.go:398] Found image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (100ms) I0331 04:24:26.804702 1 gather_workloads_info.go:387] No image sha256:503831414ca09befa276fdffd836708f04d2d430b1fd428cb3b0e3cd5bd74eb3 (105ms) I0331 04:24:26.900037 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (95ms) I0331 04:24:26.999596 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (100ms) I0331 04:24:27.099188 1 gather_workloads_info.go:387] No image sha256:b336f6e44314dd23a21236118a604411522baf5e63732463f1d08daccb417f39 (100ms) I0331 04:24:27.199232 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (100ms) I0331 04:24:27.299907 1 gather_workloads_info.go:387] No image sha256:6d83c7e0e068178360998c815a3e0c729ca80a349954172aadafad5da5180d0c (101ms) I0331 04:24:27.398887 1 gather_workloads_info.go:387] No image sha256:76cc47f3775560477ec548c7b6fddbd99112ad6604f790697eef546576051fb7 (99ms) I0331 04:24:27.499534 1 gather_workloads_info.go:387] No image sha256:0af73ad7a47c9ff53269ae2bc5163bf9e389085220c34e4bd42c92c4e7a85f6d (101ms) I0331 04:24:27.599251 1 gather_workloads_info.go:387] No image sha256:74713675d580a47a56b628469c4c05c41e114e0b935960d718ff0cf7e72f613d (100ms) I0331 04:24:27.599314 1 tasks_processing.go:74] worker 0 stopped. I0331 04:24:27.599831 1 recorder.go:75] Recording config/workload_info with fingerprint=bcf3972e45d690c3e2d02ff9f9923f91b7e907954516358e2640f3a264f77997 I0331 04:24:27.599854 1 gather.go:177] gatherer "workloads" function "workload_info" took 16.864472454s to process 1 records I0331 04:24:27.599874 1 periodic.go:256] Periodic gather workloads completed in 16.865s I0331 04:24:27.599885 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0331 04:24:27.599893 1 periodic.go:209] Running conditional gatherer I0331 04:24:27.606019 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0331 04:24:27.760175 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer I0331 04:24:27.762556 1 conditional_gatherer.go:374] alert "KubeJobFailed" has state "pending" I0331 04:24:27.762571 1 conditional_gatherer.go:374] alert "Watchdog" has state "firing" I0331 04:24:27.762576 1 conditional_gatherer.go:374] alert "AlertmanagerReceiversNotConfigured" has state "firing" I0331 04:24:27.762642 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0331 04:24:27.769163 1 conditional_gatherer.go:392] cluster version is '4.20.8' I0331 04:24:27.769202 1 tasks_processing.go:45] number of workers: 3 I0331 04:24:27.769213 1 tasks_processing.go:69] worker 2 listening for tasks. I0331 04:24:27.769217 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0331 04:24:27.769225 1 tasks_processing.go:69] worker 0 listening for tasks. I0331 04:24:27.769235 1 tasks_processing.go:69] worker 1 listening for tasks. I0331 04:24:27.769259 1 tasks_processing.go:74] worker 1 stopped. I0331 04:24:27.769275 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0331 04:24:27.769327 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0331 04:24:27.769308 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0331 04:24:27.769341 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.24µs to process 1 records I0331 04:24:27.769377 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0331 04:24:27.769384 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.95µs to process 1 records I0331 04:24:27.769390 1 tasks_processing.go:74] worker 0 stopped. I0331 04:24:27.769774 1 tasks_processing.go:74] worker 2 stopped. I0331 04:24:27.769794 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 426.28µs to process 0 records I0331 04:24:27.769842 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0331 04:24:27.769870 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0331 04:24:27.796347 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=aff46c3a5787f0a6818280b4ef600d053a7fa829f9602c7bec642eca677bcea7 I0331 04:24:27.796526 1 diskrecorder.go:70] Writing 136 records to /var/lib/insights-operator/insights-2026-03-31-042427.tar.gz I0331 04:24:27.807986 1 diskrecorder.go:51] Wrote 136 records to disk in 11ms I0331 04:24:27.808057 1 periodic.go:278] Gathering cluster info every 2h0m0s I0331 04:24:27.808079 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0331 04:25:26.922135 1 diskrecorder.go:223] Found files to send: insights-2026-03-31-042427.tar.gz I0331 04:25:26.922164 1 insightsuploader.go:150] Checking archives to upload periodically every 15m48.523486435s I0331 04:25:26.922173 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0331 04:25:26.932639 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0331 04:25:27.157095 1 requests.go:87] Successfully reported id=2026-03-31T04:25:26Z x-rh-insights-request-id=28b07100b51f48d999db7a71fc4a27ec, wrote=75932 I0331 04:25:27.157175 1 insightsuploader.go:187] Uploaded report successfully in 234.993742ms I0331 04:25:27.157200 1 controller.go:128] Initializing last reported time to 2026-03-31T04:25:26Z I0331 04:25:27.157221 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0331 04:25:27.157230 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0331 04:25:27.157242 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0331 04:25:27.163434 1 controller.go:512] The operator is healthy I0331 04:26:08.179363 1 controller.go:512] The operator is healthy I0331 04:26:27.539736 1 insightsreport.go:137] Pulling report from smart-proxy I0331 04:26:27.539764 1 insightsreport.go:149] Retrieving report I0331 04:26:27.547908 1 requests.go:110] Retrieving report for cluster: 8a01360c-b3f7-44ed-861c-02a6aeb74ede I0331 04:26:27.547922 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/8a01360c-b3f7-44ed-861c-02a6aeb74ede/reports I0331 04:26:27.552105 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/8a01360c-b3f7-44ed-861c-02a6aeb74ede/reports I0331 04:26:27.809039 1 insightsreport.go:184] Report retrieved I0331 04:26:27.857834 1 insightsreport.go:239] Report retrieved correctly I0331 04:26:45.583347 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:26:45.588235 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:26:45.619332 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:26:45.624743 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:26:45.624767 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:26:45.629081 1 secretconfigobserver.go:119] support secret does not exist I0331 04:28:08.191727 1 controller.go:512] The operator is healthy I0331 04:30:08.179568 1 controller.go:512] The operator is healthy I0331 04:31:45.629909 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:31:45.643456 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:31:45.643479 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:31:45.648012 1 secretconfigobserver.go:119] support secret does not exist I0331 04:32:08.180250 1 controller.go:512] The operator is healthy I0331 04:34:08.181650 1 controller.go:512] The operator is healthy I0331 04:36:08.180103 1 controller.go:512] The operator is healthy I0331 04:36:45.583903 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:36:45.588448 1 configmapobserver.go:84] configmaps "insights-config" not found I0331 04:36:45.648588 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:36:45.653727 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:36:45.653744 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:36:45.657847 1 secretconfigobserver.go:119] support secret does not exist I0331 04:38:08.179861 1 controller.go:512] The operator is healthy I0331 04:40:08.177892 1 controller.go:512] The operator is healthy I0331 04:41:20.682063 1 insightsuploader.go:146] Nothing to report since 2026-03-31T04:25:26Z I0331 04:41:45.657935 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0331 04:41:45.665793 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0331 04:41:45.665846 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0331 04:41:45.670065 1 secretconfigobserver.go:119] support secret does not exist I0331 04:42:08.179571 1 controller.go:512] The operator is healthy I0331 04:44:08.177441 1 controller.go:512] The operator is healthy