I0416 12:16:50.668999 1 cmd.go:253] Using service-serving-cert provided certificates I0416 12:16:50.669416 1 observer_polling.go:159] Starting file observer I0416 12:16:51.498964 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0416 12:16:51.499190 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0416 12:16:51.501217 1 secure_serving.go:57] Forcing use of http/1.1 only W0416 12:16:51.501242 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0416 12:16:51.501248 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0416 12:16:51.501255 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0416 12:16:51.501260 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0416 12:16:51.501264 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0416 12:16:51.501267 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0416 12:16:51.501289 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0416 12:16:51.504787 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0416 12:16:51.504817 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"867391a5-7d97-46ac-8b81-8e5d04fde348", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0416 12:16:51.506289 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0416 12:16:51.506305 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0416 12:16:51.506308 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0416 12:16:51.506317 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0416 12:16:51.506334 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0416 12:16:51.506321 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0416 12:16:51.506581 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0416 12:16:51.506815 1 secure_serving.go:213] Serving securely on [::]:8443 I0416 12:16:51.506841 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0416 12:16:51.513010 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0416 12:16:51.513032 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0416 12:16:51.513127 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0416 12:16:51.517370 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0416 12:16:51.517386 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0416 12:16:51.521600 1 secretconfigobserver.go:119] support secret does not exist I0416 12:16:51.525775 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0416 12:16:51.529762 1 secretconfigobserver.go:119] support secret does not exist I0416 12:16:51.533002 1 recorder.go:176] Pruning old reports every 7h41m12s, max age is 288h0m0s I0416 12:16:51.539665 1 operator.go:356] The last pod state is unhealthy I0416 12:16:51.606658 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0416 12:16:51.606680 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0416 12:16:51.606707 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0416 12:16:51.613897 1 base_controller.go:82] Caches are synced for ConfigController I0416 12:16:51.613910 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0416 12:16:51.620649 1 configmapobserver.go:84] configmaps "insights-config" not found I0416 12:17:11.541235 1 operator.go:356] The last pod state is unhealthy I0416 12:17:31.542797 1 operator.go:356] The last pod state is unhealthy I0416 12:17:51.540053 1 operator.go:356] The last pod state is unhealthy I0416 12:18:11.542436 1 operator.go:356] The last pod state is unhealthy I0416 12:18:31.541183 1 operator.go:356] The last pod state is unhealthy I0416 12:18:51.542398 1 operator.go:356] The last pod state is unhealthy I0416 12:19:11.542519 1 operator.go:356] The last pod state is unhealthy I0416 12:19:31.544729 1 operator.go:356] The last pod state is unhealthy I0416 12:19:51.539198 1 operator.go:356] The last pod state is unhealthy I0416 12:20:11.541856 1 operator.go:356] The last pod state is unhealthy I0416 12:20:31.541937 1 operator.go:356] The last pod state is unhealthy I0416 12:20:51.541148 1 operator.go:356] The last pod state is unhealthy I0416 12:21:11.540918 1 operator.go:356] The last pod state is unhealthy I0416 12:21:31.542389 1 operator.go:356] The last pod state is unhealthy I0416 12:21:51.537906 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0416 12:21:51.538514 1 operator.go:356] The last pod state is unhealthy I0416 12:21:51.542078 1 secretconfigobserver.go:119] support secret does not exist I0416 12:22:11.541754 1 operator.go:356] The last pod state is unhealthy I0416 12:22:15.877643 1 operator.go:288] Unable to check insights-operator pod status. Setting initial delay to 14m11.520260285s I0416 12:22:15.877721 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0416 12:22:15.877749 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 15m41s I0416 12:22:15.877789 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0416 12:22:15.877813 1 insightsreport.go:296] Starting report retriever I0416 12:22:15.877821 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0416 12:22:15.883746 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0416 12:22:15.883764 1 controller.go:368] The initial operator extension status is healthy I0416 12:22:15.883772 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0416 12:22:15.883777 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0416 12:22:15.883780 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0416 12:22:15.883796 1 controller.go:531] The operator is still being initialized I0416 12:22:15.883804 1 controller.go:554] The operator is healthy I0416 12:22:15.883888 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0416 12:22:15.883899 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0416 12:22:15.884100 1 operator.go:328] started I0416 12:22:15.884119 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0416 12:22:15.891856 1 controller.go:254] Source scaController *sca.Controller is not ready I0416 12:22:15.891871 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0416 12:22:15.891874 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0416 12:22:15.891877 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0416 12:22:15.891880 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0416 12:22:15.891896 1 controller.go:531] The operator is still being initialized I0416 12:22:15.891902 1 controller.go:554] The operator is healthy I0416 12:22:15.898997 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0416 12:22:15.984450 1 base_controller.go:82] Caches are synced for LoggingSyncer I0416 12:22:15.984462 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0416 12:22:16.033304 1 cluster_transfer.go:102] no available accepted cluster transfer I0416 12:22:16.033325 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0416 12:22:16.260474 1 sca.go:266] etc-pki-entitlement secret successfully created I0416 12:22:16.260493 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0416 12:24:15.895003 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0416 12:24:15.895023 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0416 12:24:15.895027 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0416 12:24:15.895048 1 controller.go:531] The operator is still being initialized I0416 12:24:15.895054 1 controller.go:554] The operator is healthy I0416 12:26:15.941581 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0416 12:26:15.941599 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0416 12:26:15.941603 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0416 12:26:15.941634 1 controller.go:554] The operator is healthy I0416 12:26:51.527601 1 configmapobserver.go:84] configmaps "insights-config" not found I0416 12:26:51.542682 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0416 12:26:51.547839 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0416 12:26:51.547854 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0416 12:26:51.552725 1 secretconfigobserver.go:119] support secret does not exist I0416 12:28:15.893093 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0416 12:28:15.893110 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0416 12:28:15.893114 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0416 12:28:15.893134 1 controller.go:554] The operator is healthy I0416 12:30:15.892498 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0416 12:30:15.892519 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0416 12:30:15.892523 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0416 12:30:15.892547 1 controller.go:554] The operator is healthy I0416 12:31:51.553750 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0416 12:31:51.559419 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0416 12:31:51.559435 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0416 12:31:51.563630 1 secretconfigobserver.go:119] support secret does not exist I0416 12:32:15.891338 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0416 12:32:15.891353 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0416 12:32:15.891358 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0416 12:32:15.891379 1 controller.go:554] The operator is healthy I0416 12:34:15.890954 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0416 12:34:15.890971 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0416 12:34:15.890977 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0416 12:34:15.890999 1 controller.go:554] The operator is healthy I0416 12:36:15.891368 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0416 12:36:15.891384 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0416 12:36:15.891388 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0416 12:36:15.891409 1 controller.go:554] The operator is healthy I0416 12:36:27.398432 1 periodic.go:216] Running clusterconfig gatherer I0416 12:36:27.398492 1 tasks_processing.go:45] number of workers: 64 I0416 12:36:27.398545 1 tasks_processing.go:69] worker 63 listening for tasks. I0416 12:36:27.398552 1 tasks_processing.go:71] worker 63 working on openshift_logging task. I0416 12:36:27.398581 1 tasks_processing.go:69] worker 31 listening for tasks. I0416 12:36:27.398589 1 tasks_processing.go:69] worker 15 listening for tasks. I0416 12:36:27.398597 1 tasks_processing.go:69] worker 0 listening for tasks. I0416 12:36:27.398603 1 tasks_processing.go:69] worker 47 listening for tasks. I0416 12:36:27.398607 1 tasks_processing.go:69] worker 24 listening for tasks. I0416 12:36:27.398608 1 tasks_processing.go:69] worker 1 listening for tasks. I0416 12:36:27.398617 1 tasks_processing.go:69] worker 26 listening for tasks. I0416 12:36:27.398612 1 tasks_processing.go:69] worker 25 listening for tasks. I0416 12:36:27.398615 1 tasks_processing.go:69] worker 2 listening for tasks. I0416 12:36:27.398623 1 tasks_processing.go:69] worker 3 listening for tasks. I0416 12:36:27.398623 1 tasks_processing.go:69] worker 23 listening for tasks. I0416 12:36:27.398634 1 tasks_processing.go:69] worker 30 listening for tasks. I0416 12:36:27.398629 1 tasks_processing.go:69] worker 29 listening for tasks. I0416 12:36:27.398624 1 tasks_processing.go:69] worker 32 listening for tasks. I0416 12:36:27.398629 1 tasks_processing.go:69] worker 33 listening for tasks. I0416 12:36:27.398642 1 tasks_processing.go:69] worker 16 listening for tasks. I0416 12:36:27.398638 1 tasks_processing.go:69] worker 28 listening for tasks. I0416 12:36:27.398650 1 tasks_processing.go:69] worker 36 listening for tasks. I0416 12:36:27.398637 1 tasks_processing.go:69] worker 4 listening for tasks. I0416 12:36:27.398655 1 tasks_processing.go:69] worker 37 listening for tasks. I0416 12:36:27.398658 1 tasks_processing.go:69] worker 6 listening for tasks. I0416 12:36:27.398660 1 tasks_processing.go:69] worker 43 listening for tasks. I0416 12:36:27.398645 1 tasks_processing.go:69] worker 35 listening for tasks. I0416 12:36:27.398650 1 tasks_processing.go:69] worker 17 listening for tasks. I0416 12:36:27.398665 1 tasks_processing.go:69] worker 19 listening for tasks. I0416 12:36:27.398668 1 tasks_processing.go:69] worker 22 listening for tasks. I0416 12:36:27.398670 1 tasks_processing.go:69] worker 39 listening for tasks. I0416 12:36:27.398651 1 tasks_processing.go:69] worker 41 listening for tasks. I0416 12:36:27.398675 1 tasks_processing.go:69] worker 55 listening for tasks. I0416 12:36:27.398651 1 tasks_processing.go:69] worker 5 listening for tasks. I0416 12:36:27.398656 1 tasks_processing.go:69] worker 42 listening for tasks. I0416 12:36:27.398681 1 tasks_processing.go:69] worker 46 listening for tasks. I0416 12:36:27.398682 1 tasks_processing.go:69] worker 9 listening for tasks. I0416 12:36:27.398687 1 tasks_processing.go:69] worker 61 listening for tasks. I0416 12:36:27.398679 1 tasks_processing.go:69] worker 20 listening for tasks. I0416 12:36:27.398691 1 tasks_processing.go:69] worker 14 listening for tasks. I0416 12:36:27.398694 1 tasks_processing.go:69] worker 60 listening for tasks. I0416 12:36:27.398695 1 tasks_processing.go:69] worker 56 listening for tasks. I0416 12:36:27.398636 1 tasks_processing.go:69] worker 34 listening for tasks. I0416 12:36:27.398701 1 tasks_processing.go:69] worker 62 listening for tasks. I0416 12:36:27.398701 1 tasks_processing.go:69] worker 10 listening for tasks. I0416 12:36:27.398702 1 tasks_processing.go:69] worker 50 listening for tasks. I0416 12:36:27.398706 1 tasks_processing.go:69] worker 54 listening for tasks. I0416 12:36:27.398700 1 tasks_processing.go:69] worker 11 listening for tasks. I0416 12:36:27.398705 1 tasks_processing.go:69] worker 51 listening for tasks. I0416 12:36:27.398663 1 tasks_processing.go:69] worker 21 listening for tasks. I0416 12:36:27.398666 1 tasks_processing.go:69] worker 38 listening for tasks. I0416 12:36:27.398668 1 tasks_processing.go:69] worker 7 listening for tasks. I0416 12:36:27.398673 1 tasks_processing.go:69] worker 44 listening for tasks. I0416 12:36:27.398666 1 tasks_processing.go:69] worker 27 listening for tasks. I0416 12:36:27.398675 1 tasks_processing.go:69] worker 8 listening for tasks. I0416 12:36:27.398676 1 tasks_processing.go:69] worker 45 listening for tasks. I0416 12:36:27.398676 1 tasks_processing.go:69] worker 40 listening for tasks. I0416 12:36:27.398683 1 tasks_processing.go:69] worker 59 listening for tasks. I0416 12:36:27.398729 1 tasks_processing.go:69] worker 53 listening for tasks. I0416 12:36:27.398684 1 tasks_processing.go:69] worker 48 listening for tasks. I0416 12:36:27.398683 1 tasks_processing.go:69] worker 12 listening for tasks. I0416 12:36:27.398688 1 tasks_processing.go:69] worker 13 listening for tasks. I0416 12:36:27.398695 1 tasks_processing.go:69] worker 57 listening for tasks. I0416 12:36:27.398695 1 tasks_processing.go:69] worker 58 listening for tasks. I0416 12:36:27.398700 1 tasks_processing.go:69] worker 52 listening for tasks. I0416 12:36:27.398700 1 tasks_processing.go:69] worker 49 listening for tasks. I0416 12:36:27.398655 1 tasks_processing.go:69] worker 18 listening for tasks. I0416 12:36:27.398772 1 tasks_processing.go:71] worker 15 working on image task. I0416 12:36:27.398777 1 tasks_processing.go:71] worker 31 working on lokistack task. I0416 12:36:27.398780 1 tasks_processing.go:71] worker 30 working on container_runtime_configs task. I0416 12:36:27.398787 1 tasks_processing.go:71] worker 35 working on infrastructures task. I0416 12:36:27.398791 1 tasks_processing.go:71] worker 33 working on machine_healthchecks task. I0416 12:36:27.398799 1 tasks_processing.go:71] worker 26 working on cluster_apiserver task. I0416 12:36:27.398814 1 tasks_processing.go:71] worker 25 working on image_registries task. I0416 12:36:27.398820 1 tasks_processing.go:71] worker 3 working on openstack_dataplanedeployments task. I0416 12:36:27.398833 1 tasks_processing.go:71] worker 47 working on cost_management_metrics_configs task. I0416 12:36:27.398837 1 tasks_processing.go:71] worker 24 working on dvo_metrics task. I0416 12:36:27.398842 1 tasks_processing.go:71] worker 36 working on config_maps task. I0416 12:36:27.398779 1 tasks_processing.go:71] worker 43 working on crds task. I0416 12:36:27.398866 1 tasks_processing.go:71] worker 1 working on machine_config_pools task. I0416 12:36:27.398885 1 tasks_processing.go:71] worker 16 working on overlapping_namespace_uids task. I0416 12:36:27.398783 1 tasks_processing.go:71] worker 18 working on node_logs task. I0416 12:36:27.398908 1 tasks_processing.go:71] worker 28 working on mutating_webhook_configurations task. I0416 12:36:27.398952 1 tasks_processing.go:71] worker 54 working on silenced_alerts task. I0416 12:36:27.398808 1 tasks_processing.go:71] worker 2 working on networks task. I0416 12:36:27.398999 1 tasks_processing.go:71] worker 23 working on qemu_kubevirt_launcher_logs task. I0416 12:36:27.399014 1 tasks_processing.go:71] worker 59 working on machine_sets task. I0416 12:36:27.399021 1 gather_lokistack.go:58] Start LokiStack gathering I0416 12:36:27.399030 1 tasks_processing.go:71] worker 0 working on pod_network_connectivity_checks task. I0416 12:36:27.398783 1 tasks_processing.go:71] worker 29 working on image_pruners task. I0416 12:36:27.399053 1 tasks_processing.go:71] worker 7 working on ceph_cluster task. I0416 12:36:27.399063 1 tasks_processing.go:71] worker 51 working on ingress task. I0416 12:36:27.399071 1 tasks_processing.go:71] worker 21 working on service_accounts task. I0416 12:36:27.399075 1 tasks_processing.go:71] worker 9 working on openstack_controlplanes task. I0416 12:36:27.399085 1 tasks_processing.go:71] worker 8 working on metrics task. I0416 12:36:27.399110 1 tasks_processing.go:71] worker 4 working on support_secret task. I0416 12:36:27.399125 1 tasks_processing.go:71] worker 44 working on machine_configs task. I0416 12:36:27.399127 1 tasks_processing.go:71] worker 11 working on authentication task. I0416 12:36:27.399146 1 tasks_processing.go:71] worker 53 working on aggregated_monitoring_cr_names task. I0416 12:36:27.399188 1 tasks_processing.go:71] worker 45 working on nodenetworkstates task. I0416 12:36:27.399207 1 tasks_processing.go:71] worker 38 working on machines task. I0416 12:36:27.399212 1 tasks_processing.go:71] worker 37 working on openstack_version task. I0416 12:36:27.399280 1 tasks_processing.go:71] worker 34 working on clusterroles task. I0416 12:36:27.399289 1 tasks_processing.go:71] worker 6 working on operators task. I0416 12:36:27.399307 1 tasks_processing.go:71] worker 41 working on sap_config task. I0416 12:36:27.399312 1 tasks_processing.go:71] worker 48 working on tsdb_status task. I0416 12:36:27.399318 1 tasks_processing.go:71] worker 61 working on container_images task. I0416 12:36:27.399318 1 tasks_processing.go:71] worker 55 working on nodes task. I0416 12:36:27.399335 1 tasks_processing.go:71] worker 27 working on openstack_dataplanenodesets task. I0416 12:36:27.399335 1 tasks_processing.go:71] worker 42 working on validating_webhook_configurations task. I0416 12:36:27.399313 1 tasks_processing.go:71] worker 14 working on pdbs task. I0416 12:36:27.399361 1 tasks_processing.go:71] worker 20 working on sap_datahubs task. I0416 12:36:27.399363 1 tasks_processing.go:71] worker 52 working on oauths task. I0416 12:36:27.399410 1 tasks_processing.go:71] worker 62 working on schedulers task. I0416 12:36:27.399402 1 tasks_processing.go:71] worker 60 working on ingress_certificates task. I0416 12:36:27.399470 1 tasks_processing.go:71] worker 46 working on openshift_machine_api_events task. I0416 12:36:27.399490 1 tasks_processing.go:71] worker 49 working on active_alerts task. I0416 12:36:27.399503 1 tasks_processing.go:71] worker 56 working on node_features task. I0416 12:36:27.399510 1 tasks_processing.go:71] worker 12 working on sap_pods task. I0416 12:36:27.399540 1 tasks_processing.go:71] worker 17 working on feature_gates task. I0416 12:36:27.399549 1 tasks_processing.go:71] worker 57 working on olm_operators task. I0416 12:36:27.399612 1 tasks_processing.go:71] worker 10 working on version task. I0416 12:36:27.399631 1 tasks_processing.go:71] worker 58 working on install_plans task. I0416 12:36:27.398787 1 tasks_processing.go:71] worker 32 working on jaegers task. I0416 12:36:27.399685 1 tasks_processing.go:71] worker 13 working on machine_autoscalers task. I0416 12:36:27.399281 1 tasks_processing.go:71] worker 40 working on storage_classes task. I0416 12:36:27.399750 1 tasks_processing.go:71] worker 19 working on certificate_signing_requests task. I0416 12:36:27.399313 1 tasks_processing.go:71] worker 5 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0416 12:36:27.399807 1 tasks_processing.go:71] worker 50 working on operators_pods_and_events task. I0416 12:36:27.400042 1 tasks_processing.go:71] worker 22 working on nodenetworkconfigurationpolicies task. I0416 12:36:27.400059 1 tasks_processing.go:71] worker 39 working on storage_cluster task. I0416 12:36:27.405122 1 tasks_processing.go:71] worker 7 working on proxies task. I0416 12:36:27.405151 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 6.055844ms to process 0 records I0416 12:36:27.405182 1 tasks_processing.go:71] worker 63 working on monitoring_persistent_volumes task. I0416 12:36:27.405192 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 6.605142ms to process 0 records I0416 12:36:27.405966 1 tasks_processing.go:74] worker 30 stopped. I0416 12:36:27.405981 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 7.173636ms to process 0 records I0416 12:36:27.406019 1 tasks_processing.go:74] worker 3 stopped. I0416 12:36:27.406031 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 7.183624ms to process 0 records I0416 12:36:27.406038 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 7.227174ms to process 0 records I0416 12:36:27.406044 1 tasks_processing.go:74] worker 31 stopped. I0416 12:36:27.406242 1 tasks_processing.go:74] worker 1 stopped. I0416 12:36:27.406255 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 7.352864ms to process 0 records I0416 12:36:27.418268 1 tasks_processing.go:74] worker 9 stopped. I0416 12:36:27.418280 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 19.185585ms to process 0 records I0416 12:36:27.418286 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 18.756459ms to process 0 records I0416 12:36:27.418291 1 tasks_processing.go:74] worker 12 stopped. I0416 12:36:27.424448 1 tasks_processing.go:74] worker 35 stopped. I0416 12:36:27.425035 1 recorder.go:75] Recording config/infrastructure with fingerprint=21a901e37842e68aa5c6a62f96d8e2c3a100f0059f9546f04351f7ce42dee7f3 I0416 12:36:27.425051 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 25.646722ms to process 1 records I0416 12:36:27.427510 1 tasks_processing.go:74] worker 38 stopped. E0416 12:36:27.427525 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0416 12:36:27.427535 1 gather.go:177] gatherer "clusterconfig" function "machines" took 28.29461ms to process 0 records I0416 12:36:27.427731 1 tasks_processing.go:74] worker 15 stopped. I0416 12:36:27.427841 1 recorder.go:75] Recording config/image with fingerprint=d4c6d607548a9d62a96c5173e2328b93129c2a0b08f80c115ffa80b64c17f5ab I0416 12:36:27.427860 1 gather.go:177] gatherer "clusterconfig" function "image" took 28.947008ms to process 1 records I0416 12:36:27.427948 1 tasks_processing.go:74] worker 26 stopped. I0416 12:36:27.427983 1 recorder.go:75] Recording config/apiserver with fingerprint=13102a2c5eb684fd386d94237c95a25dc5cf39df875cbcbd4467f75e9369fd1b I0416 12:36:27.427992 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 28.967251ms to process 1 records I0416 12:36:27.428088 1 tasks_processing.go:74] worker 4 stopped. E0416 12:36:27.428098 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0416 12:36:27.428104 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 28.966001ms to process 0 records I0416 12:36:27.428227 1 tasks_processing.go:74] worker 40 stopped. I0416 12:36:27.428336 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=5c2c8be3b491a612094a7374892d4facfa9074b7881b91bd747fd61c2f95faaa I0416 12:36:27.428362 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=8e339fc5571e189a40f69532dfc4b26e6983b121af369401a5707361a15f24b4 I0416 12:36:27.428374 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 28.485207ms to process 2 records I0416 12:36:27.428518 1 tasks_processing.go:74] worker 11 stopped. I0416 12:36:27.428734 1 recorder.go:75] Recording config/authentication with fingerprint=2f65c267220bc0060d837458fc1e192993378a7ebeb302529fd5d3089c1d8896 I0416 12:36:27.428749 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 29.378749ms to process 1 records I0416 12:36:27.429142 1 tasks_processing.go:74] worker 27 stopped. E0416 12:36:27.429146 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0416 12:36:27.429158 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 29.796577ms to process 0 records I0416 12:36:27.429175 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 29.646667ms to process 0 records I0416 12:36:27.429185 1 tasks_processing.go:74] worker 56 stopped. I0416 12:36:27.429217 1 tasks_processing.go:74] worker 22 stopped. I0416 12:36:27.429232 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 29.115986ms to process 0 records I0416 12:36:27.429472 1 tasks_processing.go:74] worker 52 stopped. I0416 12:36:27.429673 1 recorder.go:75] Recording config/oauth with fingerprint=ce37728f35c97c788fe8ba8b63e9dba55573f7878bd0ddb86377cdf8243400c7 I0416 12:36:27.429689 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 30.093243ms to process 1 records I0416 12:36:27.430155 1 tasks_processing.go:74] worker 37 stopped. I0416 12:36:27.430166 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 30.935208ms to process 0 records I0416 12:36:27.430171 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 30.957775ms to process 0 records I0416 12:36:27.430176 1 tasks_processing.go:74] worker 45 stopped. I0416 12:36:27.430341 1 tasks_processing.go:74] worker 41 stopped. I0416 12:36:27.430353 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 31.024976ms to process 0 records I0416 12:36:27.430360 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 30.988956ms to process 0 records I0416 12:36:27.430365 1 tasks_processing.go:74] worker 20 stopped. I0416 12:36:27.431314 1 tasks_processing.go:74] worker 18 stopped. I0416 12:36:27.431370 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 32.045497ms to process 0 records I0416 12:36:27.431628 1 tasks_processing.go:74] worker 62 stopped. I0416 12:36:27.431746 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=92b4fff77fa92671c68efeea8bf71aea0f01479fc8eeb2f7e14881dee8dbda58 I0416 12:36:27.431768 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 32.204678ms to process 1 records I0416 12:36:27.432037 1 tasks_processing.go:74] worker 2 stopped. I0416 12:36:27.432482 1 recorder.go:75] Recording config/network with fingerprint=7144433afa65ecea08e83a06579902cdf5bcbfce71437b8573f68326e21ae38f I0416 12:36:27.432522 1 gather.go:177] gatherer "clusterconfig" function "networks" took 33.031103ms to process 1 records I0416 12:36:27.433044 1 tasks_processing.go:74] worker 47 stopped. I0416 12:36:27.433056 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 33.644654ms to process 0 records I0416 12:36:27.433069 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 33.475263ms to process 0 records I0416 12:36:27.433077 1 tasks_processing.go:74] worker 59 stopped. I0416 12:36:27.433164 1 tasks_processing.go:74] worker 17 stopped. I0416 12:36:27.433311 1 recorder.go:75] Recording config/featuregate with fingerprint=dc4552974dd1b1a16d33297632b6f99ab5c568962d8b47b56ca2135e2bf008c8 I0416 12:36:27.433325 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 33.612849ms to process 1 records I0416 12:36:27.433332 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 33.545843ms to process 0 records I0416 12:36:27.433337 1 tasks_processing.go:74] worker 32 stopped. I0416 12:36:27.433358 1 tasks_processing.go:74] worker 39 stopped. I0416 12:36:27.433365 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 33.037252ms to process 0 records I0416 12:36:27.433457 1 tasks_processing.go:74] worker 51 stopped. I0416 12:36:27.433532 1 recorder.go:75] Recording config/ingress with fingerprint=ffd7d8c872a943f7b88337df1dd5ec866186028be4126d37267bb6950b5962df I0416 12:36:27.433546 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 34.291765ms to process 1 records I0416 12:36:27.433661 1 tasks_processing.go:74] worker 14 stopped. I0416 12:36:27.433664 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=04e4074f222e3bb7ff7b44f164438478c0f1bef5836bee5a573238468bb1e83d I0416 12:36:27.433716 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=306903bec1b7f058191c529320c1a33d01a629a81b6fc3e7fd2faa1499ef5603 I0416 12:36:27.433748 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=aecd8d058c0b65d81263477a88fa37113a13764c280aeff492f5eeff805dbacd I0416 12:36:27.433772 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=ccc9ec34ffd28cc018d8e4924bcf2b91f2dc9c379507ccf6cbadd553bac0d448 I0416 12:36:27.433807 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=772a5a32c3dbcdc44d3b6684b8d523cda8c31a7fd35b9548079e86cf44ed358b I0416 12:36:27.433831 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=0ec57e460b43d2bf4df7824efafb52568de23adaf617d91e35eca8c4e7af8d6e I0416 12:36:27.433856 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=d3cc89a60874d55afc158e8fc24061c34800bc1821daced73e7f660b85fe9026 I0416 12:36:27.433883 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=540464e7be55f5dc8e9d70fef2ebfe90fdd843225f2249c623d19f3dbca87273 I0416 12:36:27.433908 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=ef2a9e01c1dbd42c366fbf6e5b0e585f5686f6ac35e478df0d5df07be442249b I0416 12:36:27.433934 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=2645639d2be9c02f85ca76d71e77b62f40938c0ef21a5d2e675b1bbcdb2c8e65 I0416 12:36:27.433955 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=7e811df452dafb9d705725f81ea8a96b9a3e2fffbe0c099514b5492b3811dbe5 I0416 12:36:27.433965 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 34.006788ms to process 11 records I0416 12:36:27.433973 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 33.674307ms to process 0 records E0416 12:36:27.433978 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0416 12:36:27.433984 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 35.046652ms to process 0 records I0416 12:36:27.434030 1 tasks_processing.go:74] worker 13 stopped. I0416 12:36:27.434044 1 tasks_processing.go:74] worker 33 stopped. I0416 12:36:27.434048 1 recorder.go:75] Recording config/proxy with fingerprint=3dc36ab7ec20ba5cc3222922b3deb038c1b1f7a365e0b935c9d267b09707ccc6 I0416 12:36:27.434056 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 28.797855ms to process 1 records I0416 12:36:27.434065 1 tasks_processing.go:74] worker 7 stopped. I0416 12:36:27.434430 1 tasks_processing.go:74] worker 29 stopped. I0416 12:36:27.434671 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=501f15afd994ec95f94f6384efcb2bcdd3c410131170b0b9f392d1947f6dea7a I0416 12:36:27.434688 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 35.38796ms to process 1 records I0416 12:36:27.434708 1 tasks_processing.go:74] worker 25 stopped. I0416 12:36:27.435043 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=a3c2e9e59bb17d1557e8310f80f3e7e64335bbf8b86ce2f687174b87c18a0d5c I0416 12:36:27.435057 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 35.886017ms to process 1 records I0416 12:36:27.435787 1 tasks_processing.go:74] worker 28 stopped. I0416 12:36:27.435949 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/annotation.operator.tekton.dev with fingerprint=1ad9977ca1d660cf90bb6a3effc75a92130aad81c9ec107ce3f7da61b1215032 I0416 12:36:27.436003 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=5f8435efb9d8f71554beddcf053d28e00ed024269b7460b6a5f2a82c684ababa I0416 12:36:27.436024 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/cert-manager-webhook with fingerprint=8f0ee4f84c6d2c3abc4d7c7149dd97fc3d7c00accf389cd1a0784ece1a0c23ab I0416 12:36:27.436059 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/integration-service-mutating-webhook-configuration with fingerprint=6aa48d19cac98cc0484e8955aaf21ff8e9461dc09d13113b21cab817d0a3bc3f I0416 12:36:27.436099 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/proxy.operator.tekton.dev with fingerprint=73099ce7f32fc76ba6d6f5e3beb0d12dcdc29bda3f36ae2d4948d6a179c877d1 I0416 12:36:27.436185 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/release-service-mutating-webhook-configuration with fingerprint=69bd22f375ceee14c66641b35389acb7a3f6bdb8db085ea622ce259941a18100 I0416 12:36:27.436221 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=49c8f28ea30648311fc036c5e7b23511bbf4e4f0d517813f6d22b9a259a3fe13 I0416 12:36:27.436287 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=21429e4f23a01c882b566d102ef7d95c48cc7e4e228747a8c9c5c5296809aeb5 I0416 12:36:27.436339 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.operator.tekton.dev with fingerprint=63eeacbf6a52fbf67972cd42183f444c35ef329f49cb73e637f9546f8c40cdc6 I0416 12:36:27.436399 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.pipeline.tekton.dev with fingerprint=f2e8427f79ea1c14b1ce892f03dfed6703ab95e92786dd2b882fa078033b8b3e I0416 12:36:27.436453 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.triggers.tekton.dev with fingerprint=e28dbc8db66d47cb134b9b3907fc1995d5f200c3e49be49cfd0c99afd3bf7c6d I0416 12:36:27.436464 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 36.852037ms to process 11 records I0416 12:36:27.436551 1 tasks_processing.go:74] worker 55 stopped. I0416 12:36:27.436871 1 recorder.go:75] Recording config/node/ip-10-0-0-136.ec2.internal with fingerprint=8b25a5f8bd8f15f822dd21fe969667129180138a54bcf3ec9c810824ae7536cc I0416 12:36:27.436959 1 recorder.go:75] Recording config/node/ip-10-0-1-109.ec2.internal with fingerprint=3460b3eeb8b9e429f47f8a43507b110a73d6b65dee72e8fc78001a34918c867e I0416 12:36:27.437039 1 recorder.go:75] Recording config/node/ip-10-0-2-126.ec2.internal with fingerprint=2dad44dfae69c0bd58d646efa0114e080d48f3e1af7cc622c872eb95e618b003 I0416 12:36:27.437050 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 36.480304ms to process 3 records I0416 12:36:27.437080 1 recorder.go:75] Recording config/podnetworkconnectivitychecks with fingerprint=44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a I0416 12:36:27.437089 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 37.338743ms to process 1 records I0416 12:36:27.437097 1 tasks_processing.go:74] worker 0 stopped. I0416 12:36:27.437853 1 tasks_processing.go:74] worker 46 stopped. I0416 12:36:27.438033 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 38.36551ms to process 0 records I0416 12:36:27.438122 1 tasks_processing.go:74] worker 44 stopped. E0416 12:36:27.438178 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0416 12:36:27.438268 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0416 12:36:27.438290 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 38.987985ms to process 1 records I0416 12:36:27.438583 1 tasks_processing.go:74] worker 42 stopped. I0416 12:36:27.438809 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=5b83760b9fb423df5ab1e7f65c3a8c5e63a280b32cd29813e090634741cd46d0 I0416 12:36:27.438886 1 recorder.go:75] Recording config/validatingwebhookconfigurations/cert-manager-webhook with fingerprint=94cdc850f32ce015eb4f51ce8811939069498c86e0d94c28a3036bdb3fc0e402 I0416 12:36:27.438944 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.operator.tekton.dev with fingerprint=eed10caa0b32aa341b1690d4a45c41e70447ea7b94b44fd22b68c5c91995125e I0416 12:36:27.438982 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.pipeline.tekton.dev with fingerprint=97b83667cf482454e61acd616b77002727bc925cc927cc79df368d766c55b7ab I0416 12:36:27.439012 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.triggers.tekton.dev with fingerprint=3c51f97cc887ae80ece2ee2eaa65c4ae3334123bbfb458672fdde64d85cdc09a I0416 12:36:27.439112 1 recorder.go:75] Recording config/validatingwebhookconfigurations/integration-service-validating-webhook-configuration with fingerprint=1cea51e6ef9e4ccf6671a8f20fd87c512fed002dfb72e9ffa290da116726f60a I0416 12:36:27.439163 1 recorder.go:75] Recording config/validatingwebhookconfigurations/monitoringconfigmaps.openshift.io with fingerprint=067b09050b7d11509e31dbaa40fe0112f58f41bc4eb50a4c40d587a9a0fdc9a0 I0416 12:36:27.439349 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=42cc20a7ab2eaef933717e8585ad56271ccbef165ec81a0b99f1b3c52d72c489 I0416 12:36:27.439433 1 recorder.go:75] Recording config/validatingwebhookconfigurations/namespace.operator.tekton.dev with fingerprint=5af601f53e0c57483f0f02a525b4ba8a5b7be6ab1ca0b5b05b0dc1032862bf8e I0416 12:36:27.439686 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=878f0f2d7edcad7f250045ef3e35a3a2d366f4b1c0e3f87b345e682be2f116fe I0416 12:36:27.439753 1 gather_logs.go:145] no pods in namespace were found I0416 12:36:27.439825 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=0c56588faefdf4286da6564aa0e26fc6f4939e33e8cf902b09a99b57300fd4d1 I0416 12:36:27.440786 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=ee566ce707dbd7721babf85f9db28f8a37bd88fb4db981028d6b37f37251738e I0416 12:36:27.440863 1 recorder.go:75] Recording config/validatingwebhookconfigurations/release-service-validating-webhook-configuration with fingerprint=bf775d76b2ece562d8a2cbddaa0035f27ae9b5eb26b9cad231e48c4bb836e7c4 I0416 12:36:27.440894 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=a3e3ff4c67f6512b3f4e85862b123c25cb149928296f456f943f9ee3eae8a322 I0416 12:36:27.440932 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=de69056929a5aa8a531a074a1ad6abe0fcf19d4f8f6a8ce1ee71435e612dc257 I0416 12:36:27.440969 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=6fa8c7786ce00231c6c24f2cce750f2c97ed6c506fc9cf18c952515667ed6bf5 I0416 12:36:27.441024 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=51cee72ea8a1e2c2519fefc3e91d7710653573e261dfb63b8aa552c2848fe8d1 I0416 12:36:27.441077 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=bb959bf2fefd7a30d29b808fc19250a28fa7f35b69668f3f3a30280918d37e47 I0416 12:36:27.441116 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=83db4e45bebbedc5df24bf441e94bc755a5bab0a940749f33d06d0b39f5176e5 I0416 12:36:27.441153 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=a7f099286af3f3826ba01043744ba0c63856e615631532dd84891f4578cdeeb3 I0416 12:36:27.441186 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=25eb1f00c02e4be4ae8b331c35b8ce2c3d18b04b325d41225d9908cd198ad316 I0416 12:36:27.441219 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.pipelinesascode.tekton.dev with fingerprint=f1f2b6b989e70a0b307c00fdd0807a8ee71bb2333d02422da897c9261cccbb23 I0416 12:36:27.441267 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.operator.tekton.dev with fingerprint=8ad28c39bff383f5415021492131df6796921883004f5581fa418cdf7893ee69 I0416 12:36:27.441326 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.pipeline.tekton.dev with fingerprint=6670b1549d7482605f0096c65463ed2ef6c06686b4544a0c4c1f46f283ecbe10 I0416 12:36:27.441377 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.triggers.tekton.dev with fingerprint=cc1771eccb40273054354bf50654fc047fc2e6bc9887386be3616815b0a7f463 I0416 12:36:27.441386 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 39.232406ms to process 25 records I0416 12:36:27.441397 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 38.93471ms to process 0 records I0416 12:36:27.441405 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 40.776918ms to process 0 records I0416 12:36:27.441415 1 tasks_processing.go:74] worker 23 stopped. I0416 12:36:27.441423 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0416 12:36:27.441430 1 tasks_processing.go:74] worker 16 stopped. I0416 12:36:27.441416 1 tasks_processing.go:74] worker 19 stopped. I0416 12:36:27.441432 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 42.293805ms to process 1 records I0416 12:36:27.441549 1 tasks_processing.go:74] worker 43 stopped. I0416 12:36:27.441910 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=7cacf1e3b710562e5bf90e57e3cd6301b224b260c6d1d3f149d9048198827afe I0416 12:36:27.442116 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=0111c3c55849a4123b7c5378617ba5e93b7e2bbba4a7d3d945fdc46f464a0949 I0416 12:36:27.442125 1 gather.go:177] gatherer "clusterconfig" function "crds" took 42.397747ms to process 2 records I0416 12:36:27.442295 1 gather_cluster_operator_pods_and_events.go:121] Found 0 pods with 0 containers I0416 12:36:27.442318 1 tasks_processing.go:74] worker 50 stopped. I0416 12:36:27.442328 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 42.495732ms to process 0 records I0416 12:36:27.446427 1 tasks_processing.go:74] worker 63 stopped. I0416 12:36:27.446444 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 41.226205ms to process 0 records I0416 12:36:27.446840 1 tasks_processing.go:74] worker 34 stopped. I0416 12:36:27.447177 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=f45d9013923d0035ccf3aa7a6bbc9259b2b9b7ea2b2826dca90004a607e0494f I0416 12:36:27.447406 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=5d9e0eeae822bc5ba34f9a5063cbb390a9ae3d3748cc81f944be0b20459cb38b I0416 12:36:27.447417 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 47.541032ms to process 2 records I0416 12:36:27.453156 1 tasks_processing.go:74] worker 53 stopped. I0416 12:36:27.453172 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 53.994439ms to process 0 records I0416 12:36:27.478050 1 tasks_processing.go:74] worker 36 stopped. E0416 12:36:27.478065 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0416 12:36:27.478071 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0416 12:36:27.478074 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0416 12:36:27.478083 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=ad286723f58bdcfc37aeba3ec5b4110c08e1af59cd34d14b4bfaab02d18e4856 I0416 12:36:27.478118 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0416 12:36:27.478126 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0416 12:36:27.478130 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=2ab5ab7b1b10d7fcf1197bb24dea7c90f400e4effc18c7356873209d54fdf84b I0416 12:36:27.478141 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0416 12:36:27.478177 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0416 12:36:27.478185 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0416 12:36:27.478190 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 79.19199ms to process 7 records I0416 12:36:27.480624 1 tasks_processing.go:74] worker 5 stopped. I0416 12:36:27.480649 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 80.813177ms to process 0 records I0416 12:36:27.488127 1 tasks_processing.go:74] worker 61 stopped. I0416 12:36:27.489746 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-66dbbb6468-cgnng with fingerprint=c2585c91780def3957a9781c26cce4416e7d885b0098bb0091c18859155fe0b9 I0416 12:36:27.489872 1 recorder.go:75] Recording config/running_containers with fingerprint=bc530335599c96cdb739d2d4ee8d487aaf2cc413999470326137c56320f91d0c I0416 12:36:27.489882 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 88.793233ms to process 2 records I0416 12:36:27.515800 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0416 12:36:27.519934 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0416 12:36:27.520865 1 tasks_processing.go:74] worker 10 stopped. I0416 12:36:27.521079 1 recorder.go:75] Recording config/version with fingerprint=75b22d33446b3b1b2f9c91fde6fcbe3611ea6d3cf529b7852067dc53d1691182 I0416 12:36:27.521093 1 recorder.go:75] Recording config/id with fingerprint=388860dd8c84bfc82898c92903729d9baa2c8fa7e82b36c753639c4b41c36e57 I0416 12:36:27.521099 1 gather.go:177] gatherer "clusterconfig" function "version" took 121.239199ms to process 2 records I0416 12:36:27.535933 1 tasks_processing.go:74] worker 57 stopped. I0416 12:36:27.536095 1 recorder.go:75] Recording config/olm_operators with fingerprint=22239a3781a1c543b12562d16b3cfe7f58adc41e56ecc85477dbeba14f60e91c I0416 12:36:27.536107 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 136.346787ms to process 1 records I0416 12:36:27.554889 1 tasks_processing.go:74] worker 60 stopped. E0416 12:36:27.554907 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0416 12:36:27.554914 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2pn82so64dbfd7cg358bevtr5m7peubm-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2pn82so64dbfd7cg358bevtr5m7peubm-primary-cert-bundle-secret" not found I0416 12:36:27.554957 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=8a3b89d2235946e169b418453781a559804501cb07bd78483e0cbbe0a7f0d343 I0416 12:36:27.554969 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 155.457272ms to process 1 records I0416 12:36:28.491659 1 tasks_processing.go:74] worker 54 stopped. I0416 12:36:28.491680 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0416 12:36:28.491692 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.092683952s to process 1 records I0416 12:36:28.491903 1 tasks_processing.go:74] worker 8 stopped. I0416 12:36:28.491979 1 recorder.go:75] Recording config/metrics with fingerprint=ca0e194b8fc3ffd8da4db00845c720e4c34b999ece6811108bd3019a38042631 I0416 12:36:28.491992 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.092807157s to process 1 records I0416 12:36:28.492035 1 recorder.go:75] Recording config/alerts with fingerprint=6d578bed936301f0e1b3fde44d0a658843d88af5985afe510076f558a32bdf1c I0416 12:36:28.492043 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.092499906s to process 1 records I0416 12:36:28.492049 1 tasks_processing.go:74] worker 49 stopped. I0416 12:36:28.498252 1 tasks_processing.go:74] worker 48 stopped. I0416 12:36:28.498274 1 recorder.go:75] Recording config/tsdb.json with fingerprint=17a920bf9ba0278c3205b3830bb8a160ed94ec1e385755193fff093b3f0fcfbd I0416 12:36:28.498285 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.098927772s to process 1 records I0416 12:36:29.748323 1 tasks_processing.go:74] worker 24 stopped. I0416 12:36:29.748737 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=2a2d2bac906213af982b5dd49d8672d9d7613762a4399c91c9e60372f3e4ede0 I0416 12:36:29.748757 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 2.34947056s to process 1 records I0416 12:36:29.873717 1 tasks_processing.go:74] worker 6 stopped. I0416 12:36:29.873783 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=f65beda11243785a17832637d1cc74779f8e3bbf79fc47e399d621c94abeea94 I0416 12:36:29.873831 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0416 12:36:29.873865 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=94f0f52fa46ae0aae11da4197d7fbfb2b4283786957ebf77f4c49bf457dd5aac I0416 12:36:29.873875 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0416 12:36:29.873896 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=a564e36b839b40b7490be14d0ce20f6133cccfe740e4dfcf9bc30a0e5dabb49c I0416 12:36:29.873910 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0416 12:36:29.873931 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=ee8e36d8904d5e65a714f6286db33efd974d5e776fe3249270ed5d316ed26987 I0416 12:36:29.873980 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=1cf444d468daa12cfcd22de834eef9058433e21354e8bf1f00e047e6b826de68 I0416 12:36:29.874004 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=35d0ddcb514688a097094343ccf05aa4ca1641cfd5a9395528f899e913c4a961 I0416 12:36:29.874034 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=0944462a361d82fbf4dd23eada58e2f1a444a6d258d59e9a279e2628d370ea66 I0416 12:36:29.874286 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=065747f66033803b656ac49a6a1e99bbc680edc4f0a89a0cf7b4ab76fb3ddf40 I0416 12:36:29.874305 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=a9391d81e26a42537f05d30a59b06f85871662397dcd58387ebb63d197d28a3f I0416 12:36:29.874312 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0416 12:36:29.874326 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=c24fdb9bb403c589bc03fc5593fe1f45b222b9dd9dd4081b61771793eb55edcf I0416 12:36:29.874335 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0416 12:36:29.874349 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=9c3281f3f3fe23e3e05bd516b235ab9b88dab1ad7207784884caf0f81ebc6836 I0416 12:36:29.874356 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0416 12:36:29.874375 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=25f0a427ecc1b2c707620c9526cd7c1e03d2d4b21db33d6100a1ef12962bcd00 I0416 12:36:29.874384 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0416 12:36:29.874405 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=0d3cd5c6f82ca7b092063d240d257633d67a7477edd410ecd6ad69fd8a33520f I0416 12:36:29.874505 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=a79f5729b6046b007214ce41e23bee6127b19b5ad42f1b29fb821356fc92b91d I0416 12:36:29.874514 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0416 12:36:29.874520 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0416 12:36:29.874540 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0416 12:36:29.874603 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=907d770ffc5f3772902989c986c970a84b0cb118d627668570d9e4d9f578462d I0416 12:36:29.874626 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=dbe12676b46db1467c08dc79dfb5b9f5d48d785e59a38d8ea337120287c40253 I0416 12:36:29.874635 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0416 12:36:29.874651 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=a5a2f344f5ab718728ac43449b4b700602215902cd355591f91499596afbfd89 I0416 12:36:29.874660 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0416 12:36:29.874677 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=0fdb7fce810159ccd5772e47d893503b8c7dbfb8fe4a1a5b53afa34698c1d3d3 I0416 12:36:29.874685 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0416 12:36:29.874697 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=7a4a80164b627bd26ff40f57d4cebc8843d2e7d05e01fe7d4e547077ba536e93 I0416 12:36:29.874712 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=f60cd1ffdac149191762b4e9d1d20beab337ee24e164ce1a7f50fd97ee76f2f7 I0416 12:36:29.874724 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=89221849d244d7b414065dcbb8262c04e33469efdc4f0ae914fa6924a47a0ba0 I0416 12:36:29.874746 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=666b9401270838ee10de5d7c80be0b65c6d894669ad34d60d6b86ae5ea15a458 I0416 12:36:29.874754 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0416 12:36:29.874781 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=9a348e0622f39a46d000b1de0d49ff90439914c585549ec745543448710f7f47 I0416 12:36:29.874796 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0416 12:36:29.874803 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0416 12:36:29.874809 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.474413134s to process 39 records I0416 12:36:40.446614 1 tasks_processing.go:74] worker 58 stopped. I0416 12:36:40.446662 1 recorder.go:75] Recording config/installplans with fingerprint=a5b6a5709edaa0451f27698816b5b95a2700db411a592b10d2f3fe3071ef5ef9 I0416 12:36:40.446675 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.046966072s to process 1 records I0416 12:36:41.205042 1 tasks_processing.go:74] worker 21 stopped. I0416 12:36:41.205402 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=74b727b232cc45b882d26cb89407f543533046358d1731eed12d9232af57da52 I0416 12:36:41.205419 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.805954201s to process 1 records E0416 12:36:41.205484 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.807s with: function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error" I0416 12:36:41.206594 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0416 12:36:41.206608 1 periodic.go:216] Running workloads gatherer I0416 12:36:41.206622 1 tasks_processing.go:45] number of workers: 2 I0416 12:36:41.206628 1 tasks_processing.go:69] worker 1 listening for tasks. I0416 12:36:41.206632 1 tasks_processing.go:71] worker 1 working on workload_info task. I0416 12:36:41.206697 1 tasks_processing.go:69] worker 0 listening for tasks. I0416 12:36:41.206780 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0416 12:36:41.215826 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-136.ec2.internal... I0416 12:36:41.215833 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-109.ec2.internal... I0416 12:36:41.215848 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-126.ec2.internal... I0416 12:36:41.232093 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak. I0416 12:36:41.232106 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak-pgsql. I0416 12:36:41.232111 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from server. I0416 12:36:41.232116 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from tpa-pgsql. I0416 12:36:41.240296 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-keycloak from keycloak-pgsql-bee. I0416 12:36:41.240309 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from importer. I0416 12:36:41.240314 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from server. I0416 12:36:41.240319 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from tpa-pgsql-bee. I0416 12:36:41.240329 1 tasks_processing.go:74] worker 0 stopped. I0416 12:36:41.240338 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 33.529399ms to process 0 records I0416 12:36:48.751812 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 8s I0416 12:36:48.790870 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 31s for image data I0416 12:36:48.798961 1 gather_workloads_info.go:387] No image sha256:09c857f0c20721d6b447f5f567182befc1ca6157128225849117a5c830feab23 (10ms) I0416 12:36:48.807667 1 gather_workloads_info.go:387] No image sha256:57a1aea49d7cc275b37b8f52d602a3a9d1601ec6a21a3268dd4903566cb2e335 (9ms) I0416 12:36:48.816188 1 gather_workloads_info.go:387] No image sha256:00fa6a8075723e279b420c76d13105c1650b1d46db51c7018801c558c0a876c6 (9ms) I0416 12:36:48.824689 1 gather_workloads_info.go:387] No image sha256:8ef614441b76914f5727f5bec23a9d8dc2785ca7fd6a2516f393529b7801da53 (8ms) I0416 12:36:48.833064 1 gather_workloads_info.go:387] No image sha256:373050d2ded02b5acd0e5edf3ef9819fe65403b2f40b557e9077e4a57629cb97 (8ms) I0416 12:36:48.841229 1 gather_workloads_info.go:387] No image sha256:25c148fd380b1a9db3f6039d2e0eabc489a954921452391390ba9192b2325678 (8ms) I0416 12:36:48.849283 1 gather_workloads_info.go:387] No image sha256:48e883a3932aea9457f55cd4628d21397d429d4828f42f95d1c903d9d5395bde (8ms) I0416 12:36:48.859664 1 gather_workloads_info.go:387] No image sha256:572ebf7c7fab1a518582f3ca46c866730423cce6e8a19f614dc15fd61bf0c65a (10ms) I0416 12:36:48.867952 1 gather_workloads_info.go:387] No image sha256:5aaea0419169e55832cc27acfe0fe3b9513a343d6bdf71d3da1575ed322245d0 (8ms) I0416 12:36:48.876548 1 gather_workloads_info.go:387] No image sha256:2f6f91dfd7b71cad1c6db82835d709d20f4153cf500d60ee32145712af922214 (9ms) I0416 12:36:48.898344 1 gather_workloads_info.go:387] No image sha256:b23c96e42e4ad57cbb1addc486abb1ce1b2a5c440b21e168cb79308e791c5b72 (22ms) I0416 12:36:48.999299 1 gather_workloads_info.go:387] No image sha256:934d8e8c50f3c609b8eea80d1051111fe3d066fe8c65c79572072ae55fcb0a86 (101ms) I0416 12:36:49.099400 1 gather_workloads_info.go:387] No image sha256:5b6212b8f539f08e78417d8a4b7485ca0b4e7927cacd7b752742a28841bc8ccd (100ms) I0416 12:36:49.199303 1 gather_workloads_info.go:387] No image sha256:7e8f7bc3d6ac60f987cc21f275f9430665af7755659bd399f3013ee661c3bdd0 (100ms) I0416 12:36:49.299273 1 gather_workloads_info.go:387] No image sha256:0acfe677ed58031f8381cb8a4f2d8917ec4cfa95485e2a46529dffae54c75ace (100ms) I0416 12:36:49.399704 1 gather_workloads_info.go:387] No image sha256:08c5a78c8a5af04c549e2273aaf4bb452a75bf038d68aa9d01bb2aff66c30e90 (100ms) I0416 12:36:49.499537 1 gather_workloads_info.go:387] No image sha256:4f86f5c692a497442b54c435e68b0cbf961591a00ebc3a73c364a19da673e34d (100ms) I0416 12:36:49.599689 1 gather_workloads_info.go:387] No image sha256:1f118a4ec0b92cb88c8544ea31d2b9adfc7006eeddb7a8d260150ecbce4adb8c (100ms) I0416 12:36:49.699988 1 gather_workloads_info.go:387] No image sha256:590141005a88852d3327c3d1ca53a0f331f88efdb42d8de87fb7ae156c8814b3 (100ms) I0416 12:36:49.799347 1 gather_workloads_info.go:398] Found image sha256:23204877f166455ce8f9de9b91a467eeda576f172d5f96124a68aa986c4775d6 (99ms) I0416 12:36:49.899333 1 gather_workloads_info.go:387] No image sha256:637d41f067a5239096fc22b135181cda5113da833f1370e7a73965e83792e93a (100ms) I0416 12:36:49.999614 1 gather_workloads_info.go:387] No image sha256:084aa9b0f8a6d478549dc384d4e66da13ee9b25cc98531da861cc19dee2a9e8f (100ms) I0416 12:36:50.100067 1 gather_workloads_info.go:387] No image sha256:0a4dfb8d4c1b3849319d45b4c54dff26a7238a2c08fcaa121f93073e95ab12e8 (100ms) I0416 12:36:50.199745 1 gather_workloads_info.go:387] No image sha256:6d83c7e0e068178360998c815a3e0c729ca80a349954172aadafad5da5180d0c (100ms) I0416 12:36:50.299362 1 gather_workloads_info.go:387] No image sha256:1eb6a6ee3c66ac15be6bc21bb6015c595c11c15b9dfd21bd9f5ce7f7b990ebaa (100ms) I0416 12:36:50.399638 1 gather_workloads_info.go:387] No image sha256:cb5b933220b1493a9fd73380d296b3d6f79c594fc28446e0197c9a3b143025ef (100ms) I0416 12:36:50.499942 1 gather_workloads_info.go:387] No image sha256:27f3be442cf1d9f640657fb6d7cea6b133652226f9a80c3442df226b3cb3c2dc (100ms) I0416 12:36:50.599244 1 gather_workloads_info.go:387] No image sha256:6ca4eb17da6277b142a3353b675d735c106868f827243eaef70cd1ec01d36307 (99ms) I0416 12:36:50.699105 1 gather_workloads_info.go:387] No image sha256:ce98d5d844bfc2ba8de1893866ad38166c95157d54abd8192b181e819bc50bb5 (100ms) I0416 12:36:50.798838 1 gather_workloads_info.go:387] No image sha256:e4bb09dfe4513cdbe349507495c7f4044623a3c2aff866b7946d941e82a7a639 (100ms) I0416 12:36:50.900075 1 gather_workloads_info.go:387] No image sha256:48f5559439bea030a6423652da448c25fff0c62ba293eb521843c1a8eb89ddb0 (101ms) I0416 12:36:50.998774 1 gather_workloads_info.go:387] No image sha256:0b2e6536a0ca3afc5e64a218087a6287c74b77a359075a385f1949ca5bd51b22 (99ms) I0416 12:36:51.099208 1 gather_workloads_info.go:387] No image sha256:1ca6fa787c621462fa2c67b9a42b1de67688883af90316475b0df35be3ed805d (100ms) I0416 12:36:51.206200 1 gather_workloads_info.go:387] No image sha256:ada1a963ce2c45d2bba08051c1e0e2db88b200e9d616fab8fde10b698101fc69 (107ms) I0416 12:36:51.308110 1 gather_workloads_info.go:387] No image sha256:5808401268394502d335281ea1a294b07210461b986b58f91d7d1f29c0029c6d (102ms) I0416 12:36:51.402586 1 gather_workloads_info.go:387] No image sha256:95801a943ba7d0ec4af53c3cd1177483e649bcd528b5a838a32ad2d860e6503a (94ms) I0416 12:36:51.500872 1 gather_workloads_info.go:387] No image sha256:6a0d1f472283c686e438dbfbeec826db9d7d95f45f92842c4073f70704860d2f (98ms) I0416 12:36:51.528710 1 configmapobserver.go:84] configmaps "insights-config" not found I0416 12:36:51.563807 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0416 12:36:51.568739 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0416 12:36:51.568754 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0416 12:36:51.573673 1 secretconfigobserver.go:119] support secret does not exist I0416 12:36:51.599954 1 gather_workloads_info.go:387] No image sha256:4dcd0b18dea61968f20d49c4372eec43689eb52e823e1a6293e9b89c6e21e587 (99ms) I0416 12:36:51.699254 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (99ms) I0416 12:36:51.799292 1 gather_workloads_info.go:387] No image sha256:52db05084f2a2e7d7bf4040e4865df88ec4074efbbe59a78d861be2c5ab2aa40 (100ms) I0416 12:36:51.899138 1 gather_workloads_info.go:387] No image sha256:15677f0b70e6aa2dfaf088e45fc1a425c22bf6fda326b8116f87e88b6694dfab (100ms) I0416 12:36:51.999168 1 gather_workloads_info.go:387] No image sha256:f02c58838bf882d9b5d82a1a96e8ab29ce6033ae1b64418118fba43eb9151b41 (100ms) I0416 12:36:52.099798 1 gather_workloads_info.go:387] No image sha256:730d1b6988025bef0daa3a9a5d8467ec4a26b0382cc52f91c3375b4590d3518a (101ms) I0416 12:36:52.199865 1 gather_workloads_info.go:387] No image sha256:59b844637eca688cc22c7841bc4480a26d1384444bf9b0161261a182f87a1262 (100ms) I0416 12:36:52.299719 1 gather_workloads_info.go:387] No image sha256:5ffaf92fc557cb891a546ae2682d4e0259166ad6d935970dc958d255abc29a48 (100ms) I0416 12:36:52.399891 1 gather_workloads_info.go:387] No image sha256:17aefdc2f4752c23dc8f0947bb01fc34635822eeb18f2d8a5eddf8211b84d450 (100ms) I0416 12:36:52.501227 1 gather_workloads_info.go:387] No image sha256:15928a5b803fa00781b408dbc4c3bfa7c5287b18584ba31f817def8a4430c725 (101ms) I0416 12:36:52.599376 1 gather_workloads_info.go:387] No image sha256:384e639f2ce3e75712a5ee1cc5520161342e9dd1e94444d134d7ad4a39dde279 (98ms) I0416 12:36:52.699130 1 gather_workloads_info.go:387] No image sha256:1a7ac3c798d83cc37dd750ed44223630f4ebff937534a59a9e9ad029dbf31a0f (100ms) I0416 12:36:52.798967 1 gather_workloads_info.go:387] No image sha256:875c77e5d144f03fb91d8cee0259f6966683ca88d1bf818dbf4652c16b70312c (100ms) I0416 12:36:52.899120 1 gather_workloads_info.go:387] No image sha256:43efa5a676666dd4ae039ad5518eaf636f5baf8d688d9a4b475822c32ad1ddfb (100ms) I0416 12:36:52.999269 1 gather_workloads_info.go:387] No image sha256:000105ef5150e7079b90a613fb9e6193e2a6ef9b1908d2dce44f2395d4fd070f (100ms) I0416 12:36:53.099514 1 gather_workloads_info.go:387] No image sha256:a8ec9cc9b21641635ffc88656680601fb8fc2bc043e57b3feff4fb0f6cc0dbc2 (100ms) I0416 12:36:53.199670 1 gather_workloads_info.go:387] No image sha256:23a671ad4c0c57aca495adb6ea996e9580541c3cec6a57dde147a438d69090a8 (100ms) I0416 12:36:53.299751 1 gather_workloads_info.go:387] No image sha256:30e597ec5d6bb96ff70a4f8688c748b659cd4fd5d73d222e8701821d236795c5 (100ms) I0416 12:36:53.399830 1 gather_workloads_info.go:387] No image sha256:38d71a4cf177f39a2bbe745183009943dbbf404de02aa5f879694aa024a4e6ac (100ms) I0416 12:36:53.499746 1 gather_workloads_info.go:387] No image sha256:46e034f706fdcd5f84f35a1250a064495f5f68c90fef13be9c01936904b07ed6 (100ms) I0416 12:36:53.599829 1 gather_workloads_info.go:387] No image sha256:1f4a37529de4f750099af18e113556bd995fe6922030c614b7d6d23eaa0bd318 (100ms) I0416 12:36:53.699331 1 gather_workloads_info.go:387] No image sha256:d64bea34bf3e1bb0b3a701c3ff14e66665afc1b050f28124ad7e6888eaec3a81 (99ms) I0416 12:36:53.799376 1 gather_workloads_info.go:387] No image sha256:b8d380990acb0184ab685b005e22fb8369139dd8cd6550b4521bd4bc3ca23b40 (100ms) I0416 12:36:53.899203 1 gather_workloads_info.go:387] No image sha256:cc686a64f9ae83adecc7a0ffe8a6b82f0750dc39ad05654a8087cf780a1c3b3a (100ms) I0416 12:36:53.999245 1 gather_workloads_info.go:387] No image sha256:9ef6dc311b880a6442b7a3a19006ddd955c7da36850bf000f5c9b68fd0862dd4 (100ms) I0416 12:36:54.099358 1 gather_workloads_info.go:387] No image sha256:865dd51e80034018400794d07edc0b546c6e4de7e2351dddc7f1f6378e1ffdd0 (100ms) I0416 12:36:54.199307 1 gather_workloads_info.go:387] No image sha256:61aeb8693f27b60dd35e3dd1961d14bd95988cae70d649b340045619e5de7acf (100ms) I0416 12:36:54.299194 1 gather_workloads_info.go:387] No image sha256:15e1b5f763553e86d0230a751b0783e3b990438fd07cf96eed164bccb72ed564 (100ms) I0416 12:36:54.399800 1 gather_workloads_info.go:398] Found image sha256:673ebc8cc22c56c8f410e011b2fa950d28cf7b6420e17fdb6580d6cb10523384 (101ms) I0416 12:36:54.500150 1 gather_workloads_info.go:387] No image sha256:1e9a9f1b5ecdab7d074722c860daab977519123fe4385affdfd86d8c7f3c473c (100ms) I0416 12:36:54.599599 1 gather_workloads_info.go:387] No image sha256:3380fecebaeee139c1607fbcd9346cebc92806679568e2244a8905ef0f52aad2 (99ms) I0416 12:36:54.699413 1 gather_workloads_info.go:387] No image sha256:a043239802b3eb8b323d285193d2527fad0ecec98ca91d188a3472a2fac8ae04 (100ms) I0416 12:36:54.799009 1 gather_workloads_info.go:387] No image sha256:55b1db6038c5beaed54c626e3343b7a8589cc0be8dc41d1a66b4deab766ff520 (100ms) I0416 12:36:54.898837 1 gather_workloads_info.go:387] No image sha256:050fe6fe1298c45a27982e3f4d0afe637ce01d9b394e85b7eb202309ecdd0731 (100ms) I0416 12:36:54.999501 1 gather_workloads_info.go:387] No image sha256:ab60623bb32f7e75fca71ef65137731cae347a21c7a4091dfd583fa00732721c (101ms) I0416 12:36:55.099550 1 gather_workloads_info.go:387] No image sha256:5c6d21c3f97366bc7ab57031cc027b67405a684bd804ce364ed5998b0685eaca (100ms) I0416 12:36:55.199547 1 gather_workloads_info.go:387] No image sha256:2c4ec0dfd62375ed45d5758798b1069e16a0a6d1986439d23c61591c4dfb9297 (100ms) I0416 12:36:55.300026 1 gather_workloads_info.go:387] No image sha256:4ad612fdbbe2880fccbc3be8cba12de6fed4eda659acf1d9112d6e36f40bd4f9 (100ms) I0416 12:36:55.399055 1 gather_workloads_info.go:387] No image sha256:5d6a2b8d2508c7da71192661e7c0dcf1335f48b6336a20189abffbe79eeff962 (99ms) I0416 12:36:55.499255 1 gather_workloads_info.go:387] No image sha256:5940cc34b322325618929b1e0eb3864dae73d54c8f5b474e218dfb28123a61c7 (100ms) I0416 12:36:55.599504 1 gather_workloads_info.go:387] No image sha256:bdeb1c455cffccdb6c90db238e9d371de06340b1d6105d47f66d87293f878ac1 (100ms) I0416 12:36:55.700280 1 gather_workloads_info.go:387] No image sha256:9d6d63dce784df5863e6a0ba4c11317a26c9d756d4e62d47759c97190a71cce5 (101ms) I0416 12:36:55.799391 1 gather_workloads_info.go:387] No image sha256:5ac9c549d65fc1d8bc900773bebee43e9192bcec1bb5fa46afb4597230c16ac7 (99ms) I0416 12:36:55.899919 1 gather_workloads_info.go:387] No image sha256:07789f6e6e3c3a5a974c106b43c2e8bc60edb3321def1f0883f3fcd35a238ed0 (101ms) I0416 12:36:56.000262 1 gather_workloads_info.go:387] No image sha256:d71caff0f67fe8d9665d39193d955fc9352224f647406a40e56428dd6cd24953 (100ms) I0416 12:36:56.099732 1 gather_workloads_info.go:387] No image sha256:0d70224d12e358b1a107a86e0a7e0845e1e8a4d30ce3a1423600f044e3fb28d2 (99ms) I0416 12:36:56.199648 1 gather_workloads_info.go:387] No image sha256:3bba1358d4a0ae878ff491c0c2cbfffe60649e110b40342b878fe8fa332f8858 (100ms) I0416 12:36:56.299620 1 gather_workloads_info.go:387] No image sha256:a18b7658b5cf078bcef30a1c752c42c46907714b589145c7c330cf7ba7db2715 (100ms) I0416 12:36:56.399390 1 gather_workloads_info.go:387] No image sha256:315260877c58d13e0511bbff7bdcc389bcd86deca48785023e28194b08c4c924 (100ms) I0416 12:36:56.499241 1 gather_workloads_info.go:387] No image sha256:4d859b1598ced25e137ed252f263b58c6016419429eb11d04a0a46c05c994b2e (100ms) I0416 12:36:56.599329 1 gather_workloads_info.go:387] No image sha256:53ff8efdd8f563421ebc1859ab021a3bbc1306f82d4ff5d9c21bc60ec5f57898 (100ms) I0416 12:36:56.699007 1 gather_workloads_info.go:387] No image sha256:8f881f6f0498eaba860d711dc8e9dc066db8728f22abedb82e1dc9a8e1c30046 (100ms) I0416 12:36:56.798970 1 gather_workloads_info.go:387] No image sha256:3f586d6fd6139bbad131716168590b12db0cdfe4dcbb15ccee65b080d5594b6e (100ms) I0416 12:36:56.899291 1 gather_workloads_info.go:387] No image sha256:5ff204630794311b0b37fa7b197b933ad85d76a481bf7cdb3bcbada08f0cdcbf (100ms) I0416 12:36:56.999717 1 gather_workloads_info.go:387] No image sha256:6814f5fced0ef219d06374011c68a11a3da788a764a00a69ade435466d9ee240 (100ms) I0416 12:36:57.099033 1 gather_workloads_info.go:387] No image sha256:54440fa6cb1b01a6b8952f700677832d7b7d3b1b58934957f504ca885730844a (99ms) I0416 12:36:57.200981 1 gather_workloads_info.go:387] No image sha256:89277d8d4560d71db88c2dcc67c992a24544ca21810920b609c1d49d53b4a287 (102ms) I0416 12:36:57.298852 1 gather_workloads_info.go:387] No image sha256:b336f6e44314dd23a21236118a604411522baf5e63732463f1d08daccb417f39 (98ms) I0416 12:36:57.399715 1 gather_workloads_info.go:387] No image sha256:6c6d412ccf0c3d6a14645a79df6c4658c0f8725d7954cb83c3d2f0116499345a (101ms) I0416 12:36:57.399752 1 tasks_processing.go:74] worker 1 stopped. I0416 12:36:57.400156 1 recorder.go:75] Recording config/workload_info with fingerprint=3f874638ebf739f5c424e7155092fa9266de55b7e5706f41ddebfeab94fa9535 I0416 12:36:57.400171 1 gather.go:177] gatherer "workloads" function "workload_info" took 16.193112868s to process 1 records I0416 12:36:57.400183 1 periodic.go:263] Periodic gather workloads completed in 16.193s I0416 12:36:57.400191 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0416 12:36:57.400196 1 periodic.go:216] Running conditional gatherer I0416 12:36:57.406294 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.9/gathering_rules I0416 12:36:57.551506 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer I0416 12:36:57.553358 1 conditional_gatherer.go:374] alert "Watchdog" has state "firing" I0416 12:36:57.553374 1 conditional_gatherer.go:374] alert "AlertmanagerReceiversNotConfigured" has state "firing" I0416 12:36:57.553436 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0416 12:36:57.559128 1 conditional_gatherer.go:392] cluster version is '4.21.9' I0416 12:36:57.559157 1 tasks_processing.go:45] number of workers: 3 I0416 12:36:57.559166 1 tasks_processing.go:69] worker 2 listening for tasks. I0416 12:36:57.559170 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0416 12:36:57.559178 1 tasks_processing.go:69] worker 0 listening for tasks. I0416 12:36:57.559188 1 tasks_processing.go:69] worker 1 listening for tasks. I0416 12:36:57.559197 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0416 12:36:57.559199 1 tasks_processing.go:74] worker 1 stopped. I0416 12:36:57.559199 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0416 12:36:57.559246 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0416 12:36:57.559261 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 689ns to process 1 records I0416 12:36:57.559299 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0416 12:36:57.559308 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.119µs to process 1 records I0416 12:36:57.559313 1 tasks_processing.go:74] worker 0 stopped. I0416 12:36:57.559433 1 tasks_processing.go:74] worker 2 stopped. I0416 12:36:57.559447 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 229.15µs to process 0 records I0416 12:36:57.559466 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0416 12:36:57.559482 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0416 12:36:57.586704 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=4a95e01d641f5058fcec2bacac0782bb350e53d57b22f53da15141ff8b451914 I0416 12:36:57.586817 1 diskrecorder.go:70] Writing 134 records to /var/lib/insights-operator/insights-2026-04-16-123657.tar.gz I0416 12:36:57.596143 1 diskrecorder.go:51] Wrote 134 records to disk in 9ms I0416 12:36:57.596172 1 periodic.go:285] Gathering cluster info every 2h0m0s I0416 12:36:57.596188 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0416 12:37:57.398121 1 diskrecorder.go:223] Found files to send: insights-2026-04-16-123657.tar.gz I0416 12:37:57.398148 1 insightsuploader.go:150] Checking archives to upload periodically every 15m3.105563744s I0416 12:37:57.398156 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0416 12:37:57.408113 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0416 12:37:57.678794 1 requests.go:87] Successfully reported id=2026-04-16T12:37:57Z x-rh-insights-request-id=b0a0759603214cf8845059e7ca522e27, wrote=70143 I0416 12:37:57.678868 1 insightsuploader.go:187] Uploaded report successfully in 280.699767ms I0416 12:37:57.678898 1 controller.go:129] Initializing last reported time to 2026-04-16T12:37:57Z I0416 12:37:57.678930 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0416 12:37:57.678939 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0416 12:37:57.678946 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0416 12:37:57.684771 1 controller.go:554] The operator is healthy I0416 12:38:15.892921 1 controller.go:554] The operator is healthy I0416 12:39:02.182870 1 insightsreport.go:137] Pulling report from smart-proxy I0416 12:39:02.182897 1 insightsreport.go:149] Retrieving report I0416 12:39:02.189813 1 requests.go:110] Retrieving report for cluster: 07cb04e3-d071-4f65-bc3b-44d78e1079cd I0416 12:39:02.189824 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/07cb04e3-d071-4f65-bc3b-44d78e1079cd/reports I0416 12:39:02.192883 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/07cb04e3-d071-4f65-bc3b-44d78e1079cd/reports I0416 12:39:02.529059 1 insightsreport.go:184] Report retrieved I0416 12:39:02.573099 1 insightsreport.go:239] Report retrieved correctly I0416 12:40:15.894170 1 controller.go:554] The operator is healthy I0416 12:41:51.574297 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0416 12:41:51.580510 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0416 12:41:51.580527 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0416 12:41:51.585329 1 secretconfigobserver.go:119] support secret does not exist I0416 12:42:15.894639 1 controller.go:554] The operator is healthy I0416 12:44:15.894931 1 controller.go:554] The operator is healthy I0416 12:46:15.894761 1 controller.go:554] The operator is healthy I0416 12:46:51.532803 1 configmapobserver.go:84] configmaps "insights-config" not found I0416 12:46:51.537209 1 configmapobserver.go:84] configmaps "insights-config" not found I0416 12:46:51.586320 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0416 12:46:51.591688 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0416 12:46:51.591705 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0416 12:46:51.596064 1 secretconfigobserver.go:119] support secret does not exist I0416 12:48:15.894897 1 controller.go:554] The operator is healthy I0416 12:50:15.891884 1 controller.go:554] The operator is healthy