I0514 23:23:29.083104 1 cmd.go:253] Using service-serving-cert provided certificates I0514 23:23:29.083542 1 observer_polling.go:159] Starting file observer I0514 23:23:30.019723 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0514 23:23:30.019928 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0514 23:23:30.020490 1 secure_serving.go:57] Forcing use of http/1.1 only W0514 23:23:30.020513 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0514 23:23:30.020524 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0514 23:23:30.020529 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0514 23:23:30.020533 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0514 23:23:30.020536 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0514 23:23:30.020540 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0514 23:23:30.020532 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0514 23:23:30.025360 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0514 23:23:30.025417 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"510de4dc-094b-4a5a-b3d2-4ef3983b43b3", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0514 23:23:30.026799 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0514 23:23:30.026815 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0514 23:23:30.026823 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0514 23:23:30.026832 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0514 23:23:30.026841 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0514 23:23:30.026845 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0514 23:23:30.027183 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0514 23:23:30.027628 1 secure_serving.go:213] Serving securely on [::]:8443 I0514 23:23:30.027663 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0514 23:23:30.036526 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0514 23:23:30.036547 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0514 23:23:30.036650 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0514 23:23:30.043293 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 23:23:30.043309 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0514 23:23:30.048931 1 secretconfigobserver.go:119] support secret does not exist I0514 23:23:30.054555 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 23:23:30.059819 1 secretconfigobserver.go:119] support secret does not exist I0514 23:23:30.062942 1 recorder.go:161] Pruning old reports every 5h23m4s, max age is 288h0m0s I0514 23:23:30.068749 1 operator.go:316] The last pod state is unhealthy I0514 23:23:30.126868 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0514 23:23:30.126880 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0514 23:23:30.126927 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0514 23:23:30.137063 1 base_controller.go:82] Caches are synced for ConfigController I0514 23:23:30.137076 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0514 23:23:30.143016 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 23:23:50.074735 1 operator.go:316] The last pod state is unhealthy I0514 23:24:10.073632 1 operator.go:316] The last pod state is unhealthy I0514 23:24:30.070581 1 operator.go:316] The last pod state is unhealthy I0514 23:24:50.072007 1 operator.go:316] The last pod state is unhealthy I0514 23:25:10.073805 1 operator.go:316] The last pod state is unhealthy I0514 23:25:30.071400 1 operator.go:316] The last pod state is unhealthy I0514 23:25:50.072107 1 operator.go:316] The last pod state is unhealthy I0514 23:26:10.072256 1 operator.go:316] The last pod state is unhealthy I0514 23:26:30.070865 1 operator.go:316] The last pod state is unhealthy I0514 23:26:50.074210 1 operator.go:316] The last pod state is unhealthy I0514 23:27:10.074723 1 operator.go:316] The last pod state is unhealthy I0514 23:27:30.070824 1 operator.go:316] The last pod state is unhealthy I0514 23:27:50.073119 1 operator.go:316] The last pod state is unhealthy I0514 23:28:10.075228 1 operator.go:316] The last pod state is unhealthy I0514 23:28:30.067722 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 23:28:30.070233 1 operator.go:316] The last pod state is unhealthy I0514 23:28:30.073041 1 secretconfigobserver.go:119] support secret does not exist I0514 23:28:31.044582 1 operator.go:248] Unable to check insights-operator pod status. Setting initial delay to 11m48.073905724s I0514 23:28:31.044718 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0514 23:28:31.044748 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 13m18s I0514 23:28:31.044722 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0514 23:28:31.044776 1 insightsreport.go:296] Starting report retriever I0514 23:28:31.044783 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0514 23:28:31.051858 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0514 23:28:31.051877 1 controller.go:326] The initial operator extension status is healthy I0514 23:28:31.051886 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0514 23:28:31.051891 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 23:28:31.051895 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0514 23:28:31.051909 1 controller.go:489] The operator is still being initialized I0514 23:28:31.051916 1 controller.go:512] The operator is healthy I0514 23:28:31.051989 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0514 23:28:31.052063 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0514 23:28:31.052145 1 operator.go:288] started I0514 23:28:31.052174 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0514 23:28:31.059053 1 controller.go:212] Source scaController *sca.Controller is not ready I0514 23:28:31.059065 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0514 23:28:31.059068 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 23:28:31.059071 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0514 23:28:31.059074 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0514 23:28:31.059089 1 controller.go:489] The operator is still being initialized I0514 23:28:31.059095 1 controller.go:512] The operator is healthy I0514 23:28:31.072438 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0514 23:28:31.153166 1 base_controller.go:82] Caches are synced for LoggingSyncer I0514 23:28:31.153178 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0514 23:28:31.202902 1 cluster_transfer.go:102] no available accepted cluster transfer I0514 23:28:31.202916 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0514 23:28:31.326360 1 sca.go:266] etc-pki-entitlement secret successfully created I0514 23:28:31.326376 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0514 23:30:31.060892 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 23:30:31.060910 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0514 23:30:31.060914 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0514 23:30:31.060935 1 controller.go:489] The operator is still being initialized I0514 23:30:31.060940 1 controller.go:512] The operator is healthy I0514 23:32:31.074391 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 23:32:31.074409 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0514 23:32:31.074413 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0514 23:32:31.074438 1 controller.go:512] The operator is healthy I0514 23:33:30.056510 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 23:33:30.062577 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 23:33:30.073617 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 23:33:30.079806 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 23:33:30.079822 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 23:33:30.085644 1 secretconfigobserver.go:119] support secret does not exist I0514 23:34:31.063815 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 23:34:31.063833 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0514 23:34:31.063836 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0514 23:34:31.063862 1 controller.go:512] The operator is healthy I0514 23:36:31.063226 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0514 23:36:31.063246 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0514 23:36:31.063251 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 23:36:31.063276 1 controller.go:512] The operator is healthy I0514 23:38:30.086535 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 23:38:30.093296 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 23:38:30.093321 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 23:38:30.098898 1 secretconfigobserver.go:119] support secret does not exist I0514 23:38:31.058985 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 23:38:31.059002 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0514 23:38:31.059005 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0514 23:38:31.059028 1 controller.go:512] The operator is healthy I0514 23:40:19.118660 1 periodic.go:209] Running clusterconfig gatherer I0514 23:40:19.118722 1 tasks_processing.go:45] number of workers: 64 I0514 23:40:19.118743 1 tasks_processing.go:69] worker 2 listening for tasks. I0514 23:40:19.118759 1 tasks_processing.go:69] worker 0 listening for tasks. I0514 23:40:19.118763 1 tasks_processing.go:69] worker 1 listening for tasks. I0514 23:40:19.118772 1 tasks_processing.go:69] worker 37 listening for tasks. I0514 23:40:19.118774 1 tasks_processing.go:71] worker 1 working on cluster_apiserver task. I0514 23:40:19.118771 1 tasks_processing.go:69] worker 21 listening for tasks. I0514 23:40:19.118783 1 tasks_processing.go:69] worker 30 listening for tasks. I0514 23:40:19.118788 1 tasks_processing.go:69] worker 3 listening for tasks. I0514 23:40:19.118793 1 tasks_processing.go:71] worker 3 working on qemu_kubevirt_launcher_logs task. I0514 23:40:19.118794 1 tasks_processing.go:69] worker 31 listening for tasks. I0514 23:40:19.118800 1 tasks_processing.go:69] worker 32 listening for tasks. I0514 23:40:19.118805 1 tasks_processing.go:69] worker 33 listening for tasks. I0514 23:40:19.118811 1 tasks_processing.go:69] worker 34 listening for tasks. I0514 23:40:19.118816 1 tasks_processing.go:69] worker 35 listening for tasks. I0514 23:40:19.118820 1 tasks_processing.go:69] worker 36 listening for tasks. I0514 23:40:19.118784 1 tasks_processing.go:71] worker 21 working on storage_classes task. I0514 23:40:19.118820 1 tasks_processing.go:69] worker 29 listening for tasks. I0514 23:40:19.118828 1 tasks_processing.go:69] worker 51 listening for tasks. I0514 23:40:19.118832 1 tasks_processing.go:69] worker 13 listening for tasks. I0514 23:40:19.118842 1 tasks_processing.go:69] worker 38 listening for tasks. I0514 23:40:19.118848 1 tasks_processing.go:69] worker 5 listening for tasks. I0514 23:40:19.118859 1 tasks_processing.go:69] worker 8 listening for tasks. I0514 23:40:19.118857 1 tasks_processing.go:69] worker 25 listening for tasks. I0514 23:40:19.118867 1 tasks_processing.go:69] worker 39 listening for tasks. I0514 23:40:19.118869 1 tasks_processing.go:69] worker 10 listening for tasks. I0514 23:40:19.118845 1 tasks_processing.go:69] worker 4 listening for tasks. I0514 23:40:19.118883 1 tasks_processing.go:69] worker 12 listening for tasks. I0514 23:40:19.118854 1 tasks_processing.go:69] worker 7 listening for tasks. I0514 23:40:19.118881 1 tasks_processing.go:69] worker 23 listening for tasks. I0514 23:40:19.118883 1 tasks_processing.go:69] worker 28 listening for tasks. I0514 23:40:19.118891 1 tasks_processing.go:69] worker 24 listening for tasks. I0514 23:40:19.118900 1 tasks_processing.go:69] worker 52 listening for tasks. I0514 23:40:19.118904 1 tasks_processing.go:69] worker 53 listening for tasks. I0514 23:40:19.118898 1 tasks_processing.go:69] worker 54 listening for tasks. I0514 23:40:19.118869 1 tasks_processing.go:69] worker 27 listening for tasks. I0514 23:40:19.118934 1 tasks_processing.go:69] worker 49 listening for tasks. I0514 23:40:19.118789 1 tasks_processing.go:71] worker 30 working on machine_config_pools task. I0514 23:40:19.118962 1 tasks_processing.go:69] worker 47 listening for tasks. I0514 23:40:19.118851 1 tasks_processing.go:69] worker 6 listening for tasks. I0514 23:40:19.119009 1 tasks_processing.go:71] worker 51 working on crds task. I0514 23:40:19.119014 1 tasks_processing.go:71] worker 6 working on openstack_version task. I0514 23:40:19.119013 1 tasks_processing.go:71] worker 31 working on nodenetworkstates task. I0514 23:40:19.119017 1 tasks_processing.go:71] worker 32 working on machine_autoscalers task. I0514 23:40:19.119022 1 tasks_processing.go:71] worker 5 working on sap_datahubs task. I0514 23:40:19.119028 1 tasks_processing.go:71] worker 10 working on silenced_alerts task. I0514 23:40:19.119030 1 tasks_processing.go:71] worker 38 working on feature_gates task. I0514 23:40:19.119039 1 tasks_processing.go:71] worker 24 working on oauths task. I0514 23:40:19.119054 1 tasks_processing.go:71] worker 54 working on sap_config task. I0514 23:40:19.119014 1 tasks_processing.go:71] worker 47 working on openstack_controlplanes task. I0514 23:40:19.119096 1 tasks_processing.go:71] worker 4 working on schedulers task. I0514 23:40:19.119096 1 tasks_processing.go:71] worker 52 working on pod_network_connectivity_checks task. I0514 23:40:19.119102 1 tasks_processing.go:71] worker 34 working on validating_webhook_configurations task. I0514 23:40:19.119106 1 tasks_processing.go:71] worker 27 working on ingress task. I0514 23:40:19.119108 1 tasks_processing.go:71] worker 36 working on openshift_machine_api_events task. I0514 23:40:19.119114 1 tasks_processing.go:71] worker 28 working on operators task. I0514 23:40:19.119124 1 tasks_processing.go:71] worker 12 working on ingress_certificates task. I0514 23:40:19.119097 1 tasks_processing.go:71] worker 35 working on authentication task. I0514 23:40:19.119125 1 tasks_processing.go:71] worker 7 working on openstack_dataplanenodesets task. I0514 23:40:19.119024 1 tasks_processing.go:71] worker 39 working on openstack_dataplanedeployments task. I0514 23:40:19.119144 1 tasks_processing.go:71] worker 49 working on openshift_logging task. I0514 23:40:19.118884 1 tasks_processing.go:69] worker 40 listening for tasks. I0514 23:40:19.119151 1 tasks_processing.go:71] worker 29 working on storage_cluster task. I0514 23:40:19.118867 1 tasks_processing.go:69] worker 9 listening for tasks. I0514 23:40:19.118897 1 tasks_processing.go:69] worker 22 listening for tasks. I0514 23:40:19.119163 1 tasks_processing.go:71] worker 9 working on ceph_cluster task. I0514 23:40:19.118902 1 tasks_processing.go:69] worker 42 listening for tasks. I0514 23:40:19.118905 1 tasks_processing.go:69] worker 62 listening for tasks. I0514 23:40:19.118907 1 tasks_processing.go:69] worker 60 listening for tasks. I0514 23:40:19.118910 1 tasks_processing.go:69] worker 43 listening for tasks. I0514 23:40:19.118913 1 tasks_processing.go:69] worker 56 listening for tasks. I0514 23:40:19.118911 1 tasks_processing.go:69] worker 61 listening for tasks. I0514 23:40:19.118914 1 tasks_processing.go:69] worker 57 listening for tasks. I0514 23:40:19.118917 1 tasks_processing.go:69] worker 18 listening for tasks. I0514 23:40:19.118917 1 tasks_processing.go:69] worker 44 listening for tasks. I0514 23:40:19.118916 1 tasks_processing.go:69] worker 59 listening for tasks. I0514 23:40:19.118921 1 tasks_processing.go:69] worker 14 listening for tasks. I0514 23:40:19.118923 1 tasks_processing.go:69] worker 15 listening for tasks. I0514 23:40:19.118926 1 tasks_processing.go:69] worker 16 listening for tasks. I0514 23:40:19.118921 1 tasks_processing.go:69] worker 55 listening for tasks. I0514 23:40:19.118923 1 tasks_processing.go:71] worker 0 working on image_pruners task. I0514 23:40:19.119233 1 tasks_processing.go:71] worker 55 working on sap_pods task. I0514 23:40:19.119269 1 tasks_processing.go:71] worker 61 working on aggregated_monitoring_cr_names task. I0514 23:40:19.119301 1 tasks_processing.go:71] worker 62 working on clusterroles task. I0514 23:40:19.119315 1 tasks_processing.go:71] worker 59 working on machine_sets task. I0514 23:40:19.119322 1 tasks_processing.go:71] worker 14 working on operators_pods_and_events task. I0514 23:40:19.119009 1 tasks_processing.go:71] worker 33 working on jaegers task. I0514 23:40:19.119349 1 tasks_processing.go:71] worker 22 working on nodenetworkconfigurationpolicies task. I0514 23:40:19.119351 1 tasks_processing.go:71] worker 42 working on install_plans task. I0514 23:40:19.119350 1 tasks_processing.go:71] worker 43 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0514 23:40:19.119356 1 tasks_processing.go:71] worker 56 working on olm_operators task. I0514 23:40:19.119364 1 tasks_processing.go:71] worker 57 working on pdbs task. I0514 23:40:19.119318 1 tasks_processing.go:71] worker 15 working on metrics task. I0514 23:40:19.118927 1 tasks_processing.go:69] worker 45 listening for tasks. I0514 23:40:19.119401 1 tasks_processing.go:71] worker 44 working on image_registries task. I0514 23:40:19.118919 1 tasks_processing.go:69] worker 58 listening for tasks. I0514 23:40:19.119404 1 tasks_processing.go:71] worker 45 working on proxies task. I0514 23:40:19.118929 1 tasks_processing.go:69] worker 17 listening for tasks. I0514 23:40:19.119359 1 tasks_processing.go:71] worker 18 working on version task. I0514 23:40:19.119412 1 tasks_processing.go:71] worker 58 working on node_logs task. I0514 23:40:19.118926 1 tasks_processing.go:71] worker 2 working on service_accounts task. I0514 23:40:19.118934 1 tasks_processing.go:69] worker 63 listening for tasks. I0514 23:40:19.119558 1 tasks_processing.go:71] worker 63 working on dvo_metrics task. I0514 23:40:19.118934 1 tasks_processing.go:69] worker 20 listening for tasks. I0514 23:40:19.119738 1 tasks_processing.go:71] worker 20 working on mutating_webhook_configurations task. I0514 23:40:19.118934 1 tasks_processing.go:69] worker 19 listening for tasks. I0514 23:40:19.118935 1 tasks_processing.go:69] worker 46 listening for tasks. I0514 23:40:19.118938 1 tasks_processing.go:69] worker 50 listening for tasks. I0514 23:40:19.119012 1 tasks_processing.go:71] worker 8 working on container_images task. I0514 23:40:19.119774 1 tasks_processing.go:71] worker 19 working on certificate_signing_requests task. I0514 23:40:19.119778 1 tasks_processing.go:71] worker 50 working on cost_management_metrics_configs task. I0514 23:40:19.119784 1 tasks_processing.go:71] worker 46 working on container_runtime_configs task. I0514 23:40:19.119018 1 tasks_processing.go:71] worker 13 working on active_alerts task. I0514 23:40:19.119090 1 tasks_processing.go:71] worker 23 working on machine_healthchecks task. I0514 23:40:19.118881 1 tasks_processing.go:69] worker 11 listening for tasks. I0514 23:40:19.119098 1 tasks_processing.go:71] worker 53 working on overlapping_namespace_uids task. I0514 23:40:19.119154 1 tasks_processing.go:71] worker 40 working on infrastructures task. I0514 23:40:19.118894 1 tasks_processing.go:69] worker 41 listening for tasks. I0514 23:40:19.120140 1 tasks_processing.go:71] worker 41 working on lokistack task. I0514 23:40:19.118860 1 tasks_processing.go:69] worker 26 listening for tasks. I0514 23:40:19.119341 1 tasks_processing.go:71] worker 16 working on tsdb_status task. I0514 23:40:19.118928 1 tasks_processing.go:69] worker 48 listening for tasks. I0514 23:40:19.118776 1 tasks_processing.go:71] worker 37 working on image task. I0514 23:40:19.120258 1 tasks_processing.go:71] worker 48 working on support_secret task. I0514 23:40:19.119414 1 tasks_processing.go:71] worker 17 working on machines task. I0514 23:40:19.119569 1 tasks_processing.go:71] worker 60 working on config_maps task. I0514 23:40:19.119019 1 tasks_processing.go:71] worker 25 working on machine_configs task. I0514 23:40:19.120073 1 tasks_processing.go:71] worker 11 working on networks task. I0514 23:40:19.120233 1 tasks_processing.go:71] worker 26 working on nodes task. I0514 23:40:19.121418 1 gather_lokistack.go:58] Start LokiStack gathering I0514 23:40:19.127964 1 tasks_processing.go:71] worker 49 working on monitoring_persistent_volumes task. I0514 23:40:19.127974 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 8.807924ms to process 0 records I0514 23:40:19.127985 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 8.800568ms to process 0 records I0514 23:40:19.127991 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 8.823479ms to process 0 records I0514 23:40:19.127994 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 8.808259ms to process 0 records I0514 23:40:19.128000 1 tasks_processing.go:74] worker 9 stopped. I0514 23:40:19.128004 1 tasks_processing.go:74] worker 29 stopped. I0514 23:40:19.128007 1 tasks_processing.go:74] worker 39 stopped. I0514 23:40:19.135223 1 tasks_processing.go:74] worker 5 stopped. I0514 23:40:19.135238 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 16.18789ms to process 0 records I0514 23:40:19.135334 1 tasks_processing.go:74] worker 6 stopped. I0514 23:40:19.135344 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 16.309859ms to process 0 records I0514 23:40:19.135357 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 15.502141ms to process 0 records I0514 23:40:19.135362 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 16.196526ms to process 0 records I0514 23:40:19.135367 1 tasks_processing.go:74] worker 7 stopped. I0514 23:40:19.135371 1 tasks_processing.go:74] worker 46 stopped. I0514 23:40:19.135385 1 tasks_processing.go:74] worker 31 stopped. I0514 23:40:19.135399 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 16.359054ms to process 0 records I0514 23:40:19.140899 1 gather_logs.go:145] no pods in namespace were found I0514 23:40:19.140906 1 tasks_processing.go:74] worker 23 stopped. E0514 23:40:19.140917 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0514 23:40:19.140925 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 20.86879ms to process 0 records I0514 23:40:19.140946 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 22.113848ms to process 0 records I0514 23:40:19.140952 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 21.841502ms to process 0 records I0514 23:40:19.140957 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 21.926722ms to process 0 records I0514 23:40:19.140962 1 tasks_processing.go:74] worker 32 stopped. I0514 23:40:19.140965 1 tasks_processing.go:74] worker 3 stopped. I0514 23:40:19.140969 1 tasks_processing.go:74] worker 47 stopped. I0514 23:40:19.140991 1 tasks_processing.go:74] worker 54 stopped. I0514 23:40:19.141000 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 21.929373ms to process 0 records I0514 23:40:19.141222 1 tasks_processing.go:74] worker 17 stopped. E0514 23:40:19.141236 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0514 23:40:19.141245 1 gather.go:177] gatherer "clusterconfig" function "machines" took 20.917173ms to process 0 records I0514 23:40:19.141271 1 tasks_processing.go:74] worker 59 stopped. I0514 23:40:19.141284 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 21.940139ms to process 0 records I0514 23:40:19.141356 1 tasks_processing.go:74] worker 45 stopped. I0514 23:40:19.141476 1 recorder.go:75] Recording config/proxy with fingerprint=5e8fc7b3f4b0c9d7d1b3e133d86713a2942a4049933cfeaed231d829347bf37e I0514 23:40:19.141489 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 21.939984ms to process 1 records I0514 23:40:19.141567 1 tasks_processing.go:74] worker 35 stopped. I0514 23:40:19.141731 1 recorder.go:75] Recording config/authentication with fingerprint=f431392af636381356d0cf92c6d95e3a909389393287e99ccee24871cf5c9eea I0514 23:40:19.141741 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 22.234997ms to process 1 records I0514 23:40:19.141826 1 tasks_processing.go:74] worker 38 stopped. I0514 23:40:19.141829 1 recorder.go:75] Recording config/featuregate with fingerprint=9b5303f9ac6a43a2eed3f75967e3a192741ee3d8a940e4541d9c2890b9e3937c I0514 23:40:19.141851 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 22.42814ms to process 1 records I0514 23:40:19.141933 1 tasks_processing.go:74] worker 0 stopped. I0514 23:40:19.142082 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=c3b3a6302d1ab4126d2cd750048295e09aa0c1a748eeedd44acfe8825371474b I0514 23:40:19.142092 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 22.382498ms to process 1 records I0514 23:40:19.150003 1 tasks_processing.go:74] worker 33 stopped. I0514 23:40:19.150013 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 30.651626ms to process 0 records I0514 23:40:19.150027 1 tasks_processing.go:74] worker 55 stopped. I0514 23:40:19.150034 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 30.784459ms to process 0 records I0514 23:40:19.150048 1 tasks_processing.go:74] worker 50 stopped. I0514 23:40:19.150059 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 30.251302ms to process 0 records I0514 23:40:19.150069 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 30.709808ms to process 0 records E0514 23:40:19.150076 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0514 23:40:19.150082 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 29.803313ms to process 0 records I0514 23:40:19.150088 1 tasks_processing.go:74] worker 48 stopped. I0514 23:40:19.150091 1 tasks_processing.go:74] worker 22 stopped. I0514 23:40:19.150105 1 tasks_processing.go:74] worker 21 stopped. I0514 23:40:19.150771 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=5b4a89ddd94bd3dd1ee7f4a105bf62c8baecbd8ada623b2033836e355d938a46 I0514 23:40:19.150867 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=45eec5e897d7eb1e74f690ac2829e028b664b35db42f7ec22627b93a9782ed28 I0514 23:40:19.150893 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 31.276643ms to process 2 records I0514 23:40:19.151138 1 tasks_processing.go:74] worker 1 stopped. I0514 23:40:19.151170 1 recorder.go:75] Recording config/apiserver with fingerprint=8b8ec9d436bd99a6518af3df4606e2b4387e8018d7567c1abe135c6965b5cc4d I0514 23:40:19.151184 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 32.02116ms to process 1 records I0514 23:40:19.151411 1 recorder.go:75] Recording config/ingress with fingerprint=2f603133c7bbc1bacdc39c4dee51a9ca995fe0b2b4262129682d6dd4f823e08f I0514 23:40:19.151460 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 31.951574ms to process 1 records I0514 23:40:19.151492 1 tasks_processing.go:74] worker 27 stopped. I0514 23:40:19.152235 1 tasks_processing.go:74] worker 30 stopped. I0514 23:40:19.152252 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 33.280698ms to process 0 records I0514 23:40:19.152725 1 tasks_processing.go:74] worker 37 stopped. I0514 23:40:19.152810 1 recorder.go:75] Recording config/image with fingerprint=cd81526951745272ef1e40023c053c5e736cde4e6d148e9d115ae2641136af56 I0514 23:40:19.152827 1 gather.go:177] gatherer "clusterconfig" function "image" took 32.459454ms to process 1 records I0514 23:40:19.152943 1 tasks_processing.go:74] worker 24 stopped. I0514 23:40:19.153011 1 recorder.go:75] Recording config/oauth with fingerprint=3cb3551c3ec05fc7814b782ecd5f21fc7333463aa9ef7bcb9fc0beee21989616 I0514 23:40:19.153020 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 33.713631ms to process 1 records I0514 23:40:19.153112 1 tasks_processing.go:74] worker 11 stopped. I0514 23:40:19.153159 1 recorder.go:75] Recording config/network with fingerprint=cc34064da47d84d776adc4249a0f665338717354fbda481f3cb022f2ad84da61 I0514 23:40:19.153168 1 gather.go:177] gatherer "clusterconfig" function "networks" took 32.362307ms to process 1 records I0514 23:40:19.160491 1 tasks_processing.go:74] worker 41 stopped. I0514 23:40:19.160504 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 40.342191ms to process 0 records I0514 23:40:19.161243 1 tasks_processing.go:74] worker 40 stopped. I0514 23:40:19.161777 1 recorder.go:75] Recording config/infrastructure with fingerprint=89a70c8a8f75cc56bfc6b426af1c2fe8b623b8aebfa012fa2a09d760273da5fc I0514 23:40:19.161793 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 41.117239ms to process 1 records I0514 23:40:19.162680 1 tasks_processing.go:74] worker 36 stopped. I0514 23:40:19.162696 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 43.55404ms to process 0 records I0514 23:40:19.162798 1 tasks_processing.go:74] worker 58 stopped. I0514 23:40:19.162811 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 43.375328ms to process 0 records I0514 23:40:19.165072 1 tasks_processing.go:74] worker 26 stopped. I0514 23:40:19.165476 1 recorder.go:75] Recording config/node/ip-10-0-0-121.ec2.internal with fingerprint=50c136ba8b80494c28adaf346f8be62eab20cff4806fe280298eea92b672d91b I0514 23:40:19.165541 1 recorder.go:75] Recording config/node/ip-10-0-1-171.ec2.internal with fingerprint=ba09e49a949c85cac274c77aad5f9d36628e93edcaff31d531e9cac004362e2d I0514 23:40:19.165614 1 recorder.go:75] Recording config/node/ip-10-0-2-4.ec2.internal with fingerprint=2dd375a063f350748d0cba103c7641cc526928ad2da76c3e6abc493a4938a348 I0514 23:40:19.165628 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 44.510871ms to process 3 records I0514 23:40:19.165717 1 tasks_processing.go:74] worker 51 stopped. I0514 23:40:19.166085 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=60241618ca7b6401e354421771a53862063dae9990b5bd113594287544e2c09d I0514 23:40:19.166277 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=16c093543b55d6f6bcad4ddd30a92b31ab2ec4b4463d4a993b172651b0d354b5 I0514 23:40:19.166284 1 gather.go:177] gatherer "clusterconfig" function "crds" took 46.171787ms to process 2 records I0514 23:40:19.166368 1 tasks_processing.go:74] worker 34 stopped. I0514 23:40:19.166402 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=271bb084b8f0aa2c37f28a742f6362b44f37d7771146c76d8cf68e0682d2f1e8 I0514 23:40:19.166425 1 recorder.go:75] Recording config/validatingwebhookconfigurations/cert-manager-webhook with fingerprint=6403aa6cb80fd561ced0880d598b325ca2848d4dad1541061a00a8987398b097 I0514 23:40:19.166447 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.operator.tekton.dev with fingerprint=89b88005e33d55d5e93df2ee9aee0fb5a386b1b174882794b1c0f57077e774d6 I0514 23:40:19.166462 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.pipeline.tekton.dev with fingerprint=aec6957a05568e5518b62e51aeb0951d8e2a56135e269475b3f2dedbcc447c60 I0514 23:40:19.166493 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.triggers.tekton.dev with fingerprint=996b01ee5ee06b3dcad53c00ee2b34a62efccc5fb916db1780dac2b412e94deb I0514 23:40:19.166525 1 recorder.go:75] Recording config/validatingwebhookconfigurations/integration-service-validating-webhook-configuration with fingerprint=861922180cb59361456358b083adad3fddac229c6783665d97bb84a7eeb4365c I0514 23:40:19.166553 1 recorder.go:75] Recording config/validatingwebhookconfigurations/monitoringconfigmaps.openshift.io with fingerprint=60726e0cfd4cc663f31ea6a6cbb59db0450954e7b731cb4a82cff50052eea084 I0514 23:40:19.166611 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=491987dce3bd5ac544ff5816d16ae4b1387470b67f23d3b1443d6d1f26c8ec9a I0514 23:40:19.166634 1 recorder.go:75] Recording config/validatingwebhookconfigurations/namespace.operator.tekton.dev with fingerprint=957ec2a239fb167ebf52ac8fbd37552a51067681fe83a45d7df031ba9be11ae2 I0514 23:40:19.166700 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=e1efa0c246c8e66aa1206ddda29e859e8d21148142fade228eef4e97eaebff09 I0514 23:40:19.166724 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=42049a98e649cbda86d7c0daf2ffde27c2d99abfa2ed5c545d5bf972766ec295 I0514 23:40:19.166746 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=896b61c104d7cd8053762fce4e563b0a01468d42b9e7f685828d7ff995353715 I0514 23:40:19.166794 1 recorder.go:75] Recording config/validatingwebhookconfigurations/release-service-validating-webhook-configuration with fingerprint=a549e66d9f047b55cb26ad08f3ab60976d4fdbd87e192cccaa123dcaeaa09503 I0514 23:40:19.166825 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=fd782b872981d56e0838311998aad53bddfdb20f5d532d848b0b3a1face87c19 I0514 23:40:19.166855 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=0528d3c7d3841454c45b493f6deb78d47955d03bd9d02a05931b6d2600e31014 I0514 23:40:19.166902 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=c6e520d0267521c324b846c36cd820b752772e848b4b4d01cac1a42ce7f99433 I0514 23:40:19.166945 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=1acb732c45a083857bd03345f8b8157ed4671b54a4d1b74a8b733a8a5a6e4994 I0514 23:40:19.166999 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=078766d3e346a35abfe0b6ad2380ddd818ea60d76ec396d3e203fb1b204162d2 I0514 23:40:19.167030 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=8bf1b20a92659f74602db4d3646faaf83ab57dc684ee7a1d9c4285dd46a00182 I0514 23:40:19.167078 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=257e6661f257d7c9fd408fe96132adb6ae8058c493f8556b277a993cc5d77d64 I0514 23:40:19.167118 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=49e733f3ce6bf04afccca391a7475fa646b28d2620bd915fe76961c6dc5f05dc I0514 23:40:19.167143 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.pipelinesascode.tekton.dev with fingerprint=92b7e7caa118778d3ba1cb151c60a6ac859ffd7cd5b45bfb3b1860f71514d869 I0514 23:40:19.167176 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.operator.tekton.dev with fingerprint=92591c1b38592b1bf432bef613b2f7ba2f5a6d9a4e7fddda62b4a4c31fe96400 I0514 23:40:19.167215 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.pipeline.tekton.dev with fingerprint=8e8a5aeb069d0d8f23f2dfd8d36947260df7752cac4141b29c984a2eb4e465c1 I0514 23:40:19.167254 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.triggers.tekton.dev with fingerprint=da003735a822248c2f1ac158a826610105af00bc6a1e184b2fbc3904cd9ac579 I0514 23:40:19.167264 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 46.15467ms to process 25 records I0514 23:40:19.167399 1 tasks_processing.go:74] worker 44 stopped. I0514 23:40:19.167792 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=93f6e4f0a850ec464106b80e49a6fec5f049cb91c508266a8e08b1f9e0bf1298 I0514 23:40:19.167810 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 46.04787ms to process 1 records I0514 23:40:19.167834 1 recorder.go:75] Recording config/podnetworkconnectivitychecks with fingerprint=44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a I0514 23:40:19.167885 1 tasks_processing.go:74] worker 52 stopped. I0514 23:40:19.168132 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 46.655433ms to process 1 records I0514 23:40:19.168156 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 39.118174ms to process 0 records I0514 23:40:19.168236 1 tasks_processing.go:74] worker 49 stopped. I0514 23:40:19.168305 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=8c1b5c15df61b41bb7244673882ae7e140995b5a942f27f3e2aa4a30facf5f6f I0514 23:40:19.168308 1 tasks_processing.go:74] worker 4 stopped. I0514 23:40:19.168326 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 48.189504ms to process 1 records I0514 23:40:19.170887 1 tasks_processing.go:74] worker 57 stopped. I0514 23:40:19.171011 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=ebd23ad51cea3ed899ef0564af922643c1238e54e01989070adc4cf4499bb51b I0514 23:40:19.171038 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=6ca3fc99469bcea39547605ead058ba741a10c51260bd79d94301b2428cfb4a9 I0514 23:40:19.171055 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=f60fab9085217f804f9b5324bee5da2745ba5a08f660432e6b59017d0b109bab I0514 23:40:19.171077 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=b5132ee81566588ad392dae0e9a2fd63e6c5d358a6f4b87906e39f20c03fb85a I0514 23:40:19.171105 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=2ec678bc391f0c894e493e3405b9daea90e51bc292b22c790d4210dcfac360ae I0514 23:40:19.171129 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=ce59c32a8ec43de8b4d4e584836d2ba93784332b3380a590cd3341596d54e8e0 I0514 23:40:19.171153 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=e8bd87d4f3a193675903a79a2232c6156435a97bc748439ba8211d992dcbb642 I0514 23:40:19.171171 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=91361c0eeffb50c48bf9dfcdb7e6c4522d317bffed6ec37cf0eef825bc74c474 I0514 23:40:19.171186 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=69b107bc7ec794b1b94eecfa0f2cf3e13e8a5d5e31198928ce898f33ce37312d I0514 23:40:19.171205 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=3328545cbba2e1a0700aa59ac2873033bd22a5fde49ba403558526c046f57606 I0514 23:40:19.171230 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=bbcb33a208de7f8cd2b23e3e9ad1f70ed6831d2623b6ece7e0d2d1806c2771fa I0514 23:40:19.171243 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 51.509622ms to process 11 records I0514 23:40:19.171261 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0514 23:40:19.171307 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 50.949232ms to process 1 records I0514 23:40:19.171318 1 tasks_processing.go:74] worker 53 stopped. I0514 23:40:19.171454 1 tasks_processing.go:74] worker 20 stopped. I0514 23:40:19.171615 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/annotation.operator.tekton.dev with fingerprint=8ee08e35e5245b011b52a7e6813c715d74b1de95c33154911abd4a9817a018db I0514 23:40:19.171695 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=375e9c8a85292a00a6d30ebcf43843bcc8dde52c9051c4d3be4f1ae0ea82b237 I0514 23:40:19.171734 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/cert-manager-webhook with fingerprint=9c9838c830c2bc88595e9beeb2e4c0d4f3c882c5a39be3b9e8df1fc69e5e3228 I0514 23:40:19.171787 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/integration-service-mutating-webhook-configuration with fingerprint=6cf4073bbaed576243cc87070583c44c3390774fa714730bb7da7f5857d61e7e I0514 23:40:19.171820 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/proxy.operator.tekton.dev with fingerprint=e71e6e68fb156f48e78e3521716d389278487a59e41ce2ab7f079bc75b5b4c38 I0514 23:40:19.171911 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/release-service-mutating-webhook-configuration with fingerprint=dfec2ccaa49e941ac956be084f445a882f7d8ba7bdb12d9b7c70233df8ab4367 I0514 23:40:19.171952 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=3e9ae7d4e926676211098dbf9ab602cfc71c4f0ba5c6b50a0e10738488a13a29 I0514 23:40:19.171985 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=53185ec556855326e35f1ca3badf527b1efc5ba8b750e9924774d854f0d776c5 I0514 23:40:19.172029 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.operator.tekton.dev with fingerprint=b06f61a87706c97972a6f8685e516e547a8a00d1cf4b4855c4a65cb76b1fd026 I0514 23:40:19.172070 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.pipeline.tekton.dev with fingerprint=760dee83ecdcf4bd6368e2565510cf641fa581425ee6cbc00791b48de2d41767 I0514 23:40:19.172113 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.triggers.tekton.dev with fingerprint=73d7ea326d0d0612a45e832b5d20fb287466582f7c0914edd06cfef060a9d2ac I0514 23:40:19.172124 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 51.705821ms to process 11 records I0514 23:40:19.172210 1 gather_cluster_operator_pods_and_events.go:121] Found 0 pods with 0 containers I0514 23:40:19.172234 1 tasks_processing.go:74] worker 14 stopped. I0514 23:40:19.172247 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 52.898077ms to process 0 records I0514 23:40:19.173178 1 tasks_processing.go:74] worker 62 stopped. I0514 23:40:19.173580 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=96a96d97325428429f5c89a31b9b680ab426ebfc09c490fa277b1e266808b2bd I0514 23:40:19.173839 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=b5767795c789e19418b68287ce2c6585fdca7ddeea49c6896a3f8e46d698348e I0514 23:40:19.173853 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 53.864122ms to process 2 records I0514 23:40:19.173866 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 53.389228ms to process 0 records I0514 23:40:19.173873 1 tasks_processing.go:74] worker 19 stopped. I0514 23:40:19.176645 1 tasks_processing.go:74] worker 61 stopped. I0514 23:40:19.176663 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 57.354883ms to process 0 records I0514 23:40:19.222491 1 tasks_processing.go:74] worker 43 stopped. I0514 23:40:19.222509 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 103.125069ms to process 0 records I0514 23:40:19.223106 1 tasks_processing.go:74] worker 60 stopped. E0514 23:40:19.223121 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0514 23:40:19.223128 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0514 23:40:19.223132 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0514 23:40:19.223143 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0514 23:40:19.223173 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0514 23:40:19.223180 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0514 23:40:19.223184 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0514 23:40:19.223192 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0514 23:40:19.223230 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0514 23:40:19.223237 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0514 23:40:19.223242 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 102.666048ms to process 7 records I0514 23:40:19.229998 1 tasks_processing.go:74] worker 18 stopped. I0514 23:40:19.230299 1 recorder.go:75] Recording config/version with fingerprint=68db3118ff573c40b574101c4de854779ad2de74f64f5b3b54eab8d9abba8e00 I0514 23:40:19.230315 1 recorder.go:75] Recording config/id with fingerprint=f593ec5a980531d0a8515435588034171b01781120e745b6d37f03e3c31cbd6b I0514 23:40:19.230321 1 gather.go:177] gatherer "clusterconfig" function "version" took 110.570385ms to process 2 records I0514 23:40:19.233226 1 tasks_processing.go:74] worker 8 stopped. I0514 23:40:19.234681 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-v7r9k with fingerprint=cdfb8e1d08702defb08172b1b04be22d309e9521eff6c84ea2a3475c34e2e043 I0514 23:40:19.234816 1 recorder.go:75] Recording config/running_containers with fingerprint=6462b7efe5536591169634cdbc5ca19447376db87148ffb2f1a3340ae0ec2267 I0514 23:40:19.234826 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 113.446785ms to process 2 records I0514 23:40:19.248005 1 tasks_processing.go:74] worker 25 stopped. I0514 23:40:19.248036 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0514 23:40:19.248050 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 127.521297ms to process 1 records I0514 23:40:19.281683 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0514 23:40:19.287718 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0514 23:40:19.293117 1 tasks_processing.go:74] worker 12 stopped. E0514 23:40:19.293135 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0514 23:40:19.293143 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2qa0bbs8qnuq40u87qc5tpenquv0nj14-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2qa0bbs8qnuq40u87qc5tpenquv0nj14-primary-cert-bundle-secret" not found I0514 23:40:19.293213 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=77421c00b8d0c68ba2357b3b89e55f92b8692e148c90427b68bb951e797bd20c I0514 23:40:19.293233 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 173.981039ms to process 1 records I0514 23:40:19.293894 1 tasks_processing.go:74] worker 56 stopped. I0514 23:40:19.294071 1 recorder.go:75] Recording config/olm_operators with fingerprint=ea7b1317232e7d54f9f64c2f641f2f350e832d9c78c6b002709f33eeedb6e043 I0514 23:40:19.294084 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 174.521022ms to process 1 records I0514 23:40:20.152102 1 tasks_processing.go:74] worker 10 stopped. I0514 23:40:20.152126 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0514 23:40:20.152138 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.03305845s to process 1 records I0514 23:40:20.152717 1 tasks_processing.go:74] worker 13 stopped. I0514 23:40:20.152764 1 recorder.go:75] Recording config/alerts with fingerprint=5bcb1515edfe80aaad56d4a7a795000c787c2a4aeddc763b62c27edb60658add I0514 23:40:20.152776 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.032754576s to process 1 records I0514 23:40:20.167707 1 tasks_processing.go:74] worker 15 stopped. I0514 23:40:20.167782 1 recorder.go:75] Recording config/metrics with fingerprint=5192818dfd58da65da9e163264d20d55e6760939d1deebcb6d6eabca34e4e101 I0514 23:40:20.167793 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.048322542s to process 1 records I0514 23:40:20.172497 1 tasks_processing.go:74] worker 16 stopped. I0514 23:40:20.172526 1 recorder.go:75] Recording config/tsdb.json with fingerprint=e90c4deea271b66f4acaeba06c476e15d0c3a202ddf6dba31b1fa3e23fbcb8be I0514 23:40:20.172543 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.052244281s to process 1 records I0514 23:40:21.627336 1 tasks_processing.go:74] worker 28 stopped. I0514 23:40:21.627438 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=f08c844c001234a61fd20bd57716009cd471111d8380daa53297ddb5a3b2d4cc I0514 23:40:21.627516 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0514 23:40:21.627556 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=f48c0e9cff21f42984c78152e32081b7220820050bc102f064c376a56b58bd41 I0514 23:40:21.627571 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0514 23:40:21.627628 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=96958362fddf2ef85ebc3a2b12588a0cb5468141b7770655799a31d47460a0ca I0514 23:40:21.627654 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0514 23:40:21.627692 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=d659e0b767e6ede5726b38610b9977c17ad085d144d9eb813bdd065fac5270d8 I0514 23:40:21.627737 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=513e8778e3982d004c547217493a312c0adf8263ec584957f73cc33104c5e21a I0514 23:40:21.627774 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=9c909521616a47620d9721c95463d397f411ccc6278a1f35647592bd64703efa I0514 23:40:21.627827 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=1abeb51e2203a904a23671f004e2441fe21a48114d8820cccfb549cde1fbfa6c I0514 23:40:21.628338 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=bc97cfe3da06ac5710434257a44615acfb48eba8d236269d1af4ac7b685fd253 I0514 23:40:21.628372 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=67410b864d3c0bcb2b69d496758bc902d9dacfa441875623600cbbddd93a1534 I0514 23:40:21.628386 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0514 23:40:21.628414 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=c0191e7ec37684eaa4f7e2b5eba2cdd490e21e2c5ec4ec4c3e9d763db4ad7a97 I0514 23:40:21.628429 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0514 23:40:21.628458 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=b61e1eaa85c8b5e69799ead8b925600b13fa73c33d5aeefec5c4cb205bc588b4 I0514 23:40:21.628472 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0514 23:40:21.628505 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=819e9c1b3dae4fc93a09f1250c5ea036e86f2d54b4851f3f98a06f243c2873c3 I0514 23:40:21.628518 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0514 23:40:21.628556 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=e0a2f38e5bc3854485d62b5a9206f39ba88549e5537eee8e0b4f1d33070b6cf3 I0514 23:40:21.628758 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=d49edf9117e60385965b61485cc3b2015617109787de8eedf51e8f6b07804ac2 I0514 23:40:21.628772 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0514 23:40:21.628782 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0514 23:40:21.628816 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0514 23:40:21.628852 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=5dde7737d0ec38950e7fd0a6f8ed944f44f6fbc4a2e4868dc6155d7c8022c5c0 I0514 23:40:21.628927 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=9375c6eafd65722999bc458d977ed2804aa56fcf1856976bbaf0ab45a91d7739 I0514 23:40:21.628941 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0514 23:40:21.628968 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=42420cc17122f29dcbd737d34acbe00e78c24567d1b37c656a61f4e1586f99fe I0514 23:40:21.628982 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0514 23:40:21.629021 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=6be4b282f7ffcb4b1ede83f5c7c3b71ed9c4c2197a8a55ab2ba95a79d4be2712 I0514 23:40:21.629035 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0514 23:40:21.629056 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=15005c40744f031d7ea15447edf5b656f49f9ce477615acfaf9fa1d7ccf01ec5 I0514 23:40:21.629081 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=a1fc82eb9ad1b9b5b81c64a90df13e3e585b130235025e06b74cd3cf68a6de46 I0514 23:40:21.629106 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=9f2645760c78c9c3dbe3141e355bde4c5bdb76c2d4b6796bd33b48a091094202 I0514 23:40:21.629143 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=b2ca76b183d708676c2fdec14aa3dcbd5e2e7d02654ce531ee1b4b7ca5f0f386 I0514 23:40:21.629156 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0514 23:40:21.629203 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=cadd1d96b28740871f3b9a850e5654eb6e1b0730f1b0888554bfe073f77afe08 I0514 23:40:21.629229 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0514 23:40:21.629242 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0514 23:40:21.629252 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.508204116s to process 39 records I0514 23:40:21.932152 1 tasks_processing.go:74] worker 63 stopped. I0514 23:40:21.932537 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=284065f53cad552183fde5e159b91c9aec7a7076cb0e7409322ac61c1bccb31e I0514 23:40:21.932551 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 2.812523801s to process 1 records I0514 23:40:31.059452 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0514 23:40:31.059473 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0514 23:40:31.059477 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0514 23:40:31.059499 1 controller.go:512] The operator is healthy I0514 23:40:32.453256 1 tasks_processing.go:74] worker 42 stopped. I0514 23:40:32.453322 1 recorder.go:75] Recording config/installplans with fingerprint=90ad9be6cad72d8078a4c53f07b88f779c0c6e9f9fef136a6fbc44cee7ff13f0 I0514 23:40:32.453346 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.333886086s to process 1 records I0514 23:40:33.127111 1 tasks_processing.go:74] worker 2 stopped. I0514 23:40:33.127410 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=67e2b9a6194d39698ca4bcf6c63caeb3f9b9dc5919388548e3aa1914a8950180 I0514 23:40:33.127426 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 14.007608352s to process 1 records E0514 23:40:33.127499 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 14.008s with: function \"machine_healthchecks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error" I0514 23:40:33.128626 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0514 23:40:33.128642 1 periodic.go:209] Running workloads gatherer I0514 23:40:33.128660 1 tasks_processing.go:45] number of workers: 2 I0514 23:40:33.128666 1 tasks_processing.go:69] worker 1 listening for tasks. I0514 23:40:33.128670 1 tasks_processing.go:71] worker 1 working on workload_info task. I0514 23:40:33.128676 1 tasks_processing.go:69] worker 0 listening for tasks. I0514 23:40:33.128689 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0514 23:40:33.136196 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-121.ec2.internal... I0514 23:40:33.136202 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-171.ec2.internal... I0514 23:40:33.136213 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-4.ec2.internal... I0514 23:40:33.156112 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak. I0514 23:40:33.156126 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak-pgsql. I0514 23:40:33.156133 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from server. I0514 23:40:33.156137 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from tpa-pgsql. I0514 23:40:33.165828 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-keycloak from keycloak-pgsql-bee. I0514 23:40:33.165843 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from importer. I0514 23:40:33.165848 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from server. I0514 23:40:33.165852 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from tpa-pgsql-bee. I0514 23:40:33.165863 1 tasks_processing.go:74] worker 0 stopped. I0514 23:40:33.165880 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 37.162956ms to process 0 records I0514 23:40:40.227321 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 7s I0514 23:40:40.270193 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 31s for image data I0514 23:40:40.280699 1 gather_workloads_info.go:387] No image sha256:67bb018311dbb0435fd3396f9132aa33db43da9cdef92e4fe17a6c55e66c8de1 (12ms) I0514 23:40:40.292477 1 gather_workloads_info.go:387] No image sha256:484342520dc3babe0ff4a9360edc98816556f2bd1b9981ec3d5dbab09a7536a9 (12ms) I0514 23:40:40.304458 1 gather_workloads_info.go:387] No image sha256:00fa6a8075723e279b420c76d13105c1650b1d46db51c7018801c558c0a876c6 (12ms) I0514 23:40:40.316530 1 gather_workloads_info.go:387] No image sha256:1a6e733a0d8a8bfcf033e01378397d2af7cfeb6238caf67df1d2d79d63221fb6 (12ms) I0514 23:40:40.327906 1 gather_workloads_info.go:387] No image sha256:23a671ad4c0c57aca495adb6ea996e9580541c3cec6a57dde147a438d69090a8 (11ms) I0514 23:40:40.339304 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (11ms) I0514 23:40:40.350185 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (11ms) I0514 23:40:40.361097 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (11ms) I0514 23:40:40.371955 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (11ms) I0514 23:40:40.382749 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (11ms) I0514 23:40:40.393812 1 gather_workloads_info.go:387] No image sha256:15692e0deea2ee5ef374514639030317a5b033c1bd1778673329a9745feb41d1 (11ms) I0514 23:40:40.480723 1 gather_workloads_info.go:387] No image sha256:1f4a37529de4f750099af18e113556bd995fe6922030c614b7d6d23eaa0bd318 (87ms) I0514 23:40:40.581011 1 gather_workloads_info.go:387] No image sha256:b99613494e9d6a4a8207323872d63cc02b830fc80a8bf972e62c64381aa4cd17 (100ms) I0514 23:40:40.681208 1 gather_workloads_info.go:387] No image sha256:3701303c7039d88d34cf6cc4094de4a87df08951e5f5d3dd11f6388dd1d40e19 (100ms) I0514 23:40:40.781224 1 gather_workloads_info.go:387] No image sha256:204dc28f6182267851d39eff08649e921877e2771d2c39acb798aa7896f5bcef (100ms) I0514 23:40:40.881095 1 gather_workloads_info.go:387] No image sha256:1e65f9f5490fbc930d2dce96f03ddcb28990b839d7dc011ef5de5bec6c5095bf (100ms) I0514 23:40:40.981394 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (100ms) I0514 23:40:41.081000 1 gather_workloads_info.go:387] No image sha256:1d97e631c15e5b2f10de5c394e207f0f110a4720f3fbb8986b90932cd3059f93 (100ms) I0514 23:40:41.184790 1 gather_workloads_info.go:387] No image sha256:0b27f6c0254d5674d131985b5ed0d876611b2f32ca94a02844d30cd257e8c9d9 (104ms) I0514 23:40:41.280683 1 gather_workloads_info.go:387] No image sha256:7bd3e88d6d3f878a89203df590b684c5a77bf08df4717451d3197ab74683a80e (96ms) I0514 23:40:41.380111 1 gather_workloads_info.go:387] No image sha256:ab5c3e921b58d17bf6b596d2d7acf64a28b34f3f3a66720c1a07e6555ed9e0b8 (99ms) I0514 23:40:41.480872 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (101ms) I0514 23:40:41.580474 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (100ms) I0514 23:40:41.681168 1 gather_workloads_info.go:398] Found image sha256:32d4561d4bf1b3c4e3a7878f918f9c1422bab85bdf8711fbdf905d59692fee81 (101ms) I0514 23:40:41.781028 1 gather_workloads_info.go:387] No image sha256:3612c5a433effd17b7aff7ff6edf4fb27b61153908e3a0294158e4886a1d600d (100ms) I0514 23:40:41.881926 1 gather_workloads_info.go:387] No image sha256:95801a943ba7d0ec4af53c3cd1177483e649bcd528b5a838a32ad2d860e6503a (101ms) I0514 23:40:41.982526 1 gather_workloads_info.go:387] No image sha256:523fa259ebf067ac3076748d4f5c86e01e5b1960034c0876add5d67b0ca21b0b (101ms) I0514 23:40:42.081288 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (99ms) I0514 23:40:42.181618 1 gather_workloads_info.go:387] No image sha256:513b1166e376feca472fdd5174f6abf0abf02925d6a21b7b4d89a2ff2fc67bed (100ms) I0514 23:40:42.282950 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (101ms) I0514 23:40:42.380976 1 gather_workloads_info.go:387] No image sha256:2080d23c30be5b9602413e1cb881f4b62e4ad7bd2c4191b74809d0809c9e0b69 (98ms) I0514 23:40:42.481491 1 gather_workloads_info.go:387] No image sha256:7a48172cdda2a565001998fac2f3aeaa65677f080dd9cb3f9e26ef0963afdef0 (100ms) I0514 23:40:42.580798 1 gather_workloads_info.go:387] No image sha256:c1fd3736f86667698e06b4b2fed5407867dd89dbe53f8e97a9aa23a87ce12909 (99ms) I0514 23:40:42.680557 1 gather_workloads_info.go:387] No image sha256:7388a79b676b59ce71738a7a13bc16c8426fe908038a172591a0369b6d77422e (100ms) I0514 23:40:42.780911 1 gather_workloads_info.go:387] No image sha256:169cbfe0badfa9976ec7b6390cd485c39394a516e6b27bcb98bac9b1f7631ad6 (100ms) I0514 23:40:42.881394 1 gather_workloads_info.go:387] No image sha256:95f5dcecd4c2f488420d608565bcac75909a65f2c9d443c34d93f7914f1cb1ef (100ms) I0514 23:40:42.981550 1 gather_workloads_info.go:387] No image sha256:a8d45a728ef6daefe4297359acfae70c42014eb79cfcf6892aef4e8bc672475a (100ms) I0514 23:40:43.080124 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (99ms) I0514 23:40:43.181246 1 gather_workloads_info.go:387] No image sha256:90bdf9e678fe18e35401e34e1cb0912d822e9cb32b9e41cc545870540e9a87f2 (101ms) I0514 23:40:43.281212 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0514 23:40:43.381836 1 gather_workloads_info.go:387] No image sha256:09cea31cb42bebffbe682f4314fd2d452745d43eb3703a7852dab9eb9c662313 (101ms) I0514 23:40:43.481374 1 gather_workloads_info.go:387] No image sha256:1fbd070ed93685f8b5042e96a98273ac0970d9a5e81f603b82f0acbe141daef5 (100ms) I0514 23:40:43.581364 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (100ms) I0514 23:40:43.681146 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (100ms) I0514 23:40:43.781822 1 gather_workloads_info.go:387] No image sha256:040c993cf5074fb5836dfbd9458edf875a133f92fdae3acbc7e7d638fd7c75e9 (101ms) I0514 23:40:43.881301 1 gather_workloads_info.go:387] No image sha256:315260877c58d13e0511bbff7bdcc389bcd86deca48785023e28194b08c4c924 (99ms) I0514 23:40:43.981328 1 gather_workloads_info.go:387] No image sha256:3f586d6fd6139bbad131716168590b12db0cdfe4dcbb15ccee65b080d5594b6e (100ms) I0514 23:40:44.082069 1 gather_workloads_info.go:387] No image sha256:24a4686175cb6a4eceda426af1eb1df2a022ecdedf22a297c0d68f93479c7baf (101ms) I0514 23:40:44.180960 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (99ms) I0514 23:40:44.280750 1 gather_workloads_info.go:387] No image sha256:3f18cbd40d453cb50e2c0012adf9d5310960038ea241aa0c2bd8a193455b9428 (100ms) I0514 23:40:44.380685 1 gather_workloads_info.go:387] No image sha256:76cc47f3775560477ec548c7b6fddbd99112ad6604f790697eef546576051fb7 (100ms) I0514 23:40:44.480331 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (100ms) I0514 23:40:44.581074 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (101ms) I0514 23:40:44.680944 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (100ms) I0514 23:40:44.780882 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0514 23:40:44.880867 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (100ms) I0514 23:40:44.980915 1 gather_workloads_info.go:387] No image sha256:7ef409f2d070139f6034e77b598b8e904e1c4c6c77b2e37ca1de44f496951135 (100ms) I0514 23:40:45.081567 1 gather_workloads_info.go:387] No image sha256:3d6ea9e1633f38070718a1357fcb80e6cb3932aafcc4d65e659795b186c5da15 (101ms) I0514 23:40:45.181087 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (99ms) I0514 23:40:45.281278 1 gather_workloads_info.go:387] No image sha256:4316e4879c784caae03626f3924ec61dbf6be88ed436dc079baa34d42fe087d6 (100ms) I0514 23:40:45.380976 1 gather_workloads_info.go:387] No image sha256:b4a5a2c2518dba5f7812c8b4112e25a0f867a4b187c23adfc727395f871c8ca6 (100ms) I0514 23:40:45.480845 1 gather_workloads_info.go:387] No image sha256:ae7d3453fd734ecc865e5f9bb16f29244ebffe6291b77e1d4e496f71eb053174 (100ms) I0514 23:40:45.580562 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (100ms) I0514 23:40:45.680426 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (100ms) I0514 23:40:45.780074 1 gather_workloads_info.go:387] No image sha256:1e6306bc8c9dccbbc0ca28509de44606dcd5a414b6bff3c18dd0c386693997e1 (100ms) I0514 23:40:45.880811 1 gather_workloads_info.go:387] No image sha256:2d478c389bc89afc6b331bc662a84dfc1bbb9da2681ab6dc5ad36f44c346699a (101ms) I0514 23:40:45.980515 1 gather_workloads_info.go:387] No image sha256:11466675408cf4150b67445609fa208f0eacd234273c28cc8082a9526a0b6ed2 (100ms) I0514 23:40:46.080209 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (100ms) I0514 23:40:46.181752 1 gather_workloads_info.go:387] No image sha256:0092c6ff139f8698c91349d507eb3182bc5d6c4ae040f672e347ff504accdea2 (102ms) I0514 23:40:46.282524 1 gather_workloads_info.go:387] No image sha256:4be8ec9e07019a695fd1861d002fcec629c52150917d71746691a3deca74bfe1 (101ms) I0514 23:40:46.380098 1 gather_workloads_info.go:387] No image sha256:74713675d580a47a56b628469c4c05c41e114e0b935960d718ff0cf7e72f613d (98ms) I0514 23:40:46.482517 1 gather_workloads_info.go:387] No image sha256:8d2e7068d92ab9d0c8acd71ddd4a8b5e3fd2757edc460a18e81415acca5a2cf6 (102ms) I0514 23:40:46.584869 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (102ms) I0514 23:40:46.681207 1 gather_workloads_info.go:387] No image sha256:3cf90015825015fd6e25b9d81ed44bef3e0e0648351f42c788df844e4c7238ea (96ms) I0514 23:40:46.781535 1 gather_workloads_info.go:387] No image sha256:1e9a9f1b5ecdab7d074722c860daab977519123fe4385affdfd86d8c7f3c473c (100ms) I0514 23:40:46.881361 1 gather_workloads_info.go:387] No image sha256:e099d31b04aec0af0f3f28bdcb989640d4ef4cf58e2ab136585f93ebce9ee3fa (100ms) I0514 23:40:46.980408 1 gather_workloads_info.go:387] No image sha256:22b8cfd123fdd66827b81f2431903198e33579906102b2f6295276cf3eb197a6 (99ms) I0514 23:40:47.080831 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (100ms) I0514 23:40:47.180224 1 gather_workloads_info.go:387] No image sha256:9607f5c16d8e9d7ee2491ac04db78a52eb13ee0e93eeef79ff8bb6c8f9430c72 (99ms) I0514 23:40:47.281154 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (101ms) I0514 23:40:47.380849 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (100ms) I0514 23:40:47.481343 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (100ms) I0514 23:40:47.582829 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (101ms) I0514 23:40:47.681018 1 gather_workloads_info.go:387] No image sha256:95b5aefafd17dd44794f6d5d1e75278faa5a74f2472db667409d1c88caaef1f1 (98ms) I0514 23:40:47.780532 1 gather_workloads_info.go:387] No image sha256:6fc77db6045a62215c6b2c87ab9f7ac3892e381c645f2e78032d2788f83ca729 (99ms) I0514 23:40:47.880449 1 gather_workloads_info.go:387] No image sha256:f68c0da8268f23078f5f760a91a3c8212f2195acf18c231f6e034207a67adeec (100ms) I0514 23:40:47.980415 1 gather_workloads_info.go:387] No image sha256:0af73ad7a47c9ff53269ae2bc5163bf9e389085220c34e4bd42c92c4e7a85f6d (100ms) I0514 23:40:48.080658 1 gather_workloads_info.go:387] No image sha256:6e5df2aab9ce759e8f957341a11c087c233307e3c8f8760d21270efc19ccd3ce (100ms) I0514 23:40:48.180531 1 gather_workloads_info.go:387] No image sha256:050fe6fe1298c45a27982e3f4d0afe637ce01d9b394e85b7eb202309ecdd0731 (100ms) I0514 23:40:48.280484 1 gather_workloads_info.go:387] No image sha256:66fc2ec61bc94d16aef9a497a9fd98de912e012e3efdc99e8cdb99a26e7601b1 (100ms) I0514 23:40:48.379800 1 gather_workloads_info.go:387] No image sha256:430ddfcb78891bf229447111994486608cfd1d7eda8c10701e8fc2d4455612e5 (99ms) I0514 23:40:48.480913 1 gather_workloads_info.go:398] Found image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (101ms) I0514 23:40:48.580588 1 gather_workloads_info.go:387] No image sha256:c00af2d8f97dfadc48617af84708b4025d751f435e8a9e9879ae546259ae6105 (100ms) I0514 23:40:48.680479 1 gather_workloads_info.go:387] No image sha256:f211db01228530de8ed46b05189c492e6c3629df1098da57d31f2765a22ef014 (100ms) I0514 23:40:48.780096 1 gather_workloads_info.go:387] No image sha256:101993f6e65d6fda8b90c583b718b720809182961f69bc777295f47e6df4d7ce (100ms) I0514 23:40:48.881083 1 gather_workloads_info.go:387] No image sha256:2f6f91dfd7b71cad1c6db82835d709d20f4153cf500d60ee32145712af922214 (101ms) I0514 23:40:48.981549 1 gather_workloads_info.go:387] No image sha256:09e27b3a67ebeda04d3e597e0561bfb40550de78bdecb53f2f9ff3dfb1cfe7ea (100ms) I0514 23:40:49.080972 1 gather_workloads_info.go:387] No image sha256:1477f3287cc75352305274f248f781c1b7c2a8696f4f7bc450c45a4a5f5b10ea (99ms) I0514 23:40:49.081013 1 tasks_processing.go:74] worker 1 stopped. I0514 23:40:49.081445 1 recorder.go:75] Recording config/workload_info with fingerprint=5665f581aaddb2472648769dc7fc9300fa44947326a5e161cb5cca0238c1a918 I0514 23:40:49.081462 1 gather.go:177] gatherer "workloads" function "workload_info" took 15.952335312s to process 1 records I0514 23:40:49.081476 1 periodic.go:256] Periodic gather workloads completed in 15.952s I0514 23:40:49.081484 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0514 23:40:49.081489 1 periodic.go:209] Running conditional gatherer I0514 23:40:49.089293 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0514 23:40:49.273685 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer I0514 23:40:49.276388 1 conditional_gatherer.go:374] alert "Watchdog" has state "firing" I0514 23:40:49.276401 1 conditional_gatherer.go:374] alert "KubeContainerWaiting" has state "pending" I0514 23:40:49.276404 1 conditional_gatherer.go:374] alert "AlertmanagerReceiversNotConfigured" has state "firing" I0514 23:40:49.276469 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0514 23:40:49.284156 1 conditional_gatherer.go:392] cluster version is '4.20.8' I0514 23:40:49.284181 1 tasks_processing.go:45] number of workers: 3 I0514 23:40:49.284188 1 tasks_processing.go:69] worker 2 listening for tasks. I0514 23:40:49.284192 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0514 23:40:49.284255 1 tasks_processing.go:69] worker 1 listening for tasks. I0514 23:40:49.284266 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0514 23:40:49.284268 1 tasks_processing.go:69] worker 0 listening for tasks. I0514 23:40:49.284262 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0514 23:40:49.284286 1 tasks_processing.go:71] worker 1 working on remote_configuration task. I0514 23:40:49.284297 1 tasks_processing.go:74] worker 0 stopped. I0514 23:40:49.284300 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 900ns to process 1 records I0514 23:40:49.284357 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0514 23:40:49.284368 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.48µs to process 1 records I0514 23:40:49.284375 1 tasks_processing.go:74] worker 1 stopped. I0514 23:40:49.284527 1 tasks_processing.go:74] worker 2 stopped. I0514 23:40:49.284538 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 254.873µs to process 0 records I0514 23:40:49.284552 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0514 23:40:49.284566 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0514 23:40:49.314770 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=d272bed78f8dbb9a80e07b8ed213a8c265aaabc379705e2745fb7d66f7c5fc99 I0514 23:40:49.314892 1 diskrecorder.go:70] Writing 134 records to /var/lib/insights-operator/insights-2026-05-14-234049.tar.gz I0514 23:40:49.325352 1 diskrecorder.go:51] Wrote 134 records to disk in 10ms I0514 23:40:49.325385 1 periodic.go:278] Gathering cluster info every 2h0m0s I0514 23:40:49.325400 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0514 23:41:49.119414 1 diskrecorder.go:223] Found files to send: insights-2026-05-14-234049.tar.gz I0514 23:41:49.119443 1 insightsuploader.go:150] Checking archives to upload periodically every 15m13.014883005s I0514 23:41:49.119451 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0514 23:41:49.131247 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0514 23:41:49.522753 1 requests.go:87] Successfully reported id=2026-05-14T23:41:49Z x-rh-insights-request-id=f2287ec93a584320b195166743929c1e, wrote=72646 I0514 23:41:49.522875 1 insightsuploader.go:187] Uploaded report successfully in 403.410031ms I0514 23:41:49.522898 1 controller.go:128] Initializing last reported time to 2026-05-14T23:41:49Z I0514 23:41:49.522981 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0514 23:41:49.522996 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0514 23:41:49.523007 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0514 23:41:49.530082 1 controller.go:512] The operator is healthy I0514 23:42:31.061920 1 controller.go:512] The operator is healthy I0514 23:42:49.907490 1 insightsreport.go:137] Pulling report from smart-proxy I0514 23:42:49.907514 1 insightsreport.go:149] Retrieving report I0514 23:42:49.916474 1 requests.go:110] Retrieving report for cluster: b0e8cbdc-6214-42eb-94c0-2d6ed701a690 I0514 23:42:49.916485 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/b0e8cbdc-6214-42eb-94c0-2d6ed701a690/reports I0514 23:42:49.920733 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/b0e8cbdc-6214-42eb-94c0-2d6ed701a690/reports I0514 23:42:50.270817 1 insightsreport.go:184] Report retrieved I0514 23:42:50.338678 1 insightsreport.go:239] Report retrieved correctly I0514 23:43:30.057639 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 23:43:30.063513 1 configmapobserver.go:84] configmaps "insights-config" not found I0514 23:43:30.099628 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 23:43:30.105703 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 23:43:30.105723 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 23:43:30.111493 1 secretconfigobserver.go:119] support secret does not exist I0514 23:44:31.060567 1 controller.go:512] The operator is healthy I0514 23:46:31.059988 1 controller.go:512] The operator is healthy I0514 23:48:30.112496 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0514 23:48:30.119757 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0514 23:48:30.119784 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0514 23:48:30.125344 1 secretconfigobserver.go:119] support secret does not exist I0514 23:48:31.059506 1 controller.go:512] The operator is healthy I0514 23:50:31.060743 1 controller.go:512] The operator is healthy