I0326 23:17:03.234128 1 cmd.go:253] Using service-serving-cert provided certificates I0326 23:17:03.234551 1 observer_polling.go:159] Starting file observer I0326 23:17:04.153819 1 operator.go:76] Starting insights-operator v0.0.0-master+$Format:%H$ I0326 23:17:04.154136 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0326 23:17:04.155014 1 secure_serving.go:57] Forcing use of http/1.1 only W0326 23:17:04.155040 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0326 23:17:04.155049 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0326 23:17:04.155056 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0326 23:17:04.155060 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0326 23:17:04.155064 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0326 23:17:04.155068 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0326 23:17:04.155061 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0326 23:17:04.159067 1 operator.go:141] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNSInstall GatewayAPI GatewayAPIController HighlyAvailableArbiter HyperShiftOnlyDynamicResourceAllocation ImageStreamImportMode ImageVolume KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS ManagedBootImagesAzure ManagedBootImagesvSphere MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages PreconfiguredUDNAddresses ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SigstoreImageVerification SigstoreImageVerificationPKI StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSDualStackInstall AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureDualStackInstall AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement CBORServingAndStorage CRDCompatibilityRequirementOperator ClientsAllowCBOR ClientsPreferCBOR ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterAPIMachineManagement ClusterAPIMachineManagementVSphere ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud EtcdBackendQuota EventTTL EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall GCPDualStackInstall ImageModeStatusReporting IngressControllerDynamicConfigurationManager InsightsConfig InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryption KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesCPMS MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutableCSINodeAllocatableCount MutatingAdmissionPolicy NewOLM NewOLMBoxCutterRuntime NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterInstall NutanixMultiSubnets OSStreams OVNObservability OnPremDNSRecords OpenShiftPodSecurityAdmission ProvisioningRequestAvailable SELinuxMount ShortCertRotation SignatureStores TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeGroupSnapshot] I0326 23:17:04.159071 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"e2336d2e-30f6-4a41-9630-c8112d6dddac", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNSInstall", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "HyperShiftOnlyDynamicResourceAllocation", "ImageStreamImportMode", "ImageVolume", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "PreconfiguredUDNAddresses", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSDualStackInstall", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureDualStackInstall", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "CBORServingAndStorage", "CRDCompatibilityRequirementOperator", "ClientsAllowCBOR", "ClientsPreferCBOR", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterAPIMachineManagement", "ClusterAPIMachineManagementVSphere", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "EtcdBackendQuota", "EventTTL", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "GCPDualStackInstall", "ImageModeStatusReporting", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryption", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesCPMS", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutableCSINodeAllocatableCount", "MutatingAdmissionPolicy", "NewOLM", "NewOLMBoxCutterRuntime", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterInstall", "NutanixMultiSubnets", "OSStreams", "OVNObservability", "OnPremDNSRecords", "OpenShiftPodSecurityAdmission", "ProvisioningRequestAvailable", "SELinuxMount", "ShortCertRotation", "SignatureStores", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeGroupSnapshot"}} I0326 23:17:04.160182 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0326 23:17:04.160206 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0326 23:17:04.160206 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0326 23:17:04.160205 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0326 23:17:04.160221 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0326 23:17:04.160223 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0326 23:17:04.160580 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0326 23:17:04.160864 1 secure_serving.go:213] Serving securely on [::]:8443 I0326 23:17:04.160889 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0326 23:17:04.165403 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0326 23:17:04.165478 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0326 23:17:04.165925 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0326 23:17:04.173184 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:17:04.173205 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0326 23:17:04.183915 1 secretconfigobserver.go:119] support secret does not exist I0326 23:17:04.188851 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:17:04.195203 1 secretconfigobserver.go:119] support secret does not exist I0326 23:17:04.200381 1 recorder.go:176] Pruning old reports every 6h5m41s, max age is 288h0m0s I0326 23:17:04.205316 1 operator.go:356] The last pod state is unhealthy I0326 23:17:04.260498 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0326 23:17:04.260506 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0326 23:17:04.260544 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0326 23:17:04.266666 1 base_controller.go:82] Caches are synced for ConfigController I0326 23:17:04.266675 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0326 23:17:04.271417 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:17:24.209170 1 operator.go:356] The last pod state is unhealthy I0326 23:17:44.208679 1 operator.go:356] The last pod state is unhealthy I0326 23:18:04.207462 1 operator.go:356] The last pod state is unhealthy I0326 23:18:24.208953 1 operator.go:356] The last pod state is unhealthy I0326 23:18:44.208169 1 operator.go:356] The last pod state is unhealthy I0326 23:19:04.207069 1 operator.go:356] The last pod state is unhealthy I0326 23:19:24.209505 1 operator.go:356] The last pod state is unhealthy I0326 23:19:44.207855 1 operator.go:356] The last pod state is unhealthy I0326 23:20:04.206893 1 operator.go:356] The last pod state is unhealthy I0326 23:20:24.206840 1 operator.go:356] The last pod state is unhealthy I0326 23:20:44.207980 1 operator.go:356] The last pod state is unhealthy I0326 23:21:04.206998 1 operator.go:356] The last pod state is unhealthy I0326 23:21:24.208858 1 operator.go:356] The last pod state is unhealthy I0326 23:21:44.209405 1 operator.go:356] The last pod state is unhealthy I0326 23:22:04.207026 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:22:04.208057 1 operator.go:356] The last pod state is unhealthy I0326 23:22:04.211256 1 secretconfigobserver.go:119] support secret does not exist I0326 23:22:19.233019 1 operator.go:288] Unable to check insights-operator pod status. Setting initial delay to 10m42.87676129s I0326 23:22:19.233097 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0326 23:22:19.233123 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 12m12s I0326 23:22:19.233148 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0326 23:22:19.233154 1 insightsreport.go:296] Starting report retriever I0326 23:22:19.233159 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0326 23:22:19.242366 1 controller.go:129] Initializing last reported time to 0001-01-01T00:00:00Z I0326 23:22:19.242384 1 controller.go:368] The initial operator extension status is healthy I0326 23:22:19.242392 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0326 23:22:19.242396 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0326 23:22:19.242399 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0326 23:22:19.242416 1 controller.go:531] The operator is still being initialized I0326 23:22:19.242423 1 controller.go:554] The operator is healthy I0326 23:22:19.242504 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0326 23:22:19.242526 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0326 23:22:19.242655 1 operator.go:328] started I0326 23:22:19.242685 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0326 23:22:19.249328 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0326 23:22:19.249339 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0326 23:22:19.249343 1 controller.go:254] Source scaController *sca.Controller is not ready I0326 23:22:19.249347 1 controller.go:254] Source clusterTransferController *clustertransfer.Controller is not ready I0326 23:22:19.249350 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0326 23:22:19.249363 1 controller.go:531] The operator is still being initialized I0326 23:22:19.249369 1 controller.go:554] The operator is healthy I0326 23:22:19.261020 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0326 23:22:19.328646 1 cluster_transfer.go:102] no available accepted cluster transfer I0326 23:22:19.328659 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0326 23:22:19.342731 1 base_controller.go:82] Caches are synced for LoggingSyncer I0326 23:22:19.342746 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0326 23:22:19.392204 1 sca.go:266] etc-pki-entitlement secret successfully created I0326 23:22:19.392220 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0326 23:24:19.250048 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0326 23:24:19.250064 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0326 23:24:19.250067 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0326 23:24:19.250088 1 controller.go:531] The operator is still being initialized I0326 23:24:19.250094 1 controller.go:554] The operator is healthy I0326 23:26:19.252153 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0326 23:26:19.252173 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0326 23:26:19.252177 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0326 23:26:19.252199 1 controller.go:554] The operator is healthy I0326 23:27:04.192668 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:27:04.199911 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:27:04.211955 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0326 23:27:04.217265 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:27:04.217295 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0326 23:27:04.221618 1 secretconfigobserver.go:119] support secret does not exist I0326 23:28:19.248786 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0326 23:28:19.248800 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0326 23:28:19.248803 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0326 23:28:19.248827 1 controller.go:554] The operator is healthy I0326 23:30:19.250867 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0326 23:30:19.250889 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0326 23:30:19.250893 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0326 23:30:19.250925 1 controller.go:554] The operator is healthy I0326 23:32:04.222094 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0326 23:32:04.228258 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:32:04.228294 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0326 23:32:04.232625 1 secretconfigobserver.go:119] support secret does not exist I0326 23:32:19.256468 1 controller.go:254] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0326 23:32:19.256486 1 controller.go:254] Source periodic-conditional *controllerstatus.Simple is not ready I0326 23:32:19.256490 1 controller.go:254] Source periodic-workloads *controllerstatus.Simple is not ready I0326 23:32:19.256516 1 controller.go:554] The operator is healthy I0326 23:33:02.110869 1 periodic.go:216] Running clusterconfig gatherer I0326 23:33:02.110935 1 tasks_processing.go:45] number of workers: 64 I0326 23:33:02.110957 1 tasks_processing.go:69] worker 0 listening for tasks. I0326 23:33:02.110981 1 tasks_processing.go:69] worker 6 listening for tasks. I0326 23:33:02.110986 1 tasks_processing.go:69] worker 1 listening for tasks. I0326 23:33:02.110981 1 tasks_processing.go:69] worker 13 listening for tasks. I0326 23:33:02.110992 1 tasks_processing.go:69] worker 2 listening for tasks. I0326 23:33:02.110993 1 tasks_processing.go:71] worker 1 working on feature_gates task. I0326 23:33:02.110996 1 tasks_processing.go:71] worker 13 working on machine_sets task. I0326 23:33:02.110999 1 tasks_processing.go:69] worker 3 listening for tasks. I0326 23:33:02.111004 1 tasks_processing.go:69] worker 4 listening for tasks. I0326 23:33:02.111009 1 tasks_processing.go:69] worker 5 listening for tasks. I0326 23:33:02.111006 1 tasks_processing.go:69] worker 9 listening for tasks. I0326 23:33:02.111014 1 tasks_processing.go:69] worker 10 listening for tasks. I0326 23:33:02.111016 1 tasks_processing.go:69] worker 11 listening for tasks. I0326 23:33:02.111025 1 tasks_processing.go:69] worker 7 listening for tasks. I0326 23:33:02.111032 1 tasks_processing.go:69] worker 52 listening for tasks. I0326 23:33:02.111036 1 tasks_processing.go:69] worker 59 listening for tasks. I0326 23:33:02.111034 1 tasks_processing.go:69] worker 8 listening for tasks. I0326 23:33:02.111042 1 tasks_processing.go:69] worker 62 listening for tasks. I0326 23:33:02.111042 1 tasks_processing.go:69] worker 40 listening for tasks. I0326 23:33:02.111035 1 tasks_processing.go:69] worker 39 listening for tasks. I0326 23:33:02.111050 1 tasks_processing.go:69] worker 53 listening for tasks. I0326 23:33:02.111046 1 tasks_processing.go:69] worker 41 listening for tasks. I0326 23:33:02.111055 1 tasks_processing.go:69] worker 60 listening for tasks. I0326 23:33:02.111051 1 tasks_processing.go:69] worker 42 listening for tasks. I0326 23:33:02.111053 1 tasks_processing.go:69] worker 27 listening for tasks. I0326 23:33:02.111061 1 tasks_processing.go:69] worker 28 listening for tasks. I0326 23:33:02.111067 1 tasks_processing.go:69] worker 61 listening for tasks. I0326 23:33:02.111068 1 tasks_processing.go:69] worker 45 listening for tasks. I0326 23:33:02.111058 1 tasks_processing.go:69] worker 43 listening for tasks. I0326 23:33:02.111055 1 tasks_processing.go:69] worker 26 listening for tasks. I0326 23:33:02.111074 1 tasks_processing.go:69] worker 29 listening for tasks. I0326 23:33:02.111074 1 tasks_processing.go:69] worker 46 listening for tasks. I0326 23:33:02.111080 1 tasks_processing.go:69] worker 57 listening for tasks. I0326 23:33:02.111082 1 tasks_processing.go:69] worker 56 listening for tasks. I0326 23:33:02.111085 1 tasks_processing.go:69] worker 48 listening for tasks. I0326 23:33:02.111086 1 tasks_processing.go:69] worker 16 listening for tasks. I0326 23:33:02.111088 1 tasks_processing.go:69] worker 63 listening for tasks. I0326 23:33:02.111093 1 tasks_processing.go:69] worker 17 listening for tasks. I0326 23:33:02.111088 1 tasks_processing.go:71] worker 6 working on proxies task. I0326 23:33:02.111103 1 tasks_processing.go:69] worker 22 listening for tasks. I0326 23:33:02.111104 1 tasks_processing.go:69] worker 19 listening for tasks. I0326 23:33:02.111101 1 tasks_processing.go:69] worker 20 listening for tasks. I0326 23:33:02.111073 1 tasks_processing.go:69] worker 55 listening for tasks. I0326 23:33:02.111062 1 tasks_processing.go:69] worker 54 listening for tasks. I0326 23:33:02.111114 1 tasks_processing.go:69] worker 34 listening for tasks. I0326 23:33:02.111115 1 tasks_processing.go:69] worker 37 listening for tasks. I0326 23:33:02.111118 1 tasks_processing.go:69] worker 25 listening for tasks. I0326 23:33:02.111120 1 tasks_processing.go:69] worker 32 listening for tasks. I0326 23:33:02.111067 1 tasks_processing.go:69] worker 14 listening for tasks. I0326 23:33:02.111070 1 tasks_processing.go:71] worker 0 working on silenced_alerts task. I0326 23:33:02.111121 1 tasks_processing.go:69] worker 35 listening for tasks. I0326 23:33:02.111077 1 tasks_processing.go:69] worker 15 listening for tasks. I0326 23:33:02.111080 1 tasks_processing.go:69] worker 47 listening for tasks. I0326 23:33:02.111136 1 tasks_processing.go:69] worker 38 listening for tasks. I0326 23:33:02.111088 1 tasks_processing.go:69] worker 30 listening for tasks. I0326 23:33:02.111089 1 tasks_processing.go:69] worker 21 listening for tasks. I0326 23:33:02.111092 1 tasks_processing.go:69] worker 49 listening for tasks. I0326 23:33:02.111092 1 tasks_processing.go:69] worker 58 listening for tasks. I0326 23:33:02.111095 1 tasks_processing.go:69] worker 31 listening for tasks. I0326 23:33:02.111097 1 tasks_processing.go:69] worker 50 listening for tasks. I0326 23:33:02.111104 1 tasks_processing.go:69] worker 18 listening for tasks. I0326 23:33:02.111106 1 tasks_processing.go:69] worker 36 listening for tasks. I0326 23:33:02.111107 1 tasks_processing.go:69] worker 51 listening for tasks. I0326 23:33:02.111111 1 tasks_processing.go:69] worker 23 listening for tasks. I0326 23:33:02.111113 1 tasks_processing.go:69] worker 24 listening for tasks. I0326 23:33:02.111115 1 tasks_processing.go:69] worker 33 listening for tasks. I0326 23:33:02.111124 1 tasks_processing.go:69] worker 12 listening for tasks. I0326 23:33:02.111063 1 tasks_processing.go:69] worker 44 listening for tasks. I0326 23:33:02.111190 1 tasks_processing.go:71] worker 7 working on ingress task. I0326 23:33:02.111195 1 tasks_processing.go:71] worker 29 working on monitoring_persistent_volumes task. I0326 23:33:02.111197 1 tasks_processing.go:71] worker 44 working on validating_webhook_configurations task. I0326 23:33:02.111199 1 tasks_processing.go:71] worker 14 working on qemu_kubevirt_launcher_logs task. I0326 23:33:02.111205 1 tasks_processing.go:71] worker 40 working on image task. I0326 23:33:02.111209 1 tasks_processing.go:71] worker 39 working on image_registries task. I0326 23:33:02.111217 1 tasks_processing.go:71] worker 28 working on dvo_metrics task. I0326 23:33:02.111225 1 tasks_processing.go:71] worker 22 working on sap_datahubs task. I0326 23:33:02.111197 1 tasks_processing.go:71] worker 52 working on install_plans task. I0326 23:33:02.111192 1 tasks_processing.go:71] worker 5 working on container_runtime_configs task. I0326 23:33:02.111249 1 tasks_processing.go:71] worker 62 working on certificate_signing_requests task. I0326 23:33:02.111201 1 tasks_processing.go:71] worker 59 working on clusterroles task. I0326 23:33:02.111196 1 tasks_processing.go:71] worker 2 working on authentication task. I0326 23:33:02.111205 1 tasks_processing.go:71] worker 8 working on ceph_cluster task. I0326 23:33:02.111297 1 tasks_processing.go:71] worker 53 working on node_logs task. I0326 23:33:02.111304 1 tasks_processing.go:71] worker 60 working on jaegers task. I0326 23:33:02.111298 1 tasks_processing.go:71] worker 48 working on openstack_controlplanes task. I0326 23:33:02.111312 1 tasks_processing.go:71] worker 34 working on aggregated_monitoring_cr_names task. I0326 23:33:02.111315 1 tasks_processing.go:71] worker 35 working on machine_autoscalers task. I0326 23:33:02.111316 1 tasks_processing.go:71] worker 20 working on container_images task. I0326 23:33:02.111312 1 tasks_processing.go:71] worker 45 working on pod_network_connectivity_checks task. I0326 23:33:02.111325 1 tasks_processing.go:71] worker 10 working on networks task. I0326 23:33:02.111199 1 tasks_processing.go:71] worker 3 working on node_features task. I0326 23:33:02.111363 1 tasks_processing.go:71] worker 42 working on openstack_dataplanenodesets task. I0326 23:33:02.111419 1 tasks_processing.go:71] worker 15 working on support_secret task. I0326 23:33:02.111458 1 tasks_processing.go:71] worker 43 working on olm_operators task. I0326 23:33:02.111496 1 tasks_processing.go:71] worker 11 working on operators_pods_and_events task. I0326 23:33:02.111399 1 tasks_processing.go:71] worker 55 working on lokistack task. I0326 23:33:02.111689 1 gather_lokistack.go:58] Start LokiStack gathering I0326 23:33:02.111442 1 tasks_processing.go:71] worker 16 working on cost_management_metrics_configs task. I0326 23:33:02.111317 1 tasks_processing.go:71] worker 37 working on openstack_dataplanedeployments task. I0326 23:33:02.111312 1 tasks_processing.go:71] worker 19 working on crds task. I0326 23:33:02.111497 1 tasks_processing.go:71] worker 23 working on active_alerts task. I0326 23:33:02.111470 1 tasks_processing.go:71] worker 32 working on schedulers task. I0326 23:33:02.111305 1 tasks_processing.go:71] worker 61 working on nodes task. I0326 23:33:02.111192 1 tasks_processing.go:71] worker 41 working on openstack_version task. I0326 23:33:02.111313 1 tasks_processing.go:71] worker 25 working on sap_pods task. I0326 23:33:02.111414 1 tasks_processing.go:71] worker 31 working on oauths task. I0326 23:33:02.111447 1 tasks_processing.go:71] worker 63 working on ingress_certificates task. I0326 23:33:02.111451 1 tasks_processing.go:71] worker 17 working on storage_classes task. I0326 23:33:02.111475 1 tasks_processing.go:71] worker 51 working on overlapping_namespace_uids task. I0326 23:33:02.111476 1 tasks_processing.go:71] worker 9 working on machine_healthchecks task. I0326 23:33:02.111481 1 tasks_processing.go:71] worker 50 working on operators task. I0326 23:33:02.111484 1 tasks_processing.go:71] worker 27 working on nodenetworkconfigurationpolicies task. I0326 23:33:02.111485 1 tasks_processing.go:71] worker 18 working on cluster_apiserver task. I0326 23:33:02.111488 1 tasks_processing.go:71] worker 36 working on openshift_machine_api_events task. I0326 23:33:02.111491 1 tasks_processing.go:71] worker 33 working on storage_cluster task. I0326 23:33:02.111492 1 tasks_processing.go:71] worker 12 working on version task. I0326 23:33:02.111492 1 tasks_processing.go:71] worker 57 working on infrastructures task. I0326 23:33:02.111307 1 tasks_processing.go:71] worker 54 working on openshift_logging task. I0326 23:33:02.111497 1 tasks_processing.go:71] worker 46 working on sap_config task. I0326 23:33:02.111501 1 tasks_processing.go:71] worker 30 working on mutating_webhook_configurations task. I0326 23:33:02.111502 1 tasks_processing.go:71] worker 24 working on service_accounts task. I0326 23:33:02.111503 1 tasks_processing.go:71] worker 47 working on config_maps task. I0326 23:33:02.111504 1 tasks_processing.go:71] worker 38 working on machine_configs task. I0326 23:33:02.111511 1 tasks_processing.go:71] worker 49 working on machine_config_pools task. I0326 23:33:02.111510 1 tasks_processing.go:71] worker 26 working on image_pruners task. I0326 23:33:02.111514 1 tasks_processing.go:71] worker 21 working on nodenetworkstates task. I0326 23:33:02.111516 1 tasks_processing.go:71] worker 56 working on machines task. I0326 23:33:02.111522 1 tasks_processing.go:71] worker 58 working on tsdb_status task. I0326 23:33:02.111201 1 tasks_processing.go:71] worker 4 working on metrics task. I0326 23:33:02.117497 1 tasks_processing.go:71] worker 22 working on pdbs task. I0326 23:33:02.117509 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 6.257654ms to process 0 records E0326 23:33:02.126176 1 gather_node_features.go:86] GatherNodeFeatures: NodeFeatures resource not found in openshift-nfd namespace (may not be installed) I0326 23:33:02.126188 1 tasks_processing.go:71] worker 3 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0326 23:33:02.126204 1 gather.go:177] gatherer "clusterconfig" function "node_features" took 14.850579ms to process 0 records I0326 23:33:02.126229 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 14.88824ms to process 0 records I0326 23:33:02.126238 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 14.949672ms to process 0 records I0326 23:33:02.126241 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 14.109175ms to process 0 records I0326 23:33:02.126250 1 tasks_processing.go:74] worker 25 stopped. I0326 23:33:02.126255 1 tasks_processing.go:74] worker 8 stopped. I0326 23:33:02.126259 1 tasks_processing.go:74] worker 5 stopped. I0326 23:33:02.126620 1 tasks_processing.go:74] worker 48 stopped. I0326 23:33:02.126632 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 15.301355ms to process 0 records I0326 23:33:02.126637 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 13.55949ms to process 0 records I0326 23:33:02.126641 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 14.872244ms to process 0 records I0326 23:33:02.126646 1 tasks_processing.go:74] worker 16 stopped. I0326 23:33:02.126647 1 tasks_processing.go:74] worker 49 stopped. I0326 23:33:02.126694 1 tasks_processing.go:74] worker 37 stopped. I0326 23:33:02.126705 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 14.848851ms to process 0 records I0326 23:33:02.126833 1 tasks_processing.go:74] worker 60 stopped. I0326 23:33:02.126843 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 15.52204ms to process 0 records I0326 23:33:02.126938 1 tasks_processing.go:74] worker 2 stopped. I0326 23:33:02.127194 1 recorder.go:75] Recording config/authentication with fingerprint=d49995585907488965ad23a7bb23162452684fe3df8e368787f9c13b85382af0 I0326 23:33:02.127214 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 15.633285ms to process 1 records I0326 23:33:02.127292 1 tasks_processing.go:74] worker 10 stopped. I0326 23:33:02.127360 1 recorder.go:75] Recording config/network with fingerprint=b65b8b5da84be69c90d732582bddcc7dd5ace0e41e381656650aa5c5d944c248 I0326 23:33:02.127370 1 gather.go:177] gatherer "clusterconfig" function "networks" took 15.79023ms to process 1 records I0326 23:33:02.128925 1 tasks_processing.go:74] worker 36 stopped. I0326 23:33:02.128939 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 16.483941ms to process 0 records I0326 23:33:02.130233 1 tasks_processing.go:74] worker 62 stopped. I0326 23:33:02.130259 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 18.966763ms to process 0 records I0326 23:33:02.138767 1 tasks_processing.go:74] worker 15 stopped. E0326 23:33:02.138781 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0326 23:33:02.138788 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 27.305136ms to process 0 records I0326 23:33:02.138808 1 tasks_processing.go:74] worker 54 stopped. I0326 23:33:02.138818 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 26.140162ms to process 0 records I0326 23:33:02.138991 1 tasks_processing.go:74] worker 41 stopped. I0326 23:33:02.139008 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 26.925631ms to process 0 records I0326 23:33:02.139029 1 tasks_processing.go:74] worker 55 stopped. I0326 23:33:02.139056 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 27.394542ms to process 0 records E0326 23:33:02.139068 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0326 23:33:02.139074 1 gather.go:177] gatherer "clusterconfig" function "machines" took 25.687857ms to process 0 records I0326 23:33:02.139081 1 tasks_processing.go:74] worker 56 stopped. I0326 23:33:02.139186 1 tasks_processing.go:74] worker 29 stopped. I0326 23:33:02.139201 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 27.981976ms to process 0 records I0326 23:33:02.139242 1 tasks_processing.go:74] worker 53 stopped. I0326 23:33:02.139253 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 27.936883ms to process 0 records I0326 23:33:02.139375 1 tasks_processing.go:74] worker 7 stopped. I0326 23:33:02.139527 1 recorder.go:75] Recording config/ingress with fingerprint=fbff1c2e3032c559abada16edd487d4e9bf7517b134f11261058518bb9d85d62 I0326 23:33:02.139538 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 28.17618ms to process 1 records I0326 23:33:02.139623 1 tasks_processing.go:74] worker 31 stopped. I0326 23:33:02.139701 1 recorder.go:75] Recording config/oauth with fingerprint=c774ad4774525198cb1f238316280eabc4fcbbbd9c4b4ae966ad1e8d5fce79a1 I0326 23:33:02.139709 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 27.285616ms to process 1 records E0326 23:33:02.139717 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0326 23:33:02.139724 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 27.265849ms to process 0 records I0326 23:33:02.139767 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=1cf8338d2d9a8a93ea670b9896046981103feb81243ae69c2cb1e6f20bcb93f7 I0326 23:33:02.139775 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 27.624749ms to process 1 records I0326 23:33:02.139781 1 tasks_processing.go:74] worker 32 stopped. I0326 23:33:02.139787 1 tasks_processing.go:74] worker 9 stopped. I0326 23:33:02.140566 1 tasks_processing.go:74] worker 33 stopped. I0326 23:33:02.140578 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 28.021916ms to process 0 records I0326 23:33:02.140585 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 27.840942ms to process 0 records E0326 23:33:02.140592 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0326 23:33:02.140624 1 tasks_processing.go:74] worker 46 stopped. I0326 23:33:02.140648 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0326 23:33:02.140661 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 27.589441ms to process 1 records I0326 23:33:02.140667 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 29.311042ms to process 0 records I0326 23:33:02.140671 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 28.300102ms to process 0 records I0326 23:33:02.140709 1 tasks_processing.go:74] worker 27 stopped. I0326 23:33:02.140715 1 tasks_processing.go:74] worker 38 stopped. I0326 23:33:02.140710 1 tasks_processing.go:74] worker 35 stopped. I0326 23:33:02.140771 1 tasks_processing.go:74] worker 18 stopped. I0326 23:33:02.140797 1 recorder.go:75] Recording config/apiserver with fingerprint=7146b1fc1c3a39d78380e65f7f052945203ef40a90841999b09b2fc554f0a489 I0326 23:33:02.140805 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 28.226822ms to process 1 records I0326 23:33:02.140811 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 29.363026ms to process 0 records I0326 23:33:02.140816 1 tasks_processing.go:74] worker 42 stopped. I0326 23:33:02.140973 1 tasks_processing.go:74] worker 40 stopped. I0326 23:33:02.141063 1 recorder.go:75] Recording config/image with fingerprint=7415d1ba0db9ae5172959ee8c87eb9fe7ec0ea48d1784d9f3dd31ef8ad3cdaa6 I0326 23:33:02.141077 1 gather.go:177] gatherer "clusterconfig" function "image" took 29.761746ms to process 1 records I0326 23:33:02.141088 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 27.8467ms to process 0 records I0326 23:33:02.141095 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 30.023682ms to process 0 records I0326 23:33:02.141106 1 tasks_processing.go:74] worker 21 stopped. I0326 23:33:02.141119 1 tasks_processing.go:74] worker 13 stopped. I0326 23:33:02.141184 1 tasks_processing.go:74] worker 57 stopped. I0326 23:33:02.141619 1 recorder.go:75] Recording config/infrastructure with fingerprint=f6284f5f61125042d6daddff930f32c1b04f0edcce63743ece78678ec174c7a0 I0326 23:33:02.141635 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 28.433582ms to process 1 records I0326 23:33:02.141716 1 tasks_processing.go:74] worker 26 stopped. I0326 23:33:02.141797 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=e824c0255c3cf519a8347a91c11a837d4a8b2d9c279fe35fd73cf4074a44343d I0326 23:33:02.141804 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 27.920059ms to process 1 records I0326 23:33:02.141845 1 recorder.go:75] Recording config/proxy with fingerprint=cb254ebfbf771573a369f33dfda88aca76bdf27ef312a1f0d8854d420ef91a57 I0326 23:33:02.141852 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 30.036908ms to process 1 records I0326 23:33:02.141918 1 tasks_processing.go:74] worker 6 stopped. I0326 23:33:02.141987 1 tasks_processing.go:74] worker 39 stopped. I0326 23:33:02.142294 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=7c1a3539b4c35541350c69ad263d6f88a157fa35fd948354dfffda0d423d81ae I0326 23:33:02.142312 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 30.241954ms to process 1 records I0326 23:33:02.145297 1 gather_logs.go:145] no pods in namespace were found I0326 23:33:02.145312 1 tasks_processing.go:74] worker 14 stopped. I0326 23:33:02.145322 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 34.101732ms to process 0 records I0326 23:33:02.145374 1 tasks_processing.go:74] worker 17 stopped. I0326 23:33:02.145460 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=4397a0881ae6d6fdf301b79bfc5f653fd7370b937e7698ddead030f28fa0d353 I0326 23:33:02.145483 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=dc6f8c0e019342a5eb0f7ceac83f4cbc947b4fbcd6f59fa6c38e58b4b1d52032 I0326 23:33:02.145493 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 33.197235ms to process 2 records I0326 23:33:02.145559 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=592375bd60b21c1227e9142b5e6d080d001eef2701c5d3a5c91b9099077365de I0326 23:33:02.145578 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=254085c865b9d59d6fe63c7e477fad996c4a4e1f956d14faa4122dab0d18fd64 I0326 23:33:02.145584 1 tasks_processing.go:74] worker 22 stopped. I0326 23:33:02.145591 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=9cec56bfba4236573331ad942cc47a467b6f0191262c435b1608f7ebd31e5d1a I0326 23:33:02.145604 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=57b37f87396fc97b2728ba80f0979ef72c145748fa0b74594154a7b2e02f65d6 I0326 23:33:02.145621 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=dde1f93987d717ec1aaec36fdadd2cfa693332cb69c2b252f38482f0506a517c I0326 23:33:02.145634 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=d887e39ff597633eb3a61b611061a5c09a602990a9a3f126c85909c2dc4f5955 I0326 23:33:02.145647 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=692504e4fda2e657200bdf01eb6baa20d948bf8eda9a123fb8edc2b8032fc430 I0326 23:33:02.145661 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=53b5259ac2a3d0ca80f4cc5f8fa53c033d5b8565b36e9faa37f30ee3f1baa34a I0326 23:33:02.145675 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=64007bdf7e68cfb075e080d0c822a2aedf83364c00d51eaaf3bf9e33e81890ed I0326 23:33:02.145691 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=8dd070e5a5cbe32ba73b948342a3808baf4be54fc0a1d7220f6ca4e83dcdc3a6 I0326 23:33:02.145707 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=faa149d02c0fe896434478ade8edb616cac71a8013cfb0c965fbe3350f87d646 I0326 23:33:02.145714 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 27.875461ms to process 11 records I0326 23:33:02.145800 1 tasks_processing.go:74] worker 61 stopped. I0326 23:33:02.146023 1 recorder.go:75] Recording config/node/ip-10-0-0-167.ec2.internal with fingerprint=cbb8eefff43d373245f7c534b4f66ce7898b91a4fccfdd85ac8cbb79d0f01104 I0326 23:33:02.146081 1 recorder.go:75] Recording config/node/ip-10-0-1-99.ec2.internal with fingerprint=a9d2abab1add40a818ea968d6e071c50c26e4c2986c6c8e8c9fdc602300bad40 I0326 23:33:02.146134 1 recorder.go:75] Recording config/node/ip-10-0-2-103.ec2.internal with fingerprint=ee2bde126af1ce6d4576358084cc5f2cd1aacb33f8708dddd71f872a7d079c12 I0326 23:33:02.146142 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 33.341856ms to process 3 records I0326 23:33:02.146238 1 tasks_processing.go:74] worker 30 stopped. I0326 23:33:02.146297 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/annotation.operator.tekton.dev with fingerprint=242f013f477cf9b72d03fbc008c03f763ae0d8e25c176a243894b8168170b400 I0326 23:33:02.146345 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=9a8e78feabd9e193552541cd4cbbfc7ab52d243e8c17881fe89336b9d4edeee3 I0326 23:33:02.146366 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/cert-manager-webhook with fingerprint=00f4d695dd8cf4e6e58f47e9766d8f8324a8ee82fbce75ece5c893db68092f55 I0326 23:33:02.146398 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/integration-service-mutating-webhook-configuration with fingerprint=e5c971c6243870783a2a7106f38031f8eb1def1a2932a637ae19bc2fd50248b9 I0326 23:33:02.146419 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/proxy.operator.tekton.dev with fingerprint=883dab0cf75b6f9e917e8b2a35194168cb55b3cdf96d044d6c520390d25915c0 I0326 23:33:02.146502 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/release-service-mutating-webhook-configuration with fingerprint=3d14f5be9b223c9652c9504bcaf9f5f6c5230871e9e4d444dfe3505b4c997cea I0326 23:33:02.146544 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=a38c425c6d4a0fe13448dddd15977011f47c2b68030e01267237c9d419a9bc26 I0326 23:33:02.146586 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=215f910cd5f0ffe6b75f4226b8f18e04c77869870058250da164a42f3547a5e1 I0326 23:33:02.146638 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.operator.tekton.dev with fingerprint=fc957d867830b0a7443c7289fbd713bfe58c7c0e59d29492371e0f09256972eb I0326 23:33:02.146698 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.pipeline.tekton.dev with fingerprint=042b0304baefda8fe8ac0ed16d64762b636528e3b10b2a00fe17840a4ae1215b I0326 23:33:02.146738 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.triggers.tekton.dev with fingerprint=439d19feff466c56783e5a0695261fe98e9831d60cbe97d5b1f8d3b81c88f1c8 I0326 23:33:02.146745 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 32.632206ms to process 11 records I0326 23:33:02.146810 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=bbdbbbd542de99088e40dc22d042b7011184cd99c4990d38e456098fb80ba498 I0326 23:33:02.146820 1 tasks_processing.go:74] worker 44 stopped. I0326 23:33:02.146830 1 recorder.go:75] Recording config/validatingwebhookconfigurations/cert-manager-webhook with fingerprint=4acb598a32cc019b24dcbd8dbaf4374b340c57aa6e318cca8330928cac44ade6 I0326 23:33:02.146850 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.operator.tekton.dev with fingerprint=81f5138836be74c3c37c459277a34b9d990bacd6e89fa3a57c2a002151f24426 I0326 23:33:02.146865 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.pipeline.tekton.dev with fingerprint=90cae64ffb322c0bd90e2ac98a54a23476ce79cadaf6579ec84b3e49eb5bc444 I0326 23:33:02.146893 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.triggers.tekton.dev with fingerprint=5786550621d519dcc26e59543a0fce69919f7dce587cbad1e13c4c6de9ea0a53 I0326 23:33:02.146925 1 recorder.go:75] Recording config/validatingwebhookconfigurations/integration-service-validating-webhook-configuration with fingerprint=5d4c4dd9073f99d70764da1ddf76b9179be7109ea884249e4ca6a782ad009411 I0326 23:33:02.146953 1 recorder.go:75] Recording config/validatingwebhookconfigurations/monitoringconfigmaps.openshift.io with fingerprint=63e38b7231531eb2598a94b8050263e4b30a6e1b4013cb952ba7a37ba0da77fe I0326 23:33:02.146995 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=157613de775ec227d06fc85891d92e1097eda26f533e531216ab1d4611c408d2 I0326 23:33:02.147024 1 recorder.go:75] Recording config/validatingwebhookconfigurations/namespace.operator.tekton.dev with fingerprint=fe361c499daeb6dd23b315aa8a8e7a662a1e6b51e9b01dca9cafead1df800b97 I0326 23:33:02.147094 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=e4f140d2672a79ecff52d01070ef097611f7dbc19eceda14d862d91bf718a688 I0326 23:33:02.147099 1 gather_cluster_operator_pods_and_events.go:121] Found 0 pods with 0 containers I0326 23:33:02.147117 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=3c99701a5842f678f41de07287e0bf498aec13231b1880a9aef6ee1d3ecdb9db I0326 23:33:02.147136 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=c2b725796589b649f6538ac4cb3f30dc015a3996989f934e47dfe02cc46ed932 I0326 23:33:02.147186 1 recorder.go:75] Recording config/validatingwebhookconfigurations/release-service-validating-webhook-configuration with fingerprint=6ed1d1d681436e8e3e03b04c41fc874afcc68b9da819d21847331f981a923339 I0326 23:33:02.147210 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=ba981307c4815f3a10dc5f4bbce76fa7d1d57b81f9eaf3333e42d05b8474ad51 I0326 23:33:02.147241 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=df38de1ea8e8b636196b30d6da6d0d78089c911119d73b5d97324f08d1892d48 I0326 23:33:02.147293 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=d76b24726acb2acc5d6c987a0fd5a05f29f6b1573657ea12b2089d305d520bcf I0326 23:33:02.147328 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=a1124306239b994841247ff53bfae29a0299b8833eb1fc9886cb5831f93b25aa I0326 23:33:02.147375 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=4297c3d2ede7303b6d3c5627f392b55bac2d89eb6984f027c56348198f5abab3 I0326 23:33:02.147423 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=617ec78475d901ecf92356ce4b82e1d3e7b1468231a0cf953c5074cd2855d1fb I0326 23:33:02.147459 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=e13db6312db4e5b2416985ba34b3984b4814db1e7efa2bc0c4ddf1ebbc5544b4 I0326 23:33:02.147495 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=ed61a322076cec155c2fd8a10dd22c2b1ebad8681adfebf0c6a19aaca7da2dcb I0326 23:33:02.147528 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.pipelinesascode.tekton.dev with fingerprint=2e2042590a53c48f877f5603b40c5595ef641a82a7454d42b553de4a3e9a3340 I0326 23:33:02.147579 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.operator.tekton.dev with fingerprint=2d3da46c64a4c876c6d2528fb90e5419e81ed3e84365c03b8cce7265fca62024 I0326 23:33:02.147622 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.pipeline.tekton.dev with fingerprint=c73f46684ef4d6d7b600843811ed00ed2aa729032564d964a7a414dee3158632 I0326 23:33:02.147658 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.triggers.tekton.dev with fingerprint=dfb9f05701525a651de0e0510dae00b1a38aa661939b1ac3baab6fb80d68d778 I0326 23:33:02.147663 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 34.48727ms to process 25 records I0326 23:33:02.147748 1 tasks_processing.go:74] worker 1 stopped. I0326 23:33:02.147778 1 recorder.go:75] Recording config/featuregate with fingerprint=157444b3182332960bdda3eced23496f72d4f0807a61a19f5a636d25449cd7ef I0326 23:33:02.147792 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 36.016007ms to process 1 records I0326 23:33:02.147804 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 35.558531ms to process 0 records I0326 23:33:02.147812 1 tasks_processing.go:74] worker 11 stopped. I0326 23:33:02.148375 1 recorder.go:75] Recording config/podnetworkconnectivitychecks with fingerprint=44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a I0326 23:33:02.148401 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 36.967446ms to process 1 records I0326 23:33:02.148483 1 tasks_processing.go:74] worker 45 stopped. I0326 23:33:02.150174 1 tasks_processing.go:74] worker 12 stopped. I0326 23:33:02.150457 1 recorder.go:75] Recording config/version with fingerprint=164da04e67cf7bfd5fcdc6c312474239bc91aa3a950ce22f3e2a6f15ae20ae61 I0326 23:33:02.150477 1 recorder.go:75] Recording config/id with fingerprint=7c000abe07b2706ce17fd19ae730b59cfd2578d6fbef28707ac9cff8e3aa6153 I0326 23:33:02.150483 1 gather.go:177] gatherer "clusterconfig" function "version" took 37.568804ms to process 2 records I0326 23:33:02.150664 1 tasks_processing.go:74] worker 51 stopped. I0326 23:33:02.150689 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0326 23:33:02.150698 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 38.462549ms to process 1 records I0326 23:33:02.153312 1 tasks_processing.go:74] worker 59 stopped. I0326 23:33:02.153683 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=b72984389d809f0c2666a3d4381e4806621cc9fbf5c5f4979455c7a7ec3118ec I0326 23:33:02.153914 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=0b8061d250f4730b2fb6663894f5fca8fcb35f071fd04d01a1db56ce33301de2 I0326 23:33:02.153928 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 42.039135ms to process 2 records I0326 23:33:02.154013 1 tasks_processing.go:74] worker 19 stopped. I0326 23:33:02.154417 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=b0825d4a6bf24147045989f70c7aafb908168e7213140288ca583495bfd87e4a I0326 23:33:02.154641 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=0e3b35e25053266b1249237623bd2f3492ac1bacb7198c30f9e43b4a68c60a4e I0326 23:33:02.154655 1 gather.go:177] gatherer "clusterconfig" function "crds" took 41.382244ms to process 2 records I0326 23:33:02.158797 1 tasks_processing.go:74] worker 34 stopped. I0326 23:33:02.158812 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 47.471992ms to process 0 records I0326 23:33:02.181259 1 tasks_processing.go:74] worker 63 stopped. E0326 23:33:02.181293 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0326 23:33:02.181303 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2p9mp5cv8t0e1bpnh305hr8ld9shop2c-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2p9mp5cv8t0e1bpnh305hr8ld9shop2c-primary-cert-bundle-secret" not found I0326 23:33:02.181356 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=8620065dbfcf8cc41e546c504930f37ad4b49444cf1d8194abce7d1729798d58 I0326 23:33:02.181370 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 69.098947ms to process 1 records I0326 23:33:02.186075 1 tasks_processing.go:74] worker 47 stopped. E0326 23:33:02.186088 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0326 23:33:02.186095 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0326 23:33:02.186099 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0326 23:33:02.186108 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=7c953bef0cdbddb25a47a3c40772dfa7cbf73ae2ac9bb3dc97984dbf1bd43499 I0326 23:33:02.186143 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=d476c7d3f5b104863f08f481b1264dcc68cc272ecefb0ecb709b18a6afab034d I0326 23:33:02.186150 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0326 23:33:02.186154 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=4bec6f0bfa45f0ccf5709371166150dcb9cf2703d04f5f6de4476d0277c477a6 I0326 23:33:02.186164 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0326 23:33:02.186201 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0326 23:33:02.186209 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0326 23:33:02.186215 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 73.187409ms to process 7 records I0326 23:33:02.194956 1 tasks_processing.go:74] worker 3 stopped. I0326 23:33:02.194971 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 68.755674ms to process 0 records I0326 23:33:02.202050 1 tasks_processing.go:74] worker 20 stopped. I0326 23:33:02.204254 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-8777bd9bb-wj8cq with fingerprint=99e0743b0b34f6edb35afcf2af4a489f6702dd3d87df2319eb4ff0750bc71ee1 I0326 23:33:02.204777 1 recorder.go:75] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-5zdwv with fingerprint=a946f10a611af54ecdfa5844e39403c980357217a190d3c7dcc512aeceeed1de I0326 23:33:02.204983 1 recorder.go:75] Recording config/running_containers with fingerprint=55cc24454e11c6e853400c939c8b1b11e44e0fdf223e90ff90d4c1be38ecf542 I0326 23:33:02.204996 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 90.716037ms to process 3 records I0326 23:33:02.219057 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0326 23:33:02.223690 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0326 23:33:02.239947 1 tasks_processing.go:74] worker 43 stopped. I0326 23:33:02.240119 1 recorder.go:75] Recording config/olm_operators with fingerprint=1917ee60478059cfd5c2d50ee99dd8ef3895aaa641b1f80d55631bae720ace5d I0326 23:33:02.240135 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 128.439767ms to process 1 records I0326 23:33:03.163917 1 tasks_processing.go:74] worker 0 stopped. I0326 23:33:03.163937 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0326 23:33:03.163950 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.052775137s to process 1 records I0326 23:33:03.164380 1 tasks_processing.go:74] worker 23 stopped. I0326 23:33:03.164429 1 recorder.go:75] Recording config/alerts with fingerprint=93f826e88e5b34b8ff405f3cc2468453700031191fefea06702267bc4bb6dfb0 I0326 23:33:03.164444 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.052382625s to process 1 records I0326 23:33:03.171880 1 tasks_processing.go:74] worker 4 stopped. I0326 23:33:03.171945 1 recorder.go:75] Recording config/metrics with fingerprint=dfecaaaa9f0e01a82e4c9928945299b1cfa3141e6ae2020f329e74a2160d6705 I0326 23:33:03.171955 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.058399005s to process 1 records I0326 23:33:03.176906 1 tasks_processing.go:74] worker 58 stopped. I0326 23:33:03.176927 1 recorder.go:75] Recording config/tsdb.json with fingerprint=6f3832d5633b375d05ad0e1c3fa4de25f88ac09b9ee1a93d1bb47125f9094a80 I0326 23:33:03.176936 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.063462797s to process 1 records I0326 23:33:03.584858 1 tasks_processing.go:74] worker 28 stopped. I0326 23:33:03.585109 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=bb5aa24f83bf574c449570190de01735e6b0f05d33015760fd7cad6d43752e4e I0326 23:33:03.585123 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 1.473620464s to process 1 records I0326 23:33:04.574181 1 tasks_processing.go:74] worker 50 stopped. I0326 23:33:04.574259 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=fa73f176f200cbbc671e88dfa1864bd94c3d5d9032e9cd1f1cdd8afdd165bfe2 I0326 23:33:04.574332 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0326 23:33:04.574368 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=2583c1e6c8dfc14cb27dd1bbb09423f3e855961d52c46d65309e31cf47e20db2 I0326 23:33:04.574379 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0326 23:33:04.574400 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=54ff14243e5ef36fe0fe3807bd30df2f6cd42d531b05bdb7028ee4c472a6b0a3 I0326 23:33:04.574417 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0326 23:33:04.574440 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=080cd51ca042997d6a224ce9854a255ec64aeae174536736a23ac04e032f4bd7 I0326 23:33:04.574467 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=f62d4d4b880605219d886ec7eb5f757599f851e6464589785eaa667f88991675 I0326 23:33:04.574491 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=e735d097decb34b8c2f0cf776439b9b7a75440f128e21a0a90f1f43a1eeba4b5 I0326 23:33:04.574521 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=123159173877e095e15022127da48af03754e0a1f2fad2bfaab4d6f6813123cf I0326 23:33:04.574866 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=02c0c7ba0a445ef545648fa08f8b168310a52368a6574499c0c1e27a57d9c028 I0326 23:33:04.574891 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=6e51b080958ad54b784b951f59396f66a6f3d5d154b8dbe1ce570d9ec9eb1b9a I0326 23:33:04.574902 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0326 23:33:04.574919 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=555915db62f4bae0f2eda9b293c5396cabfb2cceec565127afc6fa59a94dd27b I0326 23:33:04.574929 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0326 23:33:04.574945 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=479dc296faf7773c70c61ce002b1b070083ede24facc1ea2f053e365c8de8ccd I0326 23:33:04.574953 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0326 23:33:04.574972 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=f4ee226d17f8813654691690157d6f78bc4879edc53d2c9cf7824c44a674e774 I0326 23:33:04.574983 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0326 23:33:04.575007 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=446dbaf46ff64d2e381064d6de5ad4132b99562623cee290053751513b1a5ffa I0326 23:33:04.575118 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=9b65c075a890db51da9c246429a1c0f943326a10fb4771d96a4efe55660509bc I0326 23:33:04.575128 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0326 23:33:04.575136 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0326 23:33:04.575192 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0326 23:33:04.575216 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=034e69b432a03da1cc7c1f1d94a4cebe1241540ea3de4ea3adc2a1febb904204 I0326 23:33:04.575240 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=cabd0aba582eccfbb0d8875cfdcfdb63b940c68419bff73cee88882f9f05f20d I0326 23:33:04.575251 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0326 23:33:04.575282 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=b8e86c7b7495a6abb3366d613f1aa4473edfe9fae5261aee7d7289a461d2b23b I0326 23:33:04.575293 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0326 23:33:04.575310 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=0e2a521a630cbae1bb7816f1cf65329a5d69361e27f57f07fa9eae03d4b30527 I0326 23:33:04.575320 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0326 23:33:04.575333 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=103606b11cd7144b9703cc4ca23d520654542e7fc55112ce0cdcc688be2d9e69 I0326 23:33:04.575346 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=f1d49a4df8b3c52103562e59d77444e9481da83636e95fe3edc4a78c0ea027f7 I0326 23:33:04.575359 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=de1b29dfb6e6e6e429ee38cbbe0b7356ad0a44f94cd723e3440675fb60e334f0 I0326 23:33:04.575382 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=f456ff87ebc485249bbf9102a5d4f6b93bee21ea28ae43803d1f27ef439e5eea I0326 23:33:04.575392 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0326 23:33:04.575420 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=c56bede25dddfa0b47ac30a69b0924bef63754d3260728ebbe966d67264b242a I0326 23:33:04.575438 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0326 23:33:04.575444 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0326 23:33:04.575452 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.461863851s to process 39 records I0326 23:33:15.157257 1 tasks_processing.go:74] worker 52 stopped. I0326 23:33:15.157328 1 recorder.go:75] Recording config/installplans with fingerprint=a141caf3b7ccce0ed9177a6b544856caea4879e2efb66c12f2429c93dca00dbb I0326 23:33:15.157341 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.045998154s to process 1 records I0326 23:33:15.919065 1 tasks_processing.go:74] worker 24 stopped. I0326 23:33:15.919401 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=74b727b232cc45b882d26cb89407f543533046358d1731eed12d9232af57da52 I0326 23:33:15.919421 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.806193703s to process 1 records E0326 23:33:15.919479 1 periodic.go:254] "Unhandled Error" err="clusterconfig failed after 13.808s with: function \"support_secret\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machine_configs\" failed with an error, function \"ingress_certificates\" failed with an error, function \"config_maps\" failed with an error" I0326 23:33:15.920585 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "support_secret" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "ingress_certificates" failed with an error, function "config_maps" failed with an error I0326 23:33:15.920601 1 periodic.go:216] Running workloads gatherer I0326 23:33:15.920617 1 tasks_processing.go:45] number of workers: 2 I0326 23:33:15.920626 1 tasks_processing.go:69] worker 1 listening for tasks. I0326 23:33:15.920630 1 tasks_processing.go:71] worker 1 working on workload_info task. I0326 23:33:15.920643 1 tasks_processing.go:69] worker 0 listening for tasks. I0326 23:33:15.920666 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0326 23:33:15.927650 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-167.ec2.internal... I0326 23:33:15.927659 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-103.ec2.internal... I0326 23:33:15.927672 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-99.ec2.internal... I0326 23:33:15.943088 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak. I0326 23:33:15.943101 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-keycloak from keycloak-pgsql. I0326 23:33:15.943107 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from server. I0326 23:33:15.943111 1 gather_helm_info.go:102] unable to get HelmChart from services on tsf-tpa from tpa-pgsql. I0326 23:33:15.951708 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-keycloak from keycloak-pgsql-bee. I0326 23:33:15.951721 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from importer. I0326 23:33:15.951726 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from server. I0326 23:33:15.951730 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tsf-tpa from tpa-pgsql-bee. I0326 23:33:15.951739 1 tasks_processing.go:74] worker 0 stopped. I0326 23:33:15.951747 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 31.062601ms to process 0 records I0326 23:33:23.307238 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 7s I0326 23:33:23.352323 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 31s for image data I0326 23:33:23.359740 1 gather_workloads_info.go:387] No image sha256:00fa6a8075723e279b420c76d13105c1650b1d46db51c7018801c558c0a876c6 (9ms) I0326 23:33:23.367762 1 gather_workloads_info.go:387] No image sha256:a18b7658b5cf078bcef30a1c752c42c46907714b589145c7c330cf7ba7db2715 (8ms) I0326 23:33:23.375439 1 gather_workloads_info.go:387] No image sha256:09c857f0c20721d6b447f5f567182befc1ca6157128225849117a5c830feab23 (8ms) I0326 23:33:23.383008 1 gather_workloads_info.go:387] No image sha256:57a1aea49d7cc275b37b8f52d602a3a9d1601ec6a21a3268dd4903566cb2e335 (8ms) I0326 23:33:23.390804 1 gather_workloads_info.go:387] No image sha256:12aec97ddeb527881acf5949bea2b227baa1dbfccf30679e8d57ff0b82e42707 (8ms) I0326 23:33:23.398475 1 gather_workloads_info.go:387] No image sha256:07789f6e6e3c3a5a974c106b43c2e8bc60edb3321def1f0883f3fcd35a238ed0 (8ms) I0326 23:33:23.407286 1 gather_workloads_info.go:387] No image sha256:1ca6fa787c621462fa2c67b9a42b1de67688883af90316475b0df35be3ed805d (9ms) I0326 23:33:23.416429 1 gather_workloads_info.go:387] No image sha256:72f9394f6f1b36ca9eb80961eac8f196e81f215632d14375845fbbe5970f0701 (9ms) I0326 23:33:23.424750 1 gather_workloads_info.go:387] No image sha256:1ad039a130515504a258952cb18e67c3329da5182bb0623cc0891e6c15e2113a (8ms) I0326 23:33:23.432360 1 gather_workloads_info.go:387] No image sha256:14e983ca10e1033822e1c4be0a1e4a40762951a5d6e4a77bf642891f291d32ae (8ms) I0326 23:33:23.459852 1 gather_workloads_info.go:387] No image sha256:3c674490453d5fb3d655b15874d33fa5e8ba6b33fad9ea2954b143c896f98516 (27ms) I0326 23:33:23.559456 1 gather_workloads_info.go:387] No image sha256:28652c74c16faf130ea3734cb2c7961830f11681b73567360780fe7bb0f94f84 (100ms) I0326 23:33:23.659878 1 gather_workloads_info.go:387] No image sha256:3739c0c55f7f7ccc84309ae11eb23d3d9e5ad50a68e849a8a8dfda7f2f2bc137 (100ms) I0326 23:33:23.759449 1 gather_workloads_info.go:387] No image sha256:20a3e59566dd25058fff22e18569067fe6a12d8ac5ac62fa6508e0cee44d7897 (100ms) I0326 23:33:23.860025 1 gather_workloads_info.go:387] No image sha256:8f72efd51f564d8d3e4ecee6555d7bd5394d0776054d2112febea6b7c9e71225 (101ms) I0326 23:33:23.962918 1 gather_workloads_info.go:387] No image sha256:c15ca0c0ad60fe8757c2d5d1723fcdd7a1ed6c0251a90d22a7e6cae6811d01aa (103ms) I0326 23:33:24.059955 1 gather_workloads_info.go:387] No image sha256:2ade6dfb5406ef3a4264dea95d455298f54e8ef4d458d9ee3e94c33d48676a9b (97ms) I0326 23:33:24.159797 1 gather_workloads_info.go:387] No image sha256:b336f6e44314dd23a21236118a604411522baf5e63732463f1d08daccb417f39 (100ms) I0326 23:33:24.259847 1 gather_workloads_info.go:387] No image sha256:aa65d1c7fb8805b767fc4878faea280472f372010efadc66e5641a2e634a80c0 (100ms) I0326 23:33:24.363011 1 gather_workloads_info.go:387] No image sha256:5b51a4d9d3b7ecad110fb6eb00f71e9e9b854067d79b220df397a58d9fa50eb0 (103ms) I0326 23:33:24.461052 1 gather_workloads_info.go:387] No image sha256:3e8d51b4b12d970bf561f67d0fcd9c0966a6d49866e6466daa341ee43d95d6e2 (98ms) I0326 23:33:24.560110 1 gather_workloads_info.go:387] No image sha256:43efa5a676666dd4ae039ad5518eaf636f5baf8d688d9a4b475822c32ad1ddfb (99ms) I0326 23:33:24.660553 1 gather_workloads_info.go:387] No image sha256:0fd69333c121efd68919e731cd3ea01e976e00415bda6e987bf1e949ec224eda (100ms) I0326 23:33:24.761415 1 gather_workloads_info.go:387] No image sha256:38d71a4cf177f39a2bbe745183009943dbbf404de02aa5f879694aa024a4e6ac (101ms) I0326 23:33:24.861213 1 gather_workloads_info.go:387] No image sha256:1e9a9f1b5ecdab7d074722c860daab977519123fe4385affdfd86d8c7f3c473c (100ms) I0326 23:33:24.961935 1 gather_workloads_info.go:387] No image sha256:66640a3f7bd65090345552611701a73e74bc44897b9d29e43b11f73b96598ac0 (101ms) I0326 23:33:25.060813 1 gather_workloads_info.go:387] No image sha256:7e0a58aad44d5b09954f8261e3e428c8dfa076eb9c2b6ef46a91d27ac78ac17a (99ms) I0326 23:33:25.161995 1 gather_workloads_info.go:387] No image sha256:4dcd0b18dea61968f20d49c4372eec43689eb52e823e1a6293e9b89c6e21e587 (101ms) I0326 23:33:25.260037 1 gather_workloads_info.go:387] No image sha256:cc686a64f9ae83adecc7a0ffe8a6b82f0750dc39ad05654a8087cf780a1c3b3a (98ms) I0326 23:33:25.360982 1 gather_workloads_info.go:387] No image sha256:b9b5787a7009dd7bc1589bf5a08a51e05cbdef674ed9c43bb3c9ffcb4b70c81e (101ms) I0326 23:33:25.460355 1 gather_workloads_info.go:387] No image sha256:3da5a449ace61cb7d002d8e7911c14905c74cf58a296527458d1af0f1abf0a72 (99ms) I0326 23:33:25.560169 1 gather_workloads_info.go:387] No image sha256:d88f384ee9cf4475b16d9589e88b28c9f2407247fbedfa3d9bfcaed95753514e (100ms) I0326 23:33:25.660081 1 gather_workloads_info.go:387] No image sha256:4e62a2dcb8214491388d4c17f89fe699eb53cdb8039dcba6ab052edc28da3fbd (100ms) I0326 23:33:25.760395 1 gather_workloads_info.go:387] No image sha256:917de30c85816179b3f8db32b8c94bfed2a54adc65b1a8be7ea73e245fa88b55 (100ms) I0326 23:33:25.866540 1 gather_workloads_info.go:387] No image sha256:24929612f2f0f2d4cd3ac163c04bbf4ac64cc47d3d0eef81db085d00c59058bd (106ms) I0326 23:33:25.959852 1 gather_workloads_info.go:387] No image sha256:ada1a963ce2c45d2bba08051c1e0e2db88b200e9d616fab8fde10b698101fc69 (93ms) I0326 23:33:26.059574 1 gather_workloads_info.go:387] No image sha256:0d70224d12e358b1a107a86e0a7e0845e1e8a4d30ce3a1423600f044e3fb28d2 (100ms) I0326 23:33:26.160030 1 gather_workloads_info.go:387] No image sha256:c59765325e6f286c067e555850b0d81f2de5e5ee8625ed83cdc2cea96f3a7ddb (100ms) I0326 23:33:26.260149 1 gather_workloads_info.go:387] No image sha256:5f852f6127d27e6fc071afe58d80024370467cb2476f4d9f077f8ebca8600918 (100ms) I0326 23:33:26.361751 1 gather_workloads_info.go:387] No image sha256:315260877c58d13e0511bbff7bdcc389bcd86deca48785023e28194b08c4c924 (102ms) I0326 23:33:26.460070 1 gather_workloads_info.go:387] No image sha256:12448aad6e9050c2b2445035be818a490cef502d39b73dbd51cc0f5ea7d67d40 (98ms) I0326 23:33:26.560127 1 gather_workloads_info.go:387] No image sha256:d71caff0f67fe8d9665d39193d955fc9352224f647406a40e56428dd6cd24953 (100ms) I0326 23:33:26.659794 1 gather_workloads_info.go:387] No image sha256:ad0e262327997e8cdc4074a2373e67274d9b8a943aa274a2cd8ce98ffe1db4a0 (100ms) I0326 23:33:26.761781 1 gather_workloads_info.go:387] No image sha256:2c4ec0dfd62375ed45d5758798b1069e16a0a6d1986439d23c61591c4dfb9297 (102ms) I0326 23:33:26.863666 1 gather_workloads_info.go:387] No image sha256:3f586d6fd6139bbad131716168590b12db0cdfe4dcbb15ccee65b080d5594b6e (102ms) I0326 23:33:26.959875 1 gather_workloads_info.go:387] No image sha256:1f4a37529de4f750099af18e113556bd995fe6922030c614b7d6d23eaa0bd318 (96ms) I0326 23:33:27.060086 1 gather_workloads_info.go:387] No image sha256:6ca4eb17da6277b142a3353b675d735c106868f827243eaef70cd1ec01d36307 (100ms) I0326 23:33:27.159372 1 gather_workloads_info.go:387] No image sha256:6d83c7e0e068178360998c815a3e0c729ca80a349954172aadafad5da5180d0c (99ms) I0326 23:33:27.259131 1 gather_workloads_info.go:387] No image sha256:27f3be442cf1d9f640657fb6d7cea6b133652226f9a80c3442df226b3cb3c2dc (100ms) I0326 23:33:27.359616 1 gather_workloads_info.go:387] No image sha256:1b58ba57c10e2ba03a0d8dba1f3f8faa866e1dca6170725b6909c2cc2b96efa6 (100ms) I0326 23:33:27.461757 1 gather_workloads_info.go:387] No image sha256:64dbe77583c8b23dc6852fc482ea5b4081490734944ec8b765d5450b3fdb30ed (102ms) I0326 23:33:27.559537 1 gather_workloads_info.go:387] No image sha256:cfcb0bd30c537e677ac6856c36c0c923b415f24d944c7aa1386489f511f6491d (98ms) I0326 23:33:27.659481 1 gather_workloads_info.go:387] No image sha256:6263faa8ef7759ec21f26df08314c5d64e52d967b49961cb9404c54532c03365 (100ms) I0326 23:33:27.759429 1 gather_workloads_info.go:387] No image sha256:f02c58838bf882d9b5d82a1a96e8ab29ce6033ae1b64418118fba43eb9151b41 (100ms) I0326 23:33:27.860037 1 gather_workloads_info.go:387] No image sha256:1e6d59867cbd750672bc9ccfb9c69c3d198174cd43dd6d71a0da358b4b766473 (101ms) I0326 23:33:27.960417 1 gather_workloads_info.go:387] No image sha256:6a0d1f472283c686e438dbfbeec826db9d7d95f45f92842c4073f70704860d2f (100ms) I0326 23:33:28.061035 1 gather_workloads_info.go:387] No image sha256:503831414ca09befa276fdffd836708f04d2d430b1fd428cb3b0e3cd5bd74eb3 (101ms) I0326 23:33:28.164198 1 gather_workloads_info.go:387] No image sha256:120485f6d677cfeaae0509169f46df14f3ebfafd87b3d876dfa59b738f846c77 (103ms) I0326 23:33:28.260355 1 gather_workloads_info.go:387] No image sha256:8ef614441b76914f5727f5bec23a9d8dc2785ca7fd6a2516f393529b7801da53 (96ms) I0326 23:33:28.360258 1 gather_workloads_info.go:387] No image sha256:9db50052057ad4ec94099bc3c9ab476f5ac7b00954c99cb0b26fe729abba3387 (100ms) I0326 23:33:28.460249 1 gather_workloads_info.go:387] No image sha256:4f86f5c692a497442b54c435e68b0cbf961591a00ebc3a73c364a19da673e34d (100ms) I0326 23:33:28.559609 1 gather_workloads_info.go:387] No image sha256:d339ecf788d1681ba9945a2ea63ca675caec863ec75f497ef916103f4c898003 (99ms) I0326 23:33:28.659209 1 gather_workloads_info.go:387] No image sha256:5ffaf92fc557cb891a546ae2682d4e0259166ad6d935970dc958d255abc29a48 (100ms) I0326 23:33:28.760061 1 gather_workloads_info.go:387] No image sha256:54440fa6cb1b01a6b8952f700677832d7b7d3b1b58934957f504ca885730844a (101ms) I0326 23:33:28.859908 1 gather_workloads_info.go:387] No image sha256:87de118dc29ca1b47d4768ec5ed4441bc1dada3fb2a78d53b1833249baa86dd4 (100ms) I0326 23:33:28.960171 1 gather_workloads_info.go:387] No image sha256:e4bb09dfe4513cdbe349507495c7f4044623a3c2aff866b7946d941e82a7a639 (100ms) I0326 23:33:29.059561 1 gather_workloads_info.go:387] No image sha256:865dd51e80034018400794d07edc0b546c6e4de7e2351dddc7f1f6378e1ffdd0 (99ms) I0326 23:33:29.159828 1 gather_workloads_info.go:387] No image sha256:4c39dc633bf3560c2397281b74faf9d00500b0738dec6c1aad2cc8ce326be6fc (100ms) I0326 23:33:29.260095 1 gather_workloads_info.go:387] No image sha256:31e175b644c6627779ca6b9f48d9426760dd449788ad671dd0277cce8fb822e8 (100ms) I0326 23:33:29.360266 1 gather_workloads_info.go:387] No image sha256:2ba73aa991da589b1ee1fa6903abcdd56387007f3d650d345fbc8458bc2baeac (100ms) I0326 23:33:29.460259 1 gather_workloads_info.go:387] No image sha256:46e034f706fdcd5f84f35a1250a064495f5f68c90fef13be9c01936904b07ed6 (100ms) I0326 23:33:29.560617 1 gather_workloads_info.go:387] No image sha256:b8d380990acb0184ab685b005e22fb8369139dd8cd6550b4521bd4bc3ca23b40 (100ms) I0326 23:33:29.660196 1 gather_workloads_info.go:398] Found image sha256:1c5b548d67e5c56e3297b2f8aa34428e544b5b5ac88bd8d0f465760375c501e6 (100ms) I0326 23:33:29.759606 1 gather_workloads_info.go:387] No image sha256:92a731e25801365be0ad0916bec5bf24b2035e443ad1414a1631d1e0473ddf77 (99ms) I0326 23:33:29.859250 1 gather_workloads_info.go:387] No image sha256:ce98d5d844bfc2ba8de1893866ad38166c95157d54abd8192b181e819bc50bb5 (100ms) I0326 23:33:29.962496 1 gather_workloads_info.go:387] No image sha256:2f6f91dfd7b71cad1c6db82835d709d20f4153cf500d60ee32145712af922214 (103ms) I0326 23:33:30.059999 1 gather_workloads_info.go:387] No image sha256:050fe6fe1298c45a27982e3f4d0afe637ce01d9b394e85b7eb202309ecdd0731 (97ms) I0326 23:33:30.160638 1 gather_workloads_info.go:387] No image sha256:e476b4dafff885727b0057259c9df67a68e196f8cd92c21db2e4efe84a5f7a25 (101ms) I0326 23:33:30.259616 1 gather_workloads_info.go:387] No image sha256:185a95b130b6a27ad88fcf39803215b7bd998472b1e37225858435f4eb7c3c04 (99ms) I0326 23:33:30.362175 1 gather_workloads_info.go:387] No image sha256:72ae38682f25786aec18625cfed5d7831017d2f0f1304c3320c00ce0b7fb09c1 (103ms) I0326 23:33:30.460386 1 gather_workloads_info.go:387] No image sha256:44ceafe5147680d58a5c2d3720932b972e6bc9639faadc19aa6b360af154e1a3 (98ms) I0326 23:33:30.562965 1 gather_workloads_info.go:387] No image sha256:2e3661304917ce7f3be49974faacc60c24cbe2833d7b50c8c205c2f3f2467950 (103ms) I0326 23:33:30.661031 1 gather_workloads_info.go:387] No image sha256:5bd409efe77c6a126418be2c098dde9431c1a290cec885a7e37c0c8ddc2337a8 (98ms) I0326 23:33:30.760194 1 gather_workloads_info.go:387] No image sha256:2a07c1b2ef06bbfa3a491b84f7410e24de7cb487f49bbbb3bfd7cb3510c8429a (99ms) I0326 23:33:30.860427 1 gather_workloads_info.go:387] No image sha256:a6b085cdad58db8529d99c22ec1ec79fe09ab00ab1c92ee38b29e7875dc0533c (100ms) I0326 23:33:30.963521 1 gather_workloads_info.go:387] No image sha256:51e1b5dc9fccbee5b7df78d0e8bbe379f75529232c102c9ed5b1ae134c4b9b4c (103ms) I0326 23:33:31.059890 1 gather_workloads_info.go:387] No image sha256:0e5fa2595714628c16cf590efd28715bde790d2dc6b3a793b2a38dfb3ffb591a (96ms) I0326 23:33:31.160537 1 gather_workloads_info.go:398] Found image sha256:70dcc3c7d3a572ecacc7c838fd17d07ff21531e50a7ed9227a17c27437151bf4 (101ms) I0326 23:33:31.259941 1 gather_workloads_info.go:387] No image sha256:95801a943ba7d0ec4af53c3cd1177483e649bcd528b5a838a32ad2d860e6503a (99ms) I0326 23:33:31.361073 1 gather_workloads_info.go:387] No image sha256:6ea0f19030ffc52a290e6eeb812ef2426c48a2f1083b1e415e0667998cbb7bf2 (101ms) I0326 23:33:31.460405 1 gather_workloads_info.go:387] No image sha256:384e639f2ce3e75712a5ee1cc5520161342e9dd1e94444d134d7ad4a39dde279 (99ms) I0326 23:33:31.560878 1 gather_workloads_info.go:387] No image sha256:273930332d7b481bbca4521cf740507498a2a323a4010cd66e896806b299f85e (100ms) I0326 23:33:31.660398 1 gather_workloads_info.go:387] No image sha256:2f26472542da4f89a2ac34a93fd438d385419dda16811bdfa7e679e0115abe56 (100ms) I0326 23:33:31.760871 1 gather_workloads_info.go:387] No image sha256:199df7c847c51c89b38ec42c4ac2b68156e1b24c02b60a01cfdfcbad6ea43489 (100ms) I0326 23:33:31.860334 1 gather_workloads_info.go:387] No image sha256:07a6c0a310270b830b96fcb8fca9cd11e45569276335bb5334b18b388d6eed51 (99ms) I0326 23:33:31.960939 1 gather_workloads_info.go:387] No image sha256:373050d2ded02b5acd0e5edf3ef9819fe65403b2f40b557e9077e4a57629cb97 (101ms) I0326 23:33:32.063182 1 gather_workloads_info.go:387] No image sha256:3b9f60077c475f2baad0dd51ffc9d469f3a9b54c474bb86a35f93cb9b8fdc734 (102ms) I0326 23:33:32.160520 1 gather_workloads_info.go:387] No image sha256:61aeb8693f27b60dd35e3dd1961d14bd95988cae70d649b340045619e5de7acf (97ms) I0326 23:33:32.259898 1 gather_workloads_info.go:387] No image sha256:59b844637eca688cc22c7841bc4480a26d1384444bf9b0161261a182f87a1262 (99ms) I0326 23:33:32.360080 1 gather_workloads_info.go:387] No image sha256:04156cd38c436fb6692930d18af59619b0669b2d80cd3590d0973c0e038c5d6d (100ms) I0326 23:33:32.360120 1 tasks_processing.go:74] worker 1 stopped. I0326 23:33:32.360557 1 recorder.go:75] Recording config/workload_info with fingerprint=03fb2bff954cd061f5528163e926231f66790cdeb57c272173d03734e05cac5d I0326 23:33:32.360575 1 gather.go:177] gatherer "workloads" function "workload_info" took 16.439481708s to process 1 records I0326 23:33:32.360590 1 periodic.go:263] Periodic gather workloads completed in 16.439s I0326 23:33:32.360598 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0326 23:33:32.360603 1 periodic.go:216] Running conditional gatherer I0326 23:33:32.366574 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.21.6/gathering_rules I0326 23:33:32.515166 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer I0326 23:33:32.516673 1 conditional_gatherer.go:374] alert "Watchdog" has state "firing" I0326 23:33:32.516686 1 conditional_gatherer.go:374] alert "AlertmanagerReceiversNotConfigured" has state "firing" I0326 23:33:32.516745 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0326 23:33:32.522853 1 conditional_gatherer.go:392] cluster version is '4.21.6' I0326 23:33:32.522877 1 tasks_processing.go:45] number of workers: 3 I0326 23:33:32.522888 1 tasks_processing.go:69] worker 2 listening for tasks. I0326 23:33:32.522892 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0326 23:33:32.522902 1 tasks_processing.go:69] worker 0 listening for tasks. I0326 23:33:32.522916 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0326 23:33:32.522915 1 tasks_processing.go:69] worker 1 listening for tasks. I0326 23:33:32.522922 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0326 23:33:32.522926 1 tasks_processing.go:74] worker 1 stopped. I0326 23:33:32.522967 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0326 23:33:32.522980 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.188µs to process 1 records I0326 23:33:32.523019 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0326 23:33:32.523027 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.171µs to process 1 records I0326 23:33:32.523032 1 tasks_processing.go:74] worker 0 stopped. I0326 23:33:32.523166 1 tasks_processing.go:74] worker 2 stopped. I0326 23:33:32.523179 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 238.466µs to process 0 records I0326 23:33:32.523195 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0326 23:33:32.523211 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0326 23:33:32.551237 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=6910aee5d6d4c77efcb7e7db9b2d37642494b6df5a2ae6a9b0a7492e200c8e23 I0326 23:33:32.551379 1 diskrecorder.go:70] Writing 135 records to /var/lib/insights-operator/insights-2026-03-26-233332.tar.gz I0326 23:33:32.561101 1 diskrecorder.go:51] Wrote 135 records to disk in 9ms I0326 23:33:32.561130 1 periodic.go:285] Gathering cluster info every 2h0m0s I0326 23:33:32.561144 1 periodic.go:286] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0326 23:34:19.250007 1 controller.go:554] The operator is healthy I0326 23:34:32.110179 1 diskrecorder.go:223] Found files to send: insights-2026-03-26-233332.tar.gz I0326 23:34:32.110211 1 insightsuploader.go:150] Checking archives to upload periodically every 16m2.704995971s I0326 23:34:32.110219 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0326 23:34:32.121502 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0326 23:34:32.283292 1 requests.go:87] Successfully reported id=2026-03-26T23:34:32Z x-rh-insights-request-id=e89a4a85bdff4f81a155b285a1472c22, wrote=72156 I0326 23:34:32.283349 1 insightsuploader.go:187] Uploaded report successfully in 173.12357ms I0326 23:34:32.283373 1 controller.go:129] Initializing last reported time to 2026-03-26T23:34:32Z I0326 23:34:32.283425 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0326 23:34:32.283435 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0326 23:34:32.283443 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0326 23:34:32.289391 1 controller.go:554] The operator is healthy I0326 23:35:35.999622 1 insightsreport.go:137] Pulling report from smart-proxy I0326 23:35:35.999645 1 insightsreport.go:149] Retrieving report I0326 23:35:36.006434 1 requests.go:110] Retrieving report for cluster: babdc3b0-0295-47a5-a13e-e4b06fb9ebd2 I0326 23:35:36.006445 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/babdc3b0-0295-47a5-a13e-e4b06fb9ebd2/reports I0326 23:35:36.009615 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/babdc3b0-0295-47a5-a13e-e4b06fb9ebd2/reports I0326 23:35:36.199087 1 insightsreport.go:184] Report retrieved I0326 23:35:36.243803 1 insightsreport.go:239] Report retrieved correctly I0326 23:36:19.249664 1 controller.go:554] The operator is healthy I0326 23:37:04.187550 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:37:04.192061 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:37:04.233181 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0326 23:37:04.238476 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:37:04.238494 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0326 23:37:04.243944 1 secretconfigobserver.go:119] support secret does not exist I0326 23:38:19.250935 1 controller.go:554] The operator is healthy I0326 23:40:19.249388 1 controller.go:554] The operator is healthy I0326 23:42:04.244501 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0326 23:42:04.250716 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:42:04.250737 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0326 23:42:04.255547 1 secretconfigobserver.go:119] support secret does not exist I0326 23:42:19.250422 1 controller.go:554] The operator is healthy I0326 23:44:19.250303 1 controller.go:554] The operator is healthy I0326 23:46:19.249107 1 controller.go:554] The operator is healthy I0326 23:47:04.186416 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:47:04.255608 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0326 23:47:04.260650 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:47:04.260667 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0326 23:47:04.266996 1 secretconfigobserver.go:119] support secret does not exist I0326 23:48:19.251104 1 controller.go:554] The operator is healthy I0326 23:50:19.250633 1 controller.go:554] The operator is healthy I0326 23:50:39.990323 1 insightsuploader.go:146] Nothing to report since 2026-03-26T23:34:32Z I0326 23:52:04.267408 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0326 23:52:04.272759 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:52:04.272777 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0326 23:52:04.276911 1 secretconfigobserver.go:119] support secret does not exist I0326 23:52:19.249814 1 controller.go:554] The operator is healthy I0326 23:54:19.250498 1 controller.go:554] The operator is healthy I0326 23:56:19.249729 1 controller.go:554] The operator is healthy I0326 23:57:04.186216 1 configmapobserver.go:84] configmaps "insights-config" not found I0326 23:57:04.277844 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0326 23:57:04.282984 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0326 23:57:04.283000 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0326 23:57:04.287530 1 secretconfigobserver.go:119] support secret does not exist I0326 23:58:19.249123 1 controller.go:554] The operator is healthy