I0705 02:14:41.761248 1 cmd.go:253] Using service-serving-cert provided certificates I0705 02:14:41.761623 1 observer_polling.go:159] Starting file observer I0705 02:14:42.709803 1 operator.go:60] Starting insights-operator v0.0.0-master+$Format:%H$ I0705 02:14:42.710625 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0705 02:14:42.712090 1 secure_serving.go:57] Forcing use of http/1.1 only I0705 02:14:42.712093 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0705 02:14:42.712118 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0705 02:14:42.712126 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0705 02:14:42.712134 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0705 02:14:42.712138 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0705 02:14:42.712142 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0705 02:14:42.712146 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0705 02:14:42.716932 1 operator.go:125] FeatureGates initialized: knownFeatureGates=[AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BuildCSIVolumes CPMSMachineNamePrefix ConsolePluginContentSecurityPolicy ExternalOIDC ExternalOIDCWithUIDAndExtraClaimMappings GatewayAPI GatewayAPIController HighlyAvailableArbiter ImageVolume IngressControllerLBSubnetsAWS KMSv1 MachineConfigNodes ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation PinnedImages ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController SigstoreImageVerification StoragePerformantSecurityPolicy UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiDisk VSphereMultiNetworks AWSClusterHostedDNS AWSClusterHostedDNSInstall AWSDedicatedHosts AWSServiceLBNetworkSecurityGroup AutomatedEtcdBackup AzureClusterHostedDNSInstall AzureDedicatedHosts AzureMultiDisk BootImageSkewEnforcement BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalSnapshotMetadata GCPClusterHostedDNS GCPClusterHostedDNSInstall GCPCustomAPIEndpoints GCPCustomAPIEndpointsInstall ImageModeStatusReporting ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather IrreconcilableMachineConfig KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController ManagedBootImagesAzure ManagedBootImagesvSphere MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure MultiDiskSetup MutatingAdmissionPolicy NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NewOLMWebhookProviderOpenshiftServiceCA NoRegistryClusterOperations NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PreconfiguredUDNAddresses SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMixedNodeEnv VolumeAttributesClass VolumeGroupSnapshot] I0705 02:14:42.716957 1 event.go:377] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-insights", Name:"insights-operator", UID:"3a362a46-6a9f-4d1d-9d2d-4abdcf1c59e3", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ConsolePluginContentSecurityPolicy", "ExternalOIDC", "ExternalOIDCWithUIDAndExtraClaimMappings", "GatewayAPI", "GatewayAPIController", "HighlyAvailableArbiter", "ImageVolume", "IngressControllerLBSubnetsAWS", "KMSv1", "MachineConfigNodes", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "PinnedImages", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "SigstoreImageVerification", "StoragePerformantSecurityPolicy", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiDisk", "VSphereMultiNetworks"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AWSClusterHostedDNSInstall", "AWSDedicatedHosts", "AWSServiceLBNetworkSecurityGroup", "AutomatedEtcdBackup", "AzureClusterHostedDNSInstall", "AzureDedicatedHosts", "AzureMultiDisk", "BootImageSkewEnforcement", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalSnapshotMetadata", "GCPClusterHostedDNS", "GCPClusterHostedDNSInstall", "GCPCustomAPIEndpoints", "GCPCustomAPIEndpointsInstall", "ImageModeStatusReporting", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "IrreconcilableMachineConfig", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "ManagedBootImagesAzure", "ManagedBootImagesvSphere", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "MultiDiskSetup", "MutatingAdmissionPolicy", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NewOLMWebhookProviderOpenshiftServiceCA", "NoRegistryClusterOperations", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PreconfiguredUDNAddresses", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMixedNodeEnv", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0705 02:14:42.721542 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0705 02:14:42.721558 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0705 02:14:42.721602 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0705 02:14:42.721632 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0705 02:14:42.721621 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0705 02:14:42.721645 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0705 02:14:42.721853 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0705 02:14:42.722073 1 secure_serving.go:213] Serving securely on [::]:8443 I0705 02:14:42.722100 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W0705 02:14:42.725905 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0705 02:14:42.725931 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0705 02:14:42.726070 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0705 02:14:42.735176 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 02:14:42.735196 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0705 02:14:42.740415 1 secretconfigobserver.go:119] support secret does not exist I0705 02:14:42.745249 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 02:14:42.749225 1 secretconfigobserver.go:119] support secret does not exist I0705 02:14:42.751849 1 recorder.go:161] Pruning old reports every 7h5m53s, max age is 288h0m0s I0705 02:14:42.763609 1 operator.go:316] The last pod state is unhealthy I0705 02:14:42.821765 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0705 02:14:42.821784 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0705 02:14:42.821802 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0705 02:14:42.826951 1 base_controller.go:82] Caches are synced for ConfigController I0705 02:14:42.826965 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0705 02:14:42.832114 1 configmapobserver.go:84] configmaps "insights-config" not found I0705 02:15:02.761241 1 operator.go:316] The last pod state is unhealthy I0705 02:15:22.761451 1 operator.go:316] The last pod state is unhealthy I0705 02:15:42.758835 1 operator.go:316] The last pod state is unhealthy I0705 02:16:02.760306 1 operator.go:316] The last pod state is unhealthy I0705 02:16:22.759757 1 operator.go:316] The last pod state is unhealthy I0705 02:16:42.759458 1 operator.go:316] The last pod state is unhealthy I0705 02:17:02.760681 1 operator.go:316] The last pod state is unhealthy I0705 02:17:22.759853 1 operator.go:316] The last pod state is unhealthy I0705 02:17:42.758610 1 operator.go:316] The last pod state is unhealthy I0705 02:18:02.760130 1 operator.go:316] The last pod state is unhealthy I0705 02:18:22.760973 1 operator.go:316] The last pod state is unhealthy I0705 02:18:42.758167 1 operator.go:316] The last pod state is unhealthy I0705 02:19:02.762856 1 operator.go:316] The last pod state is unhealthy I0705 02:19:22.760450 1 operator.go:316] The last pod state is unhealthy I0705 02:19:42.756781 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 02:19:42.756852 1 operator.go:316] The last pod state is unhealthy I0705 02:19:42.760088 1 secretconfigobserver.go:119] support secret does not exist I0705 02:19:51.862548 1 operator.go:248] Unable to check insights-operator pod status. Setting initial delay to 11m14.54139009s I0705 02:19:51.862639 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0705 02:19:51.862663 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 12m44s I0705 02:19:51.862686 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0705 02:19:51.862691 1 insightsreport.go:296] Starting report retriever I0705 02:19:51.862696 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0705 02:19:51.869096 1 controller.go:128] Initializing last reported time to 0001-01-01T00:00:00Z I0705 02:19:51.869115 1 controller.go:326] The initial operator extension status is healthy I0705 02:19:51.869123 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0705 02:19:51.869128 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0705 02:19:51.869131 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0705 02:19:51.869145 1 controller.go:489] The operator is still being initialized I0705 02:19:51.869153 1 controller.go:512] The operator is healthy I0705 02:19:51.869308 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0705 02:19:51.869408 1 operator.go:288] started I0705 02:19:51.869438 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0705 02:19:51.869304 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0705 02:19:51.874775 1 controller.go:212] Source scaController *sca.Controller is not ready I0705 02:19:51.874787 1 controller.go:212] Source clusterTransferController *clustertransfer.Controller is not ready I0705 02:19:51.874791 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0705 02:19:51.874794 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0705 02:19:51.874797 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0705 02:19:51.874815 1 controller.go:489] The operator is still being initialized I0705 02:19:51.874820 1 controller.go:512] The operator is healthy I0705 02:19:51.888260 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I0705 02:19:51.961701 1 cluster_transfer.go:102] no available accepted cluster transfer I0705 02:19:51.961718 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0705 02:19:51.969843 1 base_controller.go:82] Caches are synced for LoggingSyncer I0705 02:19:51.969857 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0705 02:19:52.057672 1 sca.go:266] etc-pki-entitlement secret successfully created I0705 02:19:52.057687 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I0705 02:21:51.876144 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0705 02:21:51.876160 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0705 02:21:51.876164 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0705 02:21:51.876187 1 controller.go:489] The operator is still being initialized I0705 02:21:51.876192 1 controller.go:512] The operator is healthy I0705 02:23:51.878958 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0705 02:23:51.878978 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0705 02:23:51.878983 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0705 02:23:51.879016 1 controller.go:512] The operator is healthy I0705 02:24:42.751513 1 configmapobserver.go:84] configmaps "insights-config" not found I0705 02:24:42.760620 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 02:24:42.778409 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 02:24:42.778431 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 02:24:42.783814 1 secretconfigobserver.go:119] support secret does not exist I0705 02:25:51.879535 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0705 02:25:51.879558 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0705 02:25:51.879563 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0705 02:25:51.879609 1 controller.go:512] The operator is healthy I0705 02:27:51.879208 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0705 02:27:51.879226 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0705 02:27:51.879230 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0705 02:27:51.879252 1 controller.go:512] The operator is healthy I0705 02:29:42.784089 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 02:29:42.789266 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 02:29:42.789289 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 02:29:42.792711 1 secretconfigobserver.go:119] support secret does not exist I0705 02:29:51.875164 1 controller.go:212] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0705 02:29:51.875183 1 controller.go:212] Source periodic-conditional *controllerstatus.Simple is not ready I0705 02:29:51.875187 1 controller.go:212] Source periodic-workloads *controllerstatus.Simple is not ready I0705 02:29:51.875209 1 controller.go:512] The operator is healthy I0705 02:31:06.404663 1 periodic.go:209] Running clusterconfig gatherer I0705 02:31:06.404719 1 tasks_processing.go:45] number of workers: 32 I0705 02:31:06.404755 1 tasks_processing.go:69] worker 31 listening for tasks. I0705 02:31:06.404761 1 tasks_processing.go:71] worker 31 working on schedulers task. I0705 02:31:06.404765 1 tasks_processing.go:69] worker 7 listening for tasks. I0705 02:31:06.404773 1 tasks_processing.go:69] worker 3 listening for tasks. I0705 02:31:06.404782 1 tasks_processing.go:69] worker 19 listening for tasks. I0705 02:31:06.404790 1 tasks_processing.go:69] worker 2 listening for tasks. I0705 02:31:06.404794 1 tasks_processing.go:69] worker 8 listening for tasks. I0705 02:31:06.404798 1 tasks_processing.go:69] worker 4 listening for tasks. I0705 02:31:06.404802 1 tasks_processing.go:69] worker 5 listening for tasks. I0705 02:31:06.404804 1 tasks_processing.go:69] worker 9 listening for tasks. I0705 02:31:06.404807 1 tasks_processing.go:69] worker 14 listening for tasks. I0705 02:31:06.404812 1 tasks_processing.go:69] worker 16 listening for tasks. I0705 02:31:06.404813 1 tasks_processing.go:69] worker 17 listening for tasks. I0705 02:31:06.404816 1 tasks_processing.go:69] worker 10 listening for tasks. I0705 02:31:06.404816 1 tasks_processing.go:69] worker 6 listening for tasks. I0705 02:31:06.404820 1 tasks_processing.go:69] worker 1 listening for tasks. I0705 02:31:06.404833 1 tasks_processing.go:69] worker 12 listening for tasks. I0705 02:31:06.404835 1 tasks_processing.go:69] worker 18 listening for tasks. I0705 02:31:06.404842 1 tasks_processing.go:69] worker 20 listening for tasks. I0705 02:31:06.404845 1 tasks_processing.go:69] worker 13 listening for tasks. I0705 02:31:06.404840 1 tasks_processing.go:69] worker 0 listening for tasks. I0705 02:31:06.404851 1 tasks_processing.go:69] worker 28 listening for tasks. I0705 02:31:06.404854 1 tasks_processing.go:69] worker 23 listening for tasks. I0705 02:31:06.404852 1 tasks_processing.go:69] worker 15 listening for tasks. I0705 02:31:06.404854 1 tasks_processing.go:69] worker 21 listening for tasks. I0705 02:31:06.404857 1 tasks_processing.go:69] worker 26 listening for tasks. I0705 02:31:06.404861 1 tasks_processing.go:69] worker 29 listening for tasks. I0705 02:31:06.404864 1 tasks_processing.go:69] worker 30 listening for tasks. I0705 02:31:06.404845 1 tasks_processing.go:69] worker 22 listening for tasks. I0705 02:31:06.404870 1 tasks_processing.go:71] worker 19 working on nodes task. I0705 02:31:06.404872 1 tasks_processing.go:71] worker 8 working on image task. I0705 02:31:06.404876 1 tasks_processing.go:71] worker 13 working on service_accounts task. I0705 02:31:06.404877 1 tasks_processing.go:71] worker 18 working on machines task. I0705 02:31:06.404881 1 tasks_processing.go:71] worker 0 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0705 02:31:06.404884 1 tasks_processing.go:71] worker 23 working on certificate_signing_requests task. I0705 02:31:06.404886 1 tasks_processing.go:71] worker 5 working on pdbs task. I0705 02:31:06.404882 1 tasks_processing.go:71] worker 4 working on config_maps task. I0705 02:31:06.404933 1 tasks_processing.go:71] worker 9 working on validating_webhook_configurations task. I0705 02:31:06.404935 1 tasks_processing.go:71] worker 20 working on sap_pods task. I0705 02:31:06.404937 1 tasks_processing.go:71] worker 12 working on machine_config_pools task. I0705 02:31:06.404942 1 tasks_processing.go:71] worker 15 working on nodenetworkstates task. I0705 02:31:06.404964 1 tasks_processing.go:71] worker 14 working on support_secret task. I0705 02:31:06.404878 1 tasks_processing.go:71] worker 22 working on pod_network_connectivity_checks task. I0705 02:31:06.404938 1 tasks_processing.go:71] worker 26 working on container_runtime_configs task. I0705 02:31:06.405138 1 tasks_processing.go:71] worker 21 working on olm_operators task. I0705 02:31:06.404857 1 tasks_processing.go:69] worker 24 listening for tasks. I0705 02:31:06.405210 1 tasks_processing.go:71] worker 24 working on container_images task. I0705 02:31:06.404861 1 tasks_processing.go:69] worker 27 listening for tasks. I0705 02:31:06.404869 1 tasks_processing.go:71] worker 3 working on version task. I0705 02:31:06.405298 1 tasks_processing.go:71] worker 16 working on ingress_certificates task. I0705 02:31:06.405360 1 tasks_processing.go:71] worker 29 working on ceph_cluster task. I0705 02:31:06.405629 1 tasks_processing.go:71] worker 30 working on monitoring_persistent_volumes task. I0705 02:31:06.405707 1 tasks_processing.go:71] worker 27 working on nodenetworkconfigurationpolicies task. I0705 02:31:06.404869 1 tasks_processing.go:71] worker 7 working on metrics task. I0705 02:31:06.405798 1 tasks_processing.go:71] worker 10 working on openshift_machine_api_events task. I0705 02:31:06.405882 1 tasks_processing.go:71] worker 6 working on openstack_controlplanes task. I0705 02:31:06.404870 1 tasks_processing.go:71] worker 2 working on aggregated_monitoring_cr_names task. I0705 02:31:06.404876 1 tasks_processing.go:71] worker 28 working on dvo_metrics task. I0705 02:31:06.404844 1 tasks_processing.go:69] worker 25 listening for tasks. I0705 02:31:06.406336 1 tasks_processing.go:71] worker 25 working on openstack_version task. I0705 02:31:06.404846 1 tasks_processing.go:69] worker 11 listening for tasks. I0705 02:31:06.405792 1 tasks_processing.go:71] worker 17 working on mutating_webhook_configurations task. I0705 02:31:06.404877 1 tasks_processing.go:71] worker 1 working on image_registries task. I0705 02:31:06.406526 1 tasks_processing.go:71] worker 11 working on openstack_dataplanedeployments task. I0705 02:31:06.409968 1 tasks_processing.go:71] worker 15 working on storage_cluster task. I0705 02:31:06.410006 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 5.014734ms to process 0 records E0705 02:31:06.410036 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0705 02:31:06.410053 1 gather.go:177] gatherer "clusterconfig" function "machines" took 5.113062ms to process 0 records I0705 02:31:06.410063 1 tasks_processing.go:71] worker 18 working on openstack_dataplanenodesets task. I0705 02:31:06.410090 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 5.03188ms to process 0 records I0705 02:31:06.410139 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 5.146986ms to process 0 records I0705 02:31:06.410153 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 4.688628ms to process 0 records I0705 02:31:06.410095 1 tasks_processing.go:71] worker 26 working on operators task. I0705 02:31:06.410165 1 tasks_processing.go:71] worker 29 working on silenced_alerts task. I0705 02:31:06.410156 1 tasks_processing.go:71] worker 20 working on active_alerts task. I0705 02:31:06.412076 1 tasks_processing.go:71] worker 6 working on image_pruners task. I0705 02:31:06.412087 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 6.146338ms to process 0 records I0705 02:31:06.412172 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 6.356688ms to process 0 records I0705 02:31:06.412183 1 tasks_processing.go:71] worker 27 working on machine_healthchecks task. I0705 02:31:06.412466 1 tasks_processing.go:71] worker 25 working on operators_pods_and_events task. I0705 02:31:06.412478 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 6.109248ms to process 0 records I0705 02:31:06.413293 1 tasks_processing.go:71] worker 11 working on tsdb_status task. I0705 02:31:06.413306 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 6.718034ms to process 0 records I0705 02:31:06.414252 1 tasks_processing.go:71] worker 14 working on oauths task. E0705 02:31:06.414262 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0705 02:31:06.414274 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 9.274736ms to process 0 records I0705 02:31:06.414523 1 tasks_processing.go:71] worker 15 working on storage_classes task. I0705 02:31:06.414567 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 4.53629ms to process 0 records I0705 02:31:06.414698 1 tasks_processing.go:71] worker 18 working on node_logs task. I0705 02:31:06.414714 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 4.618216ms to process 0 records I0705 02:31:06.416256 1 tasks_processing.go:71] worker 17 working on clusterroles task. I0705 02:31:06.416474 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/annotation.operator.tekton.dev with fingerprint=9a06b35a5978f6552d22bcd3d309f88b6f03ed2c6515c17d932defea23657def I0705 02:31:06.416523 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=9843c435934d885d45d70753dfb5c5a8f0097522bb0d0fbffc959f45d267d94f I0705 02:31:06.416557 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/proxy.operator.tekton.dev with fingerprint=c9cbf0152ccb66f15fe1b16de629fd8eea534e067557b95369803c0ec2a4bb1e I0705 02:31:06.416615 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=86d757294c5a97cd60fd1511bfc9f4fad44d19594c01f1b53bde020c06923b3a I0705 02:31:06.416658 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=7c48aaacf029d7d41e29d1665264cfccc725aff44d13979ba275f643defa4b38 I0705 02:31:06.416702 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.operator.tekton.dev with fingerprint=2c7ab91dda5044149edb0d0a52b7c1dbf64ca11d53c690ec8178799c389951da I0705 02:31:06.416750 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.pipeline.tekton.dev with fingerprint=2f4da669e6613946b175598e3a2998b43f7a6e1d5a4a4f30bff297cf7efdfd18 I0705 02:31:06.416797 1 recorder.go:75] Recording config/mutatingwebhookconfigurations/webhook.triggers.tekton.dev with fingerprint=a3af88f3199fd8ab62bd8bd812b007e6b3debafbca39a1f6777363868bbddf48 I0705 02:31:06.416809 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 9.881253ms to process 8 records I0705 02:31:06.416914 1 tasks_processing.go:71] worker 22 working on crds task. I0705 02:31:06.416941 1 recorder.go:75] Recording config/podnetworkconnectivitychecks with fingerprint=44136fa355b3678a1146ad16f7e8649e94fb4fc21fe77e8310c060f61caaff8a I0705 02:31:06.416956 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 11.900623ms to process 1 records I0705 02:31:06.417285 1 tasks_processing.go:71] worker 8 working on qemu_kubevirt_launcher_logs task. I0705 02:31:06.417387 1 recorder.go:75] Recording config/image with fingerprint=8fefa573b9d127e1a594725d903a9851fba6b007a705bd56a397f3d25e2e000b I0705 02:31:06.417404 1 gather.go:177] gatherer "clusterconfig" function "image" took 12.403218ms to process 1 records E0705 02:31:06.417415 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0705 02:31:06.417421 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 5.150322ms to process 0 records I0705 02:31:06.417428 1 tasks_processing.go:71] worker 27 working on openshift_logging task. I0705 02:31:06.417619 1 tasks_processing.go:71] worker 1 working on cluster_apiserver task. I0705 02:31:06.418123 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=7f7087d8561281fb66148923d92bc82e70104a62d81a74bc099cacc05f0f104a I0705 02:31:06.418182 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 11.214465ms to process 1 records I0705 02:31:06.419439 1 tasks_processing.go:71] worker 30 working on lokistack task. I0705 02:31:06.419441 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 13.729156ms to process 0 records I0705 02:31:06.419527 1 gather_lokistack.go:58] Start LokiStack gathering I0705 02:31:06.419939 1 tasks_processing.go:71] worker 12 working on feature_gates task. I0705 02:31:06.420069 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 14.993487ms to process 0 records I0705 02:31:06.421399 1 tasks_processing.go:71] worker 31 working on networks task. I0705 02:31:06.421583 1 recorder.go:75] Recording config/schedulers/cluster with fingerprint=54a4b3f845e0e62028851cbe6d90f4ed983db1511246335d9c31f22f740a26e7 I0705 02:31:06.421619 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 16.587676ms to process 1 records I0705 02:31:06.421665 1 tasks_processing.go:71] worker 5 working on sap_config task. I0705 02:31:06.421838 1 recorder.go:75] Recording config/pdbs/openshift-console/console with fingerprint=c87031ab856b76c64c4e4afa446577d3c34e3f5facb1e1061900584c1f42d107 I0705 02:31:06.421907 1 recorder.go:75] Recording config/pdbs/openshift-console/downloads with fingerprint=8773a6be288f7e05d6b46efbb0b4a9d35b0f7db6c25ff6b6271635532e59a7c7 I0705 02:31:06.421938 1 recorder.go:75] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=89a159a4370694e3ccdf5a22687c7c9a3757f810a638e2a8f4078761fc208944 I0705 02:31:06.421964 1 recorder.go:75] Recording config/pdbs/openshift-ingress/router-default with fingerprint=0ff52a3d96d65022d6b12136d21b5d96c42f279dd9b6e99291ed8192ef029510 I0705 02:31:06.421990 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=ae8de7d3b26cfe5785bb28a554318e9801feb6a930810de5e9ad5b3bb7c04605 I0705 02:31:06.422011 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=1d25802c1469b7dea3095d07dc4801a5c8b8012cbb2de90f7029722b6608c784 I0705 02:31:06.422033 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=994d6b016559c6c56b17666aabbb052f31a718471319273bb423f13a6a9b00f6 I0705 02:31:06.422055 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=50958d69394021bb10bd1cb1e6067b965c95c01e043fc983f93f787c40e7f197 I0705 02:31:06.422075 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=e1fa40f90868dc077fe9285074458d3671b8d6ca82602ec5bef4ad752e754e6e I0705 02:31:06.422108 1 recorder.go:75] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=d5820a896b3335663214b8752192ee6daa89a9794af14e05d1f22e6c732386d1 I0705 02:31:06.422170 1 recorder.go:75] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=cb17a32a26c88353bc081cde90fd78a54dbec79d83696f0a788b90d5e9a08a2f I0705 02:31:06.422180 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 16.769333ms to process 11 records I0705 02:31:06.422411 1 tasks_processing.go:71] worker 19 working on proxies task. I0705 02:31:06.422841 1 recorder.go:75] Recording config/node/ip-10-0-0-209.ec2.internal with fingerprint=3d57efad07f3eff9e40822bddb5df72da4d1edad2902263f050dc6e47f09081c I0705 02:31:06.422992 1 recorder.go:75] Recording config/node/ip-10-0-1-100.ec2.internal with fingerprint=3c8c733ed50f617ad0a3eb26251127c2b7ddf13b365abfd1102777174af0f344 I0705 02:31:06.423134 1 recorder.go:75] Recording config/node/ip-10-0-2-161.ec2.internal with fingerprint=39468bc1c501d53c31929d8ca73698a96fc9d72107974f61d8b018bedcd768f4 I0705 02:31:06.423171 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 17.52563ms to process 3 records I0705 02:31:06.423200 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 16.835357ms to process 0 records I0705 02:31:06.423213 1 tasks_processing.go:71] worker 10 working on ingress task. I0705 02:31:06.425429 1 tasks_processing.go:71] worker 23 working on overlapping_namespace_uids task. I0705 02:31:06.425441 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 20.527472ms to process 0 records I0705 02:31:06.426554 1 tasks_processing.go:71] worker 18 working on infrastructures task. I0705 02:31:06.426610 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 11.84278ms to process 0 records I0705 02:31:06.426975 1 tasks_processing.go:71] worker 6 working on authentication task. I0705 02:31:06.427068 1 recorder.go:75] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=976eb465c2b8c66355658fe2228f77d4d5d6d8cb47388521f279a4f3d2ebc6d1 I0705 02:31:06.427085 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 14.834816ms to process 1 records I0705 02:31:06.427176 1 tasks_processing.go:71] worker 14 working on jaegers task. I0705 02:31:06.427347 1 recorder.go:75] Recording config/oauth with fingerprint=e4a2247c920f2b45fa30eb290e94cc50d0b0670e9a1d30a41e51b1deaf0e0ac8 I0705 02:31:06.427363 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 12.710273ms to process 1 records I0705 02:31:06.432462 1 tasks_processing.go:71] worker 27 working on machine_autoscalers task. I0705 02:31:06.432767 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 15.025506ms to process 0 records I0705 02:31:06.433435 1 tasks_processing.go:71] worker 15 working on sap_datahubs task. I0705 02:31:06.433966 1 recorder.go:75] Recording config/storage/storageclasses/gp2-csi with fingerprint=435f08265a12f6cdc4e516ce5ce5f6ff890db3dcf86ba8f089531cd7e9eb1631 I0705 02:31:06.434020 1 recorder.go:75] Recording config/storage/storageclasses/gp3-csi with fingerprint=7dfaadd1e287a0d1dc7371074a8ef1ec81beef9e7a18dd8851ace3717d4c457b I0705 02:31:06.434036 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 18.863524ms to process 2 records I0705 02:31:06.434047 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 14.331167ms to process 0 records I0705 02:31:06.434187 1 tasks_processing.go:71] worker 30 working on machine_sets task. I0705 02:31:06.434365 1 tasks_processing.go:71] worker 1 working on cost_management_metrics_configs task. I0705 02:31:06.434386 1 recorder.go:75] Recording config/apiserver with fingerprint=745834fc5284a1a389169e334ffd140e8b9f2d7872fd5c30bc1b4502c7e46334 I0705 02:31:06.434561 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 16.342164ms to process 1 records I0705 02:31:06.435214 1 gather_logs.go:145] no pods in namespace were found I0705 02:31:06.435233 1 tasks_processing.go:71] worker 8 working on machine_configs task. I0705 02:31:06.435253 1 gather.go:177] gatherer "clusterconfig" function "qemu_kubevirt_launcher_logs" took 17.93249ms to process 0 records I0705 02:31:06.435344 1 tasks_processing.go:71] worker 5 working on install_plans task. I0705 02:31:06.435411 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 13.661112ms to process 0 records I0705 02:31:06.435474 1 tasks_processing.go:74] worker 3 stopped. I0705 02:31:06.436261 1 recorder.go:75] Recording config/version with fingerprint=afcc28ca11ca3c15698ecff9d5b617646502ecf21a9d3392d4195316cd490a6c I0705 02:31:06.436282 1 recorder.go:75] Recording config/id with fingerprint=a020276690ce033aa36a23082028034e6faaf47108ea034f764336217e40f076 I0705 02:31:06.436291 1 gather.go:177] gatherer "clusterconfig" function "version" took 30.167301ms to process 2 records I0705 02:31:06.436366 1 recorder.go:75] Recording config/proxy with fingerprint=de3d5a32ee014a2b11a3f71835832d55cb2c273e59b494a11d8ee28d590aebaa I0705 02:31:06.436380 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 13.620245ms to process 1 records I0705 02:31:06.436409 1 tasks_processing.go:74] worker 19 stopped. I0705 02:31:06.436487 1 tasks_processing.go:74] worker 10 stopped. I0705 02:31:06.436513 1 recorder.go:75] Recording config/ingress with fingerprint=a71c0ce6e4db5ebdf3b5e9ab9349ca4105f60cb63959d965ad3968618922bb58 I0705 02:31:06.436537 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 13.002554ms to process 1 records I0705 02:31:06.436786 1 tasks_processing.go:74] worker 31 stopped. I0705 02:31:06.436973 1 recorder.go:75] Recording config/network with fingerprint=3e38b35d18aa838718f2e84e2a00d47f38e9dd218280999ac7004e3c9a9c1dc3 I0705 02:31:06.436995 1 gather.go:177] gatherer "clusterconfig" function "networks" took 15.326808ms to process 1 records I0705 02:31:06.437669 1 tasks_processing.go:74] worker 12 stopped. I0705 02:31:06.437855 1 recorder.go:75] Recording config/featuregate with fingerprint=4f801961c9ff97a197bfbfdf45e7231aba205bf176116c19e63f730b6f2eb686 I0705 02:31:06.437895 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 17.712212ms to process 1 records I0705 02:31:06.438060 1 tasks_processing.go:74] worker 18 stopped. I0705 02:31:06.439134 1 recorder.go:75] Recording config/infrastructure with fingerprint=6ead2eca5d97e053666efded034a9a482ccb06d03b7cb6a40aeee45a12d9300c I0705 02:31:06.439195 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 11.486567ms to process 1 records I0705 02:31:06.439212 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 11.631109ms to process 0 records I0705 02:31:06.439218 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 6.307856ms to process 0 records I0705 02:31:06.439321 1 tasks_processing.go:74] worker 14 stopped. I0705 02:31:06.439379 1 tasks_processing.go:74] worker 27 stopped. I0705 02:31:06.439450 1 recorder.go:75] Recording config/authentication with fingerprint=34a9846efea74559991d4d1927fa362be2de5d68b5f91341367f0c31d452a364 I0705 02:31:06.439500 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 11.873003ms to process 1 records I0705 02:31:06.439514 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 5.407433ms to process 0 records I0705 02:31:06.439522 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 4.855095ms to process 0 records I0705 02:31:06.439526 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 4.726254ms to process 0 records I0705 02:31:06.439728 1 recorder.go:75] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=3802e4f4aa8227cf9b37a82895fcd2e280be7f3640f4eb490721277d2c870f69 I0705 02:31:06.439968 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.operator.tekton.dev with fingerprint=08e863bfaf99da3aa1410a5ca4dff24476548de0851103e21870e0bb616f4bbd I0705 02:31:06.440302 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.pipeline.tekton.dev with fingerprint=eb81b2af3ade9af39c3ac9a29042228983712eca5251e091ef78315d7948df66 I0705 02:31:06.440433 1 recorder.go:75] Recording config/validatingwebhookconfigurations/config.webhook.triggers.tekton.dev with fingerprint=ae791ddef0d7acc8d445c971ebd3b1ec12cd9e7cc6ac4d4a9b625b6030f48eb8 I0705 02:31:06.440528 1 recorder.go:75] Recording config/validatingwebhookconfigurations/monitoringconfigmaps.openshift.io with fingerprint=e2083bb84c035d58a675365dc0c00a91c8925dd075cf4fb7f7bd379c47b19b42 I0705 02:31:06.439810 1 tasks_processing.go:74] worker 15 stopped. I0705 02:31:06.439470 1 tasks_processing.go:74] worker 6 stopped. I0705 02:31:06.439816 1 tasks_processing.go:74] worker 30 stopped. I0705 02:31:06.439823 1 tasks_processing.go:74] worker 1 stopped. I0705 02:31:06.439830 1 tasks_processing.go:74] worker 9 stopped. I0705 02:31:06.441087 1 recorder.go:75] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=93601d623dea92f6daaac206e6d37ee5ab89c0b6fb158858ffad0aefd5ed5473 I0705 02:31:06.441144 1 recorder.go:75] Recording config/validatingwebhookconfigurations/namespace.operator.tekton.dev with fingerprint=a2523057117338823eb67ed5655d880b38a9a05a3becce1db84db2f477f24e47 I0705 02:31:06.441229 1 recorder.go:75] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=b47d920ba621c79b4a52e3094c0ecb8ebb975feeb53a6b6670f4b738e83a8c22 I0705 02:31:06.441337 1 recorder.go:75] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=0bd358d5b2f02f68db2ea6691993f6ffbce66bd003b4e10dc3c77d3adbfe7ecd I0705 02:31:06.441411 1 recorder.go:75] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=f244a56fcd01a874a1a6821cdb40e44a8108ee93feb064080e45de0843608c9f I0705 02:31:06.441496 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=7ca840c12e6e70f3b42108958383d3b28c317965d5dba0de8f726e1e4f052249 I0705 02:31:06.441578 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=a1454d4f7f852ec72ae2a700cde5eb993b1a9d56576eec3eab59f4f428763e03 I0705 02:31:06.441748 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=8c6e45f95efcc98073ad7e25ad13bd1c09a94b0d83b226eb3bfcc948ab02a502 I0705 02:31:06.441831 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=b69d2d87cb5515f61ab66fefdb5f091866206a4987ac2801993206f6a06e6f6a I0705 02:31:06.441929 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=d1f20dbd948f9e1f6c6b0cedfedd268ad1ab02a5c8a9bf6e15b8c347725c713a I0705 02:31:06.442007 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=0661bc99e5132df164305cf09f1a415b8491dd11360e79c0877de3ff686f9acf I0705 02:31:06.442079 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=e165a0625de8fa04ab2539697588b816a4686879371a1c7bece646f960afba3c I0705 02:31:06.442160 1 recorder.go:75] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=a19cd2c78019853f7377d15cf2a84d744deac0f9864ad98cd177a9e1a311fed9 I0705 02:31:06.442197 1 gather_cluster_operator_pods_and_events.go:121] Found 0 pods with 0 containers I0705 02:31:06.442247 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.pipelinesascode.tekton.dev with fingerprint=ca91067e94a320bf6d80ee307992b12d54b28bd7e81d9fa00a7cadee4c672ce9 I0705 02:31:06.442328 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.operator.tekton.dev with fingerprint=dcd769be1a8b566f2d16690eb5fe3de40dfca130dd3e6e6cabcd9b8c9bc5e466 I0705 02:31:06.442413 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.pipeline.tekton.dev with fingerprint=ded8d4ea24351c43febf6fe8755fd22f8c954d2a91d8ee51745932101c671622 I0705 02:31:06.442489 1 recorder.go:75] Recording config/validatingwebhookconfigurations/validation.webhook.triggers.tekton.dev with fingerprint=ca81163256e2ef114405b7b087dd606640a954465e7e3fb34a4604c7c34ba290 I0705 02:31:06.442522 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 34.525535ms to process 22 records I0705 02:31:06.442561 1 recorder.go:75] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0705 02:31:06.442604 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 16.729814ms to process 1 records I0705 02:31:06.442637 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 29.765126ms to process 0 records I0705 02:31:06.442672 1 tasks_processing.go:74] worker 25 stopped. I0705 02:31:06.442698 1 tasks_processing.go:74] worker 23 stopped. I0705 02:31:06.444251 1 tasks_processing.go:74] worker 17 stopped. I0705 02:31:06.445051 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=57b5fe201ce9d93652ee1431bd844f65c50c0f1dca7f33a6882dc7009a64fae3 I0705 02:31:06.445381 1 recorder.go:75] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=66c2efa26e437661af6af1bd622811008f5c6358783777325695656c4216c695 I0705 02:31:06.445447 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 27.961236ms to process 2 records I0705 02:31:06.446004 1 tasks_processing.go:74] worker 22 stopped. I0705 02:31:06.446798 1 recorder.go:75] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=1d2c9721b9162610ff7fc9682f4b4b9a1bf03298b6ea07eaa6496e9798ee343f I0705 02:31:06.447188 1 recorder.go:75] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=3a70bcd314a0a3219ee8ec02a052499c7a5a307a41dd680a8d138eecd97faa1f I0705 02:31:06.447241 1 gather.go:177] gatherer "clusterconfig" function "crds" took 29.068744ms to process 2 records I0705 02:31:06.447900 1 tasks_processing.go:74] worker 2 stopped. I0705 02:31:06.447914 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 41.930678ms to process 0 records I0705 02:31:06.461074 1 tasks_processing.go:74] worker 4 stopped. E0705 02:31:06.461143 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0705 02:31:06.461173 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0705 02:31:06.461198 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0705 02:31:06.461230 1 recorder.go:75] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=26b6661162b099a0f5a279859b4f46c867929a79d9a4a41fde4be4e6fe138018 I0705 02:31:06.461280 1 recorder.go:75] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=2b7e7d968c1ca0e033f2ae1514829fefa6008cf7d89addbe266d351cfb9cca19 I0705 02:31:06.461306 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=c93090eb0d2a4736885abeb79c91680cfd01fda46464f83456b085d4dc8239f0 I0705 02:31:06.461330 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0705 02:31:06.461360 1 recorder.go:75] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0705 02:31:06.461438 1 recorder.go:75] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0705 02:31:06.461464 1 recorder.go:75] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0705 02:31:06.461490 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 56.131044ms to process 7 records I0705 02:31:06.491056 1 tasks_processing.go:74] worker 24 stopped. I0705 02:31:06.492803 1 recorder.go:75] Recording config/pod/openshift-console-operator/console-operator-575cd97545-wrwzq with fingerprint=e347490b44f7a83f6a100972f7ffd486c805d79fd3001c47893e0f18ace7117d I0705 02:31:06.492998 1 recorder.go:75] Recording config/running_containers with fingerprint=2134ebbb602f8de376f60c0e93d71893488ca22656529b409a3506a007916024 I0705 02:31:06.493017 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 85.828611ms to process 2 records I0705 02:31:06.493032 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 88.079583ms to process 0 records I0705 02:31:06.493044 1 tasks_processing.go:74] worker 0 stopped. I0705 02:31:06.517053 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0705 02:31:06.519071 1 tasks_processing.go:74] worker 8 stopped. I0705 02:31:06.519096 1 recorder.go:75] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0705 02:31:06.519105 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 83.822497ms to process 1 records I0705 02:31:06.521457 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" not found I0705 02:31:06.534223 1 tasks_processing.go:74] worker 21 stopped. I0705 02:31:06.534432 1 recorder.go:75] Recording config/olm_operators with fingerprint=bb524acae8ff7a56e983e1f0b364634468a1acc2e0048f385d63aa303d7b5633 I0705 02:31:06.534445 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 129.061668ms to process 1 records I0705 02:31:06.546635 1 tasks_processing.go:74] worker 16 stopped. E0705 02:31:06.546649 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0705 02:31:06.546655 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2rbmoiamflni4jkskg2bjun3635bj0tp-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2rbmoiamflni4jkskg2bjun3635bj0tp-primary-cert-bundle-secret" not found I0705 02:31:06.546703 1 recorder.go:75] Recording aggregated/ingress_controllers_certs with fingerprint=c35381c60d0449f06c12e06ae944097af80673ceb2e2be554621cc187a82375d I0705 02:31:06.546714 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 141.322729ms to process 1 records I0705 02:31:07.263389 1 tasks_processing.go:74] worker 28 stopped. I0705 02:31:07.263559 1 recorder.go:75] Recording config/dvo_metrics with fingerprint=df93f1c675e7e5df4b4748538189bff38bf056400d43fc35df7e7909d7a87161 I0705 02:31:07.263576 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 857.223941ms to process 1 records I0705 02:31:07.477879 1 tasks_processing.go:74] worker 29 stopped. I0705 02:31:07.477903 1 recorder.go:75] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0705 02:31:07.477918 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 1.067697933s to process 1 records I0705 02:31:07.478358 1 tasks_processing.go:74] worker 20 stopped. I0705 02:31:07.478433 1 recorder.go:75] Recording config/alerts with fingerprint=5da653d55e8e5c3ac630d86b4c0d81e847ca02fcb38dddce3870d123c382ace5 I0705 02:31:07.478446 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 1.068055544s to process 1 records I0705 02:31:07.491688 1 tasks_processing.go:74] worker 7 stopped. I0705 02:31:07.491793 1 recorder.go:75] Recording config/metrics with fingerprint=d641c0a42a331746af8b48f6a157f5ce2fb36bad8c6922031b24f0a8193d268a I0705 02:31:07.491810 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 1.085872669s to process 1 records I0705 02:31:07.504555 1 tasks_processing.go:74] worker 11 stopped. I0705 02:31:07.504694 1 recorder.go:75] Recording config/tsdb.json with fingerprint=ab6e0d85c7f13789a74eaced67348804e78e7fbaa55100c11e98b138688f9437 I0705 02:31:07.504798 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 1.091242284s to process 1 records I0705 02:31:08.870812 1 tasks_processing.go:74] worker 26 stopped. I0705 02:31:08.870885 1 recorder.go:75] Recording config/clusteroperator/console with fingerprint=120483fb5dafd31f4435a9360a8bdf719c070337b34e809b2870caf48667c722 I0705 02:31:08.870941 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I0705 02:31:08.870965 1 recorder.go:75] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=64b43e6f4b58aa6eb88dd8bc9f41d72c048e6c3c1829abd3d5dec6676cfea259 I0705 02:31:08.870977 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0705 02:31:08.870998 1 recorder.go:75] Recording config/clusteroperator/dns with fingerprint=c61eb1e025ad7e9804f6eb6e7f40f5ebd0ad164eaf8caa8f7ae2fd03c122e3fb I0705 02:31:08.871014 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0705 02:31:08.871038 1 recorder.go:75] Recording config/clusteroperator/image-registry with fingerprint=c50e24ccac36725de530979b4b0e69a4a93e9cb1b0e572b41b4ab5c2896f61c1 I0705 02:31:08.871065 1 recorder.go:75] Recording config/clusteroperator/ingress with fingerprint=c5de0c7a819cd34a6bf140c511d99ecfa74b95387f650d97644101c3f2b2b589 I0705 02:31:08.871090 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=b23e7de8f539b9dbe90449235468d731ffb8678e9659ae461adae9919d0ab6af I0705 02:31:08.871119 1 recorder.go:75] Recording config/clusteroperator/insights with fingerprint=495d8899fcdc55dac01bc405ca507746d246029030d6d0557b1bb27b2e6242a4 I0705 02:31:08.871391 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=df3848b0fab7c8c2d5c2a68887ec26fd4f4bf2d87cc766ab1e7ea172bdcf1724 I0705 02:31:08.871412 1 recorder.go:75] Recording config/clusteroperator/kube-apiserver with fingerprint=adc9e91df91540d7695e53009828dbb662fb26218ea51b9d63a0ac4a52fc711a I0705 02:31:08.871422 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0705 02:31:08.871439 1 recorder.go:75] Recording config/clusteroperator/kube-controller-manager with fingerprint=d2e9fe6c25c7c024c419bc295eea343edc25c62a09d7ad093051fd49229beafd I0705 02:31:08.871450 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0705 02:31:08.871465 1 recorder.go:75] Recording config/clusteroperator/kube-scheduler with fingerprint=6e32ecbb81ac44ee4772a6686c2f6e319ac5277ec7f362b2e67d3fa5f435003f I0705 02:31:08.871475 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0705 02:31:08.871494 1 recorder.go:75] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=8f02e1d9488ede3f5989799ee7e3562a73e6212f047f74ce0a717884863aae1f I0705 02:31:08.871502 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0705 02:31:08.871525 1 recorder.go:75] Recording config/clusteroperator/monitoring with fingerprint=75dbfdefb53401bbd9014765e968edabd96f539d6da53ce9377166315184e454 I0705 02:31:08.871647 1 recorder.go:75] Recording config/clusteroperator/network with fingerprint=b90920fc1904a34ea162bcd962299638b1f4efa986349cff8815fff94ade927f I0705 02:31:08.871658 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/ovn with fingerprint=626a89d20e0deaed5b6dfb533acfe65f4bb1618bd200a703b62e60c5d16d94ab I0705 02:31:08.871666 1 recorder.go:75] Recording config/clusteroperator/network.operator.openshift.io/operatorpki/openshift-ovn-kubernetes/signer with fingerprint=90410b16914712b85b3c4578716ad8c0ae072e688f4cd1e022bf76f20da3506d I0705 02:31:08.871689 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0705 02:31:08.871710 1 recorder.go:75] Recording config/clusteroperator/node-tuning with fingerprint=56fe3d56c2ad69c9fbafab47adbc37590fe833103df5b91d3acafe3633a33935 I0705 02:31:08.871733 1 recorder.go:75] Recording config/clusteroperator/openshift-apiserver with fingerprint=e5046504fe9786ff130237518dfcead9695a49a0ac03809e0973d5f053da9cf5 I0705 02:31:08.871742 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0705 02:31:08.871766 1 recorder.go:75] Recording config/clusteroperator/openshift-controller-manager with fingerprint=7584d26ea8733279f5410c8caa6d89babbfe69cbb51cfcda1a027c2b61883cc0 I0705 02:31:08.871777 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0705 02:31:08.871809 1 recorder.go:75] Recording config/clusteroperator/openshift-samples with fingerprint=392da8b10690f69ae8ea7dc7f97ff1f209e3613e4a238714d70abada793d6364 I0705 02:31:08.871846 1 recorder.go:75] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0705 02:31:08.871860 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=95c381554f99274ba64651902cfafde0c6b104231c556502a0ed36ea1cb3833a I0705 02:31:08.871873 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=517badcaeb1d74b85e7fef90525bf0ebd18abef62c327cc2efee40c967867691 I0705 02:31:08.871888 1 recorder.go:75] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=2851d826d66d1c4c79484a93f6f0ab69049d8846fe75421583577590904eccff I0705 02:31:08.871909 1 recorder.go:75] Recording config/clusteroperator/service-ca with fingerprint=f238821b6b9b1ba52d11f51fa30b5d30d2b1bef03fd518f782c1217f00bad2f7 I0705 02:31:08.871918 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0705 02:31:08.871945 1 recorder.go:75] Recording config/clusteroperator/storage with fingerprint=a363d8f95e334d7adbdc114f6e654eff8fb32fe80e24ce77f605461cc48ab8ca I0705 02:31:08.871961 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0705 02:31:08.871971 1 recorder.go:75] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0705 02:31:08.871977 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.460634111s to process 39 records I0705 02:31:19.857423 1 tasks_processing.go:74] worker 5 stopped. I0705 02:31:19.857486 1 recorder.go:75] Recording config/installplans with fingerprint=f8cba67394dab62ce765c8aef4f0b3c62b1b05527bb14f47683d0630c8762f28 I0705 02:31:19.857505 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.422040355s to process 1 records I0705 02:31:20.611520 1 tasks_processing.go:74] worker 13 stopped. I0705 02:31:20.611885 1 recorder.go:75] Recording config/serviceaccounts with fingerprint=efc40044d682055ccf0bafa07603007a1089a320788c597c8b5fcf62ab9df25b I0705 02:31:20.611909 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 14.206624691s to process 1 records E0705 02:31:20.611985 1 periodic.go:247] "Unhandled Error" err="clusterconfig failed after 14.207s with: function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error" I0705 02:31:20.613089 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0705 02:31:20.613101 1 periodic.go:209] Running workloads gatherer I0705 02:31:20.613116 1 tasks_processing.go:45] number of workers: 2 I0705 02:31:20.613128 1 tasks_processing.go:69] worker 1 listening for tasks. I0705 02:31:20.613132 1 tasks_processing.go:71] worker 1 working on workload_info task. I0705 02:31:20.613133 1 tasks_processing.go:69] worker 0 listening for tasks. I0705 02:31:20.613148 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0705 02:31:20.618738 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-0-209.ec2.internal... I0705 02:31:20.618748 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-1-100.ec2.internal... I0705 02:31:20.618765 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-2-161.ec2.internal... I0705 02:31:20.634504 1 gather_helm_info.go:102] unable to get HelmChart from services on tssc-keycloak from keycloak. I0705 02:31:20.634520 1 gather_helm_info.go:102] unable to get HelmChart from services on tssc-keycloak from keycloak-pgsql. I0705 02:31:20.634527 1 gather_helm_info.go:102] unable to get HelmChart from services on tssc-tpa from server. I0705 02:31:20.634532 1 gather_helm_info.go:102] unable to get HelmChart from services on tssc-tpa from tpa-pgsql. I0705 02:31:20.646697 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tssc-keycloak from keycloak-pgsql-bee. I0705 02:31:20.646714 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tssc-tpa from importer. I0705 02:31:20.646718 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tssc-tpa from server. I0705 02:31:20.646723 1 gather_helm_info.go:102] unable to get HelmChart from deployments on tssc-tpa from tpa-pgsql-bee. I0705 02:31:20.646734 1 tasks_processing.go:74] worker 0 stopped. I0705 02:31:20.646743 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 33.572615ms to process 0 records I0705 02:31:29.118740 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 9s I0705 02:31:29.155864 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 32s for image data I0705 02:31:29.162491 1 gather_workloads_info.go:387] No image sha256:04c87c054a3f366a7dfbe0a93ebb0c80a098ee16842c5794b67c1202eec61996 (9ms) I0705 02:31:29.170031 1 gather_workloads_info.go:387] No image sha256:2904a78e2eb73fd6a9bb94c105c2a056831fb4113fbb7b0607c50adc9d879c9b (8ms) I0705 02:31:29.177144 1 gather_workloads_info.go:387] No image sha256:765f0d23b637f685f98a31bd47c131b03cf72a40761a3f9a9d6320faa3c33733 (7ms) I0705 02:31:29.184085 1 gather_workloads_info.go:387] No image sha256:f36eea94c52e358f4470211dd113d6a4a465dc389929dcd538b4e111c96092f9 (7ms) I0705 02:31:29.190706 1 gather_workloads_info.go:387] No image sha256:5a95c19d82767e0235b4edb4a0536482c816904897aae1dc3eb255cb52b87a9f (7ms) I0705 02:31:29.197546 1 gather_workloads_info.go:387] No image sha256:01a26e01918b5afb2f35db61b52f3b0156213ac93df0d8bb39758fa8c5ebf31a (7ms) I0705 02:31:29.204390 1 gather_workloads_info.go:387] No image sha256:494602e24bc90f69f9bbb1725b022e65b76bf0edd0e43f3883492a67c675fb3f (7ms) I0705 02:31:29.211257 1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (7ms) I0705 02:31:29.218102 1 gather_workloads_info.go:387] No image sha256:695cf2f0cc07683c2a3ce1eaf3e56fe18abc6e2bac716f7d9843f5d173b9df52 (7ms) I0705 02:31:29.225110 1 gather_workloads_info.go:387] No image sha256:3f586d6fd6139bbad131716168590b12db0cdfe4dcbb15ccee65b080d5594b6e (7ms) I0705 02:31:29.262434 1 gather_workloads_info.go:387] No image sha256:5f0b67cfbbc381243fb91ccc17345b56d05f4d717c667e8c644e5bf05633ba71 (37ms) I0705 02:31:29.362823 1 gather_workloads_info.go:387] No image sha256:2e564f336c77116053f34d4201d364d8da04e789cfffa0ea422574c95f2d6404 (100ms) I0705 02:31:29.463633 1 gather_workloads_info.go:387] No image sha256:fbc4a7fbc48d1888c314de042fdce35a213aa0d12dce1c097fbac7eb1ad1a2d1 (101ms) I0705 02:31:29.563444 1 gather_workloads_info.go:387] No image sha256:a258c226562adb14e3a163a1940938526ee6a0928982a7667d85d9a7334ce639 (100ms) I0705 02:31:29.664781 1 gather_workloads_info.go:387] No image sha256:517a98436c7ab863d0ecb5868767aa65b5b96cee51377ed9653014502f374040 (101ms) I0705 02:31:29.763043 1 gather_workloads_info.go:387] No image sha256:af26c01c9129a5f2fbe128d2fe7fe25fb03c0ee6cd76571155147cd4ea3c2de1 (98ms) I0705 02:31:29.862865 1 gather_workloads_info.go:387] No image sha256:c3f3d964aaa59be902f4c303a0d7b30bc9fa16afba74be3209c5084d06105c5b (100ms) I0705 02:31:29.962080 1 gather_workloads_info.go:387] No image sha256:044d2d72c21329826c144d9b55c381576a421188139de0fed693e74997665d2c (99ms) I0705 02:31:30.062791 1 gather_workloads_info.go:387] No image sha256:2598489729a4b258e4ecda4a06f6875133f2a10ced5c5241f8a57a8a05418e36 (101ms) I0705 02:31:30.163822 1 gather_workloads_info.go:387] No image sha256:2336fa9da4e7b844a4b666f364e6357d6ac5f5d203a0c690380af2b59130888f (101ms) I0705 02:31:30.263139 1 gather_workloads_info.go:387] No image sha256:7b31223098f08328f5ddea8e5b871dbbd5f5a61ec550e8956f66793c0c6031a9 (99ms) I0705 02:31:30.362482 1 gather_workloads_info.go:387] No image sha256:0b2579cba0fd9f1754c2c9515d5f873f45de009cf044ce950284dbd1a4e6f10c (99ms) I0705 02:31:30.463099 1 gather_workloads_info.go:387] No image sha256:2c9bd92ff3dd932803de061270880d8179f32b7c1217dbc8606d973c7552edcd (101ms) I0705 02:31:30.563842 1 gather_workloads_info.go:387] No image sha256:0092c6ff139f8698c91349d507eb3182bc5d6c4ae040f672e347ff504accdea2 (101ms) I0705 02:31:30.663287 1 gather_workloads_info.go:387] No image sha256:1dd9951c19379080ffa3669910d0bd4cbf825001e934507cb6c6827643b3b506 (99ms) I0705 02:31:30.763719 1 gather_workloads_info.go:387] No image sha256:211b02cf9459cf687e539459ac275db49a7768124da00873fc46a0c95b9c2936 (100ms) I0705 02:31:30.862958 1 gather_workloads_info.go:387] No image sha256:12ee577bf514a68c17d1b5ad73b91365c3f242bd82edee45422326ba2e0c0b65 (99ms) I0705 02:31:30.962364 1 gather_workloads_info.go:387] No image sha256:25bda9d34e23ba6bc9df5cf7104bdb237269740a3a76ee025f88b34e68b7e2b5 (99ms) I0705 02:31:31.063553 1 gather_workloads_info.go:387] No image sha256:1a2532940843248c57d52141185dd71fbc393ab28b65d48f682038632c1dbbad (101ms) I0705 02:31:31.163722 1 gather_workloads_info.go:387] No image sha256:327d89e4b62d990dbf55d3c78f271373747816c2e0ab3c943fb016cdcf12f9b5 (100ms) I0705 02:31:31.262485 1 gather_workloads_info.go:387] No image sha256:af942926936e39d0f7a3ef1ed1af7fb97aaa04fee8a4ad4e6e21e8931ef42809 (99ms) I0705 02:31:31.363379 1 gather_workloads_info.go:387] No image sha256:0af73ad7a47c9ff53269ae2bc5163bf9e389085220c34e4bd42c92c4e7a85f6d (101ms) I0705 02:31:31.462620 1 gather_workloads_info.go:398] Found image sha256:b3909bf664c77097f75b3768830863d642eed3815dab2bfb4415c771ca2d5007 (99ms) I0705 02:31:31.563280 1 gather_workloads_info.go:387] No image sha256:7bd3e88d6d3f878a89203df590b684c5a77bf08df4717451d3197ab74683a80e (100ms) I0705 02:31:31.662620 1 gather_workloads_info.go:387] No image sha256:09e27b3a67ebeda04d3e597e0561bfb40550de78bdecb53f2f9ff3dfb1cfe7ea (99ms) I0705 02:31:31.762878 1 gather_workloads_info.go:387] No image sha256:02deaca0a579f91fde8db73d552e9527805556a1dce7545df713f66052a4810c (100ms) I0705 02:31:31.862573 1 gather_workloads_info.go:387] No image sha256:229a5afbbf57f509956f87aebdfffb93b97eda8811ebdec91815713da6811b59 (100ms) I0705 02:31:31.963179 1 gather_workloads_info.go:387] No image sha256:25933d9a51a2679fea10bda3d72addcadfe26a055a137c628bfdb5f818896536 (101ms) I0705 02:31:32.063374 1 gather_workloads_info.go:387] No image sha256:653c666f842c13e0baae2e89a9b1efe0e2ef56f621ffb5b32005115d2a26ab8c (100ms) I0705 02:31:32.162850 1 gather_workloads_info.go:398] Found image sha256:32d4561d4bf1b3c4e3a7878f918f9c1422bab85bdf8711fbdf905d59692fee81 (99ms) I0705 02:31:32.262634 1 gather_workloads_info.go:387] No image sha256:17b00ea67b6a611aa87f1c0db9308d972cb8a18403b6a7d4b53024145aa954c4 (100ms) I0705 02:31:32.363538 1 gather_workloads_info.go:387] No image sha256:2e57e192c3c1240fd935dcd55c8fde5e70e78bf81d6176c96edf21fafe59f8ba (101ms) I0705 02:31:32.463310 1 gather_workloads_info.go:387] No image sha256:a498046d64605bcccee2440aa4f04a4602baaae263cf01d977ec5208e876b1fd (100ms) I0705 02:31:32.563621 1 gather_workloads_info.go:387] No image sha256:7adc1eab05d6724c76ba751f6df816b08d6e70b78dee9eb94fa6fd9690542c98 (100ms) I0705 02:31:32.663354 1 gather_workloads_info.go:387] No image sha256:74713675d580a47a56b628469c4c05c41e114e0b935960d718ff0cf7e72f613d (100ms) I0705 02:31:32.764936 1 gather_workloads_info.go:387] No image sha256:8498abef3336055b783c25eb477b58d77bb5d2325caf7340d080a6c8f5825a6c (102ms) I0705 02:31:32.862351 1 gather_workloads_info.go:387] No image sha256:101993f6e65d6fda8b90c583b718b720809182961f69bc777295f47e6df4d7ce (97ms) I0705 02:31:32.963062 1 gather_workloads_info.go:387] No image sha256:36b9e89c3cfcf1ab9ae500486e38afb6862cba48cb0b4d84a09508ab8f3d299f (101ms) I0705 02:31:33.064579 1 gather_workloads_info.go:387] No image sha256:0a99240166165eb5718e7516a43282fe32df9c7c5e809b31b58abe44e42ff94d (101ms) I0705 02:31:33.163413 1 gather_workloads_info.go:387] No image sha256:90bdf9e678fe18e35401e34e1cb0912d822e9cb32b9e41cc545870540e9a87f2 (99ms) I0705 02:31:33.263162 1 gather_workloads_info.go:387] No image sha256:3612c5a433effd17b7aff7ff6edf4fb27b61153908e3a0294158e4886a1d600d (100ms) I0705 02:31:33.362722 1 gather_workloads_info.go:387] No image sha256:bad4019ce77d92b2ab9c8eda870766288d97cab3a1393093549d24a80aace047 (100ms) I0705 02:31:33.463307 1 gather_workloads_info.go:387] No image sha256:6e5df2aab9ce759e8f957341a11c087c233307e3c8f8760d21270efc19ccd3ce (101ms) I0705 02:31:33.563316 1 gather_workloads_info.go:387] No image sha256:03b2aecd6940db2ec188236c3c01a82aa837f8029842223814bea1ecfbbb8528 (100ms) I0705 02:31:33.662207 1 gather_workloads_info.go:387] No image sha256:1477f3287cc75352305274f248f781c1b7c2a8696f4f7bc450c45a4a5f5b10ea (99ms) I0705 02:31:33.762573 1 gather_workloads_info.go:387] No image sha256:51d8398c7057486fbc41a810031276ccd05179d43e9cf4369c8df440495c6ef7 (100ms) I0705 02:31:33.862808 1 gather_workloads_info.go:387] No image sha256:76cc47f3775560477ec548c7b6fddbd99112ad6604f790697eef546576051fb7 (100ms) I0705 02:31:33.964045 1 gather_workloads_info.go:387] No image sha256:6eea8b149271d047973a32a6e82a52927119a9ba9786f5f915dc7a3a2c40d162 (101ms) I0705 02:31:34.063400 1 gather_workloads_info.go:387] No image sha256:3d6ea9e1633f38070718a1357fcb80e6cb3932aafcc4d65e659795b186c5da15 (99ms) I0705 02:31:34.165473 1 gather_workloads_info.go:387] No image sha256:56a85660a445eced5c79a595a0eccf590087c5672d50f49d4c25ad52f9a44f04 (102ms) I0705 02:31:34.262770 1 gather_workloads_info.go:387] No image sha256:a56211d075aa43cbb491f669a5b2e46ee023dc95b7d51dbac28f463948c5ad61 (97ms) I0705 02:31:34.363750 1 gather_workloads_info.go:387] No image sha256:289816958633a763a72dbc44e1dad40466223164e7e253039514f0d974ea5d21 (101ms) I0705 02:31:34.463135 1 gather_workloads_info.go:387] No image sha256:73ef841545cc3eea70c00ec70ce6ee5e092ff77631d551d22e8524b2bb9f96b7 (99ms) I0705 02:31:34.562872 1 gather_workloads_info.go:387] No image sha256:17b7edfca16154d51adecafc976264993e3fba2b5f1b4c5a81b58fe73a1496a7 (100ms) I0705 02:31:34.662365 1 gather_workloads_info.go:387] No image sha256:1ce99295dc5ca11f7b03530875f96c437b6a24243a02f1d27cd69680b744bc48 (99ms) I0705 02:31:34.762963 1 gather_workloads_info.go:387] No image sha256:2f54bd911d6cdf28b8d12ded1ba959ed6684274f2f4130797f1c4048296ee534 (101ms) I0705 02:31:34.862294 1 gather_workloads_info.go:387] No image sha256:07ffa47b91d8966433d437daaa74d4a93a97fcfd0791b95d46ba2001091eaf0b (99ms) I0705 02:31:34.962634 1 gather_workloads_info.go:387] No image sha256:665ed245aae2058982ff53ea7b9cd20c710460da8631dfee554be3a9d22d8473 (100ms) I0705 02:31:35.062768 1 gather_workloads_info.go:387] No image sha256:513b1166e376feca472fdd5174f6abf0abf02925d6a21b7b4d89a2ff2fc67bed (100ms) I0705 02:31:35.162866 1 gather_workloads_info.go:387] No image sha256:3ce9f7ba2537b6d30f7d6978a73df0a551770a0b9b3f4934e35ab7f224fffe5b (100ms) I0705 02:31:35.262207 1 gather_workloads_info.go:387] No image sha256:3961960ed7ed6d8494b43fce0a122be8a76f7a67158eba23272735ce385b5c8e (99ms) I0705 02:31:35.363065 1 gather_workloads_info.go:387] No image sha256:502c9e94ad138d062ca6e81de89284f5bcc0d27595b193498cf35f7e1bff9a40 (101ms) I0705 02:31:35.462204 1 gather_workloads_info.go:387] No image sha256:260a73551007abc59f7cdb4030b711788daf6d2f0fe3d21cf136df2ad301b40a (99ms) I0705 02:31:35.567319 1 gather_workloads_info.go:387] No image sha256:1df098e6fb8c81eaa39d985b8136a64fa33529e221ce96d7be48b4281d3e7f9e (105ms) I0705 02:31:35.666419 1 gather_workloads_info.go:387] No image sha256:c940ea87e7d133d75ba0002ef00c0806825eed3db8094cdb260d1bac18127733 (99ms) I0705 02:31:35.763956 1 gather_workloads_info.go:387] No image sha256:03cf4cd7ef1518610c6c7b3ad27d1622d82e98e3dc6e3f8e5d0fceb5c8d3786e (98ms) I0705 02:31:35.862717 1 gather_workloads_info.go:387] No image sha256:50197f22710766515f67944a779e00dd9ae3d17b18732d7324a970353b11f292 (99ms) I0705 02:31:35.963405 1 gather_workloads_info.go:387] No image sha256:c264173da423033db15cc0cbc87ca8fd16fd5a73b56569fc88de45f0028b87b1 (101ms) I0705 02:31:36.063083 1 gather_workloads_info.go:387] No image sha256:521712486e2c6e3c020dad6a1cb340db8e55665b69f7c208fab9cd9e965fd588 (100ms) I0705 02:31:36.162604 1 gather_workloads_info.go:387] No image sha256:1c18a45da0ab827379f3d94dd9e03cc0633e43ed4306fff242dd3be7cff6da14 (99ms) I0705 02:31:36.262060 1 gather_workloads_info.go:387] No image sha256:943018739e3db1763c3184b460dbc409e058abbac76d57b9927faad317be85e4 (99ms) I0705 02:31:36.362567 1 gather_workloads_info.go:387] No image sha256:47154813651033d59751fb655a384dbffb64dd26f10bd7f3be0c3128d0486356 (100ms) I0705 02:31:36.462786 1 gather_workloads_info.go:387] No image sha256:0f3e37cad7209700badd622d18938d14c8675bbfe2448d015e2a18df07ef09ae (100ms) I0705 02:31:36.562836 1 gather_workloads_info.go:387] No image sha256:9d748d3f2c587649dbaf6c7f222aadf47ba4e744fab63a252d49ae1c9049e26c (100ms) I0705 02:31:36.661794 1 gather_workloads_info.go:387] No image sha256:3d31c0cfaf4219f5bd1c52882b603215d1cb4aaef5b8d1a128d0174e090f96f3 (99ms) I0705 02:31:36.762849 1 gather_workloads_info.go:387] No image sha256:450606ec5016587e02ec3996cc12d12c4be4e39357730fac9729858c12a01a8c (101ms) I0705 02:31:36.861717 1 gather_workloads_info.go:387] No image sha256:655da6cbef2269018f4adea617c26c10c6c437bd7de560909d452ca7da4f6068 (99ms) I0705 02:31:36.963073 1 gather_workloads_info.go:387] No image sha256:301d210efc58e5e08c62ce58e308298aa25f92743b261c258359b26231b179d4 (101ms) I0705 02:31:37.062570 1 gather_workloads_info.go:387] No image sha256:afe0725860b057f232222c5b7c7e8a3cbf72280dc348a12f0db75532ba368d07 (99ms) I0705 02:31:37.163294 1 gather_workloads_info.go:387] No image sha256:e5a637be392afaee403c3f15e76e661c44782bbda9173129c460d889093dc41f (101ms) I0705 02:31:37.262825 1 gather_workloads_info.go:387] No image sha256:47dc50b7a92d96c2dadc980c97f5d58e6e3fcadf5a29c7736209e7e9a47a47c3 (100ms) I0705 02:31:37.363926 1 gather_workloads_info.go:387] No image sha256:b99613494e9d6a4a8207323872d63cc02b830fc80a8bf972e62c64381aa4cd17 (101ms) I0705 02:31:37.462068 1 gather_workloads_info.go:387] No image sha256:6de3add0818fe352c79cdc4c53c792fcd4150e07908a9dae274e1a7b34d7e545 (98ms) I0705 02:31:37.563752 1 gather_workloads_info.go:387] No image sha256:91828234f107c068c8a4966d08370ae7b73e637651dbc6d92c18c4553402c22c (102ms) I0705 02:31:37.662814 1 gather_workloads_info.go:387] No image sha256:a0105d1eb62cf6ac9e5e2ef28d3e89bf6dc514bc594fc7090fe5a5ee18a09c87 (99ms) I0705 02:31:37.763786 1 gather_workloads_info.go:387] No image sha256:4556896f77307821531ef91b7b7faccb82b824ea695693b2989f597f0deca038 (101ms) I0705 02:31:37.863362 1 gather_workloads_info.go:387] No image sha256:adcbc7f0f6eca7c6c7fe8ca9493648e117665892bc6df00d6cae4e784126fc32 (100ms) I0705 02:31:37.963168 1 gather_workloads_info.go:387] No image sha256:1e65f9f5490fbc930d2dce96f03ddcb28990b839d7dc011ef5de5bec6c5095bf (100ms) I0705 02:31:38.061966 1 gather_workloads_info.go:387] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (99ms) I0705 02:31:38.062018 1 tasks_processing.go:74] worker 1 stopped. I0705 02:31:38.062552 1 recorder.go:75] Recording config/workload_info with fingerprint=aa77eb3d7e7571614914174839f9eaa2cd3ecdda57e97b6ffd5253b167a10a03 I0705 02:31:38.062577 1 gather.go:177] gatherer "workloads" function "workload_info" took 17.44887738s to process 1 records I0705 02:31:38.062612 1 periodic.go:256] Periodic gather workloads completed in 17.449s I0705 02:31:38.062623 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0705 02:31:38.062630 1 periodic.go:209] Running conditional gatherer I0705 02:31:38.070283 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.20.8/gathering_rules I0705 02:31:38.238836 1 conditional_gatherer.go:338] updating alerts cache for conditional gatherer I0705 02:31:38.240467 1 conditional_gatherer.go:374] alert "Watchdog" has state "firing" I0705 02:31:38.240482 1 conditional_gatherer.go:374] alert "KubeContainerWaiting" has state "pending" I0705 02:31:38.240486 1 conditional_gatherer.go:374] alert "KubeContainerWaiting" has state "pending" I0705 02:31:38.240489 1 conditional_gatherer.go:374] alert "PodSecurityViolation" has state "firing" I0705 02:31:38.240491 1 conditional_gatherer.go:374] alert "KubeDeploymentRolloutStuck" has state "pending" I0705 02:31:38.240493 1 conditional_gatherer.go:374] alert "AlertmanagerReceiversNotConfigured" has state "firing" I0705 02:31:38.240496 1 conditional_gatherer.go:374] alert "KubePodNotReady" has state "firing" I0705 02:31:38.240499 1 conditional_gatherer.go:374] alert "KubePodNotReady" has state "firing" I0705 02:31:38.240560 1 conditional_gatherer.go:384] updating version cache for conditional gatherer I0705 02:31:38.246773 1 conditional_gatherer.go:392] cluster version is '4.20.8' I0705 02:31:38.246832 1 tasks_processing.go:45] number of workers: 5 I0705 02:31:38.246849 1 tasks_processing.go:69] worker 4 listening for tasks. I0705 02:31:38.246853 1 tasks_processing.go:71] worker 4 working on conditional_gatherer_rules task. I0705 02:31:38.246864 1 tasks_processing.go:69] worker 1 listening for tasks. I0705 02:31:38.246875 1 tasks_processing.go:69] worker 0 listening for tasks. I0705 02:31:38.246881 1 tasks_processing.go:69] worker 3 listening for tasks. I0705 02:31:38.246885 1 tasks_processing.go:69] worker 2 listening for tasks. I0705 02:31:38.246920 1 tasks_processing.go:71] worker 1 working on remote_configuration task. I0705 02:31:38.246929 1 tasks_processing.go:71] worker 0 working on containers_logs/alert_name=KubePodNotReady,tail_lines=100 task. I0705 02:31:38.246922 1 tasks_processing.go:74] worker 2 stopped. I0705 02:31:38.246936 1 tasks_processing.go:71] worker 4 working on rapid_container_logs task. I0705 02:31:38.246948 1 tasks_processing.go:71] worker 3 working on pod_definition/alert_name=KubePodNotReady task. I0705 02:31:38.247051 1 recorder.go:75] Recording insights-operator/conditional-gatherer-rules with fingerprint=a4c5f995ccfff1d27fac09f7aea1f63ba755711531a4a5d205fdd421300b5678 I0705 02:31:38.247108 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.083µs to process 1 records I0705 02:31:38.247166 1 recorder.go:75] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0705 02:31:38.247179 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.381µs to process 1 records I0705 02:31:38.247188 1 tasks_processing.go:74] worker 1 stopped. I0705 02:31:38.247294 1 tasks_processing.go:74] worker 4 stopped. I0705 02:31:38.247314 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 346.708µs to process 0 records I0705 02:31:38.254969 1 tasks_processing.go:74] worker 3 stopped. I0705 02:31:38.255242 1 recorder.go:75] Recording conditional/namespaces/openshift-ingress/pods/router-default-7db758d579-hpm5j/router-default-7db758d579-hpm5j with fingerprint=52db48945b6ab8eb634db998978b9852d560747040fee7c082fb12c81306c452 I0705 02:31:38.255410 1 recorder.go:75] Recording conditional/namespaces/openshift-ingress/pods/router-default-7db758d579-4bscw/router-default-7db758d579-4bscw with fingerprint=358bb3ac7e4e45b70e2e2b07f1e0f2a756d97fee5b3cffd379fc89f4df0a4393 I0705 02:31:38.255423 1 gather.go:177] gatherer "conditional" function "pod_definition/alert_name=KubePodNotReady" took 8.005091ms to process 2 records W0705 02:31:38.277073 1 gather_containers_logs.go:136] unable to get container logs: container "router" in pod "router-default-7db758d579-hpm5j" is waiting to start: ContainerCreating W0705 02:31:38.306508 1 gather_containers_logs.go:136] unable to get container logs: container "router" in pod "router-default-7db758d579-4bscw" is waiting to start: ContainerCreating I0705 02:31:38.306529 1 tasks_processing.go:74] worker 0 stopped. E0705 02:31:38.306540 1 gather.go:140] gatherer "conditional" function "containers_logs/alert_name=KubePodNotReady,tail_lines=100" failed with the error: unable to get container logs: container "router" in pod "router-default-7db758d579-hpm5j" is waiting to start: ContainerCreating E0705 02:31:38.306547 1 gather.go:140] gatherer "conditional" function "containers_logs/alert_name=KubePodNotReady,tail_lines=100" failed with the error: unable to get container logs: container "router" in pod "router-default-7db758d579-4bscw" is waiting to start: ContainerCreating I0705 02:31:38.306561 1 gather.go:177] gatherer "conditional" function "containers_logs/alert_name=KubePodNotReady,tail_lines=100" took 59.585582ms to process 0 records I0705 02:31:38.306616 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=Succeeded message= I0705 02:31:38.306643 1 recorder.go:75] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I0705 02:31:38.331271 1 recorder.go:75] Recording insights-operator/gathers with fingerprint=9e13f4b1fd3599642bb1c7e438153f945de33e4a60f9998375b025469e466a78 I0705 02:31:38.331385 1 diskrecorder.go:70] Writing 130 records to /var/lib/insights-operator/insights-2026-07-05-023138.tar.gz I0705 02:31:38.341226 1 diskrecorder.go:51] Wrote 130 records to disk in 9ms I0705 02:31:38.341272 1 periodic.go:278] Gathering cluster info every 2h0m0s I0705 02:31:38.341290 1 periodic.go:279] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0705 02:31:51.878770 1 controller.go:512] The operator is healthy I0705 02:32:36.405166 1 diskrecorder.go:223] Found files to send: insights-2026-07-05-023138.tar.gz I0705 02:32:36.405199 1 insightsuploader.go:150] Checking archives to upload periodically every 15m37.090397181s I0705 02:32:36.405213 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0705 02:32:36.415859 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0705 02:32:36.606396 1 requests.go:87] Successfully reported id=2026-07-05T02:32:36Z x-rh-insights-request-id=dbb05d255784483fb7ced30bbbb66ccd, wrote=70747 I0705 02:32:36.606509 1 insightsuploader.go:187] Uploaded report successfully in 201.287683ms I0705 02:32:36.606543 1 controller.go:128] Initializing last reported time to 2026-07-05T02:32:36Z I0705 02:32:36.606556 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0705 02:32:36.606566 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0705 02:32:36.606578 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0705 02:32:36.611844 1 controller.go:512] The operator is healthy I0705 02:33:37.033289 1 insightsreport.go:137] Pulling report from smart-proxy I0705 02:33:37.033319 1 insightsreport.go:149] Retrieving report I0705 02:33:37.040537 1 requests.go:110] Retrieving report for cluster: 79ba66d8-d237-4fcb-a4cf-f466f3c79e0f I0705 02:33:37.040550 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/79ba66d8-d237-4fcb-a4cf-f466f3c79e0f/reports I0705 02:33:37.043822 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/79ba66d8-d237-4fcb-a4cf-f466f3c79e0f/reports I0705 02:33:37.256763 1 insightsreport.go:184] Report retrieved I0705 02:33:37.307809 1 insightsreport.go:239] Report retrieved correctly I0705 02:33:51.874769 1 controller.go:512] The operator is healthy I0705 02:34:42.744852 1 configmapobserver.go:84] configmaps "insights-config" not found I0705 02:34:42.793098 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 02:34:42.797458 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 02:34:42.797475 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 02:34:42.801190 1 secretconfigobserver.go:119] support secret does not exist I0705 02:35:51.876845 1 controller.go:512] The operator is healthy I0705 02:37:51.877009 1 controller.go:512] The operator is healthy I0705 02:39:42.801633 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 02:39:42.806068 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 02:39:42.806088 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 02:39:42.809536 1 secretconfigobserver.go:119] support secret does not exist I0705 02:39:51.876317 1 controller.go:512] The operator is healthy I0705 02:41:51.878228 1 controller.go:512] The operator is healthy I0705 02:43:51.875695 1 controller.go:512] The operator is healthy I0705 02:44:42.749756 1 configmapobserver.go:84] configmaps "insights-config" not found I0705 02:44:42.809875 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 02:44:42.814639 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 02:44:42.814657 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 02:44:42.817991 1 secretconfigobserver.go:119] support secret does not exist I0705 02:45:51.876763 1 controller.go:512] The operator is healthy I0705 02:47:51.879093 1 controller.go:512] The operator is healthy I0705 02:48:18.698556 1 insightsuploader.go:146] Nothing to report since 2026-07-05T02:32:36Z I0705 02:49:42.818698 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 02:49:42.823735 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 02:49:42.823764 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 02:49:42.827225 1 secretconfigobserver.go:119] support secret does not exist I0705 02:49:51.875254 1 controller.go:512] The operator is healthy I0705 02:51:51.876312 1 controller.go:512] The operator is healthy I0705 02:53:51.879542 1 controller.go:512] The operator is healthy I0705 02:54:42.745611 1 configmapobserver.go:84] configmaps "insights-config" not found I0705 02:54:42.828000 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0705 02:54:42.832370 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0705 02:54:42.832394 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0705 02:54:42.835918 1 secretconfigobserver.go:119] support secret does not exist