I1009 01:46:10.197448 1 cmd.go:253] Using service-serving-cert provided certificates I1009 01:46:10.197798 1 observer_polling.go:159] Starting file observer W1009 01:46:10.220644 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I1009 01:46:10.450109 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I1009 01:46:10.450274 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I1009 01:46:10.450772 1 secure_serving.go:57] Forcing use of http/1.1 only W1009 01:46:10.450792 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W1009 01:46:10.450796 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W1009 01:46:10.450799 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W1009 01:46:10.450802 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W1009 01:46:10.450804 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W1009 01:46:10.450806 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I1009 01:46:10.450847 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I1009 01:46:10.454736 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I1009 01:46:10.454746 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I1009 01:46:10.458305 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I1009 01:46:10.458322 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I1009 01:46:10.458332 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I1009 01:46:10.458346 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1009 01:46:10.458352 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1009 01:46:10.458336 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController E1009 01:46:10.458453 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18dcb930aa61a55d openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-10-09 01:46:10.454709597 +0000 UTC m=+0.287994380,LastTimestamp:2026-10-09 01:46:10.454709597 +0000 UTC m=+0.287994380,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" I1009 01:46:10.458541 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I1009 01:46:10.458663 1 secure_serving.go:213] Serving securely on [::]:8443 I1009 01:46:10.458691 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" W1009 01:46:10.459557 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I1009 01:46:10.459577 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1009 01:46:10.459671 1 base_controller.go:76] Waiting for caches to sync for ConfigController I1009 01:46:10.464427 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1009 01:46:10.464444 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1009 01:46:10.468941 1 secretconfigobserver.go:119] support secret does not exist I1009 01:46:10.473239 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1009 01:46:10.476929 1 secretconfigobserver.go:119] support secret does not exist I1009 01:46:10.479468 1 recorder.go:156] Pruning old reports every 7h34m43s, max age is 288h0m0s I1009 01:46:10.485816 1 periodic.go:212] Running clusterconfig gatherer I1009 01:46:10.485828 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I1009 01:46:10.485836 1 insightsreport.go:296] Starting report retriever I1009 01:46:10.485841 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I1009 01:46:10.485857 1 tasks_processing.go:45] number of workers: 64 I1009 01:46:10.485886 1 tasks_processing.go:69] worker 10 listening for tasks. I1009 01:46:10.485818 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I1009 01:46:10.485902 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I1009 01:46:10.485906 1 tasks_processing.go:71] worker 10 working on lokistack task. I1009 01:46:10.485914 1 tasks_processing.go:69] worker 37 listening for tasks. I1009 01:46:10.485918 1 tasks_processing.go:71] worker 37 working on metrics task. I1009 01:46:10.485923 1 tasks_processing.go:69] worker 0 listening for tasks. I1009 01:46:10.485928 1 tasks_processing.go:69] worker 23 listening for tasks. I1009 01:46:10.485931 1 tasks_processing.go:69] worker 1 listening for tasks. I1009 01:46:10.485934 1 tasks_processing.go:69] worker 11 listening for tasks. I1009 01:46:10.485938 1 tasks_processing.go:69] worker 2 listening for tasks. I1009 01:46:10.485939 1 tasks_processing.go:69] worker 18 listening for tasks. I1009 01:46:10.485943 1 tasks_processing.go:69] worker 19 listening for tasks. I1009 01:46:10.485944 1 tasks_processing.go:69] worker 3 listening for tasks. I1009 01:46:10.485947 1 tasks_processing.go:69] worker 20 listening for tasks. I1009 01:46:10.485946 1 tasks_processing.go:69] worker 17 listening for tasks. I1009 01:46:10.485952 1 tasks_processing.go:69] worker 21 listening for tasks. I1009 01:46:10.485952 1 tasks_processing.go:69] worker 4 listening for tasks. I1009 01:46:10.485955 1 tasks_processing.go:69] worker 12 listening for tasks. I1009 01:46:10.485955 1 tasks_processing.go:69] worker 22 listening for tasks. I1009 01:46:10.485958 1 tasks_processing.go:69] worker 50 listening for tasks. I1009 01:46:10.485961 1 tasks_processing.go:69] worker 13 listening for tasks. I1009 01:46:10.485959 1 tasks_processing.go:69] worker 5 listening for tasks. I1009 01:46:10.485966 1 tasks_processing.go:69] worker 38 listening for tasks. I1009 01:46:10.485965 1 tasks_processing.go:69] worker 8 listening for tasks. I1009 01:46:10.485961 1 tasks_processing.go:69] worker 7 listening for tasks. I1009 01:46:10.485965 1 tasks_processing.go:69] worker 6 listening for tasks. I1009 01:46:10.485972 1 tasks_processing.go:69] worker 58 listening for tasks. I1009 01:46:10.485970 1 tasks_processing.go:69] worker 14 listening for tasks. I1009 01:46:10.485977 1 tasks_processing.go:69] worker 59 listening for tasks. I1009 01:46:10.485978 1 tasks_processing.go:69] worker 16 listening for tasks. I1009 01:46:10.485973 1 tasks_processing.go:69] worker 61 listening for tasks. I1009 01:46:10.485980 1 tasks_processing.go:69] worker 41 listening for tasks. I1009 01:46:10.485982 1 tasks_processing.go:69] worker 62 listening for tasks. I1009 01:46:10.485983 1 tasks_processing.go:69] worker 60 listening for tasks. I1009 01:46:10.485984 1 tasks_processing.go:69] worker 9 listening for tasks. I1009 01:46:10.485975 1 tasks_processing.go:69] worker 40 listening for tasks. I1009 01:46:10.485988 1 tasks_processing.go:69] worker 54 listening for tasks. I1009 01:46:10.485990 1 tasks_processing.go:69] worker 63 listening for tasks. I1009 01:46:10.485971 1 tasks_processing.go:69] worker 39 listening for tasks. I1009 01:46:10.485994 1 tasks_processing.go:69] worker 44 listening for tasks. I1009 01:46:10.485974 1 tasks_processing.go:69] worker 15 listening for tasks. I1009 01:46:10.485979 1 tasks_processing.go:69] worker 57 listening for tasks. I1009 01:46:10.486000 1 tasks_processing.go:69] worker 51 listening for tasks. I1009 01:46:10.485988 1 tasks_processing.go:69] worker 46 listening for tasks. I1009 01:46:10.485990 1 tasks_processing.go:69] worker 45 listening for tasks. I1009 01:46:10.485998 1 tasks_processing.go:69] worker 53 listening for tasks. I1009 01:46:10.486009 1 tasks_processing.go:69] worker 26 listening for tasks. I1009 01:46:10.485991 1 tasks_processing.go:69] worker 43 listening for tasks. I1009 01:46:10.485991 1 tasks_processing.go:69] worker 47 listening for tasks. I1009 01:46:10.485995 1 tasks_processing.go:69] worker 48 listening for tasks. I1009 01:46:10.486005 1 tasks_processing.go:69] worker 30 listening for tasks. I1009 01:46:10.486013 1 tasks_processing.go:69] worker 24 listening for tasks. I1009 01:46:10.485996 1 tasks_processing.go:69] worker 42 listening for tasks. I1009 01:46:10.486030 1 tasks_processing.go:69] worker 28 listening for tasks. I1009 01:46:10.486037 1 tasks_processing.go:69] worker 33 listening for tasks. I1009 01:46:10.486040 1 tasks_processing.go:69] worker 31 listening for tasks. I1009 01:46:10.486041 1 tasks_processing.go:69] worker 32 listening for tasks. I1009 01:46:10.486055 1 tasks_processing.go:69] worker 34 listening for tasks. I1009 01:46:10.486071 1 tasks_processing.go:71] worker 34 working on openstack_version task. I1009 01:46:10.486275 1 tasks_processing.go:69] worker 55 listening for tasks. I1009 01:46:10.486283 1 tasks_processing.go:69] worker 56 listening for tasks. I1009 01:46:10.486290 1 tasks_processing.go:71] worker 13 working on nodenetworkconfigurationpolicies task. I1009 01:46:10.486290 1 tasks_processing.go:71] worker 55 working on cost_management_metrics_configs task. I1009 01:46:10.486294 1 tasks_processing.go:71] worker 9 working on image_registries task. I1009 01:46:10.486349 1 tasks_processing.go:71] worker 40 working on ceph_cluster task. I1009 01:46:10.486368 1 tasks_processing.go:71] worker 23 working on sap_config task. I1009 01:46:10.486462 1 tasks_processing.go:71] worker 43 working on mutating_webhook_configurations task. I1009 01:46:10.486441 1 tasks_processing.go:71] worker 54 working on operators task. I1009 01:46:10.486444 1 tasks_processing.go:71] worker 63 working on support_secret task. I1009 01:46:10.486446 1 tasks_processing.go:71] worker 39 working on service_accounts task. I1009 01:46:10.486448 1 tasks_processing.go:71] worker 44 working on sap_datahubs task. I1009 01:46:10.486449 1 tasks_processing.go:71] worker 15 working on dvo_metrics task. I1009 01:46:10.486497 1 tasks_processing.go:71] worker 47 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I1009 01:46:10.486451 1 tasks_processing.go:71] worker 57 working on tsdb_status task. I1009 01:46:10.486452 1 tasks_processing.go:71] worker 51 working on operators_pods_and_events task. I1009 01:46:10.486525 1 tasks_processing.go:71] worker 48 working on openstack_dataplanenodesets task. I1009 01:46:10.486536 1 tasks_processing.go:71] worker 30 working on machine_configs task. I1009 01:46:10.486543 1 tasks_processing.go:71] worker 59 working on silenced_alerts task. I1009 01:46:10.486546 1 tasks_processing.go:71] worker 24 working on node_logs task. I1009 01:46:10.486550 1 tasks_processing.go:71] worker 16 working on openshift_logging task. I1009 01:46:10.486553 1 tasks_processing.go:71] worker 42 working on feature_gates task. I1009 01:46:10.486555 1 tasks_processing.go:71] worker 61 working on olm_operators task. I1009 01:46:10.486555 1 tasks_processing.go:71] worker 2 working on ingress task. I1009 01:46:10.486454 1 tasks_processing.go:71] worker 46 working on machine_autoscalers task. I1009 01:46:10.486562 1 tasks_processing.go:71] worker 31 working on nodenetworkstates task. I1009 01:46:10.486562 1 tasks_processing.go:71] worker 56 working on infrastructures task. I1009 01:46:10.486456 1 tasks_processing.go:71] worker 45 working on aggregated_monitoring_cr_names task. I1009 01:46:10.486566 1 tasks_processing.go:71] worker 41 working on storage_classes task. I1009 01:46:10.487251 1 tasks_processing.go:69] worker 49 listening for tasks. I1009 01:46:10.487324 1 tasks_processing.go:69] worker 36 listening for tasks. I1009 01:46:10.487294 1 tasks_processing.go:69] worker 27 listening for tasks. I1009 01:46:10.487425 1 tasks_processing.go:71] worker 27 working on proxies task. I1009 01:46:10.487565 1 tasks_processing.go:71] worker 21 working on version task. I1009 01:46:10.487598 1 tasks_processing.go:71] worker 20 working on container_runtime_configs task. I1009 01:46:10.487620 1 tasks_processing.go:71] worker 4 working on image task. I1009 01:46:10.486458 1 tasks_processing.go:71] worker 53 working on config_maps task. I1009 01:46:10.487432 1 tasks_processing.go:69] worker 35 listening for tasks. I1009 01:46:10.487779 1 tasks_processing.go:71] worker 35 working on cluster_apiserver task. I1009 01:46:10.487358 1 tasks_processing.go:71] worker 36 working on certificate_signing_requests task. I1009 01:46:10.486559 1 tasks_processing.go:71] worker 33 working on machine_config_pools task. I1009 01:46:10.487336 1 tasks_processing.go:71] worker 1 working on install_plans task. I1009 01:46:10.486460 1 tasks_processing.go:71] worker 26 working on networks task. I1009 01:46:10.487279 1 tasks_processing.go:69] worker 25 listening for tasks. I1009 01:46:10.488560 1 tasks_processing.go:71] worker 25 working on machines task. I1009 01:46:10.486290 1 tasks_processing.go:71] worker 60 working on image_pruners task. I1009 01:46:10.487380 1 tasks_processing.go:69] worker 52 listening for tasks. I1009 01:46:10.487436 1 tasks_processing.go:71] worker 17 working on monitoring_persistent_volumes task. I1009 01:46:10.488615 1 tasks_processing.go:71] worker 52 working on schedulers task. I1009 01:46:10.487440 1 tasks_processing.go:69] worker 29 listening for tasks. I1009 01:46:10.487481 1 tasks_processing.go:71] worker 18 working on openstack_controlplanes task. I1009 01:46:10.487502 1 tasks_processing.go:71] worker 32 working on nodes task. I1009 01:46:10.488689 1 tasks_processing.go:71] worker 8 working on openstack_dataplanedeployments task. I1009 01:46:10.487510 1 tasks_processing.go:71] worker 11 working on oauths task. I1009 01:46:10.487515 1 tasks_processing.go:71] worker 50 working on machine_healthchecks task. I1009 01:46:10.487547 1 tasks_processing.go:71] worker 12 working on pod_network_connectivity_checks task. I1009 01:46:10.487551 1 tasks_processing.go:71] worker 19 working on ingress_certificates task. I1009 01:46:10.487550 1 tasks_processing.go:71] worker 22 working on openshift_machine_api_events task. I1009 01:46:10.487560 1 tasks_processing.go:71] worker 3 working on storage_cluster task. I1009 01:46:10.487348 1 tasks_processing.go:71] worker 49 working on container_images task. I1009 01:46:10.487350 1 tasks_processing.go:71] worker 0 working on validating_webhook_configurations task. I1009 01:46:10.488664 1 tasks_processing.go:71] worker 29 working on sap_pods task. I1009 01:46:10.488742 1 tasks_processing.go:71] worker 28 working on active_alerts task. I1009 01:46:10.486534 1 tasks_processing.go:71] worker 14 working on clusterroles task. I1009 01:46:10.486525 1 tasks_processing.go:71] worker 6 working on crds task. I1009 01:46:10.489637 1 tasks_processing.go:71] worker 62 working on pdbs task. I1009 01:46:10.489652 1 tasks_processing.go:71] worker 5 working on jaegers task. I1009 01:46:10.489717 1 tasks_processing.go:71] worker 38 working on machine_sets task. I1009 01:46:10.486520 1 tasks_processing.go:71] worker 7 working on overlapping_namespace_uids task. I1009 01:46:10.486530 1 tasks_processing.go:71] worker 58 working on authentication task. I1009 01:46:10.490943 1 tasks_processing.go:74] worker 34 stopped. I1009 01:46:10.490956 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 4.857078ms to process 0 records I1009 01:46:10.491541 1 tasks_processing.go:74] worker 40 stopped. I1009 01:46:10.491552 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 5.180565ms to process 0 records I1009 01:46:10.492158 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I1009 01:46:10.492170 1 controller.go:317] The initial operator extension status is healthy I1009 01:46:10.492176 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1009 01:46:10.492180 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1009 01:46:10.492183 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1009 01:46:10.492194 1 controller.go:458] The operator is still being initialized I1009 01:46:10.492198 1 controller.go:481] The operator is healthy I1009 01:46:10.492209 1 tasks_processing.go:74] worker 10 stopped. I1009 01:46:10.492220 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 6.295772ms to process 0 records I1009 01:46:10.492234 1 tasks_processing.go:74] worker 55 stopped. I1009 01:46:10.492241 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 5.938462ms to process 0 records I1009 01:46:10.492319 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W1009 01:46:10.492337 1 operator.go:287] started I1009 01:46:10.492353 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I1009 01:46:10.492411 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I1009 01:46:10.494555 1 tasks_processing.go:74] worker 42 stopped. I1009 01:46:10.494687 1 recorder.go:70] Recording config/featuregate with fingerprint=bf85530379f86d0e00a9a6aa2be258b859ee83fd5d538c285bd98c71e973fde2 I1009 01:46:10.494698 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 7.991915ms to process 1 records I1009 01:46:10.497630 1 tasks_processing.go:74] worker 31 stopped. I1009 01:46:10.497641 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 11.061461ms to process 0 records I1009 01:46:10.497663 1 tasks_processing.go:74] worker 33 stopped. I1009 01:46:10.497672 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 9.54134ms to process 0 records I1009 01:46:10.497678 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 8.941781ms to process 0 records E1009 01:46:10.497683 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I1009 01:46:10.497691 1 gather.go:177] gatherer "clusterconfig" function "machines" took 9.102853ms to process 0 records E1009 01:46:10.497695 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I1009 01:46:10.497703 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 8.961024ms to process 0 records I1009 01:46:10.497708 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 10.062635ms to process 0 records I1009 01:46:10.497712 1 tasks_processing.go:74] worker 20 stopped. I1009 01:46:10.497715 1 tasks_processing.go:74] worker 3 stopped. I1009 01:46:10.497717 1 tasks_processing.go:74] worker 25 stopped. I1009 01:46:10.497719 1 tasks_processing.go:74] worker 50 stopped. I1009 01:46:10.497837 1 tasks_processing.go:74] worker 35 stopped. I1009 01:46:10.497978 1 recorder.go:70] Recording config/apiserver with fingerprint=3be101e0fb2aa63b69584e892183bbbb820f7094f6e8d7fc85625a5527513c70 I1009 01:46:10.497988 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 10.047348ms to process 1 records I1009 01:46:10.503746 1 tasks_processing.go:74] worker 5 stopped. I1009 01:46:10.503758 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 14.085159ms to process 0 records I1009 01:46:10.503763 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 14.021768ms to process 0 records I1009 01:46:10.503768 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 15.056767ms to process 0 records I1009 01:46:10.503770 1 tasks_processing.go:74] worker 38 stopped. I1009 01:46:10.503772 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 17.198528ms to process 0 records I1009 01:46:10.503777 1 tasks_processing.go:74] worker 8 stopped. I1009 01:46:10.503775 1 tasks_processing.go:74] worker 46 stopped. I1009 01:46:10.503784 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 17.27219ms to process 0 records I1009 01:46:10.503795 1 tasks_processing.go:74] worker 44 stopped. I1009 01:46:10.503831 1 tasks_processing.go:74] worker 27 stopped. I1009 01:46:10.503877 1 recorder.go:70] Recording config/proxy with fingerprint=79de966bcad6b5ebf8c634d386b657322d1a1543020983e59a566a5e1e3e645e I1009 01:46:10.503886 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 16.260727ms to process 1 records I1009 01:46:10.503943 1 tasks_processing.go:74] worker 2 stopped. I1009 01:46:10.504062 1 recorder.go:70] Recording config/ingress with fingerprint=f6bca160e6e31b646bd489c3b27d4382b220ad081ef335d88b2eaf3f8b7d0897 I1009 01:46:10.504069 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 17.377007ms to process 1 records I1009 01:46:10.506548 1 tasks_processing.go:74] worker 18 stopped. I1009 01:46:10.506556 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 17.896359ms to process 0 records I1009 01:46:10.506561 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 20.094367ms to process 0 records I1009 01:46:10.506565 1 tasks_processing.go:74] worker 23 stopped. I1009 01:46:10.512047 1 tasks_processing.go:74] worker 9 stopped. I1009 01:46:10.512472 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=50d819e1deb475a3e9744e361bca7c703c06464a1266dbf283d37e204638deed I1009 01:46:10.512484 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 25.738824ms to process 1 records E1009 01:46:10.513606 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: no such host I1009 01:46:10.513618 1 tasks_processing.go:74] worker 57 stopped. E1009 01:46:10.513623 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: no such host I1009 01:46:10.513629 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 27.113639ms to process 0 records E1009 01:46:10.513655 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: no such host I1009 01:46:10.513675 1 tasks_processing.go:74] worker 37 stopped. E1009 01:46:10.513686 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp: lookup prometheus-k8s.openshift-monitoring.svc on 172.30.0.10:53: no such host I1009 01:46:10.513704 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 27.749688ms to process 0 records E1009 01:46:10.513971 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: no such host I1009 01:46:10.513980 1 tasks_processing.go:74] worker 28 stopped. E1009 01:46:10.513984 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: no such host I1009 01:46:10.513990 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 25.227411ms to process 0 records E1009 01:46:10.514008 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: no such host I1009 01:46:10.514015 1 tasks_processing.go:74] worker 59 stopped. E1009 01:46:10.514020 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp: lookup alertmanager-main.openshift-monitoring.svc on 172.30.0.10:53: no such host I1009 01:46:10.514026 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 27.46742ms to process 0 records I1009 01:46:10.516999 1 tasks_processing.go:74] worker 11 stopped. I1009 01:46:10.517182 1 recorder.go:70] Recording config/oauth with fingerprint=f40d98c7135b993882b2ef214313f16b6357343317f327410d27e0764eb2ca7f I1009 01:46:10.517194 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 28.288766ms to process 1 records I1009 01:46:10.519568 1 tasks_processing.go:74] worker 43 stopped. I1009 01:46:10.519691 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=892cbeb34377530f3ef0c5d49d296da4629ac76b0712e2464462131736d3a463 I1009 01:46:10.519715 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=699f31d0df1aeb94e18bae9449d5fd1571d59d9511e1848c96b407157a814d50 I1009 01:46:10.519732 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=06f043daefc4cf040d580f251e3ca406a4932d0de2674a9ec71ca34a033139a2 I1009 01:46:10.519741 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 33.09617ms to process 3 records I1009 01:46:10.519809 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=9aa5523e6c8f7bef87cd4b31dc92708ba8cdf9529fb695f4aefe8aa52add151b I1009 01:46:10.519822 1 tasks_processing.go:74] worker 62 stopped. I1009 01:46:10.519824 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=88cbefc6685174df8192c0aa9e46af2fabafc31fb7113c47498fcd37771d71fc I1009 01:46:10.519855 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=940e40daffc7f0db8431e3239b2055d6e1eacc8fa27df4e0cbd71911f6771317 I1009 01:46:10.519871 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=d76760ad62679b0a8731fd63e5a5df4e57b6d2f4bf2890c039860d298826261a I1009 01:46:10.519884 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=e5ab0200f325339f684028f579d795e04c31a6f362719d65f4b438581e240916 I1009 01:46:10.519899 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=9beee7cbf368af5ecf29475aeb381a25e48265cdad721fe400e91f3cb88e4a6c I1009 01:46:10.519906 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 29.926986ms to process 6 records I1009 01:46:10.519983 1 tasks_processing.go:74] worker 32 stopped. I1009 01:46:10.520145 1 recorder.go:70] Recording config/node/ip-10-0-143-240.ec2.internal with fingerprint=adc054d8d101359d13d69b560193f8c8ebdbb1a32f01983325181c675840898b I1009 01:46:10.520183 1 recorder.go:70] Recording config/node/ip-10-0-154-87.ec2.internal with fingerprint=dbd4ba8c40e081b6da29efc148ba42163534ca16b9fe39b9b6686ca8a3423c00 I1009 01:46:10.520222 1 recorder.go:70] Recording config/node/ip-10-0-174-247.ec2.internal with fingerprint=4eef530f6ac9586cd28b613d5257463a3c5d8b3d69e6817a87f9b145a5f14c39 I1009 01:46:10.520229 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 30.989033ms to process 3 records I1009 01:46:10.521274 1 tasks_processing.go:74] worker 36 stopped. I1009 01:46:10.521287 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 33.406644ms to process 0 records I1009 01:46:10.521370 1 tasks_processing.go:74] worker 15 stopped. I1009 01:46:10.521381 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=108780cb24f15bf572a4031966507398a0d0c6a28b3a008952f53b481dc191a9 I1009 01:46:10.521403 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 34.866387ms to process 1 records I1009 01:46:10.522855 1 tasks_processing.go:74] worker 13 stopped. I1009 01:46:10.522863 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 36.560708ms to process 0 records I1009 01:46:10.522868 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 36.300704ms to process 0 records I1009 01:46:10.522872 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 36.329676ms to process 0 records I1009 01:46:10.522875 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 34.147722ms to process 0 records I1009 01:46:10.522879 1 tasks_processing.go:74] worker 29 stopped. I1009 01:46:10.522880 1 tasks_processing.go:74] worker 16 stopped. I1009 01:46:10.522882 1 tasks_processing.go:74] worker 48 stopped. I1009 01:46:10.526626 1 tasks_processing.go:74] worker 12 stopped. E1009 01:46:10.526640 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I1009 01:46:10.526647 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 37.913616ms to process 0 records I1009 01:46:10.526824 1 tasks_processing.go:74] worker 4 stopped. I1009 01:46:10.526903 1 recorder.go:70] Recording config/image with fingerprint=b87bbbf3a7527009ec6fb15958c08f2d419836ba39f5c3c282826e007126ad44 I1009 01:46:10.526918 1 gather.go:177] gatherer "clusterconfig" function "image" took 39.196774ms to process 1 records I1009 01:46:10.526994 1 tasks_processing.go:74] worker 58 stopped. I1009 01:46:10.527050 1 recorder.go:70] Recording config/authentication with fingerprint=b50dca10a4d3a5e8f0db2c86dc964d1f510a4972690ac2baf40ca388cbfb0da0 I1009 01:46:10.527061 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 36.78998ms to process 1 records I1009 01:46:10.527136 1 tasks_processing.go:74] worker 63 stopped. E1009 01:46:10.527145 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I1009 01:46:10.527152 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 40.649122ms to process 0 records I1009 01:46:10.527513 1 tasks_processing.go:74] worker 7 stopped. I1009 01:46:10.527535 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I1009 01:46:10.527543 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 37.59094ms to process 1 records I1009 01:46:10.528824 1 tasks_processing.go:74] worker 22 stopped. I1009 01:46:10.528838 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 40.094489ms to process 0 records I1009 01:46:10.528967 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1009 01:46:10.528976 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1009 01:46:10.528979 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1009 01:46:10.528983 1 controller.go:203] Source scaController *sca.Controller is not ready I1009 01:46:10.528985 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I1009 01:46:10.528997 1 controller.go:458] The operator is still being initialized I1009 01:46:10.529004 1 controller.go:481] The operator is healthy I1009 01:46:10.536904 1 tasks_processing.go:74] worker 60 stopped. I1009 01:46:10.536996 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=0ea3e03b58aee12aeb964b3d663f112bd554551129563a189511898fda8a5761 I1009 01:46:10.537011 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 48.297909ms to process 1 records I1009 01:46:10.537096 1 tasks_processing.go:74] worker 26 stopped. I1009 01:46:10.537142 1 recorder.go:70] Recording config/network with fingerprint=3c6f13820c6219ddf63b1d6d852d7f856d7980dc91d1f5ed927372ed1dbf6d50 I1009 01:46:10.537153 1 gather.go:177] gatherer "clusterconfig" function "networks" took 48.554731ms to process 1 records E1009 01:46:10.537162 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I1009 01:46:10.537173 1 tasks_processing.go:74] worker 30 stopped. I1009 01:46:10.537178 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I1009 01:46:10.537188 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 50.521859ms to process 1 records I1009 01:46:10.539877 1 tasks_processing.go:74] worker 17 stopped. I1009 01:46:10.539890 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 51.258418ms to process 0 records I1009 01:46:10.539983 1 tasks_processing.go:74] worker 6 stopped. I1009 01:46:10.540357 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=4daaf366d751f20e212fa4622312ebb36ec2c61bb76877131a147c870561aced I1009 01:46:10.540500 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=6d4a6eca6b96ab493f3917323e167614f6f97f74498b99451b6724189ee8bd74 I1009 01:46:10.540512 1 gather.go:177] gatherer "clusterconfig" function "crds" took 50.79056ms to process 2 records I1009 01:46:10.540557 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=c36abb2be33d5837951c0ff7bc6c46b10c4993f327324be510567ee38c60d592 I1009 01:46:10.540566 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 51.396268ms to process 1 records I1009 01:46:10.540600 1 tasks_processing.go:74] worker 52 stopped. I1009 01:46:10.540644 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=9b77ce27f0b9a47badd05582e41bbecb9799614e0358995dda96139a6994f379 I1009 01:46:10.540671 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=949e76e27f2725025664528d1aae95288d85e4deef361f55fa0babc95bbbf7de I1009 01:46:10.540670 1 tasks_processing.go:74] worker 0 stopped. I1009 01:46:10.540710 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=d8138f90af59d5bb06c4b80b2518dd3d5fa6554da1e74b7edb8543b13251b459 I1009 01:46:10.540726 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=0c77539fad3b6d165a7b94aa0ccdbb1fa8990a1f1359211817fabd759b784bb8 I1009 01:46:10.540737 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=2d4344cd37a9cd8aa7ee05aa1255a1b76994ce8a2beba5b708353d8a31fb13c6 I1009 01:46:10.540751 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=f600f0a883c72b2071242f3c08a0cb80fb09c1725e7f0f8f2848d35aef452c88 I1009 01:46:10.540765 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=87c5d5b3201fef0a9f4007f51a3e27e8e175c11a8642fee05b02302a53e5dc75 I1009 01:46:10.540779 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=419016bfc4e4b81505f16342c2aa2e279831607381ea8bc454666dbb00082f66 I1009 01:46:10.540792 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=7c728a6a42f454a84cfc7e1e044a64d7018ee5e6d19f33b744bf81d6e4bd0cc0 I1009 01:46:10.540811 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=697962bbc2e74a678bb45fe0a608aa43120c30743bda9ae98dbff27ad6a11876 I1009 01:46:10.540826 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=4c368f4b5c1d490667c91793b550840c1fd33c43e57a9437ce4ff794c3b31d94 I1009 01:46:10.540840 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=93cce9d82f4f066ab24f31d81524e4fcbd22dd0fdbb1fd754290c02bf5b1a777 I1009 01:46:10.540870 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=9a3a27214473dbd2fdb9499295d694fe87d09571e6c066f614453204bf510e40 I1009 01:46:10.540877 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 51.378953ms to process 13 records I1009 01:46:10.540929 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=83251680483f2ffdbfce00160f819696d5ee63dd6df61611babe366bf231887c I1009 01:46:10.540939 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=6d1ff711ea9398aa7580533e789ebe8c5ff7e7cd4af54939cdf97ad6a561686c I1009 01:46:10.540942 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 52.916992ms to process 2 records I1009 01:46:10.540966 1 tasks_processing.go:74] worker 41 stopped. I1009 01:46:10.541034 1 tasks_processing.go:74] worker 56 stopped. I1009 01:46:10.541362 1 recorder.go:70] Recording config/infrastructure with fingerprint=491594301c1a69d95a81a24e640d8b2f2ff0119b05fcce8a5348aced2c7f047e I1009 01:46:10.541369 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 53.722933ms to process 1 records I1009 01:46:10.550422 1 tasks_processing.go:74] worker 21 stopped. I1009 01:46:10.551385 1 recorder.go:70] Recording config/version with fingerprint=5e1e84f14d3f5f70f73e9cb8bbe1e1b05220e68e27eca862c3045ed4f4a344f1 I1009 01:46:10.551472 1 recorder.go:70] Recording config/id with fingerprint=bbd6c575c7469e8b0d24052a2ead37eda11ae61af591ed857a929ed370efc1f0 I1009 01:46:10.551487 1 gather.go:177] gatherer "clusterconfig" function "version" took 62.845063ms to process 2 records I1009 01:46:10.551496 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 64.693921ms to process 0 records I1009 01:46:10.551526 1 tasks_processing.go:74] worker 45 stopped. I1009 01:46:10.551787 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=b9c2fb819c683d3594c080d966cea7382121d83d565341b3cca42fc3ad260a10 I1009 01:46:10.552175 1 tasks_processing.go:74] worker 14 stopped. I1009 01:46:10.552580 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=c32d9791fa4699be7b882ed77b58eba1963c074c44820c19b3e5e6ab556fe6da I1009 01:46:10.552825 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 62.653486ms to process 2 records I1009 01:46:10.558895 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I1009 01:46:10.558907 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1009 01:46:10.558914 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1009 01:46:10.561276 1 base_controller.go:82] Caches are synced for ConfigController I1009 01:46:10.561286 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I1009 01:46:10.568413 1 tasks_processing.go:74] worker 61 stopped. I1009 01:46:10.568573 1 recorder.go:70] Recording config/olm_operators with fingerprint=09786831e270f662e1ef75987eea1be79ee9d44aa9dc719b29ab1c313e166ff1 I1009 01:46:10.568604 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 81.830871ms to process 1 records I1009 01:46:10.568848 1 configmapobserver.go:84] configmaps "insights-config" not found I1009 01:46:10.570602 1 tasks_processing.go:74] worker 47 stopped. I1009 01:46:10.570615 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 84.094611ms to process 0 records I1009 01:46:10.571517 1 tasks_processing.go:74] worker 49 stopped. I1009 01:46:10.572655 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-7zcdh with fingerprint=eecfc1850afadf1968475e5993eb1ca293f357c4e9dfc63e52639dd5603ab336 I1009 01:46:10.572707 1 recorder.go:70] Recording config/running_containers with fingerprint=f00a4fe4e36056d4658718e8b53522c4af34a634772d9385763a3af438aeaaf1 I1009 01:46:10.572716 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 82.778023ms to process 2 records I1009 01:46:10.585820 1 tasks_processing.go:74] worker 53 stopped. E1009 01:46:10.585832 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E1009 01:46:10.585837 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E1009 01:46:10.585840 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I1009 01:46:10.585847 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I1009 01:46:10.585872 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I1009 01:46:10.585880 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I1009 01:46:10.585888 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I1009 01:46:10.585898 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I1009 01:46:10.585919 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I1009 01:46:10.585927 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I1009 01:46:10.585931 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 98.171739ms to process 7 records I1009 01:46:10.592650 1 base_controller.go:82] Caches are synced for LoggingSyncer I1009 01:46:10.592659 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I1009 01:46:10.610669 1 tasks_processing.go:74] worker 24 stopped. I1009 01:46:10.610684 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 124.108616ms to process 0 records I1009 01:46:10.612941 1 cluster_transfer.go:102] no available accepted cluster transfer I1009 01:46:10.612954 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I1009 01:46:10.617075 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I1009 01:46:10.620146 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress" I1009 01:46:10.623141 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I1009 01:46:10.656439 1 gather_cluster_operator_pods_and_events.go:121] Found 12 pods with 12 containers I1009 01:46:10.656457 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 2097152 bytes I1009 01:46:10.657040 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-57b9976858-vb9jc pod in namespace openshift-image-registry (previous: false). I1009 01:46:10.661787 1 tasks_processing.go:74] worker 19 stopped. E1009 01:46:10.661803 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E1009 01:46:10.661812 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2tav908eetiabnlala1ti4uumrqe6g6s-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2tav908eetiabnlala1ti4uumrqe6g6s-primary-cert-bundle-secret" not found I1009 01:46:10.661873 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=47e4a8075961644b7d59c6bc212f701b38fd519aaa35a1b5b5da14499dda8d9a I1009 01:46:10.661885 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 173.06789ms to process 1 records I1009 01:46:10.667083 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-59c856867d-dbdvk pod in namespace openshift-image-registry (previous: false). I1009 01:46:10.671022 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1009 01:46:10.671033 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-59c856867d-mdqrf pod in namespace openshift-image-registry (previous: false). I1009 01:46:10.786267 1 sca.go:266] etc-pki-entitlement secret successfully created I1009 01:46:10.786283 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I1009 01:46:10.796741 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-47hhf pod in namespace openshift-image-registry (previous: false). I1009 01:46:10.951313 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1009 01:46:10.951330 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-j79kk pod in namespace openshift-image-registry (previous: false). I1009 01:46:11.192784 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-wnjbd pod in namespace openshift-image-registry (previous: false). I1009 01:46:11.351570 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-54dfdffc6d-64zbk pod in namespace openshift-ingress (previous: false). I1009 01:46:11.373574 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I1009 01:46:11.551889 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-54dfdffc6d-mnhsm pod in namespace openshift-ingress (previous: false). I1009 01:46:11.574026 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I1009 01:46:11.751245 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-65d76998f-jmp67 pod in namespace openshift-ingress (previous: false). I1009 01:46:11.952101 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-5h7vs pod in namespace openshift-ingress-canary (previous: false). I1009 01:46:12.152357 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-hbhh5 pod in namespace openshift-ingress-canary (previous: false). I1009 01:46:12.351919 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-z92sb pod in namespace openshift-ingress-canary (previous: false). I1009 01:46:12.551213 1 tasks_processing.go:74] worker 51 stopped. I1009 01:46:12.551385 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=ee0a0d782769a9f6841fa098a1c026a0b29f1b259b501b7fe1c2aceb177c65e3 I1009 01:46:12.551422 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=b769c5c1b04534338638e9fbecfa3a0314085e6446391e65ae55db560bce15c0 I1009 01:46:12.551464 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=992ddcf1031e64aae5e4ec6969a708cd1941648d642cb0eafeea859432c09aa4 I1009 01:46:12.551488 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=39eeb048750231a04a00c340b6bff2de5f62468195771fe0112ef72951762baa I1009 01:46:12.551497 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/image-registry-57b9976858-vb9jc/registry_current.log with fingerprint=99a6bccc304121a5acd59167697b30d860407be603a93ac2dd0811ad14c6d7df I1009 01:46:12.551503 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/image-registry-59c856867d-mdqrf/registry_current.log with fingerprint=07019ae4c26a189e7285b67ed44d90842a90b89abea50c8f9f0e46c0f24423cc I1009 01:46:12.551509 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/node-ca-j79kk/node-ca_current.log with fingerprint=d65ebe81dd478e5059cd3807dc40879e95f3997afcc033919277b83b2fa0916b I1009 01:46:12.551514 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/node-ca-wnjbd/node-ca_current.log with fingerprint=5a77ee843561acf0cd83960f7f5658d4e41726aa7a8f7788065714a984acefbf I1009 01:46:12.551521 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-54dfdffc6d-64zbk/router_current.log with fingerprint=5224ab41f51a78d9fbd6aaaf2b72c1bcadbe8c8d3be89d1363b7ccee87bd8e3f I1009 01:46:12.551528 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-54dfdffc6d-mnhsm/router_current.log with fingerprint=bd7762f2dc139cdc68a53edd177cc330ec1622a3ffd01e2dd4f1220e6891b721 I1009 01:46:12.551536 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-65d76998f-jmp67/router_current.log with fingerprint=1725d29fefdb27f203860eb65456482301ee0ba648c21c46a8aa232ac059854f I1009 01:46:12.551542 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-5h7vs/serve-healthcheck-canary_current.log with fingerprint=4fc61b560ee476d1bac9f28f3b7dcb6b22c2c2dc1563cf4cf0c63f61397e0c86 I1009 01:46:12.551545 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-hbhh5/serve-healthcheck-canary_current.log with fingerprint=a53d7e742c5c93ba218c58047b946958423f2bfe5ead282120f911f3f70d03ab I1009 01:46:12.551548 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-z92sb/serve-healthcheck-canary_current.log with fingerprint=54d3602cb30a4cc15d021f7bd639d9852065eac9472d738f962f0abdbd56b0e1 I1009 01:46:12.551554 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 2.064696688s to process 14 records I1009 01:46:12.977998 1 tasks_processing.go:74] worker 54 stopped. I1009 01:46:12.978099 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=b042af299e4636dc4e25bf33a767a1c3d158c656b0792a135aaa938458a16142 I1009 01:46:12.978140 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=b1d3a57201f472fba248e6e22732d03f4ebac77f3d7204455295e9c6f31f376a I1009 01:46:12.978158 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=6159db9994489cb5ad31169cf8d06eba71e9ba6fbf45e634dbd332ac40ec2a54 I1009 01:46:12.978168 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I1009 01:46:12.978183 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=44af471569aef62ce32b2368c4f8327567528f1c4dba64bcb30b1c16679496bc I1009 01:46:12.978197 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I1009 01:46:12.978214 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=b33eb2e0f95fb314b34ebf053735b12ef371d1b1810c910242dc9ed74f30e9fd I1009 01:46:12.978233 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=f2237685cd2ee4f6e5381dfdc267a19f4b287cd88d45a6b2084566babbee88cf I1009 01:46:12.978281 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=03daf924c5ebe9a1f2f3c5b9470192da265677a8c92c7d496372d701cb036b64 I1009 01:46:12.978300 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=5da8221be4bf2f32c1b16ca2ec9fe5b1acff14635aba2afad3485828493e0c1e I1009 01:46:12.978509 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=a71b1618fe0aeb9177f8b44acf0dbaf29cfe82b55c47df6c2caf566187f0285c I1009 01:46:12.978524 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=0270732cf91e20be0eb21774fe80368c133c1347fdb54935f1f43f0ebf69df72 I1009 01:46:12.978533 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I1009 01:46:12.978544 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=67d99ef1160bd262da4cf75ffdb6b506f6b917d5f80e49e590c1dc1de93a7e90 I1009 01:46:12.978554 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I1009 01:46:12.978564 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=956dab3659f4298a554298eb624f355f85db91daaa41206c9aa2d1764afed690 I1009 01:46:12.978570 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I1009 01:46:12.978594 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=c0d9331ffecfbb43fc857a44c037eae4fbcbbb551c3ba57c1cee21714c626ed1 I1009 01:46:12.978604 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I1009 01:46:12.978616 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=105b8f52d2cbb4b1de688c3522c3e26372085573152203797152ff37726606d1 I1009 01:46:12.978678 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=6802b977b356dcaf5b20fa38319acfd3915b75e36a9404b6bc56d9d409885e27 I1009 01:46:12.978699 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I1009 01:46:12.978714 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=653c1bad8b12e3041804743ab13f86425f1270b56b90dcd39dbe81c181f06e6b I1009 01:46:12.978730 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=931862e02090063db0f6bf822b140f4ddcb5998df09cc4ee228861e777a37d52 I1009 01:46:12.978738 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I1009 01:46:12.978747 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=4db949e11db0523432bb65f2ef3a35e624cf6b09963347ed58acb953588e8097 I1009 01:46:12.978755 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I1009 01:46:12.978765 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=2ce573b8a8a6125148f5280a1a50f5700bfce77b24a7384916c0cda272a5988f I1009 01:46:12.978775 1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I1009 01:46:12.978783 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=8bc03c8bd2c5e504c4e4a464239d9e7325b40104091881ef7b2f7eb963722474 I1009 01:46:12.978794 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=8ccf256f17ce4464d6d396a66e956fe1dfd8decb0191f8dc0c4d36cc8756cd4b I1009 01:46:12.978806 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=50e44fdb1e3a6996f2b3284a7885fad99c5bfb9fd7ef813a091b83101987810c I1009 01:46:12.978824 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=211f7b33f7f337191fbec5473e38e5005f0643ba35b1a4b0a992098ae8e83390 I1009 01:46:12.978834 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I1009 01:46:12.978849 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=4f40c2090251425f0586316e544463b6064f05c8ad2d60723bf914f153b2cb9c I1009 01:46:12.978864 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I1009 01:46:12.978873 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I1009 01:46:12.978879 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.49150756s to process 37 records I1009 01:46:23.613000 1 tasks_processing.go:74] worker 1 stopped. I1009 01:46:23.613045 1 recorder.go:70] Recording config/installplans with fingerprint=6f9781df213f917044fe07f29e6836f4c98c6ccf7740910e145b68b90ff5234d I1009 01:46:23.613057 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.124860545s to process 1 records I1009 01:46:24.296231 1 tasks_processing.go:74] worker 39 stopped. I1009 01:46:24.296469 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=dabcdda6991bac1666e8c7d62a42c20e4eacf733a346e4ee546090403d855ed3 I1009 01:46:24.296486 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.80972743s to process 1 records E1009 01:46:24.296539 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.81s with: function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"active_alerts\" failed with an error, function \"silenced_alerts\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error" I1009 01:46:24.297639 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "active_alerts" failed with an error, function "silenced_alerts" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I1009 01:46:24.297654 1 periodic.go:212] Running workloads gatherer I1009 01:46:24.297667 1 tasks_processing.go:45] number of workers: 2 I1009 01:46:24.297672 1 tasks_processing.go:69] worker 1 listening for tasks. I1009 01:46:24.297675 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I1009 01:46:24.297682 1 tasks_processing.go:69] worker 0 listening for tasks. I1009 01:46:24.297758 1 tasks_processing.go:71] worker 0 working on workload_info task. I1009 01:46:24.305915 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-174-247.ec2.internal... I1009 01:46:24.324698 1 tasks_processing.go:74] worker 1 stopped. I1009 01:46:24.324713 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 27.010937ms to process 0 records I1009 01:46:26.937559 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 3s I1009 01:46:26.956676 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 25s for image data I1009 01:46:26.964518 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (9ms) I1009 01:46:26.972611 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (8ms) I1009 01:46:26.981460 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (9ms) I1009 01:46:26.989353 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (8ms) I1009 01:46:26.996957 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (8ms) I1009 01:46:27.004117 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (7ms) I1009 01:46:27.011758 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (8ms) I1009 01:46:27.018847 1 gather_workloads_info.go:387] No image sha256:1f2aa1e1026570162984f7fbb634635bcf319e408cafa8f9034ee842a2f193ab (7ms) I1009 01:46:27.025956 1 gather_workloads_info.go:387] No image sha256:f6e156f39b06d196b46d8ed3a03ca337e939dba0060e40de4455b4e77b90929e (7ms) I1009 01:46:27.033751 1 gather_workloads_info.go:387] No image sha256:38dd36da63b1f01316a02daf6c18b821318c6ec313712147292d74abf955e0da (8ms) I1009 01:46:27.064208 1 gather_workloads_info.go:387] No image sha256:ce3d8211c0bde5788a4fd04c3eff31ae591437ceab2b3168dbbdfe408673c8b1 (30ms) I1009 01:46:27.168087 1 gather_workloads_info.go:398] Found image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (104ms) I1009 01:46:27.265302 1 gather_workloads_info.go:387] No image sha256:798001e24f1ed6a5621c442729a840ba2a2abc43433901e8450caa12b4bad5c5 (97ms) I1009 01:46:27.364805 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (99ms) I1009 01:46:27.465161 1 gather_workloads_info.go:387] No image sha256:1d471ad866b8564b209214d7dd3a7363c47e9535211d660b63b46abb278af7ab (100ms) I1009 01:46:27.566176 1 gather_workloads_info.go:387] No image sha256:8cd08f0f48933436f3a468a54b2b149f009575ee8216438fcbb0928fdbc318cf (101ms) I1009 01:46:27.664698 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (99ms) I1009 01:46:27.765249 1 gather_workloads_info.go:398] Found image sha256:a55ca046782bd0b0132681f9924ee4920a9d302114a6b779363b670b7711a488 (101ms) I1009 01:46:27.865456 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (100ms) I1009 01:46:27.966359 1 gather_workloads_info.go:387] No image sha256:a3d34d8f38a540ce79d34a5248b1965346155497db57b72cb4758d659418059c (101ms) I1009 01:46:28.064826 1 gather_workloads_info.go:387] No image sha256:b8bec6b95a0ad60e0549887be27e3d9cb912aaa7bae3f30ca4ffb5d2fe1e2078 (98ms) I1009 01:46:28.164557 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (100ms) I1009 01:46:28.266234 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (102ms) I1009 01:46:28.365529 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (99ms) I1009 01:46:28.483754 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (118ms) I1009 01:46:28.584774 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (101ms) I1009 01:46:28.664624 1 gather_workloads_info.go:387] No image sha256:46c2c396ca651699738c3f26b79b10af2922123dd27c2e32382d2a31a87e92c7 (80ms) I1009 01:46:28.764620 1 gather_workloads_info.go:387] No image sha256:1cc2f3c83068c8c67d9070f67677e1bb6b4feff7ac5744cad08711893e56b55f (100ms) I1009 01:46:28.864584 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (100ms) I1009 01:46:28.964740 1 gather_workloads_info.go:398] Found image sha256:59db91eadf1e1e5343777be43ff25fb712f300f9341be48ba05f45270944536f (100ms) I1009 01:46:29.064657 1 gather_workloads_info.go:387] No image sha256:bcca5c17371caa2dce7e28da4c9fe30163c340fa172187f94db90ea1bd6ab80d (100ms) I1009 01:46:29.167537 1 gather_workloads_info.go:387] No image sha256:cd74338580ef435dd66cf39f6252d20ff882f6af7bb1e8a7f17df49672d3d8d7 (103ms) I1009 01:46:29.264502 1 gather_workloads_info.go:387] No image sha256:02bf992177d2273092f029a9c9869e46f91b3dc995afd2235eccd123a375b66e (97ms) I1009 01:46:29.364909 1 gather_workloads_info.go:387] No image sha256:5cba745f09f3bd6b8028c6773597cbb30bf3639a84f2b4b6493fe20642339a2c (100ms) I1009 01:46:29.464690 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (100ms) I1009 01:46:29.564340 1 gather_workloads_info.go:387] No image sha256:527ed405bf66234718321996dacf51f91c64c746de9f1509416ef6ce89c90a50 (100ms) I1009 01:46:29.664459 1 gather_workloads_info.go:387] No image sha256:68d8e92046969bcfcbca2d2b3dcf4dcad5f6edc5fcb44861eb22f8079a43ea4d (100ms) I1009 01:46:29.765091 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (101ms) I1009 01:46:29.865049 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (100ms) I1009 01:46:29.966630 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (102ms) I1009 01:46:30.063925 1 gather_workloads_info.go:387] No image sha256:d74692f1f8ed2943454038de065291d8c0f628c7d6606ac5d443b043d0822a5f (97ms) I1009 01:46:30.164595 1 gather_workloads_info.go:387] No image sha256:6277dac65decba0ea094146bb99600f479eaf804696842e724de1f1b436f9a38 (101ms) I1009 01:46:30.264772 1 gather_workloads_info.go:387] No image sha256:e40bbab1e52f580ab471bd7ab19ae23a4bcbaf1893243a05238af6bede7ba9cc (100ms) I1009 01:46:30.365472 1 gather_workloads_info.go:387] No image sha256:68d39341b7b34498859118847deb8e8f1d624927bfa84f7a6a5aaacc452d688a (101ms) I1009 01:46:30.464869 1 gather_workloads_info.go:387] No image sha256:099b3af427b8e1eb44765283a640446c3225151baa06eed789623206151a60cd (99ms) I1009 01:46:30.564892 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (100ms) I1009 01:46:30.664624 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (100ms) I1009 01:46:30.764082 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (99ms) I1009 01:46:30.886689 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (123ms) I1009 01:46:30.979252 1 gather_workloads_info.go:387] No image sha256:799f5628c18e77a49c08645c03179046b5200c8cbcfd65737fb59668132f393e (93ms) I1009 01:46:31.064843 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (86ms) I1009 01:46:31.164341 1 gather_workloads_info.go:387] No image sha256:b3bd3daa79dba6bf63f8be5ed9856ba8c8041f36b16d73c4b920cfec7c4b2fd4 (99ms) I1009 01:46:31.264771 1 gather_workloads_info.go:387] No image sha256:270a7bac889ed64d75ce11ae26e8634a6209ff718b83fae2c888cfc758316aa3 (100ms) I1009 01:46:31.264805 1 tasks_processing.go:74] worker 0 stopped. I1009 01:46:31.265047 1 recorder.go:70] Recording config/workload_info with fingerprint=19e0c16494782ed591c88e4a60d606ed58bbef5e85efbc77508f9fde1cfe10e8 I1009 01:46:31.265062 1 gather.go:177] gatherer "workloads" function "workload_info" took 6.967033005s to process 1 records I1009 01:46:31.265073 1 periodic.go:259] Periodic gather workloads completed in 6.967s I1009 01:46:31.265079 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I1009 01:46:31.265084 1 periodic.go:212] Running conditional gatherer I1009 01:46:31.273364 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I1009 01:46:31.440290 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer E1009 01:46:31.442533 1 conditional_gatherer.go:322] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.198.220:9091: connect: connection refused I1009 01:46:31.442590 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I1009 01:46:31.451123 1 conditional_gatherer.go:390] cluster version is '4.19.9' E1009 01:46:31.451135 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:46:31.451140 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:46:31.451143 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:46:31.451145 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:46:31.451147 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:46:31.451150 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:46:31.451152 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:46:31.451154 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:46:31.451156 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:46:31.451159 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I1009 01:46:31.451170 1 tasks_processing.go:45] number of workers: 3 I1009 01:46:31.451179 1 tasks_processing.go:69] worker 2 listening for tasks. I1009 01:46:31.451182 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I1009 01:46:31.451187 1 tasks_processing.go:69] worker 0 listening for tasks. I1009 01:46:31.451192 1 tasks_processing.go:69] worker 1 listening for tasks. I1009 01:46:31.451199 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I1009 01:46:31.451200 1 tasks_processing.go:74] worker 1 stopped. I1009 01:46:31.451214 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I1009 01:46:31.451244 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I1009 01:46:31.451257 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 838ns to process 1 records I1009 01:46:31.451284 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I1009 01:46:31.451292 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 889ns to process 1 records I1009 01:46:31.451296 1 tasks_processing.go:74] worker 0 stopped. I1009 01:46:31.451453 1 tasks_processing.go:74] worker 2 stopped. I1009 01:46:31.451465 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 226.781µs to process 0 records I1009 01:46:31.451478 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I1009 01:46:31.451488 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I1009 01:46:31.475857 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=c1175026a485c9332c46522c00a83a6586ec2fd24e5459d5991a940f33c3bca7 I1009 01:46:31.475960 1 diskrecorder.go:70] Writing 116 records to /var/lib/insights-operator/insights-2026-10-09-014631.tar.gz I1009 01:46:31.483270 1 diskrecorder.go:51] Wrote 116 records to disk in 7ms I1009 01:46:31.483301 1 periodic.go:281] Gathering cluster info every 2h0m0s I1009 01:46:31.483314 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I1009 01:47:40.486375 1 diskrecorder.go:223] Found files to send: insights-2026-10-09-014631.tar.gz I1009 01:47:40.486418 1 insightsuploader.go:150] Checking archives to upload periodically every 15m48.673276765s I1009 01:47:40.486426 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I1009 01:47:40.499119 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I1009 01:47:40.700894 1 requests.go:87] Successfully reported id=2026-10-09T01:47:40Z x-rh-insights-request-id=11da29f44c7740a1924416a87b25cf65, wrote=58469 I1009 01:47:40.700958 1 insightsuploader.go:187] Uploaded report successfully in 214.522662ms I1009 01:47:40.700989 1 controller.go:119] Initializing last reported time to 2026-10-09T01:47:40Z I1009 01:47:40.701004 1 insightsreport.go:304] Archive uploaded, starting pulling report... I1009 01:47:40.701013 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I1009 01:47:40.701020 1 insightsreport.go:221] Initial delay for pulling: 1m0s I1009 01:47:40.706373 1 controller.go:481] The operator is healthy I1009 01:48:10.498431 1 controller.go:481] The operator is healthy I1009 01:48:45.036425 1 insightsreport.go:137] Pulling report from smart-proxy I1009 01:48:45.036449 1 insightsreport.go:149] Retrieving report I1009 01:48:45.046158 1 requests.go:110] Retrieving report for cluster: b82e43c6-b10e-4cc7-a3e5-3df331c7bad3 I1009 01:48:45.046170 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/b82e43c6-b10e-4cc7-a3e5-3df331c7bad3/reports I1009 01:48:45.048023 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/b82e43c6-b10e-4cc7-a3e5-3df331c7bad3/reports I1009 01:48:45.361029 1 insightsreport.go:184] Report retrieved I1009 01:48:45.400898 1 insightsreport.go:239] Report retrieved correctly I1009 01:50:10.498765 1 controller.go:481] The operator is healthy I1009 01:51:10.477909 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1009 01:51:10.483377 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1009 01:51:10.483409 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1009 01:51:10.487244 1 secretconfigobserver.go:119] support secret does not exist I1009 01:52:10.498744 1 controller.go:481] The operator is healthy I1009 01:54:10.499063 1 controller.go:481] The operator is healthy I1009 01:56:10.480311 1 configmapobserver.go:84] configmaps "insights-config" not found I1009 01:56:10.487319 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1009 01:56:10.492464 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1009 01:56:10.492482 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1009 01:56:10.497683 1 secretconfigobserver.go:119] support secret does not exist I1009 01:56:10.497929 1 controller.go:481] The operator is healthy I1009 01:58:10.502931 1 controller.go:481] The operator is healthy I1009 02:00:10.501882 1 controller.go:481] The operator is healthy I1009 02:01:10.497750 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1009 02:01:10.506118 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1009 02:01:10.506138 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1009 02:01:10.510089 1 secretconfigobserver.go:119] support secret does not exist I1009 02:02:10.502291 1 controller.go:481] The operator is healthy I1009 02:03:34.375771 1 insightsuploader.go:146] Nothing to report since 2026-10-09T01:47:40Z I1009 02:04:10.508272 1 controller.go:481] The operator is healthy I1009 02:06:10.477360 1 configmapobserver.go:84] configmaps "insights-config" not found I1009 02:06:10.498528 1 controller.go:481] The operator is healthy I1009 02:06:10.510361 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1009 02:06:10.514722 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1009 02:06:10.514741 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1009 02:06:10.518979 1 secretconfigobserver.go:119] support secret does not exist I1009 02:08:10.502104 1 controller.go:481] The operator is healthy I1009 02:10:10.499921 1 controller.go:481] The operator is healthy I1009 02:11:10.519318 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1009 02:11:10.527593 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1009 02:11:10.527618 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1009 02:11:10.534731 1 secretconfigobserver.go:119] support secret does not exist I1009 02:12:10.499996 1 controller.go:481] The operator is healthy I1009 02:14:10.502456 1 controller.go:481] The operator is healthy I1009 02:16:10.479005 1 configmapobserver.go:84] configmaps "insights-config" not found I1009 02:16:10.486425 1 configmapobserver.go:84] configmaps "insights-config" not found I1009 02:16:10.497744 1 controller.go:481] The operator is healthy I1009 02:16:10.535819 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1009 02:16:10.540594 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1009 02:16:10.540614 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1009 02:16:10.544586 1 secretconfigobserver.go:119] support secret does not exist I1009 02:18:10.502428 1 controller.go:481] The operator is healthy I1009 02:19:20.237110 1 insightsuploader.go:146] Nothing to report since 2026-10-09T01:47:40Z I1009 02:20:10.498337 1 controller.go:481] The operator is healthy I1009 02:21:10.545313 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1009 02:21:10.550648 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1009 02:21:10.550668 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1009 02:21:10.557090 1 secretconfigobserver.go:119] support secret does not exist I1009 02:22:10.499331 1 controller.go:481] The operator is healthy