I0629 14:22:14.708588 1 cmd.go:250] Using service-serving-cert provided certificates I0629 14:22:14.709015 1 observer_polling.go:159] Starting file observer W0629 14:22:14.732770 1 builder.go:266] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-6fd96f47fd" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0629 14:22:14.945547 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0629 14:22:14.945745 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0629 14:22:14.946093 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0629 14:22:14.946227 1 secure_serving.go:57] Forcing use of http/1.1 only W0629 14:22:14.946245 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0629 14:22:14.946248 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0629 14:22:14.946251 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0629 14:22:14.946253 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0629 14:22:14.946255 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0629 14:22:14.946272 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0629 14:22:14.951733 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes ChunkSizeMiB CloudDualStackNodeIPs DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy PersistentIPsForVirtualization PrivateHostedZoneAWS SetEIPForNLBIngressController VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy AWSClusterHostedDNS AdditionalRoutingCapabilities AutomatedEtcdBackup BootcNodeManagement CSIDriverSharedResource ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ConsolePluginContentSecurityPolicy DNSNameResolver DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example GCPClusterHostedDNS GatewayAPI ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MetricsCollectionProfiles MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NodeSwap NutanixMultiSubnets OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0629 14:22:14.951744 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ConsolePluginContentSecurityPolicy", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} E0629 14:22:14.955971 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18bd934103a24cbc openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"SetEIPForNLBIngressController\", \"VSphereControlPlaneMachineSet\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"VSphereStaticIPs\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AdditionalRoutingCapabilities\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"CSIDriverSharedResource\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ConsolePluginContentSecurityPolicy\", \"DNSNameResolver\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"GCPClusterHostedDNS\", \"GatewayAPI\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MetricsCollectionProfiles\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OnClusterBuild\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SignatureStores\", \"SigstoreImageVerification\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-06-29 14:22:14.951709884 +0000 UTC m=+0.277659671,LastTimestamp:2026-06-29 14:22:14.951709884 +0000 UTC m=+0.277659671,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" I0629 14:22:14.956290 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0629 14:22:14.956302 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0629 14:22:14.956307 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0629 14:22:14.956305 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0629 14:22:14.956316 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0629 14:22:14.956319 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0629 14:22:14.956539 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0629 14:22:14.956732 1 secure_serving.go:213] Serving securely on [::]:8443 I0629 14:22:14.956767 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" W0629 14:22:14.963443 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0629 14:22:14.963466 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0629 14:22:14.963559 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0629 14:22:14.969940 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 14:22:14.969962 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0629 14:22:14.975169 1 secretconfigobserver.go:119] support secret does not exist I0629 14:22:14.980242 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 14:22:14.981854 1 recorder.go:156] Pruning old reports every 8h6m22s, max age is 288h0m0s I0629 14:22:14.985393 1 secretconfigobserver.go:119] support secret does not exist I0629 14:22:14.988347 1 periodic.go:214] Running clusterconfig gatherer I0629 14:22:14.988360 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0629 14:22:14.988373 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0629 14:22:14.988380 1 tasks_processing.go:45] number of workers: 64 I0629 14:22:14.988394 1 tasks_processing.go:69] worker 3 listening for tasks. I0629 14:22:14.988403 1 tasks_processing.go:69] worker 0 listening for tasks. I0629 14:22:14.988404 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0629 14:22:14.988412 1 tasks_processing.go:69] worker 2 listening for tasks. I0629 14:22:14.988413 1 insightsreport.go:296] Starting report retriever I0629 14:22:14.988417 1 tasks_processing.go:69] worker 29 listening for tasks. I0629 14:22:14.988418 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0629 14:22:14.988421 1 tasks_processing.go:71] worker 29 working on overlapping_namespace_uids task. I0629 14:22:14.988408 1 tasks_processing.go:69] worker 1 listening for tasks. I0629 14:22:14.988426 1 tasks_processing.go:69] worker 30 listening for tasks. I0629 14:22:14.988432 1 tasks_processing.go:69] worker 31 listening for tasks. I0629 14:22:14.988435 1 tasks_processing.go:69] worker 16 listening for tasks. I0629 14:22:14.988436 1 tasks_processing.go:69] worker 32 listening for tasks. I0629 14:22:14.988440 1 tasks_processing.go:69] worker 4 listening for tasks. I0629 14:22:14.988441 1 tasks_processing.go:69] worker 33 listening for tasks. I0629 14:22:14.988445 1 tasks_processing.go:69] worker 34 listening for tasks. I0629 14:22:14.988447 1 tasks_processing.go:69] worker 5 listening for tasks. I0629 14:22:14.988449 1 tasks_processing.go:69] worker 35 listening for tasks. I0629 14:22:14.988451 1 tasks_processing.go:69] worker 6 listening for tasks. I0629 14:22:14.988453 1 tasks_processing.go:69] worker 36 listening for tasks. I0629 14:22:14.988457 1 tasks_processing.go:69] worker 7 listening for tasks. I0629 14:22:14.988457 1 tasks_processing.go:69] worker 37 listening for tasks. I0629 14:22:14.988461 1 tasks_processing.go:69] worker 8 listening for tasks. I0629 14:22:14.988462 1 tasks_processing.go:69] worker 38 listening for tasks. I0629 14:22:14.988465 1 tasks_processing.go:69] worker 9 listening for tasks. I0629 14:22:14.988466 1 tasks_processing.go:69] worker 39 listening for tasks. I0629 14:22:14.988470 1 tasks_processing.go:69] worker 10 listening for tasks. I0629 14:22:14.988471 1 tasks_processing.go:69] worker 40 listening for tasks. I0629 14:22:14.988475 1 tasks_processing.go:69] worker 11 listening for tasks. I0629 14:22:14.988475 1 tasks_processing.go:69] worker 41 listening for tasks. I0629 14:22:14.988480 1 tasks_processing.go:69] worker 42 listening for tasks. I0629 14:22:14.988481 1 tasks_processing.go:69] worker 14 listening for tasks. I0629 14:22:14.988484 1 tasks_processing.go:69] worker 43 listening for tasks. I0629 14:22:14.988485 1 tasks_processing.go:69] worker 15 listening for tasks. I0629 14:22:14.988488 1 tasks_processing.go:69] worker 44 listening for tasks. I0629 14:22:14.988490 1 tasks_processing.go:69] worker 23 listening for tasks. I0629 14:22:14.988488 1 tasks_processing.go:69] worker 13 listening for tasks. I0629 14:22:14.988495 1 tasks_processing.go:69] worker 17 listening for tasks. I0629 14:22:14.988493 1 tasks_processing.go:69] worker 45 listening for tasks. I0629 14:22:14.988496 1 tasks_processing.go:69] worker 46 listening for tasks. I0629 14:22:14.988500 1 tasks_processing.go:69] worker 18 listening for tasks. I0629 14:22:14.988501 1 tasks_processing.go:69] worker 47 listening for tasks. I0629 14:22:14.988503 1 tasks_processing.go:69] worker 19 listening for tasks. I0629 14:22:14.988504 1 tasks_processing.go:69] worker 48 listening for tasks. I0629 14:22:14.988502 1 tasks_processing.go:69] worker 12 listening for tasks. I0629 14:22:14.988508 1 tasks_processing.go:69] worker 20 listening for tasks. I0629 14:22:14.988509 1 tasks_processing.go:69] worker 57 listening for tasks. I0629 14:22:14.988510 1 tasks_processing.go:69] worker 58 listening for tasks. I0629 14:22:14.988514 1 tasks_processing.go:69] worker 21 listening for tasks. I0629 14:22:14.988514 1 tasks_processing.go:69] worker 52 listening for tasks. I0629 14:22:14.988515 1 tasks_processing.go:69] worker 59 listening for tasks. I0629 14:22:14.988518 1 tasks_processing.go:69] worker 22 listening for tasks. I0629 14:22:14.988519 1 tasks_processing.go:69] worker 54 listening for tasks. I0629 14:22:14.988515 1 tasks_processing.go:69] worker 53 listening for tasks. I0629 14:22:14.988522 1 tasks_processing.go:69] worker 61 listening for tasks. I0629 14:22:14.988519 1 tasks_processing.go:69] worker 26 listening for tasks. I0629 14:22:14.988526 1 tasks_processing.go:69] worker 63 listening for tasks. I0629 14:22:14.988518 1 tasks_processing.go:69] worker 60 listening for tasks. I0629 14:22:14.988528 1 tasks_processing.go:71] worker 3 working on config_maps task. I0629 14:22:14.988529 1 tasks_processing.go:69] worker 56 listening for tasks. I0629 14:22:14.988525 1 tasks_processing.go:69] worker 55 listening for tasks. I0629 14:22:14.988533 1 tasks_processing.go:69] worker 62 listening for tasks. I0629 14:22:14.988533 1 tasks_processing.go:69] worker 25 listening for tasks. I0629 14:22:14.988528 1 tasks_processing.go:69] worker 50 listening for tasks. I0629 14:22:14.988536 1 tasks_processing.go:69] worker 28 listening for tasks. I0629 14:22:14.988545 1 tasks_processing.go:71] worker 31 working on version task. I0629 14:22:14.988546 1 tasks_processing.go:71] worker 32 working on jaegers task. I0629 14:22:14.988544 1 tasks_processing.go:71] worker 25 working on image_pruners task. I0629 14:22:14.988551 1 tasks_processing.go:71] worker 28 working on image task. I0629 14:22:14.988548 1 tasks_processing.go:71] worker 0 working on mutating_webhook_configurations task. I0629 14:22:14.988557 1 tasks_processing.go:71] worker 47 working on olm_operators task. I0629 14:22:14.988563 1 tasks_processing.go:71] worker 45 working on node_logs task. I0629 14:22:14.988579 1 tasks_processing.go:71] worker 22 working on proxies task. I0629 14:22:14.988591 1 tasks_processing.go:71] worker 60 working on networks task. I0629 14:22:14.988593 1 tasks_processing.go:71] worker 53 working on openstack_dataplanenodesets task. I0629 14:22:14.988523 1 tasks_processing.go:69] worker 49 listening for tasks. I0629 14:22:14.988602 1 tasks_processing.go:71] worker 49 working on cost_management_metrics_configs task. I0629 14:22:14.988609 1 tasks_processing.go:71] worker 19 working on machine_autoscalers task. I0629 14:22:14.988623 1 tasks_processing.go:71] worker 56 working on operators task. I0629 14:22:14.988619 1 tasks_processing.go:71] worker 10 working on sap_config task. I0629 14:22:14.988586 1 tasks_processing.go:71] worker 63 working on aggregated_monitoring_cr_names task. I0629 14:22:14.988635 1 tasks_processing.go:71] worker 43 working on image_registries task. I0629 14:22:14.988650 1 tasks_processing.go:71] worker 30 working on machines task. I0629 14:22:14.988676 1 tasks_processing.go:71] worker 23 working on certificate_signing_requests task. I0629 14:22:14.988693 1 tasks_processing.go:71] worker 55 working on pod_network_connectivity_checks task. I0629 14:22:14.988420 1 tasks_processing.go:71] worker 2 working on lokistack task. I0629 14:22:14.988532 1 tasks_processing.go:69] worker 51 listening for tasks. I0629 14:22:14.988552 1 tasks_processing.go:71] worker 46 working on sap_datahubs task. I0629 14:22:14.988816 1 tasks_processing.go:71] worker 5 working on support_secret task. I0629 14:22:14.989494 1 tasks_processing.go:71] worker 44 working on machine_sets task. I0629 14:22:14.989520 1 tasks_processing.go:71] worker 1 working on openshift_logging task. I0629 14:22:14.989531 1 tasks_processing.go:71] worker 40 working on active_alerts task. I0629 14:22:14.989550 1 tasks_processing.go:71] worker 51 working on ceph_cluster task. I0629 14:22:14.989560 1 tasks_processing.go:71] worker 6 working on storage_cluster task. I0629 14:22:14.989572 1 tasks_processing.go:71] worker 48 working on metrics task. I0629 14:22:14.989580 1 tasks_processing.go:71] worker 52 working on operators_pods_and_events task. I0629 14:22:14.989556 1 tasks_processing.go:71] worker 35 working on crds task. I0629 14:22:14.989608 1 tasks_processing.go:71] worker 11 working on feature_gates task. I0629 14:22:14.989616 1 tasks_processing.go:71] worker 58 working on machine_healthchecks task. I0629 14:22:14.989616 1 tasks_processing.go:71] worker 21 working on validating_webhook_configurations task. I0629 14:22:14.988554 1 tasks_processing.go:71] worker 18 working on openstack_dataplanedeployments task. I0629 14:22:14.988549 1 tasks_processing.go:71] worker 34 working on schedulers task. I0629 14:22:14.989609 1 tasks_processing.go:71] worker 42 working on install_plans task. I0629 14:22:14.988680 1 tasks_processing.go:71] worker 15 working on authentication task. I0629 14:22:14.988602 1 tasks_processing.go:71] worker 57 working on silenced_alerts task. I0629 14:22:14.988528 1 tasks_processing.go:69] worker 24 listening for tasks. I0629 14:22:14.988589 1 tasks_processing.go:71] worker 54 working on sap_pods task. I0629 14:22:14.989733 1 tasks_processing.go:71] worker 24 working on openstack_version task. I0629 14:22:14.989587 1 tasks_processing.go:71] worker 12 working on dvo_metrics task. I0629 14:22:14.988546 1 tasks_processing.go:71] worker 50 working on ingress task. I0629 14:22:14.989587 1 tasks_processing.go:71] worker 7 working on oauths task. I0629 14:22:14.989592 1 tasks_processing.go:71] worker 8 working on machine_config_pools task. I0629 14:22:14.989590 1 tasks_processing.go:71] worker 37 working on pdbs task. I0629 14:22:14.989595 1 tasks_processing.go:71] worker 62 working on nodenetworkconfigurationpolicies task. I0629 14:22:14.989595 1 tasks_processing.go:71] worker 38 working on storage_classes task. I0629 14:22:14.989594 1 tasks_processing.go:71] worker 20 working on openshift_machine_api_events task. I0629 14:22:14.988540 1 tasks_processing.go:71] worker 4 working on nodenetworkstates task. I0629 14:22:14.989584 1 tasks_processing.go:71] worker 36 working on container_runtime_configs task. I0629 14:22:14.989601 1 tasks_processing.go:71] worker 59 working on tsdb_status task. I0629 14:22:14.989597 1 tasks_processing.go:71] worker 9 working on openstack_controlplanes task. I0629 14:22:14.988543 1 tasks_processing.go:71] worker 16 working on monitoring_persistent_volumes task. I0629 14:22:14.988546 1 tasks_processing.go:71] worker 33 working on ingress_certificates task. I0629 14:22:14.989609 1 tasks_processing.go:71] worker 17 working on infrastructures task. I0629 14:22:14.989602 1 tasks_processing.go:71] worker 61 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0629 14:22:14.989608 1 tasks_processing.go:71] worker 26 working on container_images task. I0629 14:22:14.989610 1 tasks_processing.go:71] worker 14 working on clusterroles task. I0629 14:22:14.988539 1 tasks_processing.go:69] worker 27 listening for tasks. I0629 14:22:14.991200 1 tasks_processing.go:71] worker 27 working on service_accounts task. I0629 14:22:14.989603 1 tasks_processing.go:71] worker 41 working on machine_configs task. I0629 14:22:14.989602 1 tasks_processing.go:71] worker 39 working on nodes task. I0629 14:22:14.989609 1 tasks_processing.go:71] worker 13 working on cluster_apiserver task. I0629 14:22:14.993166 1 tasks_processing.go:74] worker 32 stopped. I0629 14:22:14.993176 1 gather.go:181] gatherer "clusterconfig" function "jaegers" took 4.608491ms to process 0 records I0629 14:22:14.993817 1 tasks_processing.go:74] worker 49 stopped. I0629 14:22:14.993829 1 gather.go:181] gatherer "clusterconfig" function "cost_management_metrics_configs" took 5.199476ms to process 0 records E0629 14:22:14.993939 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.149.192:9091: connect: connection refused I0629 14:22:14.993960 1 tasks_processing.go:74] worker 59 stopped. E0629 14:22:14.993965 1 gather.go:144] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.149.192:9091: connect: connection refused I0629 14:22:14.993978 1 gather.go:181] gatherer "clusterconfig" function "tsdb_status" took 3.824117ms to process 0 records E0629 14:22:14.993992 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.149.192:9091: connect: connection refused I0629 14:22:14.994014 1 tasks_processing.go:74] worker 53 stopped. I0629 14:22:14.994020 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 5.408592ms to process 0 records E0629 14:22:14.994025 1 gather.go:144] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.149.192:9091: connect: connection refused I0629 14:22:14.994038 1 gather.go:181] gatherer "clusterconfig" function "metrics" took 4.431353ms to process 0 records I0629 14:22:14.994047 1 tasks_processing.go:74] worker 48 stopped. I0629 14:22:14.997570 1 tasks_processing.go:74] worker 28 stopped. I0629 14:22:14.997735 1 recorder.go:70] Recording config/image with fingerprint=40f23fc6f6685881540c1208ff9ded9a22b01b78c08b565d0e639b6a583907ba I0629 14:22:14.997753 1 gather.go:181] gatherer "clusterconfig" function "image" took 9.006369ms to process 1 records I0629 14:22:15.005813 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0629 14:22:15.005835 1 controller.go:317] The initial operator extension status is healthy I0629 14:22:15.005844 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0629 14:22:15.005850 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0629 14:22:15.005853 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0629 14:22:15.005870 1 controller.go:457] The operator is still being initialized I0629 14:22:15.005875 1 controller.go:482] The operator is healthy I0629 14:22:15.005929 1 tasks_processing.go:74] worker 2 stopped. I0629 14:22:15.005941 1 gather.go:181] gatherer "clusterconfig" function "lokistack" took 17.171887ms to process 0 records I0629 14:22:15.005945 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s I0629 14:22:15.005952 1 tasks_processing.go:74] worker 44 stopped. I0629 14:22:15.005949 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0629 14:22:15.005949 1 gather.go:181] gatherer "clusterconfig" function "machine_sets" took 16.423275ms to process 0 records I0629 14:22:15.006026 1 gather.go:181] gatherer "clusterconfig" function "sap_config" took 17.323656ms to process 0 records I0629 14:22:15.006038 1 tasks_processing.go:74] worker 10 stopped. W0629 14:22:15.006126 1 operator.go:288] started I0629 14:22:15.006145 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0629 14:22:15.007503 1 tasks_processing.go:74] worker 1 stopped. I0629 14:22:15.007514 1 gather.go:181] gatherer "clusterconfig" function "openshift_logging" took 17.970057ms to process 0 records I0629 14:22:15.012332 1 tasks_processing.go:74] worker 46 stopped. I0629 14:22:15.012347 1 gather.go:181] gatherer "clusterconfig" function "sap_datahubs" took 23.534025ms to process 0 records I0629 14:22:15.048158 1 tasks_processing.go:74] worker 8 stopped. I0629 14:22:15.048178 1 gather.go:181] gatherer "clusterconfig" function "machine_config_pools" took 58.314443ms to process 0 records I0629 14:22:15.049037 1 tasks_processing.go:74] worker 19 stopped. I0629 14:22:15.049051 1 gather.go:181] gatherer "clusterconfig" function "machine_autoscalers" took 60.418948ms to process 0 records I0629 14:22:15.049083 1 tasks_processing.go:74] worker 55 stopped. E0629 14:22:15.049093 1 gather.go:144] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0629 14:22:15.049102 1 gather.go:181] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 60.380355ms to process 0 records E0629 14:22:15.049107 1 gather.go:144] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0629 14:22:15.049111 1 gather.go:181] gatherer "clusterconfig" function "support_secret" took 60.269216ms to process 0 records I0629 14:22:15.049122 1 tasks_processing.go:74] worker 5 stopped. I0629 14:22:15.049135 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0629 14:22:15.049149 1 gather.go:181] gatherer "clusterconfig" function "overlapping_namespace_uids" took 60.673728ms to process 1 records I0629 14:22:15.049185 1 tasks_processing.go:74] worker 29 stopped. I0629 14:22:15.049251 1 tasks_processing.go:74] worker 25 stopped. I0629 14:22:15.049477 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=a48832fa9bb51458b8e36ba34436692dcac694cd4cb1613ef05f045d36e7de9f I0629 14:22:15.049489 1 gather.go:181] gatherer "clusterconfig" function "image_pruners" took 60.566741ms to process 1 records E0629 14:22:15.049498 1 gather.go:144] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0629 14:22:15.049505 1 gather.go:181] gatherer "clusterconfig" function "machines" took 60.45152ms to process 0 records I0629 14:22:15.049509 1 tasks_processing.go:74] worker 30 stopped. I0629 14:22:15.050170 1 tasks_processing.go:74] worker 4 stopped. I0629 14:22:15.050180 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkstates" took 60.225292ms to process 0 records I0629 14:22:15.050187 1 gather.go:181] gatherer "clusterconfig" function "container_runtime_configs" took 60.218532ms to process 0 records I0629 14:22:15.050191 1 gather.go:181] gatherer "clusterconfig" function "storage_cluster" took 60.611453ms to process 0 records I0629 14:22:15.050194 1 tasks_processing.go:74] worker 6 stopped. I0629 14:22:15.050196 1 tasks_processing.go:74] worker 36 stopped. I0629 14:22:15.050220 1 tasks_processing.go:74] worker 20 stopped. I0629 14:22:15.050233 1 gather.go:181] gatherer "clusterconfig" function "openshift_machine_api_events" took 60.289599ms to process 0 records I0629 14:22:15.050238 1 gather.go:181] gatherer "clusterconfig" function "openstack_controlplanes" took 60.052254ms to process 0 records I0629 14:22:15.050241 1 gather.go:181] gatherer "clusterconfig" function "openstack_version" took 60.490382ms to process 0 records I0629 14:22:15.050245 1 tasks_processing.go:74] worker 24 stopped. I0629 14:22:15.050254 1 tasks_processing.go:74] worker 9 stopped. I0629 14:22:15.050337 1 tasks_processing.go:74] worker 22 stopped. I0629 14:22:15.050408 1 recorder.go:70] Recording config/proxy with fingerprint=af05ad5d257df868cf4dc6d123cf437076ca049b5557557524750046c49842f2 I0629 14:22:15.050422 1 gather.go:181] gatherer "clusterconfig" function "proxies" took 61.74106ms to process 1 records I0629 14:22:15.050859 1 tasks_processing.go:74] worker 7 stopped. I0629 14:22:15.051071 1 recorder.go:70] Recording config/oauth with fingerprint=c9dc6a9d7d18531976133529f5b4ec3105441f112dd9b4d18cdc26ca9b5577ac I0629 14:22:15.051087 1 gather.go:181] gatherer "clusterconfig" function "oauths" took 61.043296ms to process 1 records I0629 14:22:15.051217 1 recorder.go:70] Recording config/network with fingerprint=5fdec96ebe8f8d9a09dd34751e16eb9163662b46e5fb1f7d5fd97ee1aa133050 I0629 14:22:15.051220 1 tasks_processing.go:74] worker 60 stopped. I0629 14:22:15.051227 1 gather.go:181] gatherer "clusterconfig" function "networks" took 62.267596ms to process 1 records I0629 14:22:15.051277 1 tasks_processing.go:74] worker 38 stopped. I0629 14:22:15.051312 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=20b48f9803f0a11a30a5bc1caadcae15473716887e7253a4c1005944e21a1e52 I0629 14:22:15.051329 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=e4cfc030430d3178c14ea420d816fd03b4ca5f82a57d980e1a8723fb8e368b86 I0629 14:22:15.051339 1 gather.go:181] gatherer "clusterconfig" function "storage_classes" took 60.959791ms to process 2 records I0629 14:22:15.051419 1 tasks_processing.go:74] worker 15 stopped. I0629 14:22:15.051485 1 recorder.go:70] Recording config/authentication with fingerprint=f265a3310569c62e469c62b19ebce885d841c2b922561cf106e0536762540eda I0629 14:22:15.051494 1 gather.go:181] gatherer "clusterconfig" function "authentication" took 61.204411ms to process 1 records I0629 14:22:15.051567 1 tasks_processing.go:74] worker 43 stopped. I0629 14:22:15.051763 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=9b9dc8050005b61632b62bdfda4c6acfc47b1ca149ecb502e06d4f48d6e0054b I0629 14:22:15.051771 1 gather.go:181] gatherer "clusterconfig" function "image_registries" took 62.436693ms to process 1 records I0629 14:22:15.051969 1 tasks_processing.go:74] worker 18 stopped. I0629 14:22:15.051984 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 62.33717ms to process 0 records I0629 14:22:15.054168 1 tasks_processing.go:74] worker 0 stopped. I0629 14:22:15.054315 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=091832ec1cd16a050bd09ae3436b9e99d51d40f5bb85b573073a52122bc55ada I0629 14:22:15.054337 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=7ac9d5cf38be37900af5a74421d735b8422aa585766fe908d17179856372bcab I0629 14:22:15.054353 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=ab9305185d8e7fedb711c40c608a034d01069e832f4288e22768e4f279e00758 I0629 14:22:15.054360 1 gather.go:181] gatherer "clusterconfig" function "mutating_webhook_configurations" took 65.607042ms to process 3 records I0629 14:22:15.054370 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 64.268511ms to process 0 records I0629 14:22:15.054377 1 gather.go:181] gatherer "clusterconfig" function "node_logs" took 65.67708ms to process 0 records I0629 14:22:15.054381 1 gather.go:181] gatherer "clusterconfig" function "sap_pods" took 64.549186ms to process 0 records I0629 14:22:15.054385 1 gather.go:181] gatherer "clusterconfig" function "ceph_cluster" took 64.726434ms to process 0 records I0629 14:22:15.054389 1 tasks_processing.go:74] worker 51 stopped. I0629 14:22:15.054393 1 tasks_processing.go:74] worker 62 stopped. I0629 14:22:15.054396 1 tasks_processing.go:74] worker 45 stopped. I0629 14:22:15.054398 1 tasks_processing.go:74] worker 54 stopped. I0629 14:22:15.054480 1 tasks_processing.go:74] worker 34 stopped. I0629 14:22:15.054536 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=523adfee37133acc719ea65c2582037de6f184458d38e37f356b7a209f3ccf0d I0629 14:22:15.054693 1 gather.go:181] gatherer "clusterconfig" function "schedulers" took 64.833573ms to process 1 records I0629 14:22:15.056342 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0629 14:22:15.056350 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0629 14:22:15.056342 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0629 14:22:15.056557 1 tasks_processing.go:74] worker 39 stopped. I0629 14:22:15.056830 1 controller.go:203] Source scaController *sca.Controller is not ready I0629 14:22:15.056848 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0629 14:22:15.056854 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0629 14:22:15.056858 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0629 14:22:15.056864 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0629 14:22:15.056883 1 controller.go:457] The operator is still being initialized I0629 14:22:15.056894 1 controller.go:482] The operator is healthy I0629 14:22:15.056977 1 recorder.go:70] Recording config/node/ip-10-0-137-89.ec2.internal with fingerprint=639088c3745142a30ea06d9e60eada1a5145a10066cdd4432c12c5ef015af72f I0629 14:22:15.057028 1 recorder.go:70] Recording config/node/ip-10-0-147-231.ec2.internal with fingerprint=f284a73ef4583a21646b4a9a6ec00c97a4686b6fab652c2927d0dbad4cfa15ec I0629 14:22:15.057081 1 recorder.go:70] Recording config/node/ip-10-0-175-58.ec2.internal with fingerprint=a582d0126ae2fc00f122affe7fb7cfe9c7feee10d68e3507bd02e0d9247d862d I0629 14:22:15.057091 1 gather.go:181] gatherer "clusterconfig" function "nodes" took 65.26961ms to process 3 records I0629 14:22:15.057184 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=8a8bcee8c26b0a2e74bd4094336b64a4b5c0c9928dbe9f05f262d3576914e366 I0629 14:22:15.057183 1 tasks_processing.go:74] worker 21 stopped. I0629 14:22:15.057235 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=17492c8777e8646e7e4b3c4465b95cd9ae28cf1f4efd61b108f408e9da970ec0 I0629 14:22:15.057328 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=c0b6953200b5e2ae82735fe63abe07ebcff275cd2d57d99b7e3d09fe275a3bee I0629 14:22:15.057354 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=192d6efe85cec988a78149343b0e351208791c66175b38d89d75f51c8d8a9b33 I0629 14:22:15.057376 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=8d3074149edec1912cf3f5988e4f41138bcaa458277ae1f8b847f9eb21daa1f7 I0629 14:22:15.057401 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=dc12182bc3c0d2688486b94281784f1a95cea1ca1381b814af73c1e9ae4d9428 I0629 14:22:15.057425 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=f15a57b921507ade0942478a760d5a146f8b5b984811b5bc6dc4940ede6b603f I0629 14:22:15.057450 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=c41c501bdab6a304afa09f2f0fe603cccfe3d6c480292a08c0596284be35faaf I0629 14:22:15.057474 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=37ee65cf00d562f9cb73b653a05dd3945d93bc28c199e0dc76b6bba3f0e3fc44 I0629 14:22:15.057505 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=6f4b38a021fe42e89e46711abe212a687721ac0a1e53cc96b417c58f0247e3a3 I0629 14:22:15.057532 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=89fb7c061a948f14e10dc2135d4846051825b52ed3c354f880866ada20136897 I0629 14:22:15.057556 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=f1945f345dfcd09a513ca56b5b17a17affad986df0d1ac2edca1d24f375a2e40 I0629 14:22:15.057594 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=845a7cd5c27d179e43c7d5484a8c7b6854a4bdd3561b473469129148487d29e4 I0629 14:22:15.057605 1 gather.go:181] gatherer "clusterconfig" function "validating_webhook_configurations" took 66.977042ms to process 13 records E0629 14:22:15.057620 1 gather.go:144] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0629 14:22:15.057629 1 gather.go:181] gatherer "clusterconfig" function "machine_healthchecks" took 67.024872ms to process 0 records I0629 14:22:15.057690 1 tasks_processing.go:74] worker 58 stopped. I0629 14:22:15.057775 1 tasks_processing.go:74] worker 11 stopped. I0629 14:22:15.057780 1 recorder.go:70] Recording config/featuregate with fingerprint=1e4312d72c072b91859bf3af444f14cb5ce9bbe1cd3efc0be06e41e4b0e30cfe I0629 14:22:15.057788 1 gather.go:181] gatherer "clusterconfig" function "feature_gates" took 67.245201ms to process 1 records I0629 14:22:15.057866 1 tasks_processing.go:74] worker 13 stopped. I0629 14:22:15.057892 1 recorder.go:70] Recording config/apiserver with fingerprint=45c7b0a70d0b81498ba6a7b2207e1cb21fa1227c3ba0fc7a0e9be85989a77777 I0629 14:22:15.057900 1 gather.go:181] gatherer "clusterconfig" function "cluster_apiserver" took 65.968181ms to process 1 records I0629 14:22:15.057948 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=77ca3917d40dc373c686bbf3acec26fd9020bb61b58f27885908f12543b8d6a8 I0629 14:22:15.057961 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=2f651e6128b2d3b612a5ab0d0bb8dfae0aae258eb5b007441178195936ac1b0a I0629 14:22:15.057972 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=98583dddd72c7a61d8bf3abeb43abc7471b7b65f74f73db32fed56ec29c5058d I0629 14:22:15.057976 1 tasks_processing.go:74] worker 37 stopped. I0629 14:22:15.057988 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=f2346f9a75660847fa78bb9118eac5d5a7e1d4edef6c84623299a6c9b35bd119 I0629 14:22:15.058001 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=260918fdc1b4044a7b1f5ea72303b45f12191a955ca3743baa77b395e73342eb I0629 14:22:15.058014 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=6717a5b5d9ba11548d7a15b71c2b870f4dff6c8549057e132d603e7824889bef I0629 14:22:15.058026 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=645203bef446bfab82d3d07cd733afc0b3aae400397e008f3218552780e2208e I0629 14:22:15.058035 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=f31abedfe25ebbf109fd0f59fc36771acaa060590d46aea4d97e72733c8e8330 I0629 14:22:15.058046 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=a54ecae62d6c81ddb67a4ed110dbbc99f78630b6233ccf4373b089e76efc7ede I0629 14:22:15.058057 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=ed39a335a4e499164b7bd6e8ac3b21dcf54b9aef427291547f6f810220ad005d I0629 14:22:15.058066 1 gather.go:181] gatherer "clusterconfig" function "pdbs" took 67.501695ms to process 10 records I0629 14:22:15.058543 1 tasks_processing.go:74] worker 23 stopped. I0629 14:22:15.058557 1 gather.go:181] gatherer "clusterconfig" function "certificate_signing_requests" took 69.839145ms to process 0 records I0629 14:22:15.062623 1 tasks_processing.go:74] worker 12 stopped. I0629 14:22:15.062635 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=108780cb24f15bf572a4031966507398a0d0c6a28b3a008952f53b481dc191a9 I0629 14:22:15.062642 1 gather.go:181] gatherer "clusterconfig" function "dvo_metrics" took 72.865824ms to process 1 records I0629 14:22:15.063683 1 base_controller.go:73] Caches are synced for ConfigController I0629 14:22:15.063695 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0629 14:22:15.064071 1 tasks_processing.go:74] worker 41 stopped. E0629 14:22:15.064081 1 gather.go:144] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0629 14:22:15.064100 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0629 14:22:15.064110 1 gather.go:181] gatherer "clusterconfig" function "machine_configs" took 72.823259ms to process 1 records I0629 14:22:15.068175 1 tasks_processing.go:74] worker 17 stopped. I0629 14:22:15.068609 1 recorder.go:70] Recording config/infrastructure with fingerprint=7b30344818501b1b97eebf3a1c6f6e692e52014239ffeb33035df4e12f265496 I0629 14:22:15.068621 1 gather.go:181] gatherer "clusterconfig" function "infrastructures" took 77.699996ms to process 1 records I0629 14:22:15.073178 1 tasks_processing.go:74] worker 50 stopped. I0629 14:22:15.073344 1 recorder.go:70] Recording config/ingress with fingerprint=a0a5b2d4a2bc52aa44cab2b58d8cea98d08bbfe972a5b38894c508199dd9197b I0629 14:22:15.073355 1 gather.go:181] gatherer "clusterconfig" function "ingress" took 83.359275ms to process 1 records I0629 14:22:15.076758 1 requests.go:204] Asking for SCA certificate for x86_64 architecture I0629 14:22:15.094415 1 tasks_processing.go:74] worker 63 stopped. I0629 14:22:15.094432 1 gather.go:181] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 105.766488ms to process 0 records I0629 14:22:15.096292 1 tasks_processing.go:74] worker 47 stopped. I0629 14:22:15.096344 1 recorder.go:70] Recording config/olm_operators with fingerprint=586cae8c3bc4cf3596135847b7a4d9d9b9e932fb500d7ad4f5e441e604c069de I0629 14:22:15.096358 1 gather.go:181] gatherer "clusterconfig" function "olm_operators" took 107.724322ms to process 1 records I0629 14:22:15.096487 1 tasks_processing.go:74] worker 16 stopped. I0629 14:22:15.096504 1 gather.go:181] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 106.181956ms to process 0 records I0629 14:22:15.096696 1 tasks_processing.go:74] worker 14 stopped. I0629 14:22:15.096791 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 14:22:15.096907 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=938732dbafe0e47a6295cf5ae92c1568f060b86d0721d286dfc58817a4eb6a4e I0629 14:22:15.096964 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=370e214825e0febadee0f72620a8f21b8948bcefd3bf80a4694e2d308043816f I0629 14:22:15.096975 1 gather.go:181] gatherer "clusterconfig" function "clusterroles" took 105.807013ms to process 2 records I0629 14:22:15.097074 1 tasks_processing.go:74] worker 35 stopped. I0629 14:22:15.097480 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=881f617fae2af5e044970f56e5b6a2ffc62f4e3b639f7c432e59f5534a4ca818 I0629 14:22:15.097608 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=5a9bb49da14d36e94bbadc7f1c087e35fc982cea55a362162fdfd3f0f89aac82 I0629 14:22:15.097618 1 gather.go:181] gatherer "clusterconfig" function "crds" took 107.460064ms to process 2 records I0629 14:22:15.106298 1 base_controller.go:73] Caches are synced for LoggingSyncer I0629 14:22:15.106392 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0629 14:22:15.121208 1 tasks_processing.go:74] worker 61 stopped. I0629 14:22:15.121228 1 gather.go:181] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 130.669843ms to process 0 records I0629 14:22:15.128251 1 tasks_processing.go:74] worker 26 stopped. I0629 14:22:15.129313 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-7d4ddc79d6-2r8mf with fingerprint=6849759e49697993c7dc5448e14e311ec5aa19062df0b052dde27bda5a6d88e3 I0629 14:22:15.129452 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-j4r4v with fingerprint=976ca952d016ef007841431c61acf6a197612e3b11f7b1b822799b926ac1fb1a I0629 14:22:15.129565 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-vthjt with fingerprint=651c594a5effcf6310d147c5cef8a4a15a46661ec3ce17bbfd73f36a44a32990 I0629 14:22:15.129619 1 recorder.go:70] Recording config/running_containers with fingerprint=973d7a5d54f736cb4843b951474c6225c65be5b3b37ee986a827029fe91102d9 I0629 14:22:15.129628 1 gather.go:181] gatherer "clusterconfig" function "container_images" took 137.503619ms to process 4 records I0629 14:22:15.131234 1 tasks_processing.go:74] worker 3 stopped. E0629 14:22:15.131246 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0629 14:22:15.131251 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0629 14:22:15.131254 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0629 14:22:15.131304 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0629 14:22:15.131315 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0629 14:22:15.131324 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=e1a0ad594db3a5d5d50e9e25d7b235af20f84f5def41537f127febe525b834f2 I0629 14:22:15.131331 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0629 14:22:15.131352 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0629 14:22:15.131358 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0629 14:22:15.131362 1 gather.go:181] gatherer "clusterconfig" function "config_maps" took 142.693513ms to process 6 records I0629 14:22:15.132350 1 tasks_processing.go:74] worker 33 stopped. E0629 14:22:15.132361 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0629 14:22:15.132366 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2r82qc7oqufqt2f3ecmv6ipqtojbdvut-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2r82qc7oqufqt2f3ecmv6ipqtojbdvut-primary-cert-bundle-secret" not found I0629 14:22:15.132410 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=62d58e6f6c60764e192cf8151f69f20fa9c6f504746b17ca3f82c880b4001cf2 I0629 14:22:15.132419 1 gather.go:181] gatherer "clusterconfig" function "ingress_certificates" took 141.937222ms to process 1 records I0629 14:22:15.136058 1 tasks_processing.go:74] worker 31 stopped. I0629 14:22:15.136379 1 recorder.go:70] Recording config/version with fingerprint=77c61ba3988f5def38f7d5f11a1a901c3dd0fdb79b4fa185d8d3858a7cb7b87a I0629 14:22:15.136390 1 recorder.go:70] Recording config/id with fingerprint=7c49a1a5a768a4375b123803a27c3da03dd9cc6d9c91529967dc1726e7dfde84 I0629 14:22:15.136395 1 gather.go:181] gatherer "clusterconfig" function "version" took 147.503003ms to process 2 records I0629 14:22:15.149698 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I0629 14:22:15.205906 1 cluster_transfer.go:102] no available accepted cluster transfer I0629 14:22:15.205921 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0629 14:22:15.261670 1 sca.go:141] etc-pki-entitlement secret successfully updated I0629 14:22:15.261690 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated in the etc-pki-entitlement secret I0629 14:22:15.261702 1 gather_cluster_operator_pods_and_events.go:121] Found 12 pods with 15 containers I0629 14:22:15.261711 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1677721 bytes I0629 14:22:15.262166 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-bsx79 pod in namespace openshift-dns (previous: false). I0629 14:22:15.275870 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-bsx79 pod in namespace openshift-dns (previous: false). I0629 14:22:15.478475 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-hfddj pod in namespace openshift-dns (previous: false). I0629 14:22:15.676396 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-hfddj pod in namespace openshift-dns (previous: false). I0629 14:22:15.696502 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0629 14:22:15.876339 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-zhp68 pod in namespace openshift-dns (previous: false). I0629 14:22:15.896637 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0629 14:22:16.036623 1 tasks_processing.go:74] worker 57 stopped. I0629 14:22:16.036649 1 recorder.go:70] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0629 14:22:16.036662 1 gather.go:181] gatherer "clusterconfig" function "silenced_alerts" took 1.046896317s to process 1 records I0629 14:22:16.036898 1 tasks_processing.go:74] worker 40 stopped. I0629 14:22:16.036940 1 recorder.go:70] Recording config/alerts with fingerprint=14514193aea81818ff27d18d2a6c9218df50f41d9ee6869a39680281ad4826b2 I0629 14:22:16.036963 1 gather.go:181] gatherer "clusterconfig" function "active_alerts" took 1.047352578s to process 1 records I0629 14:22:16.074897 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-zhp68 pod in namespace openshift-dns (previous: false). I0629 14:22:16.275544 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-b29hw pod in namespace openshift-dns (previous: false). I0629 14:22:16.476798 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-q4xjx pod in namespace openshift-dns (previous: false). I0629 14:22:16.674945 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-qf5dw pod in namespace openshift-dns (previous: false). I0629 14:22:16.875072 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5f7587f555-7vkst pod in namespace openshift-ingress (previous: false). I0629 14:22:17.076099 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-67fc45f5bb-jlssx pod in namespace openshift-ingress (previous: false). I0629 14:22:17.275873 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-67fc45f5bb-pvgjm pod in namespace openshift-ingress (previous: false). I0629 14:22:17.299624 1 tasks_processing.go:74] worker 56 stopped. I0629 14:22:17.299770 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=fea5db53c609b7e4e352c303d544613370021239303f23029b5501706bcd7263 I0629 14:22:17.299808 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=183539bbe89c989a326011f124cb26e91d4dc0406689baecde44742b1c4a8e80 I0629 14:22:17.299824 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=3db41fa0f7967e5aef70f4403f26ae073fe559e15729f56443dcc1a2f1df38bf I0629 14:22:17.299833 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0629 14:22:17.299847 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=3955ebf0b9e8cfb952058eeec1aba84ea74dcf4ccabcf0fd53a60e3341fedfc4 I0629 14:22:17.299860 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0629 14:22:17.299873 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=09943dce33fbad39e1d88cd85db907794178f5b14b99621fe66530f465381314 I0629 14:22:17.299890 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=1e0386e447f70ca67265a2fd9a558343d772cfe162db75e796af65be08d1bf0d I0629 14:22:17.299910 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=706450cac35a5755e239c13565796b308a91a329838375577498e1d999e64ab2 I0629 14:22:17.299930 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=1b7a4b13fbd8f73c63f780da6b7b36d7b0bd0f0a84a91b941e09737d2e0054bd I0629 14:22:17.300120 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=8f68b142f74e4f38c8de7737497ba2dabd8b53650c761227c3ce12ab24ba3b42 I0629 14:22:17.300133 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=13e40ba7da42b44a1d1758e5361aec607c13dd8942f716d9f41cc25af7e7f14c I0629 14:22:17.300141 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0629 14:22:17.300151 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=2201ae7c823270d6197bad3e6838a3258fb1bcc158cb905da5bd4888547ca46d I0629 14:22:17.300159 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0629 14:22:17.300167 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=8c0d4074d23222d2df4caec8b0035ce7997086adc37d476ea5e6d7cd5041beba I0629 14:22:17.300176 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0629 14:22:17.300187 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=264e392db494d554d58a3837bffe115561ddde158d4d37d39add43cdb442d4bf I0629 14:22:17.300196 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0629 14:22:17.300207 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=45125885661e6305bd882b347e4821d788a1bfd613b7636ef4500d386fa0cbb7 I0629 14:22:17.300278 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=c1e7fc186486c5248bf9c6bde2e916b07342b0997d553331d1620ed2045d789f I0629 14:22:17.300298 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0629 14:22:17.300313 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=b9e93155e05837c39bbe27a876a0cf8f143067b7aca8d1ebd9bec75120b06b50 I0629 14:22:17.300328 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=4c18d1b730ee0c9a41ac6f13830f94cd8a2f9c302c172765f455d23ca6851c9f I0629 14:22:17.300335 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0629 14:22:17.300345 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=98d075d2439a324401ec6075333903947d78cb6a1a9342e0c87c2e38634b651b I0629 14:22:17.300353 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0629 14:22:17.300365 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=bcec3a6c371d37a12aac158dd1b6567c430b5579c7d95bbc564b978bcbb2e320 I0629 14:22:17.300374 1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0629 14:22:17.300383 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=4d0e61de57c90f7c83e439c34b08ed5edfaf9567ab7ec76069d5df75f2ed81c0 I0629 14:22:17.300393 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=29c50d04747fa2cb6662e1d8ce6780843117ee968ff19084c065693df8878e8d I0629 14:22:17.300401 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=821dc6546f203e2a3cfaa4e9a057abde9bb51498e05b5071fecef90ffdfe8b53 I0629 14:22:17.300416 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=e3204f210c9c7fc9dda10c49308acc15646cea0f7e684ffd8a06e99b3146aab0 I0629 14:22:17.300424 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0629 14:22:17.300437 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=d5ad4948891b90963c87de7999937de67fb42467a558f28f990143d6d861d188 I0629 14:22:17.300450 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0629 14:22:17.300457 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0629 14:22:17.300462 1 gather.go:181] gatherer "clusterconfig" function "operators" took 2.310984512s to process 37 records I0629 14:22:17.475770 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-h6prs pod in namespace openshift-ingress-canary (previous: false). I0629 14:22:17.675420 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-hqdfx pod in namespace openshift-ingress-canary (previous: false). I0629 14:22:17.875504 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-vkl4f pod in namespace openshift-ingress-canary (previous: false). I0629 14:22:18.076560 1 tasks_processing.go:74] worker 52 stopped. I0629 14:22:18.076647 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=6fcb53ab10572aa018b9304b66922f159625432e1973708b3ce1b96b9b9e5f58 I0629 14:22:18.076706 1 recorder.go:70] Recording events/openshift-dns with fingerprint=7d727aad00b06e782526b456e42d40c4fc732db5fcfb6ce7595fba1a444ab243 I0629 14:22:18.076728 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=18bcf6896b8ba0330089163ec36bad0c25a3bc9e2610987a3d4f3e4161b05169 I0629 14:22:18.076770 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=e6cddd49189712bae44434c85426fe59c65693b88e8940cef3f15802692e8015 I0629 14:22:18.076797 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=a4b8b56b904344f175990ace429fce767c52c708d22f76653ddcdbd4b97078de I0629 14:22:18.076805 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-bsx79/dns_current.log with fingerprint=fad4e75f2fe011fd69244316ba9402d3e44a52df2fcd1d720b62db15c4ad4f6b I0629 14:22:18.076811 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-bsx79/kube-rbac-proxy_current.log with fingerprint=bee4888b94afe62da28978ef548d913efb1e98e33bdbd9f09e51bc9e57028389 I0629 14:22:18.076814 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-hfddj/dns_current.log with fingerprint=060c062e074274c64bde43b0bc70b992ee8452b456a442d9f6db171d2e72d1dd I0629 14:22:18.076819 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-hfddj/kube-rbac-proxy_current.log with fingerprint=e3e0b64f5c71af793e5ce674d1c66f2cd35c6dd9727047808a8565f28fb94512 I0629 14:22:18.076825 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-zhp68/dns_current.log with fingerprint=924da02c1e7cc72df132c9d5caef8ffb3782cac11fe9e5760a20dc036080b753 I0629 14:22:18.076832 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-zhp68/kube-rbac-proxy_current.log with fingerprint=d9d48bca9a5511f387db427dc1fdd5857a6dc595e0da9fdf494cb9459b3c8e64 I0629 14:22:18.076836 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-b29hw/dns-node-resolver_current.log with fingerprint=1ad9a71b77fb91fc4990d90a71d7513aee55f2b678f463093a9729be3e6b0ba4 I0629 14:22:18.076841 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-q4xjx/dns-node-resolver_current.log with fingerprint=f8bb2781ee039d0142082920c81437441c60925e074f93a14d0b4fa303f317b5 I0629 14:22:18.076846 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-qf5dw/dns-node-resolver_current.log with fingerprint=4e0af5a105ef517236244cb29f6cc39dc1633540ab2ca88e16e2f2925871a276 I0629 14:22:18.076853 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-5f7587f555-7vkst/router_current.log with fingerprint=b102964405b38c2f93af5d2b55751e42f8f5f9d61bb12198ad0656b361f68599 I0629 14:22:18.076862 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-67fc45f5bb-jlssx/router_current.log with fingerprint=36258eec4a6c8cc7fe287d3e6857fe13141b808e9ac7d3c7643dee565d0ffd74 I0629 14:22:18.076868 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-67fc45f5bb-pvgjm/router_current.log with fingerprint=fff9e31f73b6f4235cd04cdb42b4675d5f0172f6a928f7ae3cabd8b7046b4f1d I0629 14:22:18.076871 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-h6prs/serve-healthcheck-canary_current.log with fingerprint=625a054c29bdfcdf168aee05e45eacc3fb959246e45cfd9428f6e57f2c190c8b I0629 14:22:18.076874 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-hqdfx/serve-healthcheck-canary_current.log with fingerprint=0a30fe3ea1288f68d0732cb7e5b9165a916e8134658b21084d5eaef643ad7e71 I0629 14:22:18.076876 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-vkl4f/serve-healthcheck-canary_current.log with fingerprint=a92b6877421700937bd6ccbab7abebb7aa9069fe2ed005e6728b0733d36c839d I0629 14:22:18.076881 1 gather.go:181] gatherer "clusterconfig" function "operators_pods_and_events" took 3.086960373s to process 20 records I0629 14:22:28.065174 1 tasks_processing.go:74] worker 42 stopped. I0629 14:22:28.065226 1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0629 14:22:28.065239 1 gather.go:181] gatherer "clusterconfig" function "install_plans" took 13.075508434s to process 1 records I0629 14:22:28.797438 1 tasks_processing.go:74] worker 27 stopped. I0629 14:22:28.797672 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=ba16ea6b4503917d33437d4d1999039313b5aa3c669ab94c714d5681918865aa I0629 14:22:28.797686 1 gather.go:181] gatherer "clusterconfig" function "service_accounts" took 13.806222922s to process 1 records E0629 14:22:28.797727 1 periodic.go:252] clusterconfig failed after 13.809s with: function "tsdb_status" failed with an error, function "metrics" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0629 14:22:28.797738 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "tsdb_status" failed with an error, function "metrics" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0629 14:22:28.797745 1 periodic.go:214] Running workloads gatherer I0629 14:22:28.797765 1 tasks_processing.go:45] number of workers: 2 I0629 14:22:28.797771 1 tasks_processing.go:69] worker 1 listening for tasks. I0629 14:22:28.797774 1 tasks_processing.go:71] worker 1 working on workload_info task. I0629 14:22:28.797789 1 tasks_processing.go:69] worker 0 listening for tasks. I0629 14:22:28.797865 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0629 14:22:28.820934 1 gather_workloads_info.go:281] Loaded pods in 0s, will wait 24s for image data I0629 14:22:28.825892 1 tasks_processing.go:74] worker 0 stopped. I0629 14:22:28.825907 1 gather.go:181] gatherer "workloads" function "helmchart_info" took 28.006235ms to process 0 records I0629 14:22:28.829282 1 gather_workloads_info.go:390] No image sha256:3fea7db586d3236c1876a8b523af0d8d65c84d6f6cf5d0f4e41cafcffe6db5b5 (9ms) I0629 14:22:28.838295 1 gather_workloads_info.go:390] No image sha256:351ca92471647f383f3cd7f0b70f33f5fa11c39ab569c4948dff7d471a6c8be3 (9ms) I0629 14:22:28.846951 1 gather_workloads_info.go:390] No image sha256:0c1abef76d6d2832ddcff31e950ffafeb4e0f6fad80a5f5dca94591de0fc9581 (9ms) I0629 14:22:28.855665 1 gather_workloads_info.go:390] No image sha256:3a2c82b772ea6072e1eca0efc5303f002189e80b0e985fb3e3b8ea9a12fe8060 (9ms) I0629 14:22:28.864238 1 gather_workloads_info.go:390] No image sha256:5bcfb1b739fa4e6ff9e21e4843f8520f29608135341f7d8dcc31084b9ba25f1d (9ms) I0629 14:22:28.873446 1 gather_workloads_info.go:390] No image sha256:a7fc4d05c4a3c82c9f355ca985d6fd26033c0d6a98716f25fcd2f54bae1d2fa0 (9ms) I0629 14:22:28.882365 1 gather_workloads_info.go:390] No image sha256:02283a64c1936a5dd09d5c6bc0ecbcf9196fe4df6a4055c8be22cebd850aa7a3 (9ms) I0629 14:22:28.891065 1 gather_workloads_info.go:390] No image sha256:06821dfe231330e0eb5be915b9468cd13826a7ee59d1a732b89cb140548eade2 (9ms) I0629 14:22:28.899724 1 gather_workloads_info.go:390] No image sha256:42b4c6bdf3081ec264bc5edbc4eb779151de9e4742d6fe59a316645891df649c (9ms) I0629 14:22:28.908526 1 gather_workloads_info.go:390] No image sha256:41029e57ece558b2e0b12174ce924647fd9d5c5d83aadf4bba03d6916d3f9f54 (9ms) I0629 14:22:28.930153 1 gather_workloads_info.go:390] No image sha256:09b3e9e6a4f382fb4bbdb67bc945bcf19d66f604b7c8ffd66d4d4a2c94224248 (22ms) I0629 14:22:29.030670 1 gather_workloads_info.go:390] No image sha256:3969660e807e8ce5656a74e5816573656241946ef1d766a9d2e21d434356313c (101ms) I0629 14:22:29.130836 1 gather_workloads_info.go:390] No image sha256:30ff5e5b72f274598704ca69f1832eba1040cc25da47386004fd59500b6e4c55 (100ms) I0629 14:22:29.230750 1 gather_workloads_info.go:390] No image sha256:c96b4bddf3dd7daaa797cbda4dd92e981de2f5fc3404c01381f31dc0414d5c8d (100ms) I0629 14:22:29.330363 1 gather_workloads_info.go:390] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (100ms) I0629 14:22:29.430319 1 gather_workloads_info.go:390] No image sha256:2897724cec17bc13acc133181f64ccb8d54ce5dc9582f9cecf704c2540e15600 (100ms) I0629 14:22:29.531087 1 gather_workloads_info.go:390] No image sha256:0c6b7f828184b16a5e6630111e0715e11d34dae9b0bf64619466543e6168e05c (101ms) I0629 14:22:29.633655 1 gather_workloads_info.go:390] No image sha256:70f4702845ec5b627d49504a53a13d997c0578630cddffb89aba5cfebe04fc25 (103ms) I0629 14:22:29.730804 1 gather_workloads_info.go:390] No image sha256:48dff3fcb0da58eb9b2b500f89af8b7d0790ffa60da0b0e301feca971dbafcbb (97ms) I0629 14:22:29.831085 1 gather_workloads_info.go:401] Found image sha256:751bd7eb62f632c0eef0ca91b6c57c64d4f1279d4dbe1a9b875ac4020a7b693f (100ms) I0629 14:22:29.930065 1 gather_workloads_info.go:390] No image sha256:24519dcc0e63cdc60a639dd474d06e7612e9b76966bc60322cd9026a0f1b878c (99ms) I0629 14:22:30.030637 1 gather_workloads_info.go:390] No image sha256:4b9b7949d209e257a76053de4ac74193f747c0d42e25dcd270d655849a4e51aa (101ms) I0629 14:22:30.131417 1 gather_workloads_info.go:390] No image sha256:13aabbaf260d634ff0e9ac1af88af075b5ba671fd51313e33e74d7d2f7e54128 (101ms) I0629 14:22:30.231064 1 gather_workloads_info.go:401] Found image sha256:b8781637560d49de9b8e8cdd59ec75f03d98921ea66950381849398128cc9cb9 (100ms) I0629 14:22:30.330366 1 gather_workloads_info.go:390] No image sha256:0242cefbf0bb876101c4d67ab4e07401cb0ba6c02be2b73a4f17ba33b2960005 (99ms) I0629 14:22:30.434385 1 gather_workloads_info.go:390] No image sha256:6a9b4fd887fa7f1729302fb0330c3c9a483197bf78becdcfda4235ec823a2c39 (104ms) I0629 14:22:30.530726 1 gather_workloads_info.go:390] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (96ms) I0629 14:22:30.649096 1 gather_workloads_info.go:390] No image sha256:1eee856bde9bad71c4444c494225a0cf02d1f4a5293acf0bd6e7e1814efa0064 (118ms) I0629 14:22:30.738553 1 gather_workloads_info.go:390] No image sha256:194ee1155b87e110bc6c4a6e55667e41f3bdc8292e26a9561f9082fdfe467eec (89ms) I0629 14:22:30.830707 1 gather_workloads_info.go:390] No image sha256:68abf16a3b6c33fdd22a823c7d00f96aaaa8015d370116962a5835984908645a (92ms) I0629 14:22:30.931169 1 gather_workloads_info.go:390] No image sha256:8562a483f4568254250f19fc68d79f88c94a48508aefe59a70c1021a3aad000a (100ms) I0629 14:22:31.034696 1 gather_workloads_info.go:390] No image sha256:bc829520eeec090b60d17abbad1a22b34ea99b426193395808a778d73a5fb57a (104ms) I0629 14:22:31.131252 1 gather_workloads_info.go:390] No image sha256:4dcdadc14b7bdb2c00954d92e957d63aafbbe5f4047fe028e575d65725923cb0 (97ms) I0629 14:22:31.230435 1 gather_workloads_info.go:390] No image sha256:894452e6587de55d04e37163d3da53e11fced8fb08bd0acf61e6d49f7964284e (99ms) I0629 14:22:31.330633 1 gather_workloads_info.go:390] No image sha256:0158b297aec0a66376c04d3c7cf4828db5e5d9f424e331ff7c7b796828036875 (100ms) I0629 14:22:31.430654 1 gather_workloads_info.go:390] No image sha256:221622a101db9797df0622b4534e3e42c4498df458f355a8a02fad8d65f8e3f2 (100ms) I0629 14:22:31.531585 1 gather_workloads_info.go:390] No image sha256:8e158c83ec12b3e0237fab9a221630bd691e79c079a111f346354ff43b8199df (101ms) I0629 14:22:31.630514 1 gather_workloads_info.go:390] No image sha256:ed0c9631d6e424912cd8ce78ca7a2c4f76b3fc15e9e34fe00999170ccf19a611 (99ms) I0629 14:22:31.730723 1 gather_workloads_info.go:390] No image sha256:788d16bfff4bd6bb3ce97acc643b56fae6e619674ab279535480e519b4d5b769 (100ms) I0629 14:22:31.831860 1 gather_workloads_info.go:390] No image sha256:31a22f6ee061d0f6558664e580ec0f80f1927d4ec29626cf3e9420837f5d80e5 (101ms) I0629 14:22:31.931181 1 gather_workloads_info.go:390] No image sha256:1c7c24111f1709d7648156873ced09462638aa4b3cf7e7aee13297e51bcdfb3e (99ms) I0629 14:22:32.030861 1 gather_workloads_info.go:390] No image sha256:586127c49e25052113263d8aeaf6a1623aef22987364f119a17b2848982ff716 (100ms) I0629 14:22:32.130478 1 gather_workloads_info.go:390] No image sha256:50076d29400ecf9b704d8175509fc8cb7c28bea91d46a28dc37cbda1668c69f9 (100ms) I0629 14:22:32.230222 1 gather_workloads_info.go:390] No image sha256:38787de16ee8c686305f93b501d891b50cde24136009863869d230c0d4eeee5c (100ms) I0629 14:22:32.330307 1 gather_workloads_info.go:390] No image sha256:c7aa910ca06f8fd89cdf2519136e0f3533bdacfc6bd58a3f6683f9f08756c7b1 (100ms) I0629 14:22:32.330337 1 tasks_processing.go:74] worker 1 stopped. I0629 14:22:32.330579 1 recorder.go:70] Recording config/workload_info with fingerprint=f5021cd41751a4c8cb9f042b3eeccb297d58de3c987868ec0c968401bb43bb5d I0629 14:22:32.330592 1 gather.go:181] gatherer "workloads" function "workload_info" took 3.532556564s to process 1 records I0629 14:22:32.330603 1 periodic.go:261] Periodic gather workloads completed in 3.532s I0629 14:22:32.330611 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0629 14:22:32.330615 1 periodic.go:214] Running conditional gatherer I0629 14:22:32.339144 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules I0629 14:22:32.612170 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer E0629 14:22:32.614284 1 conditional_gatherer.go:322] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.149.192:9091: connect: connection refused I0629 14:22:32.614345 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0629 14:22:32.623946 1 conditional_gatherer.go:390] cluster version is '4.18.9' E0629 14:22:32.623960 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:22:32.623964 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:22:32.623967 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:22:32.623969 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:22:32.623971 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:22:32.623974 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:22:32.623976 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:22:32.623977 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:22:32.623979 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:22:32.623981 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0629 14:22:32.623996 1 tasks_processing.go:45] number of workers: 3 I0629 14:22:32.624008 1 tasks_processing.go:69] worker 2 listening for tasks. I0629 14:22:32.624012 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0629 14:22:32.624013 1 tasks_processing.go:69] worker 0 listening for tasks. I0629 14:22:32.624020 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I0629 14:22:32.624022 1 tasks_processing.go:69] worker 1 listening for tasks. I0629 14:22:32.624028 1 tasks_processing.go:74] worker 1 stopped. I0629 14:22:32.624032 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0629 14:22:32.624059 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0629 14:22:32.624073 1 gather.go:181] gatherer "conditional" function "remote_configuration" took 1.121µs to process 1 records I0629 14:22:32.624153 1 tasks_processing.go:74] worker 2 stopped. I0629 14:22:32.624155 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I0629 14:22:32.624165 1 gather.go:181] gatherer "conditional" function "conditional_gatherer_rules" took 768ns to process 1 records I0629 14:22:32.624217 1 tasks_processing.go:74] worker 0 stopped. I0629 14:22:32.624227 1 gather.go:181] gatherer "conditional" function "rapid_container_logs" took 190.371µs to process 0 records I0629 14:22:32.624238 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I0629 14:22:32.624247 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f W0629 14:22:32.653965 1 gather.go:213] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0629 14:22:32.654073 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=6e9d8feadadb3f5b624a0a4240e65cb3f80fe8f8dee71846d43ee7663851a274 I0629 14:22:32.654182 1 diskrecorder.go:70] Writing 129 records to /var/lib/insights-operator/insights-2026-06-29-142232.tar.gz I0629 14:22:32.660518 1 diskrecorder.go:51] Wrote 129 records to disk in 6ms I0629 14:22:32.660550 1 periodic.go:283] Gathering cluster info every 2h0m0s I0629 14:22:32.660564 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0629 14:23:44.989121 1 diskrecorder.go:170] Found files to send: insights-2026-06-29-142232.tar.gz I0629 14:23:44.989151 1 insightsuploader.go:150] Checking archives to upload periodically every 15m59.745719039s I0629 14:23:44.989159 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0629 14:23:45.000426 1 requests.go:47] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0629 14:23:45.261420 1 requests.go:88] Successfully reported id=2026-06-29T14:23:44Z x-rh-insights-request-id=b01194ae39f244f3bc528c7d80d6a1a1, wrote=60641 I0629 14:23:45.261478 1 insightsuploader.go:187] Uploaded report successfully in 272.3117ms I0629 14:23:45.261500 1 controller.go:119] Initializing last reported time to 2026-06-29T14:23:44Z I0629 14:23:45.261520 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0629 14:23:45.261532 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0629 14:23:45.261541 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0629 14:23:45.267554 1 controller.go:482] The operator is healthy I0629 14:24:15.014614 1 controller.go:482] The operator is healthy I0629 14:24:46.105236 1 insightsreport.go:137] Pulling report from smart-proxy I0629 14:24:46.105273 1 insightsreport.go:149] Retrieving report I0629 14:24:46.115897 1 requests.go:111] Retrieving report for cluster: 6648d6d7-0021-45bf-84d3-affae14e6204 I0629 14:24:46.115910 1 requests.go:112] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/6648d6d7-0021-45bf-84d3-affae14e6204/reports I0629 14:24:46.117732 1 requests.go:122] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/6648d6d7-0021-45bf-84d3-affae14e6204/reports I0629 14:24:46.333232 1 insightsreport.go:184] Report retrieved I0629 14:24:46.376782 1 insightsreport.go:239] Report retrieved correctly I0629 14:26:15.015602 1 controller.go:482] The operator is healthy I0629 14:27:14.985991 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 14:27:14.994881 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 14:27:14.994899 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 14:27:14.999432 1 secretconfigobserver.go:119] support secret does not exist I0629 14:28:15.015440 1 controller.go:482] The operator is healthy I0629 14:30:15.013188 1 controller.go:482] The operator is healthy I0629 14:32:14.981708 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 14:32:14.986042 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 14:32:15.000147 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 14:32:15.004977 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 14:32:15.004995 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 14:32:15.009396 1 secretconfigobserver.go:119] support secret does not exist I0629 14:32:15.011390 1 controller.go:482] The operator is healthy I0629 14:34:15.013482 1 controller.go:482] The operator is healthy I0629 14:36:15.012734 1 controller.go:482] The operator is healthy I0629 14:37:15.010196 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 14:37:15.015839 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 14:37:15.015856 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 14:37:15.019938 1 secretconfigobserver.go:119] support secret does not exist I0629 14:38:15.012556 1 controller.go:482] The operator is healthy I0629 14:39:50.008503 1 insightsuploader.go:146] Nothing to report since 2026-06-29T14:23:44Z I0629 14:40:15.015936 1 controller.go:482] The operator is healthy I0629 14:42:14.985569 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 14:42:15.012017 1 controller.go:482] The operator is healthy I0629 14:42:15.020940 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 14:42:15.025528 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 14:42:15.025548 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 14:42:15.029705 1 secretconfigobserver.go:119] support secret does not exist I0629 14:44:15.017376 1 controller.go:482] The operator is healthy I0629 14:46:15.016319 1 controller.go:482] The operator is healthy I0629 14:47:15.030641 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 14:47:15.040909 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 14:47:15.040933 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 14:47:15.045755 1 secretconfigobserver.go:119] support secret does not exist I0629 14:48:15.014929 1 controller.go:482] The operator is healthy I0629 14:50:15.012649 1 controller.go:482] The operator is healthy I0629 14:52:14.981979 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 14:52:14.986183 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 14:52:15.011448 1 controller.go:482] The operator is healthy I0629 14:52:15.046356 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 14:52:15.051158 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 14:52:15.051175 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 14:52:15.054993 1 secretconfigobserver.go:119] support secret does not exist I0629 14:54:15.012895 1 controller.go:482] The operator is healthy I0629 14:55:25.014131 1 insightsuploader.go:146] Nothing to report since 2026-06-29T14:23:44Z I0629 14:56:15.012485 1 controller.go:482] The operator is healthy I0629 14:57:15.055609 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 14:57:15.061834 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 14:57:15.061852 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 14:57:15.065756 1 secretconfigobserver.go:119] support secret does not exist I0629 14:58:15.015983 1 controller.go:482] The operator is healthy I0629 15:00:15.012500 1 controller.go:482] The operator is healthy I0629 15:02:14.983121 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 15:02:14.987683 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 15:02:15.012915 1 controller.go:482] The operator is healthy I0629 15:02:15.066291 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:02:15.071311 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:02:15.071327 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:02:15.075435 1 secretconfigobserver.go:119] support secret does not exist I0629 15:04:15.013283 1 controller.go:482] The operator is healthy I0629 15:06:15.014940 1 controller.go:482] The operator is healthy I0629 15:07:15.076154 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:07:15.081606 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:07:15.081622 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:07:15.086067 1 secretconfigobserver.go:119] support secret does not exist I0629 15:08:15.013172 1 controller.go:482] The operator is healthy I0629 15:10:15.012348 1 controller.go:482] The operator is healthy I0629 15:10:41.214136 1 insightsuploader.go:146] Nothing to report since 2026-06-29T14:23:44Z I0629 15:12:14.983171 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 15:12:15.012529 1 controller.go:482] The operator is healthy I0629 15:12:15.086705 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:12:15.092053 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:12:15.092074 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:12:15.096482 1 secretconfigobserver.go:119] support secret does not exist I0629 15:14:15.013472 1 controller.go:482] The operator is healthy I0629 15:16:15.013387 1 controller.go:482] The operator is healthy I0629 15:17:15.097049 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:17:15.102458 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:17:15.102477 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:17:15.106622 1 secretconfigobserver.go:119] support secret does not exist I0629 15:18:15.013529 1 controller.go:482] The operator is healthy I0629 15:20:15.013199 1 controller.go:482] The operator is healthy I0629 15:22:14.987034 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 15:22:14.991681 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 15:22:15.012755 1 controller.go:482] The operator is healthy I0629 15:22:15.106994 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:22:15.112017 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:22:15.112035 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:22:15.116632 1 secretconfigobserver.go:119] support secret does not exist I0629 15:24:15.013078 1 controller.go:482] The operator is healthy I0629 15:26:15.012338 1 controller.go:482] The operator is healthy I0629 15:26:42.225528 1 insightsuploader.go:146] Nothing to report since 2026-06-29T14:23:44Z I0629 15:27:15.117433 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:27:15.122947 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:27:15.122963 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:27:15.127377 1 secretconfigobserver.go:119] support secret does not exist I0629 15:28:15.013127 1 controller.go:482] The operator is healthy I0629 15:30:15.012184 1 controller.go:482] The operator is healthy I0629 15:32:14.987623 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 15:32:14.992444 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 15:32:15.012676 1 controller.go:482] The operator is healthy I0629 15:32:15.127946 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:32:15.132921 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:32:15.132940 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:32:15.137040 1 secretconfigobserver.go:119] support secret does not exist I0629 15:34:15.013102 1 controller.go:482] The operator is healthy I0629 15:36:15.012059 1 controller.go:482] The operator is healthy I0629 15:37:15.137371 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:37:15.143045 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:37:15.143062 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:37:15.147358 1 secretconfigobserver.go:119] support secret does not exist I0629 15:38:15.012718 1 controller.go:482] The operator is healthy I0629 15:40:15.015360 1 controller.go:482] The operator is healthy I0629 15:42:14.988122 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 15:42:15.012471 1 controller.go:482] The operator is healthy I0629 15:42:15.147851 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:42:15.152835 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:42:15.152858 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:42:15.157357 1 secretconfigobserver.go:119] support secret does not exist I0629 15:42:59.396490 1 insightsuploader.go:146] Nothing to report since 2026-06-29T14:23:44Z I0629 15:44:15.016506 1 controller.go:482] The operator is healthy I0629 15:46:15.016689 1 controller.go:482] The operator is healthy I0629 15:47:15.157467 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:47:15.162663 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:47:15.162679 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:47:15.166927 1 secretconfigobserver.go:119] support secret does not exist I0629 15:48:15.016549 1 controller.go:482] The operator is healthy I0629 15:50:15.015673 1 controller.go:482] The operator is healthy I0629 15:52:14.991890 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 15:52:15.012318 1 controller.go:482] The operator is healthy I0629 15:52:15.167558 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:52:15.172424 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:52:15.172441 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:52:15.176936 1 secretconfigobserver.go:119] support secret does not exist I0629 15:54:15.012884 1 controller.go:482] The operator is healthy I0629 15:56:15.016563 1 controller.go:482] The operator is healthy I0629 15:57:15.177514 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 15:57:15.183213 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 15:57:15.183234 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 15:57:15.187421 1 secretconfigobserver.go:119] support secret does not exist I0629 15:58:15.012412 1 controller.go:482] The operator is healthy I0629 15:59:33.524359 1 insightsuploader.go:146] Nothing to report since 2026-06-29T14:23:44Z I0629 16:00:15.013142 1 controller.go:482] The operator is healthy I0629 16:02:14.987377 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 16:02:14.992276 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 16:02:15.013219 1 controller.go:482] The operator is healthy I0629 16:02:15.187530 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 16:02:15.192474 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 16:02:15.192492 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 16:02:15.196472 1 secretconfigobserver.go:119] support secret does not exist I0629 16:04:15.012710 1 controller.go:482] The operator is healthy I0629 16:06:15.013358 1 controller.go:482] The operator is healthy I0629 16:07:15.196626 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 16:07:15.202429 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 16:07:15.202449 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 16:07:15.206708 1 secretconfigobserver.go:119] support secret does not exist I0629 16:08:15.013070 1 controller.go:482] The operator is healthy I0629 16:10:15.012593 1 controller.go:482] The operator is healthy I0629 16:12:14.987775 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 16:12:15.012491 1 controller.go:482] The operator is healthy I0629 16:12:15.207035 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0629 16:12:15.212167 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 16:12:15.212184 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0629 16:12:15.216573 1 secretconfigobserver.go:119] support secret does not exist I0629 16:14:15.014720 1 controller.go:482] The operator is healthy I0629 16:15:01.978909 1 insightsuploader.go:146] Nothing to report since 2026-06-29T14:23:44Z