W0809 18:30:21.469480 1 cmd.go:254] Using insecure, self-signed certificates I0809 18:30:21.850975 1 start.go:223] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0809 18:30:21.851250 1 observer_polling.go:159] Starting file observer W0809 18:30:21.875091 1 builder.go:266] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-6fd96f47fd" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0809 18:30:22.078653 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0809 18:30:22.078866 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0809 18:30:22.079248 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0809 18:30:22.079788 1 secure_serving.go:57] Forcing use of http/1.1 only W0809 18:30:22.079811 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0809 18:30:22.079819 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0809 18:30:22.079825 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0809 18:30:22.079832 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0809 18:30:22.079836 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0809 18:30:22.079840 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0809 18:30:22.083110 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes ChunkSizeMiB CloudDualStackNodeIPs DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy PersistentIPsForVirtualization PrivateHostedZoneAWS SetEIPForNLBIngressController VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy AWSClusterHostedDNS AdditionalRoutingCapabilities AutomatedEtcdBackup BootcNodeManagement CSIDriverSharedResource ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ConsolePluginContentSecurityPolicy DNSNameResolver DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example GCPClusterHostedDNS GatewayAPI ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MetricsCollectionProfiles MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NodeSwap NutanixMultiSubnets OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0809 18:30:22.083132 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ConsolePluginContentSecurityPolicy", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} E0809 18:30:22.086181 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18ca369677765ee3 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"SetEIPForNLBIngressController\", \"VSphereControlPlaneMachineSet\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"VSphereStaticIPs\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AdditionalRoutingCapabilities\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"CSIDriverSharedResource\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ConsolePluginContentSecurityPolicy\", \"DNSNameResolver\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"GCPClusterHostedDNS\", \"GatewayAPI\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MetricsCollectionProfiles\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OnClusterBuild\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SignatureStores\", \"SigstoreImageVerification\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-08-09 18:30:22.083063523 +0000 UTC m=+0.642491895,LastTimestamp:2026-08-09 18:30:22.083063523 +0000 UTC m=+0.642491895,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" I0809 18:30:22.086259 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0809 18:30:22.086271 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0809 18:30:22.086274 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0809 18:30:22.086281 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0809 18:30:22.086286 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0809 18:30:22.086290 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0809 18:30:22.086621 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/tmp/serving-cert-1838532088/tls.crt::/tmp/serving-cert-1838532088/tls.key" I0809 18:30:22.087347 1 secure_serving.go:213] Serving securely on [::]:8443 I0809 18:30:22.087377 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" W0809 18:30:22.088175 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0809 18:30:22.088208 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0809 18:30:22.088294 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0809 18:30:22.094105 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0809 18:30:22.094124 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0809 18:30:22.099089 1 secretconfigobserver.go:119] support secret does not exist I0809 18:30:22.103288 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0809 18:30:22.104241 1 recorder.go:156] Pruning old reports every 4h5m14s, max age is 288h0m0s I0809 18:30:22.107135 1 secretconfigobserver.go:119] support secret does not exist I0809 18:30:22.108930 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0809 18:30:22.108942 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0809 18:30:22.108948 1 insightsreport.go:296] Starting report retriever I0809 18:30:22.108949 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0809 18:30:22.108952 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0809 18:30:22.108932 1 periodic.go:214] Running clusterconfig gatherer I0809 18:30:22.108993 1 tasks_processing.go:45] number of workers: 64 I0809 18:30:22.109025 1 tasks_processing.go:69] worker 4 listening for tasks. I0809 18:30:22.109032 1 tasks_processing.go:69] worker 1 listening for tasks. I0809 18:30:22.109039 1 tasks_processing.go:69] worker 2 listening for tasks. I0809 18:30:22.109041 1 tasks_processing.go:69] worker 24 listening for tasks. I0809 18:30:22.109043 1 tasks_processing.go:69] worker 0 listening for tasks. I0809 18:30:22.109047 1 tasks_processing.go:69] worker 3 listening for tasks. I0809 18:30:22.109050 1 tasks_processing.go:69] worker 14 listening for tasks. I0809 18:30:22.109052 1 tasks_processing.go:71] worker 3 working on silenced_alerts task. I0809 18:30:22.109056 1 tasks_processing.go:69] worker 16 listening for tasks. I0809 18:30:22.109055 1 tasks_processing.go:69] worker 43 listening for tasks. I0809 18:30:22.109062 1 tasks_processing.go:69] worker 21 listening for tasks. I0809 18:30:22.109064 1 tasks_processing.go:69] worker 45 listening for tasks. I0809 18:30:22.109057 1 tasks_processing.go:69] worker 44 listening for tasks. I0809 18:30:22.109051 1 tasks_processing.go:69] worker 15 listening for tasks. I0809 18:30:22.109070 1 tasks_processing.go:69] worker 22 listening for tasks. I0809 18:30:22.109063 1 tasks_processing.go:69] worker 6 listening for tasks. I0809 18:30:22.109068 1 tasks_processing.go:69] worker 25 listening for tasks. I0809 18:30:22.109069 1 tasks_processing.go:69] worker 7 listening for tasks. I0809 18:30:22.109077 1 tasks_processing.go:69] worker 23 listening for tasks. I0809 18:30:22.109073 1 tasks_processing.go:69] worker 20 listening for tasks. I0809 18:30:22.109082 1 tasks_processing.go:69] worker 9 listening for tasks. I0809 18:30:22.109084 1 tasks_processing.go:69] worker 46 listening for tasks. I0809 18:30:22.109086 1 tasks_processing.go:69] worker 36 listening for tasks. I0809 18:30:22.109087 1 tasks_processing.go:69] worker 57 listening for tasks. I0809 18:30:22.109084 1 tasks_processing.go:69] worker 18 listening for tasks. I0809 18:30:22.109106 1 tasks_processing.go:69] worker 42 listening for tasks. I0809 18:30:22.109107 1 tasks_processing.go:71] worker 14 working on ingress task. I0809 18:30:22.109110 1 tasks_processing.go:69] worker 34 listening for tasks. I0809 18:30:22.109112 1 tasks_processing.go:69] worker 61 listening for tasks. I0809 18:30:22.109113 1 tasks_processing.go:69] worker 13 listening for tasks. I0809 18:30:22.109113 1 tasks_processing.go:69] worker 40 listening for tasks. I0809 18:30:22.109116 1 tasks_processing.go:71] worker 34 working on container_images task. I0809 18:30:22.109118 1 tasks_processing.go:69] worker 51 listening for tasks. I0809 18:30:22.109105 1 tasks_processing.go:69] worker 60 listening for tasks. I0809 18:30:22.109121 1 tasks_processing.go:69] worker 17 listening for tasks. I0809 18:30:22.109123 1 tasks_processing.go:69] worker 52 listening for tasks. I0809 18:30:22.109126 1 tasks_processing.go:71] worker 51 working on nodenetworkstates task. I0809 18:30:22.109077 1 tasks_processing.go:69] worker 27 listening for tasks. I0809 18:30:22.109129 1 tasks_processing.go:71] worker 4 working on operators_pods_and_events task. I0809 18:30:22.109130 1 tasks_processing.go:69] worker 55 listening for tasks. I0809 18:30:22.109133 1 tasks_processing.go:71] worker 27 working on storage_cluster task. I0809 18:30:22.109130 1 tasks_processing.go:69] worker 30 listening for tasks. I0809 18:30:22.109135 1 tasks_processing.go:71] worker 43 working on overlapping_namespace_uids task. I0809 18:30:22.109140 1 tasks_processing.go:71] worker 15 working on image_registries task. I0809 18:30:22.109141 1 tasks_processing.go:71] worker 22 working on monitoring_persistent_volumes task. I0809 18:30:22.109050 1 tasks_processing.go:71] worker 0 working on ingress_certificates task. I0809 18:30:22.109143 1 tasks_processing.go:71] worker 21 working on infrastructures task. I0809 18:30:22.109146 1 tasks_processing.go:71] worker 45 working on openstack_dataplanenodesets task. I0809 18:30:22.109171 1 tasks_processing.go:71] worker 1 working on storage_classes task. I0809 18:30:22.109176 1 tasks_processing.go:71] worker 13 working on openstack_controlplanes task. I0809 18:30:22.109114 1 tasks_processing.go:69] worker 53 listening for tasks. I0809 18:30:22.109072 1 tasks_processing.go:69] worker 26 listening for tasks. I0809 18:30:22.109201 1 tasks_processing.go:71] worker 40 working on pod_network_connectivity_checks task. I0809 18:30:22.109076 1 tasks_processing.go:69] worker 8 listening for tasks. I0809 18:30:22.109047 1 tasks_processing.go:69] worker 5 listening for tasks. W0809 18:30:22.109077 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0809 18:30:22.109217 1 gather.go:181] gatherer "clusterconfig" function "silenced_alerts" took 155.235µs to process 0 records I0809 18:30:22.109222 1 tasks_processing.go:71] worker 3 working on sap_pods task. I0809 18:30:22.109230 1 tasks_processing.go:71] worker 8 working on operators task. I0809 18:30:22.109236 1 tasks_processing.go:71] worker 53 working on feature_gates task. I0809 18:30:22.109251 1 tasks_processing.go:71] worker 20 working on networks task. I0809 18:30:22.109129 1 tasks_processing.go:71] worker 6 working on dvo_metrics task. I0809 18:30:22.109137 1 tasks_processing.go:71] worker 44 working on aggregated_monitoring_cr_names task. I0809 18:30:22.109173 1 tasks_processing.go:71] worker 61 working on certificate_signing_requests task. I0809 18:30:22.109132 1 tasks_processing.go:71] worker 52 working on support_secret task. I0809 18:30:22.109093 1 tasks_processing.go:69] worker 58 listening for tasks. I0809 18:30:22.109951 1 tasks_processing.go:71] worker 58 working on proxies task. I0809 18:30:22.109094 1 tasks_processing.go:69] worker 10 listening for tasks. I0809 18:30:22.109096 1 tasks_processing.go:69] worker 38 listening for tasks. I0809 18:30:22.109097 1 tasks_processing.go:69] worker 47 listening for tasks. I0809 18:30:22.109097 1 tasks_processing.go:69] worker 29 listening for tasks. I0809 18:30:22.109095 1 tasks_processing.go:69] worker 19 listening for tasks. I0809 18:30:22.109098 1 tasks_processing.go:69] worker 59 listening for tasks. I0809 18:30:22.109100 1 tasks_processing.go:69] worker 39 listening for tasks. I0809 18:30:22.109100 1 tasks_processing.go:69] worker 11 listening for tasks. I0809 18:30:22.109102 1 tasks_processing.go:69] worker 48 listening for tasks. I0809 18:30:22.109103 1 tasks_processing.go:69] worker 33 listening for tasks. I0809 18:30:22.109100 1 tasks_processing.go:71] worker 57 working on active_alerts task. W0809 18:30:22.110024 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0809 18:30:22.110062 1 tasks_processing.go:71] worker 57 working on pdbs task. I0809 18:30:22.110100 1 gather.go:181] gatherer "clusterconfig" function "active_alerts" took 35.101µs to process 0 records I0809 18:30:22.109105 1 tasks_processing.go:69] worker 41 listening for tasks. I0809 18:30:22.109105 1 tasks_processing.go:69] worker 12 listening for tasks. I0809 18:30:22.110184 1 tasks_processing.go:71] worker 11 working on config_maps task. I0809 18:30:22.110231 1 tasks_processing.go:71] worker 47 working on container_runtime_configs task. I0809 18:30:22.110263 1 tasks_processing.go:71] worker 29 working on service_accounts task. I0809 18:30:22.109110 1 tasks_processing.go:71] worker 18 working on mutating_webhook_configurations task. I0809 18:30:22.110239 1 tasks_processing.go:71] worker 48 working on crds task. I0809 18:30:22.109114 1 tasks_processing.go:71] worker 42 working on sap_datahubs task. I0809 18:30:22.109117 1 tasks_processing.go:69] worker 50 listening for tasks. I0809 18:30:22.110607 1 tasks_processing.go:71] worker 50 working on sap_config task. I0809 18:30:22.109117 1 tasks_processing.go:69] worker 32 listening for tasks. I0809 18:30:22.109124 1 tasks_processing.go:69] worker 54 listening for tasks. I0809 18:30:22.109124 1 tasks_processing.go:69] worker 63 listening for tasks. I0809 18:30:22.109127 1 tasks_processing.go:71] worker 60 working on machine_sets task. I0809 18:30:22.109129 1 tasks_processing.go:69] worker 31 listening for tasks. I0809 18:30:22.109133 1 tasks_processing.go:71] worker 16 working on machine_autoscalers task. I0809 18:30:22.109119 1 tasks_processing.go:69] worker 62 listening for tasks. I0809 18:30:22.110774 1 tasks_processing.go:71] worker 31 working on openstack_version task. I0809 18:30:22.110777 1 tasks_processing.go:71] worker 62 working on nodenetworkconfigurationpolicies task. I0809 18:30:22.109138 1 tasks_processing.go:69] worker 56 listening for tasks. I0809 18:30:22.109087 1 tasks_processing.go:69] worker 35 listening for tasks. I0809 18:30:22.109081 1 tasks_processing.go:69] worker 28 listening for tasks. I0809 18:30:22.109264 1 tasks_processing.go:71] worker 5 working on openstack_dataplanedeployments task. I0809 18:30:22.109260 1 tasks_processing.go:71] worker 26 working on lokistack task. I0809 18:30:22.110823 1 tasks_processing.go:71] worker 54 working on cluster_apiserver task. I0809 18:30:22.109271 1 tasks_processing.go:71] worker 7 working on machine_config_pools task. I0809 18:30:22.110945 1 tasks_processing.go:71] worker 56 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0809 18:30:22.110982 1 tasks_processing.go:71] worker 32 working on schedulers task. I0809 18:30:22.110945 1 tasks_processing.go:71] worker 63 working on ceph_cluster task. I0809 18:30:22.109270 1 tasks_processing.go:71] worker 55 working on clusterroles task. I0809 18:30:22.109276 1 tasks_processing.go:71] worker 30 working on machines task. I0809 18:30:22.109282 1 tasks_processing.go:71] worker 46 working on olm_operators task. I0809 18:30:22.109283 1 tasks_processing.go:71] worker 36 working on machine_configs task. I0809 18:30:22.109285 1 tasks_processing.go:71] worker 9 working on oauths task. I0809 18:30:22.109290 1 tasks_processing.go:71] worker 2 working on version task. I0809 18:30:22.109289 1 tasks_processing.go:71] worker 23 working on image_pruners task. I0809 18:30:22.109294 1 tasks_processing.go:71] worker 24 working on openshift_machine_api_events task. I0809 18:30:22.109093 1 tasks_processing.go:69] worker 37 listening for tasks. I0809 18:30:22.110172 1 tasks_processing.go:71] worker 38 working on machine_healthchecks task. I0809 18:30:22.111263 1 tasks_processing.go:74] worker 37 stopped. I0809 18:30:22.110176 1 tasks_processing.go:71] worker 41 working on nodes task. I0809 18:30:22.110180 1 tasks_processing.go:71] worker 10 working on jaegers task. I0809 18:30:22.110182 1 tasks_processing.go:71] worker 19 working on node_logs task. I0809 18:30:22.110188 1 tasks_processing.go:71] worker 59 working on cost_management_metrics_configs task. I0809 18:30:22.109108 1 tasks_processing.go:69] worker 49 listening for tasks. I0809 18:30:22.110256 1 tasks_processing.go:71] worker 12 working on validating_webhook_configurations task. I0809 18:30:22.110268 1 tasks_processing.go:71] worker 39 working on authentication task. I0809 18:30:22.110269 1 tasks_processing.go:71] worker 33 working on openshift_logging task. I0809 18:30:22.109137 1 tasks_processing.go:71] worker 17 working on image task. I0809 18:30:22.110891 1 tasks_processing.go:71] worker 28 working on tsdb_status task. W0809 18:30:22.111471 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0809 18:30:22.111476 1 tasks_processing.go:74] worker 28 stopped. I0809 18:30:22.110956 1 tasks_processing.go:71] worker 35 working on metrics task. W0809 18:30:22.111502 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0809 18:30:22.109275 1 tasks_processing.go:71] worker 25 working on install_plans task. I0809 18:30:22.111482 1 gather.go:181] gatherer "clusterconfig" function "tsdb_status" took 12.133µs to process 0 records I0809 18:30:22.111537 1 gather.go:181] gatherer "clusterconfig" function "metrics" took 21.811µs to process 0 records I0809 18:30:22.111543 1 tasks_processing.go:74] worker 35 stopped. I0809 18:30:22.112300 1 tasks_processing.go:74] worker 49 stopped. I0809 18:30:22.114638 1 tasks_processing.go:74] worker 45 stopped. I0809 18:30:22.114647 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 5.475201ms to process 0 records I0809 18:30:22.114659 1 gather.go:181] gatherer "clusterconfig" function "openstack_controlplanes" took 5.455883ms to process 0 records I0809 18:30:22.114664 1 tasks_processing.go:74] worker 13 stopped. I0809 18:30:22.122896 1 tasks_processing.go:74] worker 27 stopped. I0809 18:30:22.122910 1 gather.go:181] gatherer "clusterconfig" function "storage_cluster" took 13.75591ms to process 0 records E0809 18:30:22.122917 1 gather.go:144] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0809 18:30:22.122923 1 gather.go:181] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 13.703269ms to process 0 records I0809 18:30:22.122928 1 tasks_processing.go:74] worker 40 stopped. I0809 18:30:22.123003 1 tasks_processing.go:74] worker 47 stopped. I0809 18:30:22.123015 1 gather.go:181] gatherer "clusterconfig" function "container_runtime_configs" took 12.733529ms to process 0 records I0809 18:30:22.123042 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0809 18:30:22.123058 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0809 18:30:22.123059 1 tasks_processing.go:74] worker 58 stopped. I0809 18:30:22.123062 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0809 18:30:22.123065 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0809 18:30:22.123075 1 controller.go:457] The operator is still being initialized I0809 18:30:22.123079 1 controller.go:482] The operator is healthy I0809 18:30:22.123165 1 recorder.go:70] Recording config/proxy with fingerprint=56a685f77d3dc15f258bbde259ba82fdadaf9bc99f3c313fbca4cec34d3bf6af I0809 18:30:22.123176 1 gather.go:181] gatherer "clusterconfig" function "proxies" took 13.096618ms to process 1 records I0809 18:30:22.123183 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkstates" took 13.9795ms to process 0 records I0809 18:30:22.123186 1 gather.go:181] gatherer "clusterconfig" function "cost_management_metrics_configs" took 11.70754ms to process 0 records I0809 18:30:22.123190 1 gather.go:181] gatherer "clusterconfig" function "openshift_logging" took 11.671569ms to process 0 records E0809 18:30:22.123194 1 gather.go:144] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0809 18:30:22.123199 1 tasks_processing.go:74] worker 51 stopped. I0809 18:30:22.123201 1 tasks_processing.go:74] worker 59 stopped. I0809 18:30:22.123200 1 gather.go:181] gatherer "clusterconfig" function "support_secret" took 13.334844ms to process 0 records I0809 18:30:22.123204 1 tasks_processing.go:74] worker 52 stopped. I0809 18:30:22.123210 1 tasks_processing.go:74] worker 33 stopped. I0809 18:30:22.123348 1 tasks_processing.go:74] worker 14 stopped. I0809 18:30:22.123518 1 recorder.go:70] Recording config/ingress with fingerprint=5c812978a051990ff770bad78cb8161228d9e25d2f8874802b377422319ac97c I0809 18:30:22.123546 1 gather.go:181] gatherer "clusterconfig" function "ingress" took 14.233077ms to process 1 records I0809 18:30:22.123629 1 tasks_processing.go:74] worker 20 stopped. I0809 18:30:22.123670 1 recorder.go:70] Recording config/network with fingerprint=4f694e5332ef35fd22953de01332504d159e6b12778527619437b9eed69d96b1 I0809 18:30:22.123678 1 gather.go:181] gatherer "clusterconfig" function "networks" took 14.102199ms to process 1 records I0809 18:30:22.123757 1 tasks_processing.go:74] worker 53 stopped. I0809 18:30:22.123760 1 recorder.go:70] Recording config/featuregate with fingerprint=1bb701d77248a2f6c2a0eece08a18529d32308bbfc6ff53e98fffcb645e1ef47 I0809 18:30:22.123780 1 gather.go:181] gatherer "clusterconfig" function "feature_gates" took 14.30277ms to process 1 records I0809 18:30:22.123796 1 gather.go:181] gatherer "clusterconfig" function "sap_pods" took 14.388803ms to process 0 records I0809 18:30:22.123862 1 tasks_processing.go:74] worker 3 stopped. I0809 18:30:22.123928 1 tasks_processing.go:74] worker 15 stopped. I0809 18:30:22.124308 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=ca8e6c1d2ab545a1028917f3bfb82e80075f9ad419611291855085f6d360f1ac I0809 18:30:22.124320 1 gather.go:181] gatherer "clusterconfig" function "image_registries" took 14.613766ms to process 1 records I0809 18:30:22.129860 1 tasks_processing.go:74] worker 1 stopped. I0809 18:30:22.129943 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=14cae35ffe6f3ae79a2ea534b99107e6cc99026e9237a6a974cf3ba8505effbc I0809 18:30:22.129960 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=f9aef5fc6549120a85848bfcf6c6bd556ebee6ecc83a22ba5927d6a501dd4427 I0809 18:30:22.129971 1 gather.go:181] gatherer "clusterconfig" function "storage_classes" took 20.673065ms to process 2 records I0809 18:30:22.140127 1 tasks_processing.go:74] worker 30 stopped. E0809 18:30:22.140148 1 gather.go:144] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0809 18:30:22.140156 1 gather.go:181] gatherer "clusterconfig" function "machines" took 29.035407ms to process 0 records I0809 18:30:22.140605 1 tasks_processing.go:74] worker 21 stopped. I0809 18:30:22.140985 1 recorder.go:70] Recording config/infrastructure with fingerprint=bbd43fccdc630043ddf44f9efb960692c73abfe264f1eef774eb8d8e13a50c08 I0809 18:30:22.140998 1 gather.go:181] gatherer "clusterconfig" function "infrastructures" took 31.449697ms to process 1 records I0809 18:30:22.145644 1 tasks_processing.go:74] worker 60 stopped. I0809 18:30:22.145657 1 gather.go:181] gatherer "clusterconfig" function "machine_sets" took 35.013169ms to process 0 records I0809 18:30:22.145669 1 tasks_processing.go:74] worker 19 stopped. I0809 18:30:22.145680 1 gather.go:181] gatherer "clusterconfig" function "node_logs" took 34.34813ms to process 0 records I0809 18:30:22.145687 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 34.883086ms to process 0 records I0809 18:30:22.145694 1 gather.go:181] gatherer "clusterconfig" function "machine_config_pools" took 34.753652ms to process 0 records I0809 18:30:22.145700 1 gather.go:181] gatherer "clusterconfig" function "sap_datahubs" took 35.200592ms to process 0 records I0809 18:30:22.145705 1 gather.go:181] gatherer "clusterconfig" function "lokistack" took 34.868314ms to process 0 records I0809 18:30:22.145709 1 gather.go:181] gatherer "clusterconfig" function "machine_autoscalers" took 35.050416ms to process 0 records I0809 18:30:22.145714 1 gather.go:181] gatherer "clusterconfig" function "ceph_cluster" took 34.704545ms to process 0 records I0809 18:30:22.145719 1 gather.go:181] gatherer "clusterconfig" function "openstack_version" took 34.927787ms to process 0 records I0809 18:30:22.145720 1 tasks_processing.go:74] worker 62 stopped. I0809 18:30:22.145721 1 tasks_processing.go:74] worker 42 stopped. I0809 18:30:22.145727 1 tasks_processing.go:74] worker 5 stopped. I0809 18:30:22.145723 1 tasks_processing.go:74] worker 16 stopped. I0809 18:30:22.145721 1 tasks_processing.go:74] worker 7 stopped. I0809 18:30:22.145722 1 tasks_processing.go:74] worker 63 stopped. I0809 18:30:22.145735 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 34.92507ms to process 0 records I0809 18:30:22.145724 1 tasks_processing.go:74] worker 31 stopped. I0809 18:30:22.145726 1 tasks_processing.go:74] worker 26 stopped. I0809 18:30:22.145766 1 tasks_processing.go:74] worker 38 stopped. E0809 18:30:22.145776 1 gather.go:144] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0809 18:30:22.145784 1 gather.go:181] gatherer "clusterconfig" function "machine_healthchecks" took 34.503193ms to process 0 records I0809 18:30:22.145850 1 recorder.go:70] Recording config/image with fingerprint=baf1518a6e307995ddb682288affaaa32a7b608e5e09093a0405df6613f5a7a6 I0809 18:30:22.145853 1 tasks_processing.go:74] worker 17 stopped. I0809 18:30:22.145866 1 gather.go:181] gatherer "clusterconfig" function "image" took 34.316686ms to process 1 records I0809 18:30:22.145921 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=cb5aca1520e0a33560c8987e0b9b94ee8f52eb695b54ec5953e46036738e457c I0809 18:30:22.145935 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=50271fc688de6a1efa7e22bc1ab2cc97b97e23b2c9ca9b93a6f97dfcdda733b7 I0809 18:30:22.145939 1 tasks_processing.go:74] worker 57 stopped. I0809 18:30:22.145945 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=ffff21ecfbd76b807a33ad74d54dfc371c7ea9b7956fdc7390446d08fd82647c I0809 18:30:22.145950 1 gather.go:181] gatherer "clusterconfig" function "pdbs" took 35.78074ms to process 3 records I0809 18:30:22.145978 1 tasks_processing.go:74] worker 54 stopped. I0809 18:30:22.146440 1 recorder.go:70] Recording config/apiserver with fingerprint=85dc76d45569b4ae54bbf3d1538e50ee2fa4e6ebcf1c5e542e94e0e649c8856e I0809 18:30:22.146459 1 gather.go:181] gatherer "clusterconfig" function "cluster_apiserver" took 35.143458ms to process 1 records I0809 18:30:22.147652 1 tasks_processing.go:74] worker 41 stopped. I0809 18:30:22.147899 1 recorder.go:70] Recording config/node/ip-10-0-134-201.ec2.internal with fingerprint=40374fadcafc05f22de8b5358d7a2d8ab9955bd33cb8eab0cd0775d122864f9b I0809 18:30:22.147952 1 recorder.go:70] Recording config/node/ip-10-0-149-245.ec2.internal with fingerprint=2bf0d85ce488a65d4a16160f713052229d90fbe60582e4b8713fdebf49808305 I0809 18:30:22.147996 1 recorder.go:70] Recording config/node/ip-10-0-164-62.ec2.internal with fingerprint=625f85f14ef59473f38b858b9d3e373b6b46e51a4953a457ff1da9e99d9de63d I0809 18:30:22.148007 1 gather.go:181] gatherer "clusterconfig" function "nodes" took 36.373175ms to process 3 records I0809 18:30:22.148090 1 tasks_processing.go:74] worker 39 stopped. I0809 18:30:22.148164 1 recorder.go:70] Recording config/authentication with fingerprint=1c4d2f334e191bde3d9f2339c8030ff5c843f68711b45f7ef23525a528119607 I0809 18:30:22.148176 1 gather.go:181] gatherer "clusterconfig" function "authentication" took 36.366379ms to process 1 records I0809 18:30:22.148192 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0809 18:30:22.148202 1 gather.go:181] gatherer "clusterconfig" function "overlapping_namespace_uids" took 38.778277ms to process 1 records I0809 18:30:22.148208 1 tasks_processing.go:74] worker 43 stopped. I0809 18:30:22.148394 1 tasks_processing.go:74] worker 10 stopped. I0809 18:30:22.148410 1 gather.go:181] gatherer "clusterconfig" function "jaegers" took 37.09045ms to process 0 records I0809 18:30:22.148486 1 tasks_processing.go:74] worker 2 stopped. I0809 18:30:22.148774 1 recorder.go:70] Recording config/version with fingerprint=74925cdd289243ec90ada5f2d4fcae0f9d33f3e33234221d3e9730471762e0f6 I0809 18:30:22.148788 1 recorder.go:70] Recording config/id with fingerprint=bb5a95445ece116b6ef6072b93b604f6c976118b99db1c530c9e4edee961bddf I0809 18:30:22.148793 1 gather.go:181] gatherer "clusterconfig" function "version" took 37.236336ms to process 2 records I0809 18:30:22.148801 1 gather.go:181] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 39.454348ms to process 0 records I0809 18:30:22.148806 1 gather.go:181] gatherer "clusterconfig" function "sap_config" took 38.011751ms to process 0 records I0809 18:30:22.148812 1 gather.go:181] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 39.306422ms to process 0 records I0809 18:30:22.148834 1 tasks_processing.go:74] worker 50 stopped. I0809 18:30:22.148835 1 tasks_processing.go:74] worker 44 stopped. I0809 18:30:22.148843 1 tasks_processing.go:74] worker 22 stopped. I0809 18:30:22.148869 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=c06f1d45002437231a04f595fdd6873bd1140fe2c205774b5e3c86a81e73f6f0 I0809 18:30:22.148880 1 gather.go:181] gatherer "clusterconfig" function "schedulers" took 37.770063ms to process 1 records I0809 18:30:22.148885 1 gather.go:181] gatherer "clusterconfig" function "olm_operators" took 37.716168ms to process 0 records I0809 18:30:22.148889 1 tasks_processing.go:74] worker 46 stopped. I0809 18:30:22.148892 1 tasks_processing.go:74] worker 32 stopped. I0809 18:30:22.151143 1 tasks_processing.go:74] worker 18 stopped. I0809 18:30:22.151308 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=7422f9dbcee67ed5c2a02a01fbc997aef75a1db69ca2ee98595bdf40a7f251a7 I0809 18:30:22.151341 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=aec3f448b5bf41faec9ab200f49a2323ad8f18778c5c69756ca9f2803ff01d31 I0809 18:30:22.151366 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=f87a492a802474f52428061b235afe1bd6620d55ba7f38cc36881fef17692373 I0809 18:30:22.151377 1 gather.go:181] gatherer "clusterconfig" function "mutating_webhook_configurations" took 40.784297ms to process 3 records W0809 18:30:22.151931 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0809 18:30:22.152684 1 tasks_processing.go:74] worker 61 stopped. I0809 18:30:22.152694 1 gather.go:181] gatherer "clusterconfig" function "certificate_signing_requests" took 43.226474ms to process 0 records I0809 18:30:22.154915 1 tasks_processing.go:74] worker 23 stopped. I0809 18:30:22.154980 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=9c24dd89af9656b344dd8ef1a41b0f08644360bba56e4b4c736e11fcc8541a68 I0809 18:30:22.154990 1 gather.go:181] gatherer "clusterconfig" function "image_pruners" took 43.738363ms to process 1 records I0809 18:30:22.155808 1 tasks_processing.go:74] worker 36 stopped. E0809 18:30:22.155818 1 gather.go:144] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0809 18:30:22.155836 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0809 18:30:22.155843 1 gather.go:181] gatherer "clusterconfig" function "machine_configs" took 44.656023ms to process 1 records I0809 18:30:22.155847 1 gather.go:181] gatherer "clusterconfig" function "openshift_machine_api_events" took 44.641114ms to process 0 records I0809 18:30:22.155851 1 tasks_processing.go:74] worker 24 stopped. I0809 18:30:22.156813 1 tasks_processing.go:74] worker 9 stopped. I0809 18:30:22.157512 1 recorder.go:70] Recording config/oauth with fingerprint=9bb80e04f175d238bd4586bfe10af2434894f3c4ef8476c743cf6fecc0e6458a I0809 18:30:22.157551 1 gather.go:181] gatherer "clusterconfig" function "oauths" took 45.645003ms to process 1 records I0809 18:30:22.157698 1 tasks_processing.go:74] worker 12 stopped. I0809 18:30:22.157792 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=394c52474ab5321fb89ad275d6d612b14a2a8ded8063163f42cdbf6ea067eaf1 I0809 18:30:22.157839 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=db3d20935ba8d36e2234949b11d40e1b172a3aa84238bba63a0b8899cff41b05 I0809 18:30:22.157857 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=56a8c4320c2986072401d33564061e841089456323c45928ee4c136fbf1b8014 I0809 18:30:22.157878 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=323e28e89cd867fd92507817cf034e57faca6ebca53d7078b8a6dbe0377a16b4 I0809 18:30:22.157893 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=ba70494c42b547979741c35ceb3558ab77b920e7bd7829bb802c72e130c8f8ea I0809 18:30:22.157904 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=262544d66f001ac62f87f5adf69bc319ffc59f9aa22ebd55ea66fcbcd397085d I0809 18:30:22.157917 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=cbad7495b422a587545b9d29235a21c844286775904d3f42981ee6eda35ddbae I0809 18:30:22.157933 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=1e08a9e09bbc9a3f6b95bd0a3e450f7d4ff5b2e03cc2a24c5b0ef9f2389c4409 I0809 18:30:22.157947 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=61d4c872b0c62363a5bc151d1b2371fb5318e41b347369899239e930b3712f1a I0809 18:30:22.157958 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=a78230a5a5a3d6106ea2a6dbc9e38ef620965ce74b809c64eddc4e8d57696a94 I0809 18:30:22.157973 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=05ff890548cb6c7a08bb1d08916bbe5c7710a7c5b8a87dde290e8bfad0126c64 I0809 18:30:22.157980 1 gather.go:181] gatherer "clusterconfig" function "validating_webhook_configurations" took 46.28082ms to process 11 records I0809 18:30:22.160657 1 tasks_processing.go:74] worker 48 stopped. I0809 18:30:22.161239 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=5de022721dd43fc79593da0478c6e61e249d9442f897c1e47dd43580a52f8fe6 I0809 18:30:22.161462 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=9545f977df04cfa6c2682bdbb281c71e2831b64a1ad8386790c33639e383c504 I0809 18:30:22.161474 1 gather.go:181] gatherer "clusterconfig" function "crds" took 50.19579ms to process 2 records I0809 18:30:22.169164 1 tasks_processing.go:74] worker 55 stopped. I0809 18:30:22.169180 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s I0809 18:30:22.169219 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0809 18:30:22.169313 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=123646851937cbaa3ba7a5a3c2ea543372cd3a40c913830f59fddda68bbfe028 I0809 18:30:22.169372 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=0b5c14b716b245ef07cdbad52c5df8ba807184096826589144ebf887d759594c I0809 18:30:22.169382 1 gather.go:181] gatherer "clusterconfig" function "clusterroles" took 58.121628ms to process 2 records W0809 18:30:22.169392 1 operator.go:288] started I0809 18:30:22.169404 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0809 18:30:22.172884 1 tasks_processing.go:74] worker 34 stopped. I0809 18:30:22.173972 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-2rcxg with fingerprint=4d33e2095dfcc7b2e5c01dbc0ac846174b1fb21fdfcd7749499212709b9f46d6 I0809 18:30:22.174083 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-4dr7c with fingerprint=dfdf14f2f1f211eea6bc9a9dc13834a8d93d8f6917f1df0dc54088bb39fe4059 I0809 18:30:22.174185 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-d8fz4 with fingerprint=8aedb60f82c36778131fd4f216ec4829205d220f2f40e4989ca96d3c29af6ac8 I0809 18:30:22.174220 1 recorder.go:70] Recording config/running_containers with fingerprint=69c170df11a055594f47d9364fbe246cf68ea1de857579e7e0b48707dd700ac7 I0809 18:30:22.174228 1 gather.go:181] gatherer "clusterconfig" function "container_images" took 63.754368ms to process 4 records I0809 18:30:22.182880 1 tasks_processing.go:74] worker 56 stopped. I0809 18:30:22.182890 1 gather.go:181] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 71.900874ms to process 0 records I0809 18:30:22.186774 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0809 18:30:22.186787 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0809 18:30:22.186801 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0809 18:30:22.189104 1 base_controller.go:73] Caches are synced for ConfigController I0809 18:30:22.189112 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0809 18:30:22.199433 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0809 18:30:22.199443 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0809 18:30:22.199448 1 controller.go:203] Source scaController *sca.Controller is not ready I0809 18:30:22.199451 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0809 18:30:22.199454 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0809 18:30:22.199467 1 controller.go:457] The operator is still being initialized I0809 18:30:22.199471 1 controller.go:482] The operator is healthy E0809 18:30:22.201953 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%!f(MISSING)1cd8cfe-2309-4264-9b66-9daa7cc217df%!+(MISSING)and+status+is+%!a(MISSING)ccepted%!"(MISSING): dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.8:43888->172.30.0.10:53: read: connection refused I0809 18:30:22.201964 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27f1cd8cfe-2309-4264-9b66-9daa7cc217df%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.8:43888->172.30.0.10:53: read: connection refused I0809 18:30:22.206252 1 prometheus_rules.go:88] Prometheus rules successfully created I0809 18:30:22.209730 1 requests.go:204] Asking for SCA certificate for x86_64 architecture W0809 18:30:22.212192 1 sca.go:117] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.8:54083->172.30.0.10:53: read: connection refused I0809 18:30:22.212203 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.8:54083->172.30.0.10:53: read: connection refused I0809 18:30:22.216966 1 configmapobserver.go:84] configmaps "insights-config" not found I0809 18:30:22.232871 1 tasks_processing.go:74] worker 11 stopped. E0809 18:30:22.232884 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0809 18:30:22.232889 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0809 18:30:22.232892 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0809 18:30:22.232922 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0809 18:30:22.232932 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=e1a0ad594db3a5d5d50e9e25d7b235af20f84f5def41537f127febe525b834f2 I0809 18:30:22.232937 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0809 18:30:22.232941 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0809 18:30:22.232960 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0809 18:30:22.232968 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0809 18:30:22.232974 1 gather.go:181] gatherer "clusterconfig" function "config_maps" took 122.650376ms to process 6 records I0809 18:30:22.255909 1 tasks_processing.go:74] worker 0 stopped. E0809 18:30:22.255921 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0809 18:30:22.255929 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2s377sgmmrr06kf5oqu797sl8578ho0n-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2s377sgmmrr06kf5oqu797sl8578ho0n-primary-cert-bundle-secret" not found I0809 18:30:22.255976 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=07fee5b86993e85d45ccb57492fe0aa6b6957ac5a4f6ff2c57814acb23947719 I0809 18:30:22.255992 1 gather.go:181] gatherer "clusterconfig" function "ingress_certificates" took 146.756227ms to process 1 records I0809 18:30:22.269568 1 base_controller.go:73] Caches are synced for LoggingSyncer I0809 18:30:22.269578 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0809 18:30:22.375657 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0809 18:30:22.556441 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0809 18:30:22.556455 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0809 18:30:22.556607 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-6vrqx pod in namespace openshift-dns (previous: false). I0809 18:30:22.575639 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0809 18:30:22.779006 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-6vrqx pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-6vrqx\" is waiting to start: ContainerCreating" I0809 18:30:22.779026 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-6vrqx\" is waiting to start: ContainerCreating" I0809 18:30:22.779033 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-6vrqx pod in namespace openshift-dns (previous: false). I0809 18:30:22.959579 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-6vrqx pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-6vrqx\" is waiting to start: ContainerCreating" I0809 18:30:22.959597 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-6vrqx\" is waiting to start: ContainerCreating" I0809 18:30:22.959627 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-f7qtp pod in namespace openshift-dns (previous: false). W0809 18:30:23.152053 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0809 18:30:23.202470 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-f7qtp pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-f7qtp\" is waiting to start: ContainerCreating" I0809 18:30:23.202488 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-f7qtp\" is waiting to start: ContainerCreating" I0809 18:30:23.202495 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-f7qtp pod in namespace openshift-dns (previous: false). I0809 18:30:23.362733 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-f7qtp pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-f7qtp\" is waiting to start: ContainerCreating" I0809 18:30:23.362753 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-f7qtp\" is waiting to start: ContainerCreating" I0809 18:30:23.362780 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-tnctd pod in namespace openshift-dns (previous: false). I0809 18:30:23.379774 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0809 18:30:23.582131 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-tnctd pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-tnctd\" is waiting to start: ContainerCreating" I0809 18:30:23.582147 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-tnctd\" is waiting to start: ContainerCreating" I0809 18:30:23.582154 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-tnctd pod in namespace openshift-dns (previous: false). I0809 18:30:23.759769 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-tnctd pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-tnctd\" is waiting to start: ContainerCreating" I0809 18:30:23.759782 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-tnctd\" is waiting to start: ContainerCreating" I0809 18:30:23.759791 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-cwdxh pod in namespace openshift-dns (previous: false). I0809 18:30:23.778855 1 tasks_processing.go:74] worker 8 stopped. I0809 18:30:23.778896 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=623fecdcd4b5ec645e57a8b4cf311068b37b6bc98c1f7ac7fbecf6d447c7e077 I0809 18:30:23.778925 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=1680a841044609a0d812e5f2080da51125837f7681b1d6ba51431f7f9c662f9d I0809 18:30:23.778956 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0809 18:30:23.778979 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=aac4aeb190a3cfdb420c1e548ce29b1da8f23a8c8fb4822e14df9d71d9872835 I0809 18:30:23.778996 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0809 18:30:23.779011 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=7cba6e2dbaab6d76808446de566144353c0df45d65fad2d2a219c1e26084fb27 I0809 18:30:23.779032 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=054580febb2b55a65eb1987e15b84e3b37bc0ae0af329cd26e2c60975f76bbe7 I0809 18:30:23.779053 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=24e724a059b6cede612c99bcdea8fe239d57608ce213632754d1f8ef467fea2b I0809 18:30:23.779063 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=a75e770ae79cc7e10e984945aad6a2cd85bf6f96f40cd49cd994385db90e2554 I0809 18:30:23.779078 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=4efe31092f9a02eef5cdc51c171f1b20b9d2b7908e585ae90116a0af3338f534 I0809 18:30:23.779087 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0809 18:30:23.779097 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=49b2e415558eddd95045e35bc393e1a05df017cd0dbc5e6e5ee23bdf0c494809 I0809 18:30:23.779107 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0809 18:30:23.779117 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=59dad4c9dca73fdc81e431dc12be927b6bb26cdfd446aecc26494d93ef4c51dc I0809 18:30:23.779126 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0809 18:30:23.779134 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=2e216fd0f14fe8cc02a6cac8be7d5409995000a06bcb81e3d4c43a7102c2d714 I0809 18:30:23.779142 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0809 18:30:23.779151 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=0175d04972d2e3211074b4db140043d2cf0a6ff5703da576e92adad25fd56123 I0809 18:30:23.779217 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=7aef874c6970d0eae2251e9320de718a7d4a5b3bae212c22996902e3db98aebd I0809 18:30:23.779236 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0809 18:30:23.779250 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=43e750c00d881e3f6014dded67b3fd953f07895fca44e8c3e9025318d303f514 I0809 18:30:23.779266 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=707bf7697a894425b603ed7178c51a2190767e259652453dd3a4db88e4331ebc I0809 18:30:23.779273 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0809 18:30:23.779284 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=bc9ef16593dd8cda20fbec4ad06863dd5d1fd205825decd115f27e5ab3f4c302 I0809 18:30:23.779291 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0809 18:30:23.779300 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=4f0f6addffe80fb679b1fb3d6a9772d8ebb6f6e0eca663a515f25a376d9af1f7 I0809 18:30:23.779310 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=327e5f1eef4ed3928987b0b2d2e3788c90a4f34d5977a44148f9e30c86fbfff9 I0809 18:30:23.779318 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=e27872de5c944ce205f8884bddb9bb5abc6da60767da7cbbd1788bfbf84df876 I0809 18:30:23.779328 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=f510e901aad33e502cc17d4201932147452d1684019cc779e979a853babea173 I0809 18:30:23.779336 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=771b9349ce612f84b2d667bf639e386ff539a01268b4a4a37109a97c3e6964a7 I0809 18:30:23.779353 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=8e5e948f724caa9cbfb19cf530188b4b00faa2c30927e35cf1af248047d6d0d4 I0809 18:30:23.779366 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0809 18:30:23.779373 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0809 18:30:23.779378 1 gather.go:181] gatherer "clusterconfig" function "operators" took 1.669613296s to process 33 records I0809 18:30:23.960894 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0809 18:30:23.960908 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-j6kbn pod in namespace openshift-dns (previous: false). W0809 18:30:24.151960 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0809 18:30:24.158558 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0809 18:30:24.158570 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-lxmpv pod in namespace openshift-dns (previous: false). I0809 18:30:24.360300 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0809 18:30:24.360369 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6d9c9695f7-m2dlp pod in namespace openshift-image-registry (previous: false). I0809 18:30:24.559230 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6d9c9695f7-m2dlp pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6d9c9695f7-m2dlp\" is waiting to start: ContainerCreating" I0809 18:30:24.559247 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6d9c9695f7-m2dlp\" is waiting to start: ContainerCreating" I0809 18:30:24.559279 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7d469fc598-9rmrn pod in namespace openshift-image-registry (previous: false). I0809 18:30:24.760434 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7d469fc598-9rmrn pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7d469fc598-9rmrn\" is waiting to start: ContainerCreating" I0809 18:30:24.760453 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7d469fc598-9rmrn\" is waiting to start: ContainerCreating" I0809 18:30:24.760482 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7d469fc598-j8sg8 pod in namespace openshift-image-registry (previous: false). I0809 18:30:24.962872 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7d469fc598-j8sg8 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7d469fc598-j8sg8\" is waiting to start: ContainerCreating" I0809 18:30:24.962887 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7d469fc598-j8sg8\" is waiting to start: ContainerCreating" I0809 18:30:24.962895 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-nbnvw pod in namespace openshift-image-registry (previous: false). W0809 18:30:25.152129 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0809 18:30:25.161182 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0809 18:30:25.161195 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-sfm75 pod in namespace openshift-image-registry (previous: false). I0809 18:30:25.360590 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0809 18:30:25.360603 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-xrd9b pod in namespace openshift-image-registry (previous: false). I0809 18:30:25.559395 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0809 18:30:25.559407 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-68dc5f799-blsr2 pod in namespace openshift-ingress (previous: false). I0809 18:30:25.759004 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-68dc5f799-blsr2 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-68dc5f799-blsr2\" is waiting to start: ContainerCreating" I0809 18:30:25.759025 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-68dc5f799-blsr2\" is waiting to start: ContainerCreating" I0809 18:30:25.759033 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-68dc5f799-mq568 pod in namespace openshift-ingress (previous: false). I0809 18:30:25.959628 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-68dc5f799-mq568 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-68dc5f799-mq568\" is waiting to start: ContainerCreating" I0809 18:30:25.959640 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-68dc5f799-mq568\" is waiting to start: ContainerCreating" I0809 18:30:25.959653 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-86c8795fc5-mcprh pod in namespace openshift-ingress (previous: false). W0809 18:30:26.151748 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0809 18:30:26.158452 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-86c8795fc5-mcprh pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-86c8795fc5-mcprh\" is waiting to start: ContainerCreating" I0809 18:30:26.158464 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-86c8795fc5-mcprh\" is waiting to start: ContainerCreating" I0809 18:30:26.158492 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-2x7jg pod in namespace openshift-ingress-canary (previous: false). I0809 18:30:26.359903 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-2x7jg pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-2x7jg\" is waiting to start: ContainerCreating" I0809 18:30:26.359919 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-2x7jg\" is waiting to start: ContainerCreating" I0809 18:30:26.359946 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-l8btd pod in namespace openshift-ingress-canary (previous: false). I0809 18:30:26.567105 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-l8btd pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-l8btd\" is waiting to start: ContainerCreating" I0809 18:30:26.567121 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-l8btd\" is waiting to start: ContainerCreating" I0809 18:30:26.567145 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-qfw6s pod in namespace openshift-ingress-canary (previous: false). I0809 18:30:26.760671 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-qfw6s pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-qfw6s\" is waiting to start: ContainerCreating" I0809 18:30:26.760686 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-qfw6s\" is waiting to start: ContainerCreating" I0809 18:30:26.760700 1 tasks_processing.go:74] worker 4 stopped. I0809 18:30:26.760766 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=346a4482c7aa26fa064337741d5f19c6b526e30436ca5e1ac6194029f1302047 I0809 18:30:26.760799 1 recorder.go:70] Recording events/openshift-dns with fingerprint=ec8eae30c1d0e14c633af2c81c08e2a3219127dbf07a4e3a2e0b33142dd1200a I0809 18:30:26.760848 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=6dbe4f7675c7012c9a460d324b6da7e0e0f2b67d886e907f2902fc833b6ff435 I0809 18:30:26.760864 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=a679795260c7d0f079850d6049f6f246e92c0cee2eef893e8c291616ba2aae87 I0809 18:30:26.760891 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=e72e7842d01fe1936de3723bd1cbf53aeca8b39ca9ea1cbf44e6bfe5c13ca171 I0809 18:30:26.760903 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=8a17d8c6d85fadecbfb349f3d49c14fafb2efcb4cd30ae06aa1850b10615fa16 I0809 18:30:26.760993 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-6vrqx with fingerprint=ca7d7014ae355165b6d5a4e66ebd3f251721ea6575ed04945be2397ed817d738 I0809 18:30:26.761044 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-f7qtp with fingerprint=c44a3ad2617840f48a930ac85971ed8fb077bf9721821e40de56bc7026b1bf55 I0809 18:30:26.761084 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-tnctd with fingerprint=e3768fb9644b621a4158dc63c419d0380039e45284e0bab01e8c10063c51476b I0809 18:30:26.761150 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-6d9c9695f7-m2dlp with fingerprint=9f06ab6e19324507b35510a9ba9eebc60157a0a702b487eabe33b0578f3d5f25 I0809 18:30:26.761205 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-7d469fc598-9rmrn with fingerprint=cacf77bd3e94135146d26daecf0220531d3528759772f0000c4d8bab389b5dcf I0809 18:30:26.761253 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-7d469fc598-j8sg8 with fingerprint=3bbf1805189130301dc736bf0a5c13a42e53fd86700eccdb8d471354641f8411 I0809 18:30:26.761290 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-2x7jg with fingerprint=734ffe7cc6dd4515e002e99fd96fc8e848b974db5145716ba9c020be98bf8c67 I0809 18:30:26.761321 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-l8btd with fingerprint=f8c2032d1ae9d2b987bd05db13e001b4a72b47a73d19a286db37ee5e616eb9f1 I0809 18:30:26.761352 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-qfw6s with fingerprint=a3f996953530a4a0925a3aa2abeb2289f2a25cb4dfc12bae23ed6d680c53a829 I0809 18:30:26.761360 1 gather.go:181] gatherer "clusterconfig" function "operators_pods_and_events" took 4.651560748s to process 15 records W0809 18:30:27.151616 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0809 18:30:27.151638 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0809 18:30:27.151652 1 tasks_processing.go:74] worker 6 stopped. E0809 18:30:27.151660 1 gather.go:144] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0809 18:30:27.151668 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0809 18:30:27.151680 1 gather.go:159] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0809 18:30:27.151690 1 gather.go:181] gatherer "clusterconfig" function "dvo_metrics" took 5.042247504s to process 1 records I0809 18:30:34.751878 1 tasks_processing.go:74] worker 25 stopped. I0809 18:30:34.751910 1 recorder.go:70] Recording config/installplans with fingerprint=6f9781df213f917044fe07f29e6836f4c98c6ccf7740910e145b68b90ff5234d I0809 18:30:34.751920 1 gather.go:181] gatherer "clusterconfig" function "install_plans" took 12.640355289s to process 1 records I0809 18:30:35.517328 1 tasks_processing.go:74] worker 29 stopped. I0809 18:30:35.517548 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=765abbbb8353a910402ad1771e2ae09bfdf14a9dd166bdb2594893eccc550da6 I0809 18:30:35.517562 1 gather.go:181] gatherer "clusterconfig" function "service_accounts" took 13.407028369s to process 1 records E0809 18:30:35.517607 1 periodic.go:252] clusterconfig failed after 13.408s with: function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0809 18:30:35.517620 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0809 18:30:35.517626 1 periodic.go:214] Running workloads gatherer I0809 18:30:35.517637 1 tasks_processing.go:45] number of workers: 2 I0809 18:30:35.517645 1 tasks_processing.go:69] worker 1 listening for tasks. I0809 18:30:35.517648 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I0809 18:30:35.517712 1 tasks_processing.go:69] worker 0 listening for tasks. I0809 18:30:35.517790 1 tasks_processing.go:71] worker 0 working on workload_info task. I0809 18:30:35.535625 1 gather_workloads_info.go:281] Loaded pods in 0s, will wait 22s for image data I0809 18:30:35.544581 1 gather_workloads_info.go:390] No image sha256:5bcfb1b739fa4e6ff9e21e4843f8520f29608135341f7d8dcc31084b9ba25f1d (10ms) I0809 18:30:35.547863 1 tasks_processing.go:74] worker 1 stopped. I0809 18:30:35.547875 1 gather.go:181] gatherer "workloads" function "helmchart_info" took 30.205658ms to process 0 records I0809 18:30:35.553170 1 gather_workloads_info.go:390] No image sha256:3a2c82b772ea6072e1eca0efc5303f002189e80b0e985fb3e3b8ea9a12fe8060 (9ms) I0809 18:30:35.561542 1 gather_workloads_info.go:390] No image sha256:3fea7db586d3236c1876a8b523af0d8d65c84d6f6cf5d0f4e41cafcffe6db5b5 (8ms) I0809 18:30:35.570923 1 gather_workloads_info.go:390] No image sha256:351ca92471647f383f3cd7f0b70f33f5fa11c39ab569c4948dff7d471a6c8be3 (9ms) I0809 18:30:35.579293 1 gather_workloads_info.go:390] No image sha256:0c1abef76d6d2832ddcff31e950ffafeb4e0f6fad80a5f5dca94591de0fc9581 (8ms) I0809 18:30:35.587849 1 gather_workloads_info.go:390] No image sha256:751bd7eb62f632c0eef0ca91b6c57c64d4f1279d4dbe1a9b875ac4020a7b693f (9ms) I0809 18:30:35.596326 1 gather_workloads_info.go:390] No image sha256:ed0c9631d6e424912cd8ce78ca7a2c4f76b3fc15e9e34fe00999170ccf19a611 (8ms) I0809 18:30:35.610979 1 gather_workloads_info.go:390] No image sha256:4b9b7949d209e257a76053de4ac74193f747c0d42e25dcd270d655849a4e51aa (15ms) I0809 18:30:35.623031 1 gather_workloads_info.go:390] No image sha256:0242cefbf0bb876101c4d67ab4e07401cb0ba6c02be2b73a4f17ba33b2960005 (12ms) I0809 18:30:35.631607 1 gather_workloads_info.go:390] No image sha256:8562a483f4568254250f19fc68d79f88c94a48508aefe59a70c1021a3aad000a (9ms) I0809 18:30:35.646432 1 gather_workloads_info.go:390] No image sha256:0c6b7f828184b16a5e6630111e0715e11d34dae9b0bf64619466543e6168e05c (15ms) I0809 18:30:35.744789 1 gather_workloads_info.go:390] No image sha256:099b3af427b8e1eb44765283a640446c3225151baa06eed789623206151a60cd (98ms) I0809 18:30:35.844955 1 gather_workloads_info.go:390] No image sha256:1eee856bde9bad71c4444c494225a0cf02d1f4a5293acf0bd6e7e1814efa0064 (100ms) I0809 18:30:35.945234 1 gather_workloads_info.go:390] No image sha256:02283a64c1936a5dd09d5c6bc0ecbcf9196fe4df6a4055c8be22cebd850aa7a3 (100ms) I0809 18:30:36.044986 1 gather_workloads_info.go:390] No image sha256:13aabbaf260d634ff0e9ac1af88af075b5ba671fd51313e33e74d7d2f7e54128 (100ms) I0809 18:30:36.145391 1 gather_workloads_info.go:390] No image sha256:c7aa910ca06f8fd89cdf2519136e0f3533bdacfc6bd58a3f6683f9f08756c7b1 (100ms) I0809 18:30:36.245218 1 gather_workloads_info.go:390] No image sha256:798001e24f1ed6a5621c442729a840ba2a2abc43433901e8450caa12b4bad5c5 (100ms) I0809 18:30:36.344872 1 gather_workloads_info.go:390] No image sha256:a7fc4d05c4a3c82c9f355ca985d6fd26033c0d6a98716f25fcd2f54bae1d2fa0 (100ms) I0809 18:30:36.445439 1 gather_workloads_info.go:390] No image sha256:42b4c6bdf3081ec264bc5edbc4eb779151de9e4742d6fe59a316645891df649c (101ms) I0809 18:30:36.545280 1 gather_workloads_info.go:390] No image sha256:1c7c24111f1709d7648156873ced09462638aa4b3cf7e7aee13297e51bcdfb3e (100ms) I0809 18:30:36.644962 1 gather_workloads_info.go:390] No image sha256:4dcdadc14b7bdb2c00954d92e957d63aafbbe5f4047fe028e575d65725923cb0 (100ms) I0809 18:30:36.746433 1 gather_workloads_info.go:390] No image sha256:d09ac899f3001937771c6cadd50802a983e7c833fa2e0bde1958e134458c76ae (101ms) I0809 18:30:36.844771 1 gather_workloads_info.go:390] No image sha256:894452e6587de55d04e37163d3da53e11fced8fb08bd0acf61e6d49f7964284e (98ms) I0809 18:30:36.945779 1 gather_workloads_info.go:390] No image sha256:30ff5e5b72f274598704ca69f1832eba1040cc25da47386004fd59500b6e4c55 (101ms) I0809 18:30:37.047863 1 gather_workloads_info.go:390] No image sha256:41029e57ece558b2e0b12174ce924647fd9d5c5d83aadf4bba03d6916d3f9f54 (102ms) I0809 18:30:37.144988 1 gather_workloads_info.go:390] No image sha256:80fdd5049bd2815e49c198a795a116976a852e8de630be74872439ba6c08758a (97ms) I0809 18:30:37.244470 1 gather_workloads_info.go:390] No image sha256:48dff3fcb0da58eb9b2b500f89af8b7d0790ffa60da0b0e301feca971dbafcbb (99ms) I0809 18:30:37.345244 1 gather_workloads_info.go:390] No image sha256:0158b297aec0a66376c04d3c7cf4828db5e5d9f424e331ff7c7b796828036875 (101ms) I0809 18:30:37.445099 1 gather_workloads_info.go:390] No image sha256:38787de16ee8c686305f93b501d891b50cde24136009863869d230c0d4eeee5c (100ms) I0809 18:30:37.551366 1 gather_workloads_info.go:390] No image sha256:6a9b4fd887fa7f1729302fb0330c3c9a483197bf78becdcfda4235ec823a2c39 (106ms) I0809 18:30:37.551392 1 tasks_processing.go:74] worker 0 stopped. I0809 18:30:37.551622 1 recorder.go:70] Recording config/workload_info with fingerprint=79d647fbbfb021dbd3b027183e27bce3151dea7a1413d14cfd37b871e8af57a8 I0809 18:30:37.551638 1 gather.go:181] gatherer "workloads" function "workload_info" took 2.033587364s to process 1 records I0809 18:30:37.551650 1 periodic.go:261] Periodic gather workloads completed in 2.034s I0809 18:30:37.551656 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0809 18:30:37.551660 1 periodic.go:214] Running conditional gatherer I0809 18:30:37.562700 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules I0809 18:30:37.567229 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.8:48067->172.30.0.10:53: read: connection refused E0809 18:30:37.567450 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0809 18:30:37.567498 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0809 18:30:37.577209 1 conditional_gatherer.go:390] cluster version is '4.18.9' E0809 18:30:37.577243 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0809 18:30:37.577250 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0809 18:30:37.577255 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0809 18:30:37.577259 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0809 18:30:37.577262 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0809 18:30:37.577267 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0809 18:30:37.577270 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0809 18:30:37.577273 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0809 18:30:37.577282 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0809 18:30:37.577295 1 tasks_processing.go:45] number of workers: 3 I0809 18:30:37.577341 1 tasks_processing.go:69] worker 2 listening for tasks. I0809 18:30:37.577350 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0809 18:30:37.577422 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0809 18:30:37.577454 1 gather.go:181] gatherer "conditional" function "remote_configuration" took 1.194µs to process 1 records I0809 18:30:37.577465 1 tasks_processing.go:69] worker 0 listening for tasks. I0809 18:30:37.577469 1 tasks_processing.go:69] worker 1 listening for tasks. I0809 18:30:37.577475 1 tasks_processing.go:74] worker 1 stopped. I0809 18:30:37.577480 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0809 18:30:37.577493 1 tasks_processing.go:74] worker 2 stopped. I0809 18:30:37.577568 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I0809 18:30:37.577606 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0809 18:30:37.577621 1 gather.go:181] gatherer "conditional" function "conditional_gatherer_rules" took 733ns to process 1 records I0809 18:30:37.578039 1 tasks_processing.go:74] worker 0 stopped. I0809 18:30:37.578052 1 gather.go:181] gatherer "conditional" function "rapid_container_logs" took 447.25µs to process 0 records I0809 18:30:37.578075 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.8:48067->172.30.0.10:53: read: connection refused I0809 18:30:37.578086 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 W0809 18:30:37.603272 1 gather.go:213] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0809 18:30:37.603356 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=204ff441251aa0c731cd64fa0103c6b7c65a0612a6a5a2e242d2a96914f8dfea I0809 18:30:37.603455 1 diskrecorder.go:70] Writing 108 records to /var/lib/insights-operator/insights-2026-08-09-183037.tar.gz I0809 18:30:37.609425 1 diskrecorder.go:51] Wrote 108 records to disk in 6ms I0809 18:30:37.609448 1 periodic.go:283] Gathering cluster info every 2h0m0s I0809 18:30:37.609460 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0809 18:30:37.811771 1 configmapobserver.go:84] configmaps "insights-config" not found I0809 18:30:38.012090 1 configmapobserver.go:84] configmaps "insights-config" not found I0809 18:30:45.769993 1 configmapobserver.go:84] configmaps "insights-config" not found I0809 18:31:41.851688 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="7c8c734d454ca1e289ca1e8b95b6f3eacddbdc70dcdc359af33e058444206cd3") W0809 18:31:41.851719 1 builder.go:154] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0809 18:31:41.851746 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="03fa192042bade86c14269dce39c6ad03536da76ad87f506803c5cd267c656a9") I0809 18:31:41.851791 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="15b9298e3a497f38b33d912cf326123498f534c8ed336a17a090847e2f4cbb5d") I0809 18:31:41.851844 1 base_controller.go:172] Shutting down LoggingSyncer ... I0809 18:31:41.851862 1 periodic.go:175] Shutting down I0809 18:31:41.851861 1 genericapiserver.go:670] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0809 18:31:41.851878 1 base_controller.go:114] Shutting down worker of LoggingSyncer controller ... I0809 18:31:41.851885 1 base_controller.go:104] All LoggingSyncer workers have been terminated I0809 18:31:41.851893 1 genericapiserver.go:527] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0809 18:31:41.851894 1 base_controller.go:172] Shutting down ConfigController ... I0809 18:31:41.851898 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0809 18:31:41.851919 1 base_controller.go:114] Shutting down worker of ConfigController controller ... I0809 18:31:41.851925 1 genericapiserver.go:628] "[graceful-termination] not going to wait for active watch request(s) to drain" I0809 18:31:41.851930 1 base_controller.go:104] All ConfigController workers have been terminated I0809 18:31:41.851934 1 configmap_cafile_content.go:223] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0809 18:31:41.851945 1 requestheader_controller.go:183] Shutting down RequestHeaderAuthRequestController I0809 18:31:41.851956 1 configmap_cafile_content.go:223] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0809 18:31:41.851942 1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController" E0809 18:31:41.851973 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled