W0630 10:45:05.655134 1 cmd.go:254] Using insecure, self-signed certificates I0630 10:45:06.019401 1 start.go:223] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0630 10:45:06.019792 1 observer_polling.go:159] Starting file observer W0630 10:45:06.045196 1 builder.go:266] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-6fd96f47fd" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0630 10:45:06.231599 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0630 10:45:06.232085 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0630 10:45:06.233314 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0630 10:45:06.233489 1 secure_serving.go:57] Forcing use of http/1.1 only W0630 10:45:06.233505 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0630 10:45:06.233509 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0630 10:45:06.233513 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0630 10:45:06.233515 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0630 10:45:06.233517 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0630 10:45:06.233519 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0630 10:45:06.237264 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes ChunkSizeMiB CloudDualStackNodeIPs DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy PersistentIPsForVirtualization PrivateHostedZoneAWS SetEIPForNLBIngressController VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy AWSClusterHostedDNS AdditionalRoutingCapabilities AutomatedEtcdBackup BootcNodeManagement CSIDriverSharedResource ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ConsolePluginContentSecurityPolicy DNSNameResolver DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example GCPClusterHostedDNS GatewayAPI ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MetricsCollectionProfiles MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NodeSwap NutanixMultiSubnets OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0630 10:45:06.237322 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ConsolePluginContentSecurityPolicy", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0630 10:45:06.239736 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0630 10:45:06.239749 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0630 10:45:06.239776 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0630 10:45:06.239795 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0630 10:45:06.239784 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0630 10:45:06.239813 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0630 10:45:06.239927 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/tmp/serving-cert-2904075357/tls.crt::/tmp/serving-cert-2904075357/tls.key" I0630 10:45:06.240039 1 secure_serving.go:213] Serving securely on [::]:8443 I0630 10:45:06.240061 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" E0630 10:45:06.240261 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18bdd5fc190b7f7c openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"SetEIPForNLBIngressController\", \"VSphereControlPlaneMachineSet\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"VSphereStaticIPs\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AdditionalRoutingCapabilities\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"CSIDriverSharedResource\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ConsolePluginContentSecurityPolicy\", \"DNSNameResolver\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"GCPClusterHostedDNS\", \"GatewayAPI\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MetricsCollectionProfiles\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OnClusterBuild\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SignatureStores\", \"SigstoreImageVerification\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-06-30 10:45:06.23724326 +0000 UTC m=+0.623960571,LastTimestamp:2026-06-30 10:45:06.23724326 +0000 UTC m=+0.623960571,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0630 10:45:06.242116 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0630 10:45:06.242138 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0630 10:45:06.242240 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0630 10:45:06.248564 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0630 10:45:06.248582 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0630 10:45:06.252912 1 secretconfigobserver.go:119] support secret does not exist I0630 10:45:06.257311 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0630 10:45:06.258615 1 recorder.go:156] Pruning old reports every 7h8m38s, max age is 288h0m0s I0630 10:45:06.261487 1 secretconfigobserver.go:119] support secret does not exist I0630 10:45:06.264002 1 periodic.go:214] Running clusterconfig gatherer I0630 10:45:06.264008 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0630 10:45:06.264025 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0630 10:45:06.264031 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0630 10:45:06.264039 1 insightsreport.go:296] Starting report retriever I0630 10:45:06.264045 1 tasks_processing.go:45] number of workers: 64 I0630 10:45:06.264045 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0630 10:45:06.264068 1 tasks_processing.go:69] worker 3 listening for tasks. I0630 10:45:06.264086 1 tasks_processing.go:71] worker 3 working on oauths task. I0630 10:45:06.264087 1 tasks_processing.go:69] worker 0 listening for tasks. I0630 10:45:06.264092 1 tasks_processing.go:71] worker 0 working on ingress_certificates task. I0630 10:45:06.264119 1 tasks_processing.go:69] worker 33 listening for tasks. I0630 10:45:06.264123 1 tasks_processing.go:69] worker 48 listening for tasks. I0630 10:45:06.264131 1 tasks_processing.go:69] worker 34 listening for tasks. I0630 10:45:06.264133 1 tasks_processing.go:69] worker 4 listening for tasks. I0630 10:45:06.264135 1 tasks_processing.go:69] worker 1 listening for tasks. I0630 10:45:06.264140 1 tasks_processing.go:69] worker 5 listening for tasks. I0630 10:45:06.264142 1 tasks_processing.go:69] worker 19 listening for tasks. I0630 10:45:06.264143 1 tasks_processing.go:69] worker 35 listening for tasks. I0630 10:45:06.264145 1 tasks_processing.go:69] worker 20 listening for tasks. I0630 10:45:06.264147 1 tasks_processing.go:69] worker 6 listening for tasks. I0630 10:45:06.264149 1 tasks_processing.go:69] worker 21 listening for tasks. I0630 10:45:06.264151 1 tasks_processing.go:69] worker 42 listening for tasks. I0630 10:45:06.264153 1 tasks_processing.go:69] worker 7 listening for tasks. I0630 10:45:06.264154 1 tasks_processing.go:69] worker 22 listening for tasks. I0630 10:45:06.264158 1 tasks_processing.go:69] worker 8 listening for tasks. I0630 10:45:06.264159 1 tasks_processing.go:69] worker 23 listening for tasks. I0630 10:45:06.264158 1 tasks_processing.go:69] worker 43 listening for tasks. I0630 10:45:06.264163 1 tasks_processing.go:69] worker 9 listening for tasks. I0630 10:45:06.264164 1 tasks_processing.go:69] worker 44 listening for tasks. I0630 10:45:06.264165 1 tasks_processing.go:69] worker 24 listening for tasks. I0630 10:45:06.264169 1 tasks_processing.go:69] worker 25 listening for tasks. I0630 10:45:06.264168 1 tasks_processing.go:69] worker 10 listening for tasks. I0630 10:45:06.264165 1 tasks_processing.go:69] worker 41 listening for tasks. I0630 10:45:06.264175 1 tasks_processing.go:69] worker 11 listening for tasks. I0630 10:45:06.264177 1 tasks_processing.go:69] worker 26 listening for tasks. I0630 10:45:06.264176 1 tasks_processing.go:69] worker 45 listening for tasks. I0630 10:45:06.264178 1 tasks_processing.go:69] worker 39 listening for tasks. I0630 10:45:06.264178 1 tasks_processing.go:69] worker 38 listening for tasks. I0630 10:45:06.264184 1 tasks_processing.go:69] worker 12 listening for tasks. I0630 10:45:06.264182 1 tasks_processing.go:69] worker 46 listening for tasks. I0630 10:45:06.264186 1 tasks_processing.go:69] worker 40 listening for tasks. I0630 10:45:06.264188 1 tasks_processing.go:69] worker 47 listening for tasks. I0630 10:45:06.264193 1 tasks_processing.go:69] worker 36 listening for tasks. I0630 10:45:06.264191 1 tasks_processing.go:69] worker 13 listening for tasks. I0630 10:45:06.264185 1 tasks_processing.go:69] worker 27 listening for tasks. I0630 10:45:06.264199 1 tasks_processing.go:69] worker 37 listening for tasks. I0630 10:45:06.264192 1 tasks_processing.go:69] worker 28 listening for tasks. I0630 10:45:06.264197 1 tasks_processing.go:69] worker 14 listening for tasks. I0630 10:45:06.264199 1 tasks_processing.go:69] worker 31 listening for tasks. I0630 10:45:06.264200 1 tasks_processing.go:69] worker 2 listening for tasks. I0630 10:45:06.264206 1 tasks_processing.go:69] worker 29 listening for tasks. I0630 10:45:06.264199 1 tasks_processing.go:69] worker 30 listening for tasks. I0630 10:45:06.264210 1 tasks_processing.go:69] worker 18 listening for tasks. I0630 10:45:06.264211 1 tasks_processing.go:69] worker 16 listening for tasks. I0630 10:45:06.264214 1 tasks_processing.go:69] worker 54 listening for tasks. I0630 10:45:06.264216 1 tasks_processing.go:69] worker 52 listening for tasks. I0630 10:45:06.264205 1 tasks_processing.go:69] worker 56 listening for tasks. I0630 10:45:06.264219 1 tasks_processing.go:69] worker 53 listening for tasks. I0630 10:45:06.264219 1 tasks_processing.go:69] worker 55 listening for tasks. I0630 10:45:06.264218 1 tasks_processing.go:69] worker 32 listening for tasks. I0630 10:45:06.264225 1 tasks_processing.go:69] worker 51 listening for tasks. I0630 10:45:06.264226 1 tasks_processing.go:69] worker 59 listening for tasks. I0630 10:45:06.264227 1 tasks_processing.go:69] worker 58 listening for tasks. I0630 10:45:06.264228 1 tasks_processing.go:69] worker 57 listening for tasks. I0630 10:45:06.264212 1 tasks_processing.go:69] worker 49 listening for tasks. I0630 10:45:06.264227 1 tasks_processing.go:69] worker 50 listening for tasks. I0630 10:45:06.264234 1 tasks_processing.go:69] worker 63 listening for tasks. I0630 10:45:06.264203 1 tasks_processing.go:69] worker 15 listening for tasks. I0630 10:45:06.264220 1 tasks_processing.go:69] worker 60 listening for tasks. I0630 10:45:06.264205 1 tasks_processing.go:69] worker 17 listening for tasks. I0630 10:45:06.264228 1 tasks_processing.go:69] worker 62 listening for tasks. I0630 10:45:06.264230 1 tasks_processing.go:69] worker 61 listening for tasks. I0630 10:45:06.264297 1 tasks_processing.go:71] worker 6 working on machine_healthchecks task. I0630 10:45:06.264303 1 tasks_processing.go:71] worker 33 working on aggregated_monitoring_cr_names task. I0630 10:45:06.264304 1 tasks_processing.go:71] worker 5 working on feature_gates task. I0630 10:45:06.264309 1 tasks_processing.go:71] worker 7 working on cluster_apiserver task. I0630 10:45:06.264313 1 tasks_processing.go:71] worker 2 working on infrastructures task. I0630 10:45:06.264312 1 tasks_processing.go:71] worker 28 working on sap_datahubs task. I0630 10:45:06.264318 1 tasks_processing.go:71] worker 35 working on machine_sets task. I0630 10:45:06.264341 1 tasks_processing.go:71] worker 20 working on image task. I0630 10:45:06.264350 1 tasks_processing.go:71] worker 46 working on schedulers task. I0630 10:45:06.264352 1 tasks_processing.go:71] worker 45 working on machine_config_pools task. I0630 10:45:06.264362 1 tasks_processing.go:71] worker 59 working on image_registries task. I0630 10:45:06.264369 1 tasks_processing.go:71] worker 51 working on service_accounts task. I0630 10:45:06.264398 1 tasks_processing.go:71] worker 39 working on container_images task. I0630 10:45:06.264434 1 tasks_processing.go:71] worker 4 working on olm_operators task. I0630 10:45:06.264443 1 tasks_processing.go:71] worker 58 working on install_plans task. I0630 10:45:06.264445 1 tasks_processing.go:71] worker 16 working on nodenetworkstates task. I0630 10:45:06.264446 1 tasks_processing.go:71] worker 10 working on openstack_dataplanenodesets task. I0630 10:45:06.264447 1 tasks_processing.go:71] worker 30 working on active_alerts task. I0630 10:45:06.264453 1 tasks_processing.go:71] worker 60 working on monitoring_persistent_volumes task. I0630 10:45:06.264303 1 tasks_processing.go:71] worker 61 working on openstack_dataplanedeployments task. W0630 10:45:06.264471 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0630 10:45:06.264435 1 tasks_processing.go:71] worker 43 working on ingress task. I0630 10:45:06.264489 1 tasks_processing.go:71] worker 15 working on image_pruners task. I0630 10:45:06.264495 1 gather.go:181] gatherer "clusterconfig" function "active_alerts" took 30.754µs to process 0 records I0630 10:45:06.264503 1 tasks_processing.go:71] worker 49 working on proxies task. I0630 10:45:06.264510 1 tasks_processing.go:71] worker 53 working on support_secret task. I0630 10:45:06.264548 1 tasks_processing.go:71] worker 56 working on cost_management_metrics_configs task. I0630 10:45:06.264299 1 tasks_processing.go:71] worker 1 working on validating_webhook_configurations task. I0630 10:45:06.264305 1 tasks_processing.go:71] worker 42 working on networks task. I0630 10:45:06.264308 1 tasks_processing.go:71] worker 31 working on authentication task. I0630 10:45:06.264300 1 tasks_processing.go:71] worker 19 working on container_runtime_configs task. I0630 10:45:06.264394 1 tasks_processing.go:71] worker 34 working on crds task. I0630 10:45:06.264301 1 tasks_processing.go:71] worker 21 working on openstack_controlplanes task. I0630 10:45:06.264771 1 tasks_processing.go:71] worker 25 working on machine_autoscalers task. I0630 10:45:06.264406 1 tasks_processing.go:71] worker 48 working on mutating_webhook_configurations task. I0630 10:45:06.264412 1 tasks_processing.go:71] worker 27 working on certificate_signing_requests task. I0630 10:45:06.264404 1 tasks_processing.go:71] worker 36 working on storage_cluster task. I0630 10:45:06.264416 1 tasks_processing.go:71] worker 13 working on storage_classes task. I0630 10:45:06.264422 1 tasks_processing.go:71] worker 47 working on lokistack task. I0630 10:45:06.264422 1 tasks_processing.go:71] worker 40 working on silenced_alerts task. W0630 10:45:06.265142 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0630 10:45:06.264419 1 tasks_processing.go:71] worker 9 working on operators_pods_and_events task. I0630 10:45:06.265151 1 tasks_processing.go:74] worker 40 stopped. I0630 10:45:06.265157 1 gather.go:181] gatherer "clusterconfig" function "silenced_alerts" took 17.447µs to process 0 records I0630 10:45:06.264425 1 tasks_processing.go:71] worker 24 working on pdbs task. I0630 10:45:06.264427 1 tasks_processing.go:71] worker 11 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0630 10:45:06.264428 1 tasks_processing.go:71] worker 8 working on operators task. I0630 10:45:06.264428 1 tasks_processing.go:71] worker 38 working on overlapping_namespace_uids task. I0630 10:45:06.264431 1 tasks_processing.go:71] worker 23 working on openstack_version task. I0630 10:45:06.264431 1 tasks_processing.go:71] worker 12 working on sap_config task. I0630 10:45:06.264432 1 tasks_processing.go:71] worker 22 working on tsdb_status task. W0630 10:45:06.265428 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0630 10:45:06.264432 1 tasks_processing.go:71] worker 26 working on jaegers task. I0630 10:45:06.265439 1 tasks_processing.go:74] worker 22 stopped. I0630 10:45:06.265446 1 gather.go:181] gatherer "clusterconfig" function "tsdb_status" took 23.08µs to process 0 records I0630 10:45:06.264438 1 tasks_processing.go:71] worker 54 working on config_maps task. I0630 10:45:06.264439 1 tasks_processing.go:71] worker 63 working on nodes task. I0630 10:45:06.264438 1 tasks_processing.go:71] worker 37 working on pod_network_connectivity_checks task. I0630 10:45:06.264299 1 tasks_processing.go:71] worker 41 working on sap_pods task. I0630 10:45:06.264441 1 tasks_processing.go:71] worker 29 working on clusterroles task. I0630 10:45:06.264443 1 tasks_processing.go:71] worker 18 working on openshift_logging task. I0630 10:45:06.264487 1 tasks_processing.go:74] worker 30 stopped. I0630 10:45:06.264532 1 tasks_processing.go:71] worker 57 working on node_logs task. I0630 10:45:06.264537 1 tasks_processing.go:71] worker 55 working on nodenetworkconfigurationpolicies task. I0630 10:45:06.264541 1 tasks_processing.go:71] worker 52 working on metrics task. W0630 10:45:06.266058 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0630 10:45:06.266065 1 tasks_processing.go:74] worker 52 stopped. I0630 10:45:06.266072 1 gather.go:181] gatherer "clusterconfig" function "metrics" took 17.593µs to process 0 records I0630 10:45:06.264543 1 tasks_processing.go:71] worker 32 working on machine_configs task. I0630 10:45:06.264549 1 tasks_processing.go:71] worker 17 working on openshift_machine_api_events task. I0630 10:45:06.264556 1 tasks_processing.go:71] worker 62 working on dvo_metrics task. I0630 10:45:06.264558 1 tasks_processing.go:71] worker 50 working on machines task. I0630 10:45:06.264306 1 tasks_processing.go:71] worker 14 working on ceph_cluster task. I0630 10:45:06.264419 1 tasks_processing.go:71] worker 44 working on version task. I0630 10:45:06.269758 1 tasks_processing.go:74] worker 28 stopped. I0630 10:45:06.269769 1 gather.go:181] gatherer "clusterconfig" function "sap_datahubs" took 5.430653ms to process 0 records I0630 10:45:06.269788 1 tasks_processing.go:74] worker 6 stopped. E0630 10:45:06.269795 1 gather.go:144] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0630 10:45:06.269804 1 gather.go:181] gatherer "clusterconfig" function "machine_healthchecks" took 5.481305ms to process 0 records I0630 10:45:06.269840 1 tasks_processing.go:74] worker 45 stopped. I0630 10:45:06.269856 1 gather.go:181] gatherer "clusterconfig" function "machine_config_pools" took 5.479827ms to process 0 records I0630 10:45:06.270835 1 tasks_processing.go:74] worker 61 stopped. I0630 10:45:06.270844 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 6.360776ms to process 0 records I0630 10:45:06.280809 1 tasks_processing.go:74] worker 35 stopped. I0630 10:45:06.280824 1 gather.go:181] gatherer "clusterconfig" function "machine_sets" took 16.480929ms to process 0 records I0630 10:45:06.280925 1 tasks_processing.go:74] worker 14 stopped. I0630 10:45:06.280931 1 gather.go:181] gatherer "clusterconfig" function "ceph_cluster" took 14.625211ms to process 0 records I0630 10:45:06.280936 1 gather.go:181] gatherer "clusterconfig" function "jaegers" took 15.491594ms to process 0 records I0630 10:45:06.280939 1 tasks_processing.go:74] worker 26 stopped. I0630 10:45:06.280983 1 tasks_processing.go:74] worker 19 stopped. I0630 10:45:06.280989 1 gather.go:181] gatherer "clusterconfig" function "container_runtime_configs" took 16.291065ms to process 0 records I0630 10:45:06.280992 1 gather.go:181] gatherer "clusterconfig" function "machine_autoscalers" took 16.206566ms to process 0 records I0630 10:45:06.280995 1 gather.go:181] gatherer "clusterconfig" function "sap_config" took 15.596577ms to process 0 records I0630 10:45:06.280999 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkstates" took 16.544616ms to process 0 records I0630 10:45:06.281002 1 gather.go:181] gatherer "clusterconfig" function "cost_management_metrics_configs" took 16.409141ms to process 0 records I0630 10:45:06.281001 1 tasks_processing.go:74] worker 12 stopped. I0630 10:45:06.281005 1 tasks_processing.go:74] worker 56 stopped. I0630 10:45:06.281006 1 tasks_processing.go:74] worker 16 stopped. I0630 10:45:06.281000 1 tasks_processing.go:74] worker 25 stopped. I0630 10:45:06.281387 1 tasks_processing.go:74] worker 10 stopped. I0630 10:45:06.281412 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 16.927147ms to process 0 records I0630 10:45:06.281443 1 tasks_processing.go:74] worker 21 stopped. I0630 10:45:06.281453 1 gather.go:181] gatherer "clusterconfig" function "openstack_controlplanes" took 16.662302ms to process 0 records I0630 10:45:06.281479 1 tasks_processing.go:74] worker 23 stopped. I0630 10:45:06.281487 1 gather.go:181] gatherer "clusterconfig" function "openstack_version" took 16.089173ms to process 0 records I0630 10:45:06.281517 1 tasks_processing.go:74] worker 50 stopped. E0630 10:45:06.281540 1 gather.go:144] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0630 10:45:06.281550 1 gather.go:181] gatherer "clusterconfig" function "machines" took 15.22892ms to process 0 records I0630 10:45:06.281720 1 tasks_processing.go:74] worker 42 stopped. I0630 10:45:06.281923 1 recorder.go:70] Recording config/network with fingerprint=c3d83c8d652386c87f4400c5b7d1942ec6802b96980ca70c786e4c817e3aa874 I0630 10:45:06.281940 1 gather.go:181] gatherer "clusterconfig" function "networks" took 16.867594ms to process 1 records I0630 10:45:06.281954 1 gather.go:181] gatherer "clusterconfig" function "storage_cluster" took 16.662598ms to process 0 records I0630 10:45:06.281985 1 gather.go:181] gatherer "clusterconfig" function "lokistack" took 16.626165ms to process 0 records E0630 10:45:06.281991 1 gather.go:144] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0630 10:45:06.281998 1 gather.go:181] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 16.159393ms to process 0 records I0630 10:45:06.282010 1 tasks_processing.go:74] worker 37 stopped. I0630 10:45:06.282015 1 tasks_processing.go:74] worker 36 stopped. I0630 10:45:06.282018 1 tasks_processing.go:74] worker 47 stopped. I0630 10:45:06.282119 1 tasks_processing.go:74] worker 49 stopped. I0630 10:45:06.282237 1 recorder.go:70] Recording config/proxy with fingerprint=283785a0b6e1a90a99a909472a95c26b064691f99cdc6865bdbd47fec27f0c87 I0630 10:45:06.282249 1 gather.go:181] gatherer "clusterconfig" function "proxies" took 17.611923ms to process 1 records I0630 10:45:06.282389 1 tasks_processing.go:74] worker 7 stopped. I0630 10:45:06.282462 1 recorder.go:70] Recording config/apiserver with fingerprint=1848663160930154a2713b3f3d4738ab73cedcbf557dc86d94a0de817acfdb21 I0630 10:45:06.282474 1 gather.go:181] gatherer "clusterconfig" function "cluster_apiserver" took 17.876014ms to process 1 records I0630 10:45:06.282575 1 tasks_processing.go:74] worker 43 stopped. I0630 10:45:06.282736 1 recorder.go:70] Recording config/ingress with fingerprint=a324c71ba40f266a39563f2227c7389d5bea3c3d11fad353636bb2b6d9a7ba8f I0630 10:45:06.282770 1 gather.go:181] gatherer "clusterconfig" function "ingress" took 17.815595ms to process 1 records I0630 10:45:06.282852 1 tasks_processing.go:74] worker 31 stopped. I0630 10:45:06.283333 1 recorder.go:70] Recording config/authentication with fingerprint=9a3f7a5ac4298376f75866db282268413dcabf5a92ed8e0ee1c2375315401c7d I0630 10:45:06.283348 1 gather.go:181] gatherer "clusterconfig" function "authentication" took 17.664331ms to process 1 records I0630 10:45:06.283396 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=f3af61eef5cc3f1ddcf3bad2c5448c6acbb29e6ba0805f7800ae36abca11f6a8 I0630 10:45:06.283404 1 gather.go:181] gatherer "clusterconfig" function "schedulers" took 18.083556ms to process 1 records I0630 10:45:06.283423 1 tasks_processing.go:74] worker 46 stopped. I0630 10:45:06.283492 1 tasks_processing.go:74] worker 3 stopped. I0630 10:45:06.283569 1 recorder.go:70] Recording config/oauth with fingerprint=52800a4fb4b6fa4ee756b813d1b22eb6c8c7cfddc2904f8a1ae2da2e999efa6e I0630 10:45:06.283576 1 gather.go:181] gatherer "clusterconfig" function "oauths" took 18.459482ms to process 1 records I0630 10:45:06.283651 1 tasks_processing.go:74] worker 5 stopped. I0630 10:45:06.283659 1 recorder.go:70] Recording config/featuregate with fingerprint=6db5eb26f8f54d65af3b5e55588c3391b4846db9c3a7ae4ff6687aca0da1d12b I0630 10:45:06.283664 1 gather.go:181] gatherer "clusterconfig" function "feature_gates" took 18.66971ms to process 1 records I0630 10:45:06.283734 1 tasks_processing.go:74] worker 2 stopped. I0630 10:45:06.284047 1 recorder.go:70] Recording config/infrastructure with fingerprint=5d595f1ef9d08e2b34697a9db56b9e3898d87bdf31a3ec9e336d5f4179a7bace I0630 10:45:06.284058 1 gather.go:181] gatherer "clusterconfig" function "infrastructures" took 19.103696ms to process 1 records I0630 10:45:06.284061 1 gather.go:181] gatherer "clusterconfig" function "openshift_machine_api_events" took 17.814228ms to process 0 records I0630 10:45:06.284066 1 tasks_processing.go:74] worker 17 stopped. I0630 10:45:06.284189 1 tasks_processing.go:74] worker 20 stopped. I0630 10:45:06.284242 1 recorder.go:70] Recording config/image with fingerprint=26baae59bbd95a5dd9f4174b2f7975b8d5f1d88ef9470990f404a29b12d20d0a I0630 10:45:06.284249 1 gather.go:181] gatherer "clusterconfig" function "image" took 19.8338ms to process 1 records I0630 10:45:06.284555 1 tasks_processing.go:74] worker 55 stopped. I0630 10:45:06.284564 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 18.615585ms to process 0 records I0630 10:45:06.284587 1 tasks_processing.go:74] worker 41 stopped. I0630 10:45:06.284595 1 gather.go:181] gatherer "clusterconfig" function "sap_pods" took 19.008568ms to process 0 records I0630 10:45:06.285402 1 tasks_processing.go:74] worker 4 stopped. I0630 10:45:06.285413 1 gather.go:181] gatherer "clusterconfig" function "olm_operators" took 20.948732ms to process 0 records I0630 10:45:06.286648 1 tasks_processing.go:74] worker 18 stopped. I0630 10:45:06.286657 1 gather.go:181] gatherer "clusterconfig" function "openshift_logging" took 20.934233ms to process 0 records I0630 10:45:06.286707 1 tasks_processing.go:74] worker 53 stopped. E0630 10:45:06.286717 1 gather.go:144] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0630 10:45:06.286723 1 gather.go:181] gatherer "clusterconfig" function "support_secret" took 22.154331ms to process 0 records I0630 10:45:06.286781 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0630 10:45:06.286800 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0630 10:45:06.286807 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0630 10:45:06.286811 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0630 10:45:06.286837 1 controller.go:457] The operator is still being initialized I0630 10:45:06.286847 1 controller.go:482] The operator is healthy I0630 10:45:06.287006 1 tasks_processing.go:74] worker 13 stopped. I0630 10:45:06.287091 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=23c11051b4ccfeb9c540d14b0a0a92e1d2d45a3a40e49a437c243964271e642e I0630 10:45:06.287109 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=238c3c69a1e4508e95c49e2f1c3a275c137863d22f9c4dbb6da6cd939bdcd2ce I0630 10:45:06.287118 1 gather.go:181] gatherer "clusterconfig" function "storage_classes" took 22.048486ms to process 2 records I0630 10:45:06.287264 1 tasks_processing.go:74] worker 59 stopped. I0630 10:45:06.287673 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=f2387e7245623e5e725030d63d13797d49f9ef30651c17100d1d6ae416f3fdf2 I0630 10:45:06.287685 1 gather.go:181] gatherer "clusterconfig" function "image_registries" took 22.890625ms to process 1 records I0630 10:45:06.287693 1 gather.go:181] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 23.134703ms to process 0 records I0630 10:45:06.287698 1 tasks_processing.go:74] worker 60 stopped. I0630 10:45:06.290053 1 tasks_processing.go:74] worker 15 stopped. I0630 10:45:06.290180 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=a06dfd34708fb87085bd8b56f77762631516a4cddcab9114a09f61c97cfdb8a8 I0630 10:45:06.290194 1 gather.go:181] gatherer "clusterconfig" function "image_pruners" took 25.549345ms to process 1 records I0630 10:45:06.290205 1 gather.go:181] gatherer "clusterconfig" function "certificate_signing_requests" took 25.219491ms to process 0 records I0630 10:45:06.290209 1 tasks_processing.go:74] worker 27 stopped. W0630 10:45:06.291294 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0630 10:45:06.291317 1 tasks_processing.go:74] worker 48 stopped. I0630 10:45:06.292598 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=e5d6b8426a43c66ad5271763d956d22aee75a78ef243911a65e8b990dc5d7b14 I0630 10:45:06.292625 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=741b58b27f9c2bc29b8fd0308c4cf64474fee385015878677812f1c20fd01a74 I0630 10:45:06.292639 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=41d22bdf6468239a6a6fcc91606d1ff25e90c2a04e2119d587adc6b803b4d7b9 I0630 10:45:06.292644 1 gather.go:181] gatherer "clusterconfig" function "mutating_webhook_configurations" took 26.506622ms to process 3 records E0630 10:45:06.292653 1 gather.go:144] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0630 10:45:06.292664 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0630 10:45:06.292674 1 gather.go:181] gatherer "clusterconfig" function "machine_configs" took 25.239899ms to process 1 records I0630 10:45:06.292733 1 tasks_processing.go:74] worker 32 stopped. I0630 10:45:06.292746 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=6c3f5dfe80a29ac3d35ed161d0cfb69616f75822839d91b4db9448901023b1cb I0630 10:45:06.292751 1 tasks_processing.go:74] worker 1 stopped. I0630 10:45:06.292790 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=93553382df4adda6831922e38c0818e9c0989bcc2525b1a923cb1279917ab65d I0630 10:45:06.292811 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=ae22e8e0f640069160afd884fa6050432c163a6056427e50f69657964a07e23c I0630 10:45:06.292826 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=09fe7e35048e80d378a25f01602452fad16b9e9733bb777173a9645bdb242901 I0630 10:45:06.292841 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=e1523efe5a0b451645d4d9c64bcd2b48ec3adfdf3862d055f37e5a23dbc39f28 I0630 10:45:06.292858 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=6e29fda1c54fecb8e8cc51fdd62dd93130d2924c6290e60ccdde461898a9c8db I0630 10:45:06.292872 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=6dd73b7c332fdae98f3c6f12b67b2457f3b96173ae562d60293f8ee3944d9912 I0630 10:45:06.292892 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=ab1b3852e21efe45eba1a1972938824b7a68bd5f0f48b2d3d9044d60c2f9dd87 I0630 10:45:06.292906 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=042774e796fe547d0c4b1fe195c37447ba2de45117f850aa4169bdfac0911a56 I0630 10:45:06.292930 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=520cda3ef4ef8cfa2a457303c687a1aa8483665564017a82786b9eaa3e9b2828 I0630 10:45:06.292946 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=40d01118188a03299f4f69c25a42b161ae396a469b7f9af88a066de5c86b235c I0630 10:45:06.292950 1 gather.go:181] gatherer "clusterconfig" function "validating_webhook_configurations" took 27.508049ms to process 11 records I0630 10:45:06.292984 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0630 10:45:06.292991 1 gather.go:181] gatherer "clusterconfig" function "overlapping_namespace_uids" took 26.95077ms to process 1 records I0630 10:45:06.292990 1 tasks_processing.go:74] worker 38 stopped. I0630 10:45:06.293187 1 tasks_processing.go:74] worker 24 stopped. I0630 10:45:06.293249 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=1e4a557dd1b8b3a566e073188bb33242c34e70beb1d5b57c35d7f72f3e3e268b I0630 10:45:06.293266 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=7a47a7703206cf7021a02ce737befd05b2f093da80ea861d4c4710dd1f9c957f I0630 10:45:06.293279 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=0b9582b851ef3fd51af2a6ff3414cc7b2c854b0cbaef4122e28d7c3d7134757b I0630 10:45:06.293286 1 gather.go:181] gatherer "clusterconfig" function "pdbs" took 28.01747ms to process 3 records I0630 10:45:06.296986 1 tasks_processing.go:74] worker 33 stopped. I0630 10:45:06.296999 1 gather.go:181] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 32.671569ms to process 0 records I0630 10:45:06.298550 1 tasks_processing.go:74] worker 57 stopped. I0630 10:45:06.298562 1 gather.go:181] gatherer "clusterconfig" function "node_logs" took 32.731299ms to process 0 records I0630 10:45:06.298670 1 tasks_processing.go:74] worker 34 stopped. I0630 10:45:06.299282 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=479d44f8f62a9a67081df4f77d16eaafe52c6e7bc8dfb49f4402c0bd5c82d481 I0630 10:45:06.299510 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=de3cf029a3c90d4cd729c21ba0782dd2f0a9d3f15e79df0b71e50b3b8aa1b1aa I0630 10:45:06.299522 1 gather.go:181] gatherer "clusterconfig" function "crds" took 33.938158ms to process 2 records I0630 10:45:06.299599 1 tasks_processing.go:74] worker 63 stopped. I0630 10:45:06.299857 1 recorder.go:70] Recording config/node/ip-10-0-150-104.ec2.internal with fingerprint=f75bfdfa717a29574e1d91edc63681f15bb7aa1e8b137116f8a7ef669733be1a I0630 10:45:06.299869 1 gather.go:181] gatherer "clusterconfig" function "nodes" took 33.371263ms to process 1 records I0630 10:45:06.303102 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0630 10:45:06.303100 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s W0630 10:45:06.303218 1 operator.go:288] started I0630 10:45:06.303231 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0630 10:45:06.305762 1 tasks_processing.go:74] worker 29 stopped. I0630 10:45:06.305898 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=0ce8e9e376d46cae07e8b869f86fa80850fb16a4d98bdc45df871ec29357f7c5 I0630 10:45:06.305948 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=8c0f56955beee1dd891c720efb2e7bc60681ec3f049937115c266746d996f57c I0630 10:45:06.305974 1 gather.go:181] gatherer "clusterconfig" function "clusterroles" took 40.081831ms to process 2 records I0630 10:45:06.306747 1 tasks_processing.go:74] worker 39 stopped. I0630 10:45:06.307869 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-m7j6p with fingerprint=753f913c1d7f5a8a1a5227b45a788f6f5917c63dce2fc8161185077f900763e8 I0630 10:45:06.307929 1 recorder.go:70] Recording config/running_containers with fingerprint=022862cc27f627733701650bd2e4f29db82880625a1fb9766bdf689b7e25d88c I0630 10:45:06.307942 1 gather.go:181] gatherer "clusterconfig" function "container_images" took 42.298897ms to process 2 records I0630 10:45:06.313842 1 tasks_processing.go:74] worker 44 stopped. I0630 10:45:06.314283 1 recorder.go:70] Recording config/version with fingerprint=c8e9dd826ecc529e2f896638932760a35a8f5333063956407e81880788a69343 I0630 10:45:06.314300 1 recorder.go:70] Recording config/id with fingerprint=cb4fe337e07e1cf1f043f085e4adc31cb5994c4c96499a192715c4949abff396 I0630 10:45:06.314308 1 gather.go:181] gatherer "clusterconfig" function "version" took 47.52276ms to process 2 records I0630 10:45:06.314345 1 controller.go:203] Source scaController *sca.Controller is not ready I0630 10:45:06.314358 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0630 10:45:06.314361 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0630 10:45:06.314364 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0630 10:45:06.314377 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0630 10:45:06.314403 1 controller.go:457] The operator is still being initialized I0630 10:45:06.314417 1 controller.go:482] The operator is healthy E0630 10:45:06.320503 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%!a(MISSING)ff50cc4-d162-438f-abcc-6ab171eff6bf%!+(MISSING)and+status+is+%!a(MISSING)ccepted%!"(MISSING): dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:51732->172.30.0.10:53: read: connection refused I0630 10:45:06.320521 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27aff50cc4-d162-438f-abcc-6ab171eff6bf%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:51732->172.30.0.10:53: read: connection refused I0630 10:45:06.322740 1 tasks_processing.go:74] worker 11 stopped. I0630 10:45:06.322753 1 gather.go:181] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 57.517436ms to process 0 records I0630 10:45:06.323130 1 prometheus_rules.go:88] Prometheus rules successfully created I0630 10:45:06.327347 1 requests.go:204] Asking for SCA certificate for x86_64 architecture W0630 10:45:06.330161 1 sca.go:117] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:34438->172.30.0.10:53: read: connection refused I0630 10:45:06.330175 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:34438->172.30.0.10:53: read: connection refused I0630 10:45:06.340483 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0630 10:45:06.340495 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0630 10:45:06.340510 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0630 10:45:06.342494 1 base_controller.go:73] Caches are synced for ConfigController I0630 10:45:06.342512 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0630 10:45:06.342605 1 tasks_processing.go:74] worker 54 stopped. E0630 10:45:06.342626 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0630 10:45:06.342640 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0630 10:45:06.342644 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0630 10:45:06.342681 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0630 10:45:06.342696 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=e1a0ad594db3a5d5d50e9e25d7b235af20f84f5def41537f127febe525b834f2 I0630 10:45:06.342701 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0630 10:45:06.342706 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0630 10:45:06.342726 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0630 10:45:06.342734 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0630 10:45:06.342739 1 gather.go:181] gatherer "clusterconfig" function "config_maps" took 77.144734ms to process 6 records I0630 10:45:06.353478 1 configmapobserver.go:84] configmaps "insights-config" not found I0630 10:45:06.403491 1 base_controller.go:73] Caches are synced for LoggingSyncer I0630 10:45:06.403509 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0630 10:45:06.412209 1 tasks_processing.go:74] worker 0 stopped. E0630 10:45:06.412229 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0630 10:45:06.412236 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2r8knhgge1r45c0iern9mlk0pdbejqgi-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2r8knhgge1r45c0iern9mlk0pdbejqgi-primary-cert-bundle-secret" not found I0630 10:45:06.412303 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=3e0df5e6158617a9f60edb993f5c0fb79aee0659e11530a91db6176d3f3bdb07 I0630 10:45:06.412317 1 gather.go:181] gatherer "clusterconfig" function "ingress_certificates" took 148.102807ms to process 1 records I0630 10:45:06.540937 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0630 10:45:06.707558 1 gather_cluster_operator_pods_and_events.go:121] Found 10 pods with 11 containers I0630 10:45:06.707572 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 2287802 bytes I0630 10:45:06.707653 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-75zc7 pod in namespace openshift-dns (previous: false). I0630 10:45:06.732783 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0630 10:45:06.930218 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-75zc7 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-75zc7\" is waiting to start: ContainerCreating" I0630 10:45:06.930238 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-75zc7\" is waiting to start: ContainerCreating" I0630 10:45:06.930245 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-75zc7 pod in namespace openshift-dns (previous: false). I0630 10:45:07.110809 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-75zc7 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-75zc7\" is waiting to start: ContainerCreating" I0630 10:45:07.110832 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-75zc7\" is waiting to start: ContainerCreating" I0630 10:45:07.110841 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-vkhzp pod in namespace openshift-dns (previous: false). W0630 10:45:07.291787 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0630 10:45:07.311323 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0630 10:45:07.311342 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-796f86cf68-jmm4r pod in namespace openshift-image-registry (previous: false). I0630 10:45:07.512417 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-796f86cf68-jmm4r pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-796f86cf68-jmm4r\" is waiting to start: ContainerCreating" I0630 10:45:07.512435 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-796f86cf68-jmm4r\" is waiting to start: ContainerCreating" I0630 10:45:07.512445 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-796f86cf68-rjcr7 pod in namespace openshift-image-registry (previous: false). I0630 10:45:07.535455 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0630 10:45:07.709222 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0630 10:45:07.709244 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-d4d55d79f-78dfk pod in namespace openshift-image-registry (previous: false). I0630 10:45:07.906631 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0630 10:45:07.906649 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-mq78n pod in namespace openshift-image-registry (previous: false). I0630 10:45:07.936489 1 tasks_processing.go:74] worker 8 stopped. I0630 10:45:07.936536 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=d425008295fd5aa9c373c2adf9cd0fe656f600103d9b4af79aaad93945d23a14 I0630 10:45:07.936558 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=547ca29df858de6d1c24dc7547de5d3ef6cf3098439aff085c6bcd65fc386978 I0630 10:45:07.936593 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0630 10:45:07.936613 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=758639c9504754f5dcceb5f7586ef765cde466e01bcd133ee3594ef3b8ef7cf3 I0630 10:45:07.936632 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0630 10:45:07.936651 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=d100b4260d6cadd87a310ea90b319cdec52615541fec9afd0065c49e755c63d3 I0630 10:45:07.936677 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=b287aa6c304f9549e38206f1ce1f87011e65c7285e044e53084c519c5ae14967 I0630 10:45:07.936704 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=f689c7f682bc5c6b286a40af308a012c4fa744ef4f5171b451f7ba64ae0c8a44 I0630 10:45:07.936716 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=9e69bed9374621c814c27cfc9325eadff6ff3eb164d0985f865ca9d6590c55cf I0630 10:45:07.936726 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=264d62f14fe074657a6a2f660dcc88e1c915683b22638225ac422dd3aa86c789 I0630 10:45:07.936738 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0630 10:45:07.936751 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=f4d6eb1a4b8c3a642df2bdf44dfb9f5bf7e3f2e72507405590baf761b943f682 I0630 10:45:07.936760 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0630 10:45:07.936773 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=34bc8d2e5a6bd6b273e72c2f387f05b52258cc30baae523843300322e8165372 I0630 10:45:07.936786 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0630 10:45:07.936795 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=6771c79fba77bbce60a8d0b92cf0a358940242e03fcaade3b75548809daa8f0c I0630 10:45:07.936803 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0630 10:45:07.936813 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=a71a597025ed891905d17dfd720f58c2734e223a14acbc4ebd6d1a593d2ad7b8 I0630 10:45:07.936882 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=96c7707dfdbf31d2b59adeab708b600731fbbd484c2a13f43be3da44ccc3a53f I0630 10:45:07.936902 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0630 10:45:07.936917 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=0d6985bf0c67db5484b5fe63ae33afb3ea982e9d1e1cb56eb3d9d3671730ede4 I0630 10:45:07.936936 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=6dfb7aa2778a6336575ca1da5c5ed605dbfbc603e1bf523d16afb9b3d53759dd I0630 10:45:07.936944 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0630 10:45:07.936955 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=58a143ae142feadbb0306323086b3083ae4181dcee7e9811f4937e6e9f2ac090 I0630 10:45:07.936978 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0630 10:45:07.936988 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=cf47afcb74d257ef13955fb11f165f5c3da6bcfd23633071f7dbb7b3bc5ab9d0 I0630 10:45:07.936997 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=27b5e4f042011e7ef22abcf6af63690ca2226b7b46f19ac2cb456989d951d7ff I0630 10:45:07.937005 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=c72c68a4a2b1ccb4726bb8e347f9f5b2b288896253e3b76b9aec1b7102633df7 I0630 10:45:07.937013 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=3f70876fda5037228a2ab0ef8b5a90dcc93385430a1d451799ef5eafdc9f5ec4 I0630 10:45:07.937020 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=71a4f714e0b481573b1e8e70883b8eb5d660447927866b5a9b1b2a66e2d3c2f4 I0630 10:45:07.937033 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=ef8dd1ce3db0e08be11b359559928400d67292c138ac87ba1690f20ecd95e425 I0630 10:45:07.937045 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0630 10:45:07.937050 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0630 10:45:07.937056 1 gather.go:181] gatherer "clusterconfig" function "operators" took 1.671219384s to process 33 records I0630 10:45:08.112784 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0630 10:45:08.112805 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6bdbf54fdc-6dgst pod in namespace openshift-ingress (previous: false). W0630 10:45:08.291935 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0630 10:45:08.311232 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6bdbf54fdc-6dgst pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6bdbf54fdc-6dgst\" is waiting to start: ContainerCreating" I0630 10:45:08.311251 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6bdbf54fdc-6dgst\" is waiting to start: ContainerCreating" I0630 10:45:08.311261 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6bdbf54fdc-h84z2 pod in namespace openshift-ingress (previous: false). I0630 10:45:08.507220 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0630 10:45:08.507243 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-89f4f88ff-hkzk5 pod in namespace openshift-ingress (previous: false). I0630 10:45:08.711558 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-89f4f88ff-hkzk5 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-89f4f88ff-hkzk5\" is waiting to start: ContainerCreating" I0630 10:45:08.711576 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-89f4f88ff-hkzk5\" is waiting to start: ContainerCreating" I0630 10:45:08.711591 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-m5htp pod in namespace openshift-ingress-canary (previous: false). I0630 10:45:08.925537 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-m5htp pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-m5htp\" is waiting to start: ContainerCreating" I0630 10:45:08.925568 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-m5htp\" is waiting to start: ContainerCreating" I0630 10:45:08.925582 1 tasks_processing.go:74] worker 9 stopped. I0630 10:45:08.925651 1 recorder.go:70] Recording events/openshift-dns with fingerprint=09b4c4be10aad37316bac4f33ddc5b18e0fe7d1f95f4ce5d89f3a95d2d4f13c1 I0630 10:45:08.925693 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=83ed9ee64b5264d246efc6ab3d3d4cee4e7c8a20b9a8f3cedbd5f4613c32959a I0630 10:45:08.925716 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=ff814aaa8ee1fbe6b95ac27a4106b45a95505eec530d4936f0985ff289aac4cf I0630 10:45:08.925745 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=90c63093ee335d52a6f4f6991bf49cf681c4d2cb3791a93714f9ebcd252f57d9 I0630 10:45:08.925753 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=1dfa8909e782a9f3733bf19a08b3e8bd6827b3700c8976903950b8dcd901d30c I0630 10:45:08.925759 1 gather.go:181] gatherer "clusterconfig" function "operators_pods_and_events" took 2.660423145s to process 5 records W0630 10:45:09.291372 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0630 10:45:10.290876 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0630 10:45:11.290335 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0630 10:45:11.290369 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0630 10:45:11.290390 1 tasks_processing.go:74] worker 62 stopped. E0630 10:45:11.290397 1 gather.go:144] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0630 10:45:11.290406 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0630 10:45:11.290419 1 gather.go:159] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0630 10:45:11.290431 1 gather.go:181] gatherer "clusterconfig" function "dvo_metrics" took 5.024171774s to process 1 records I0630 10:45:18.893421 1 tasks_processing.go:74] worker 58 stopped. I0630 10:45:18.893451 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0630 10:45:18.893462 1 gather.go:181] gatherer "clusterconfig" function "install_plans" took 12.62896251s to process 1 records I0630 10:45:19.671394 1 tasks_processing.go:74] worker 51 stopped. I0630 10:45:19.671605 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=2662ff818c2c89fcf82005c4249f483bfd40a1685ff4c57704a4800ad8843164 I0630 10:45:19.671620 1 gather.go:181] gatherer "clusterconfig" function "service_accounts" took 13.407008769s to process 1 records E0630 10:45:19.671671 1 periodic.go:252] clusterconfig failed after 13.407s with: function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0630 10:45:19.671683 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0630 10:45:19.671689 1 periodic.go:214] Running workloads gatherer I0630 10:45:19.671700 1 tasks_processing.go:45] number of workers: 2 I0630 10:45:19.671710 1 tasks_processing.go:69] worker 1 listening for tasks. I0630 10:45:19.671713 1 tasks_processing.go:71] worker 1 working on workload_info task. I0630 10:45:19.671725 1 tasks_processing.go:69] worker 0 listening for tasks. I0630 10:45:19.671804 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0630 10:45:19.685073 1 gather_workloads_info.go:281] Loaded pods in 0s, will wait 19s for image data I0630 10:45:19.693429 1 gather_workloads_info.go:390] No image sha256:351ca92471647f383f3cd7f0b70f33f5fa11c39ab569c4948dff7d471a6c8be3 (9ms) I0630 10:45:19.700443 1 tasks_processing.go:74] worker 0 stopped. I0630 10:45:19.700455 1 gather.go:181] gatherer "workloads" function "helmchart_info" took 28.62679ms to process 0 records I0630 10:45:19.701265 1 gather_workloads_info.go:390] No image sha256:5bcfb1b739fa4e6ff9e21e4843f8520f29608135341f7d8dcc31084b9ba25f1d (8ms) I0630 10:45:19.708728 1 gather_workloads_info.go:390] No image sha256:3fea7db586d3236c1876a8b523af0d8d65c84d6f6cf5d0f4e41cafcffe6db5b5 (7ms) I0630 10:45:19.716560 1 gather_workloads_info.go:390] No image sha256:3a2c82b772ea6072e1eca0efc5303f002189e80b0e985fb3e3b8ea9a12fe8060 (8ms) I0630 10:45:19.724493 1 gather_workloads_info.go:390] No image sha256:0c1abef76d6d2832ddcff31e950ffafeb4e0f6fad80a5f5dca94591de0fc9581 (8ms) I0630 10:45:19.731819 1 gather_workloads_info.go:390] No image sha256:02283a64c1936a5dd09d5c6bc0ecbcf9196fe4df6a4055c8be22cebd850aa7a3 (7ms) I0630 10:45:19.739268 1 gather_workloads_info.go:390] No image sha256:1eee856bde9bad71c4444c494225a0cf02d1f4a5293acf0bd6e7e1814efa0064 (7ms) I0630 10:45:19.746656 1 gather_workloads_info.go:390] No image sha256:80fdd5049bd2815e49c198a795a116976a852e8de630be74872439ba6c08758a (7ms) I0630 10:45:19.753741 1 gather_workloads_info.go:390] No image sha256:6a9b4fd887fa7f1729302fb0330c3c9a483197bf78becdcfda4235ec823a2c39 (7ms) I0630 10:45:19.761542 1 gather_workloads_info.go:390] No image sha256:8562a483f4568254250f19fc68d79f88c94a48508aefe59a70c1021a3aad000a (8ms) I0630 10:45:19.794358 1 gather_workloads_info.go:390] No image sha256:0c6b7f828184b16a5e6630111e0715e11d34dae9b0bf64619466543e6168e05c (33ms) I0630 10:45:19.895113 1 gather_workloads_info.go:390] No image sha256:38787de16ee8c686305f93b501d891b50cde24136009863869d230c0d4eeee5c (101ms) I0630 10:45:19.994077 1 gather_workloads_info.go:390] No image sha256:d09ac899f3001937771c6cadd50802a983e7c833fa2e0bde1958e134458c76ae (99ms) I0630 10:45:20.094225 1 gather_workloads_info.go:390] No image sha256:751bd7eb62f632c0eef0ca91b6c57c64d4f1279d4dbe1a9b875ac4020a7b693f (100ms) I0630 10:45:20.116913 1 configmapobserver.go:84] configmaps "insights-config" not found I0630 10:45:20.193848 1 gather_workloads_info.go:390] No image sha256:4dcdadc14b7bdb2c00954d92e957d63aafbbe5f4047fe028e575d65725923cb0 (100ms) I0630 10:45:20.295700 1 gather_workloads_info.go:390] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (102ms) I0630 10:45:20.320453 1 configmapobserver.go:84] configmaps "insights-config" not found I0630 10:45:20.397037 1 gather_workloads_info.go:390] No image sha256:1c7c24111f1709d7648156873ced09462638aa4b3cf7e7aee13297e51bcdfb3e (101ms) I0630 10:45:20.498413 1 gather_workloads_info.go:390] No image sha256:894452e6587de55d04e37163d3da53e11fced8fb08bd0acf61e6d49f7964284e (101ms) I0630 10:45:20.595593 1 gather_workloads_info.go:390] No image sha256:0242cefbf0bb876101c4d67ab4e07401cb0ba6c02be2b73a4f17ba33b2960005 (97ms) I0630 10:45:20.695850 1 gather_workloads_info.go:390] No image sha256:c7aa910ca06f8fd89cdf2519136e0f3533bdacfc6bd58a3f6683f9f08756c7b1 (100ms) I0630 10:45:20.795614 1 gather_workloads_info.go:390] No image sha256:13aabbaf260d634ff0e9ac1af88af075b5ba671fd51313e33e74d7d2f7e54128 (100ms) I0630 10:45:20.894791 1 gather_workloads_info.go:390] No image sha256:48dff3fcb0da58eb9b2b500f89af8b7d0790ffa60da0b0e301feca971dbafcbb (99ms) I0630 10:45:20.994003 1 gather_workloads_info.go:390] No image sha256:4b9b7949d209e257a76053de4ac74193f747c0d42e25dcd270d655849a4e51aa (99ms) I0630 10:45:21.096094 1 gather_workloads_info.go:390] No image sha256:a7fc4d05c4a3c82c9f355ca985d6fd26033c0d6a98716f25fcd2f54bae1d2fa0 (102ms) I0630 10:45:21.194708 1 gather_workloads_info.go:390] No image sha256:ed0c9631d6e424912cd8ce78ca7a2c4f76b3fc15e9e34fe00999170ccf19a611 (99ms) I0630 10:45:21.294618 1 gather_workloads_info.go:390] No image sha256:41029e57ece558b2e0b12174ce924647fd9d5c5d83aadf4bba03d6916d3f9f54 (100ms) I0630 10:45:21.395988 1 gather_workloads_info.go:390] No image sha256:30ff5e5b72f274598704ca69f1832eba1040cc25da47386004fd59500b6e4c55 (101ms) I0630 10:45:21.494580 1 gather_workloads_info.go:390] No image sha256:0158b297aec0a66376c04d3c7cf4828db5e5d9f424e331ff7c7b796828036875 (99ms) I0630 10:45:21.595073 1 gather_workloads_info.go:390] No image sha256:42b4c6bdf3081ec264bc5edbc4eb779151de9e4742d6fe59a316645891df649c (100ms) I0630 10:45:21.595101 1 tasks_processing.go:74] worker 1 stopped. I0630 10:45:21.595337 1 recorder.go:70] Recording config/workload_info with fingerprint=babdf8ecf4f5d7a8d384751139208cbc0cb9c0690404e94891f4fb8bd656872f I0630 10:45:21.595356 1 gather.go:181] gatherer "workloads" function "workload_info" took 1.923381655s to process 1 records I0630 10:45:21.595367 1 periodic.go:261] Periodic gather workloads completed in 1.923s I0630 10:45:21.595374 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0630 10:45:21.595378 1 periodic.go:214] Running conditional gatherer I0630 10:45:21.604044 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules I0630 10:45:21.608740 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:42640->172.30.0.10:53: read: connection refused E0630 10:45:21.608985 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0630 10:45:21.609035 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0630 10:45:21.617736 1 conditional_gatherer.go:390] cluster version is '4.18.9' E0630 10:45:21.617748 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0630 10:45:21.617753 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0630 10:45:21.617755 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0630 10:45:21.617758 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0630 10:45:21.617761 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0630 10:45:21.617763 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0630 10:45:21.617765 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0630 10:45:21.617768 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0630 10:45:21.617769 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0630 10:45:21.617784 1 tasks_processing.go:45] number of workers: 3 I0630 10:45:21.617793 1 tasks_processing.go:69] worker 2 listening for tasks. I0630 10:45:21.617796 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0630 10:45:21.617798 1 tasks_processing.go:69] worker 0 listening for tasks. I0630 10:45:21.617805 1 tasks_processing.go:69] worker 1 listening for tasks. I0630 10:45:21.617819 1 tasks_processing.go:74] worker 1 stopped. I0630 10:45:21.617830 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0630 10:45:21.617837 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0630 10:45:21.617867 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0630 10:45:21.617878 1 gather.go:181] gatherer "conditional" function "conditional_gatherer_rules" took 1.117µs to process 1 records I0630 10:45:21.617902 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0630 10:45:21.617909 1 gather.go:181] gatherer "conditional" function "remote_configuration" took 1.148µs to process 1 records I0630 10:45:21.617914 1 tasks_processing.go:74] worker 0 stopped. I0630 10:45:21.618049 1 tasks_processing.go:74] worker 2 stopped. I0630 10:45:21.618061 1 gather.go:181] gatherer "conditional" function "rapid_container_logs" took 197.386µs to process 0 records I0630 10:45:21.618079 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:42640->172.30.0.10:53: read: connection refused I0630 10:45:21.618092 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 W0630 10:45:21.641487 1 gather.go:213] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0630 10:45:21.641607 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=9cde2066e5248bafe0b79fc8265e66f2b48d24bb3ce0bb81158a064c15da12ea I0630 10:45:21.641713 1 diskrecorder.go:70] Writing 94 records to /var/lib/insights-operator/insights-2026-06-30-104521.tar.gz I0630 10:45:21.646758 1 diskrecorder.go:51] Wrote 94 records to disk in 5ms I0630 10:45:21.646782 1 periodic.go:283] Gathering cluster info every 2h0m0s I0630 10:45:21.646796 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0630 10:45:28.594333 1 configmapobserver.go:84] configmaps "insights-config" not found I0630 10:46:36.020404 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="deb31ea50a065263fdd3b848956c790715cc623dc0a2db89029b309c7724a9c8") W0630 10:46:36.020459 1 builder.go:154] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0630 10:46:36.020487 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="58b082fb50a976647dfcfdba2cc08a923fac54bdd69436664f2289d3affcdbfd") I0630 10:46:36.020538 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="296d1e290ceab87d47a7939fd0515392709aff5576d281b77ebedab77bfd81df") I0630 10:46:36.020559 1 base_controller.go:172] Shutting down LoggingSyncer ... I0630 10:46:36.020557 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0630 10:46:36.020574 1 base_controller.go:172] Shutting down ConfigController ... I0630 10:46:36.020610 1 genericapiserver.go:670] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0630 10:46:36.020648 1 genericapiserver.go:527] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0630 10:46:36.020664 1 base_controller.go:114] Shutting down worker of ConfigController controller ... I0630 10:46:36.020668 1 periodic.go:175] Shutting down I0630 10:46:36.020658 1 base_controller.go:114] Shutting down worker of LoggingSyncer controller ... I0630 10:46:36.020673 1 base_controller.go:104] All ConfigController workers have been terminated I0630 10:46:36.020679 1 base_controller.go:104] All LoggingSyncer workers have been terminated E0630 10:46:36.020684 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled I0630 10:46:36.020693 1 genericapiserver.go:628] "[graceful-termination] not going to wait for active watch request(s) to drain" I0630 10:46:36.020707 1 requestheader_controller.go:183] Shutting down RequestHeaderAuthRequestController