W0629 14:20:54.100705 1 cmd.go:254] Using insecure, self-signed certificates I0629 14:20:54.428718 1 start.go:223] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 14:20:54.428926 1 observer_polling.go:159] Starting file observer W0629 14:20:54.452124 1 builder.go:266] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-6fd96f47fd" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0629 14:20:54.902305 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0629 14:20:54.902508 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0629 14:20:54.902871 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0629 14:20:54.902914 1 secure_serving.go:57] Forcing use of http/1.1 only W0629 14:20:54.902931 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0629 14:20:54.902934 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0629 14:20:54.902937 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0629 14:20:54.902939 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0629 14:20:54.902941 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0629 14:20:54.902943 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0629 14:20:54.906179 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes ChunkSizeMiB CloudDualStackNodeIPs DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy PersistentIPsForVirtualization PrivateHostedZoneAWS SetEIPForNLBIngressController VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy AWSClusterHostedDNS AdditionalRoutingCapabilities AutomatedEtcdBackup BootcNodeManagement CSIDriverSharedResource ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ConsolePluginContentSecurityPolicy DNSNameResolver DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example GCPClusterHostedDNS GatewayAPI ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MetricsCollectionProfiles MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NodeSwap NutanixMultiSubnets OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0629 14:20:54.906196 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ConsolePluginContentSecurityPolicy", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0629 14:20:54.908159 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0629 14:20:54.908170 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0629 14:20:54.908173 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0629 14:20:54.908183 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0629 14:20:54.908192 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0629 14:20:54.908185 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0629 14:20:54.908390 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/tmp/serving-cert-3225310789/tls.crt::/tmp/serving-cert-3225310789/tls.key" I0629 14:20:54.908506 1 secure_serving.go:213] Serving securely on [::]:8443 I0629 14:20:54.908571 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" E0629 14:20:54.908913 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18bd932e608bad49 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"SetEIPForNLBIngressController\", \"VSphereControlPlaneMachineSet\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"VSphereStaticIPs\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AdditionalRoutingCapabilities\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"CSIDriverSharedResource\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ConsolePluginContentSecurityPolicy\", \"DNSNameResolver\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"GCPClusterHostedDNS\", \"GatewayAPI\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MetricsCollectionProfiles\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OnClusterBuild\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SignatureStores\", \"SigstoreImageVerification\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-06-29 14:20:54.906129737 +0000 UTC m=+0.836227612,LastTimestamp:2026-06-29 14:20:54.906129737 +0000 UTC m=+0.836227612,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0629 14:20:54.912070 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0629 14:20:54.912088 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0629 14:20:54.912179 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0629 14:20:54.916701 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 14:20:54.916720 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0629 14:20:54.921901 1 secretconfigobserver.go:119] support secret does not exist I0629 14:20:54.927333 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0629 14:20:54.927405 1 recorder.go:156] Pruning old reports every 7h42m20s, max age is 288h0m0s I0629 14:20:54.931284 1 secretconfigobserver.go:119] support secret does not exist I0629 14:20:54.932387 1 periodic.go:214] Running clusterconfig gatherer I0629 14:20:54.932399 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0629 14:20:54.932408 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0629 14:20:54.932411 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0629 14:20:54.932415 1 insightsreport.go:296] Starting report retriever I0629 14:20:54.932421 1 tasks_processing.go:45] number of workers: 64 I0629 14:20:54.932421 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0629 14:20:54.932441 1 tasks_processing.go:69] worker 0 listening for tasks. I0629 14:20:54.932441 1 tasks_processing.go:69] worker 2 listening for tasks. I0629 14:20:54.932443 1 tasks_processing.go:69] worker 1 listening for tasks. I0629 14:20:54.932448 1 tasks_processing.go:69] worker 15 listening for tasks. I0629 14:20:54.932452 1 tasks_processing.go:69] worker 28 listening for tasks. I0629 14:20:54.932453 1 tasks_processing.go:69] worker 8 listening for tasks. I0629 14:20:54.932458 1 tasks_processing.go:69] worker 9 listening for tasks. I0629 14:20:54.932459 1 tasks_processing.go:69] worker 3 listening for tasks. I0629 14:20:54.932461 1 tasks_processing.go:71] worker 9 working on pod_network_connectivity_checks task. I0629 14:20:54.932461 1 tasks_processing.go:69] worker 11 listening for tasks. I0629 14:20:54.932465 1 tasks_processing.go:69] worker 14 listening for tasks. I0629 14:20:54.932467 1 tasks_processing.go:69] worker 17 listening for tasks. I0629 14:20:54.932467 1 tasks_processing.go:69] worker 43 listening for tasks. I0629 14:20:54.932456 1 tasks_processing.go:69] worker 12 listening for tasks. I0629 14:20:54.932471 1 tasks_processing.go:69] worker 10 listening for tasks. I0629 14:20:54.932473 1 tasks_processing.go:69] worker 18 listening for tasks. I0629 14:20:54.932462 1 tasks_processing.go:69] worker 16 listening for tasks. I0629 14:20:54.932474 1 tasks_processing.go:69] worker 5 listening for tasks. I0629 14:20:54.932478 1 tasks_processing.go:69] worker 19 listening for tasks. I0629 14:20:54.932479 1 tasks_processing.go:71] worker 16 working on tsdb_status task. I0629 14:20:54.932481 1 tasks_processing.go:71] worker 3 working on olm_operators task. I0629 14:20:54.932483 1 tasks_processing.go:69] worker 7 listening for tasks. I0629 14:20:54.932484 1 tasks_processing.go:69] worker 20 listening for tasks. I0629 14:20:54.932485 1 tasks_processing.go:69] worker 46 listening for tasks. I0629 14:20:54.932481 1 tasks_processing.go:69] worker 29 listening for tasks. I0629 14:20:54.932490 1 tasks_processing.go:71] worker 17 working on machine_autoscalers task. I0629 14:20:54.932493 1 tasks_processing.go:69] worker 22 listening for tasks. I0629 14:20:54.932495 1 tasks_processing.go:69] worker 47 listening for tasks. I0629 14:20:54.932498 1 tasks_processing.go:69] worker 23 listening for tasks. I0629 14:20:54.932492 1 tasks_processing.go:69] worker 6 listening for tasks. I0629 14:20:54.932503 1 tasks_processing.go:69] worker 24 listening for tasks. I0629 14:20:54.932505 1 tasks_processing.go:69] worker 32 listening for tasks. I0629 14:20:54.932508 1 tasks_processing.go:69] worker 25 listening for tasks. I0629 14:20:54.932508 1 tasks_processing.go:71] worker 6 working on container_runtime_configs task. I0629 14:20:54.932511 1 tasks_processing.go:71] worker 5 working on ingress_certificates task. I0629 14:20:54.932514 1 tasks_processing.go:69] worker 26 listening for tasks. I0629 14:20:54.932515 1 tasks_processing.go:69] worker 50 listening for tasks. I0629 14:20:54.932515 1 tasks_processing.go:69] worker 33 listening for tasks. I0629 14:20:54.932518 1 tasks_processing.go:69] worker 27 listening for tasks. I0629 14:20:54.932513 1 tasks_processing.go:71] worker 14 working on nodenetworkstates task. I0629 14:20:54.932522 1 tasks_processing.go:69] worker 34 listening for tasks. I0629 14:20:54.932524 1 tasks_processing.go:69] worker 51 listening for tasks. I0629 14:20:54.932478 1 tasks_processing.go:71] worker 18 working on networks task. I0629 14:20:54.932529 1 tasks_processing.go:71] worker 2 working on ceph_cluster task. I0629 14:20:54.932532 1 tasks_processing.go:69] worker 53 listening for tasks. I0629 14:20:54.932531 1 tasks_processing.go:71] worker 0 working on machine_healthchecks task. I0629 14:20:54.932539 1 tasks_processing.go:69] worker 54 listening for tasks. I0629 14:20:54.932544 1 tasks_processing.go:69] worker 58 listening for tasks. I0629 14:20:54.932551 1 tasks_processing.go:69] worker 59 listening for tasks. I0629 14:20:54.932497 1 tasks_processing.go:71] worker 11 working on config_maps task. I0629 14:20:54.932560 1 tasks_processing.go:71] worker 43 working on operators task. I0629 14:20:54.932472 1 tasks_processing.go:69] worker 42 listening for tasks. I0629 14:20:54.932568 1 tasks_processing.go:71] worker 42 working on container_images task. I0629 14:20:54.932577 1 tasks_processing.go:69] worker 56 listening for tasks. I0629 14:20:54.932573 1 tasks_processing.go:71] worker 59 working on silenced_alerts task. I0629 14:20:54.932580 1 tasks_processing.go:71] worker 15 working on aggregated_monitoring_cr_names task. I0629 14:20:54.932590 1 tasks_processing.go:71] worker 19 working on mutating_webhook_configurations task. I0629 14:20:54.932596 1 tasks_processing.go:71] worker 10 working on service_accounts task. W0629 14:20:54.932604 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 14:20:54.932643 1 tasks_processing.go:71] worker 28 working on proxies task. I0629 14:20:54.932675 1 tasks_processing.go:71] worker 50 working on sap_datahubs task. I0629 14:20:54.932696 1 tasks_processing.go:71] worker 34 working on crds task. I0629 14:20:54.932586 1 tasks_processing.go:71] worker 46 working on machine_sets task. I0629 14:20:54.932479 1 tasks_processing.go:69] worker 45 listening for tasks. I0629 14:20:54.932754 1 tasks_processing.go:71] worker 45 working on oauths task. I0629 14:20:54.932676 1 tasks_processing.go:71] worker 59 working on sap_pods task. I0629 14:20:54.932570 1 tasks_processing.go:69] worker 55 listening for tasks. I0629 14:20:54.932501 1 tasks_processing.go:69] worker 48 listening for tasks. I0629 14:20:54.932506 1 tasks_processing.go:69] worker 49 listening for tasks. I0629 14:20:54.932506 1 tasks_processing.go:71] worker 23 working on lokistack task. I0629 14:20:54.932556 1 tasks_processing.go:71] worker 12 working on version task. I0629 14:20:54.932460 1 tasks_processing.go:69] worker 13 listening for tasks. I0629 14:20:54.932851 1 tasks_processing.go:71] worker 55 working on clusterroles task. I0629 14:20:54.932498 1 tasks_processing.go:69] worker 31 listening for tasks. I0629 14:20:54.932854 1 tasks_processing.go:71] worker 48 working on cluster_apiserver task. I0629 14:20:54.932860 1 tasks_processing.go:71] worker 31 working on support_secret task. I0629 14:20:54.932524 1 tasks_processing.go:69] worker 60 listening for tasks. I0629 14:20:54.932468 1 tasks_processing.go:69] worker 4 listening for tasks. I0629 14:20:54.932910 1 tasks_processing.go:71] worker 60 working on certificate_signing_requests task. I0629 14:20:54.932629 1 tasks_processing.go:69] worker 40 listening for tasks. I0629 14:20:54.932632 1 tasks_processing.go:69] worker 38 listening for tasks. I0629 14:20:54.932636 1 tasks_processing.go:69] worker 39 listening for tasks. I0629 14:20:54.932646 1 tasks_processing.go:69] worker 35 listening for tasks. I0629 14:20:54.932654 1 tasks_processing.go:69] worker 36 listening for tasks. I0629 14:20:54.932655 1 gather.go:181] gatherer "clusterconfig" function "silenced_alerts" took 62.615µs to process 0 records I0629 14:20:54.932660 1 tasks_processing.go:71] worker 24 working on storage_cluster task. I0629 14:20:54.932660 1 tasks_processing.go:69] worker 37 listening for tasks. I0629 14:20:54.932461 1 tasks_processing.go:71] worker 8 working on overlapping_namespace_uids task. I0629 14:20:54.932664 1 tasks_processing.go:71] worker 32 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0629 14:20:54.932668 1 tasks_processing.go:71] worker 25 working on openstack_dataplanenodesets task. I0629 14:20:54.932995 1 tasks_processing.go:71] worker 37 working on image_registries task. I0629 14:20:54.933007 1 tasks_processing.go:71] worker 38 working on image_pruners task. I0629 14:20:54.933016 1 tasks_processing.go:71] worker 36 working on storage_classes task. I0629 14:20:54.933017 1 tasks_processing.go:71] worker 39 working on openstack_controlplanes task. I0629 14:20:54.933018 1 tasks_processing.go:71] worker 4 working on nodes task. I0629 14:20:54.933022 1 tasks_processing.go:71] worker 35 working on validating_webhook_configurations task. I0629 14:20:54.933071 1 tasks_processing.go:71] worker 40 working on dvo_metrics task. I0629 14:20:54.932668 1 tasks_processing.go:71] worker 1 working on metrics task. W0629 14:20:54.933104 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 14:20:54.932677 1 tasks_processing.go:69] worker 41 listening for tasks. I0629 14:20:54.933115 1 tasks_processing.go:71] worker 1 working on machine_config_pools task. I0629 14:20:54.932475 1 tasks_processing.go:69] worker 44 listening for tasks. I0629 14:20:54.932672 1 tasks_processing.go:71] worker 7 working on machine_configs task. I0629 14:20:54.933123 1 gather.go:181] gatherer "clusterconfig" function "metrics" took 22.873µs to process 0 records I0629 14:20:54.932672 1 tasks_processing.go:71] worker 26 working on openshift_logging task. I0629 14:20:54.932680 1 tasks_processing.go:71] worker 56 working on nodenetworkconfigurationpolicies task. I0629 14:20:54.933227 1 tasks_processing.go:71] worker 41 working on feature_gates task. I0629 14:20:54.932688 1 tasks_processing.go:71] worker 33 working on monitoring_persistent_volumes task. I0629 14:20:54.932684 1 tasks_processing.go:71] worker 51 working on pdbs task. I0629 14:20:54.932687 1 tasks_processing.go:69] worker 62 listening for tasks. I0629 14:20:54.933419 1 tasks_processing.go:71] worker 62 working on schedulers task. I0629 14:20:54.932690 1 tasks_processing.go:69] worker 61 listening for tasks. I0629 14:20:54.932692 1 tasks_processing.go:71] worker 27 working on openstack_dataplanedeployments task. I0629 14:20:54.933483 1 tasks_processing.go:71] worker 61 working on image task. I0629 14:20:54.932697 1 tasks_processing.go:71] worker 22 working on jaegers task. I0629 14:20:54.932696 1 tasks_processing.go:71] worker 20 working on openshift_machine_api_events task. I0629 14:20:54.932699 1 tasks_processing.go:69] worker 63 listening for tasks. I0629 14:20:54.933547 1 tasks_processing.go:71] worker 63 working on active_alerts task. I0629 14:20:54.932701 1 tasks_processing.go:71] worker 29 working on openstack_version task. W0629 14:20:54.933570 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 14:20:54.933581 1 tasks_processing.go:71] worker 63 working on authentication task. I0629 14:20:54.933591 1 gather.go:181] gatherer "clusterconfig" function "active_alerts" took 24.192µs to process 0 records I0629 14:20:54.932702 1 tasks_processing.go:71] worker 54 working on install_plans task. I0629 14:20:54.932708 1 tasks_processing.go:71] worker 47 working on infrastructures task. I0629 14:20:54.932707 1 tasks_processing.go:71] worker 53 working on cost_management_metrics_configs task. I0629 14:20:54.932490 1 tasks_processing.go:69] worker 30 listening for tasks. I0629 14:20:54.933828 1 tasks_processing.go:71] worker 30 working on ingress task. I0629 14:20:54.932706 1 tasks_processing.go:71] worker 58 working on sap_config task. I0629 14:20:54.932848 1 tasks_processing.go:71] worker 49 working on operators_pods_and_events task. I0629 14:20:54.932853 1 tasks_processing.go:71] worker 13 working on node_logs task. I0629 14:20:54.932528 1 tasks_processing.go:69] worker 52 listening for tasks. I0629 14:20:54.932489 1 tasks_processing.go:69] worker 21 listening for tasks. I0629 14:20:54.934280 1 tasks_processing.go:74] worker 52 stopped. I0629 14:20:54.934294 1 tasks_processing.go:74] worker 21 stopped. W0629 14:20:54.932500 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 14:20:54.934304 1 tasks_processing.go:74] worker 16 stopped. I0629 14:20:54.934311 1 gather.go:181] gatherer "clusterconfig" function "tsdb_status" took 1.819183ms to process 0 records I0629 14:20:54.932557 1 tasks_processing.go:69] worker 57 listening for tasks. I0629 14:20:54.934325 1 tasks_processing.go:74] worker 57 stopped. I0629 14:20:54.933226 1 tasks_processing.go:71] worker 44 working on machines task. I0629 14:20:54.938662 1 tasks_processing.go:74] worker 59 stopped. I0629 14:20:54.938671 1 gather.go:181] gatherer "clusterconfig" function "sap_pods" took 5.880093ms to process 0 records I0629 14:20:54.938682 1 gather.go:181] gatherer "clusterconfig" function "ceph_cluster" took 6.125013ms to process 0 records I0629 14:20:54.938687 1 tasks_processing.go:74] worker 2 stopped. I0629 14:20:54.938722 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0629 14:20:54.938736 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0629 14:20:54.938739 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0629 14:20:54.938742 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0629 14:20:54.938754 1 controller.go:457] The operator is still being initialized I0629 14:20:54.938760 1 controller.go:482] The operator is healthy I0629 14:20:54.945752 1 tasks_processing.go:74] worker 17 stopped. I0629 14:20:54.945764 1 gather.go:181] gatherer "clusterconfig" function "machine_autoscalers" took 13.254646ms to process 0 records I0629 14:20:54.945770 1 gather.go:181] gatherer "clusterconfig" function "storage_cluster" took 12.833498ms to process 0 records I0629 14:20:54.945774 1 tasks_processing.go:74] worker 24 stopped. I0629 14:20:54.945782 1 tasks_processing.go:74] worker 6 stopped. I0629 14:20:54.945797 1 gather.go:181] gatherer "clusterconfig" function "container_runtime_configs" took 13.265339ms to process 0 records E0629 14:20:54.945803 1 gather.go:144] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0629 14:20:54.945808 1 gather.go:181] gatherer "clusterconfig" function "machine_healthchecks" took 13.255895ms to process 0 records I0629 14:20:54.945811 1 tasks_processing.go:74] worker 0 stopped. E0629 14:20:54.945816 1 gather.go:144] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0629 14:20:54.945821 1 gather.go:181] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 13.341109ms to process 0 records I0629 14:20:54.945824 1 tasks_processing.go:74] worker 9 stopped. I0629 14:20:54.950517 1 tasks_processing.go:74] worker 50 stopped. I0629 14:20:54.950529 1 gather.go:181] gatherer "clusterconfig" function "sap_datahubs" took 17.816364ms to process 0 records I0629 14:20:54.950537 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 17.524515ms to process 0 records I0629 14:20:54.950542 1 tasks_processing.go:74] worker 25 stopped. I0629 14:20:54.950546 1 tasks_processing.go:74] worker 14 stopped. I0629 14:20:54.950551 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkstates" took 18.019734ms to process 0 records I0629 14:20:54.950584 1 tasks_processing.go:74] worker 1 stopped. I0629 14:20:54.950591 1 gather.go:181] gatherer "clusterconfig" function "machine_config_pools" took 17.464916ms to process 0 records I0629 14:20:54.950606 1 tasks_processing.go:74] worker 26 stopped. I0629 14:20:54.950615 1 gather.go:181] gatherer "clusterconfig" function "openshift_logging" took 17.438798ms to process 0 records I0629 14:20:54.950621 1 gather.go:181] gatherer "clusterconfig" function "lokistack" took 17.802117ms to process 0 records I0629 14:20:54.950626 1 tasks_processing.go:74] worker 23 stopped. I0629 14:20:54.950647 1 tasks_processing.go:74] worker 46 stopped. I0629 14:20:54.950652 1 gather.go:181] gatherer "clusterconfig" function "machine_sets" took 17.901598ms to process 0 records I0629 14:20:54.950699 1 tasks_processing.go:74] worker 31 stopped. E0629 14:20:54.950708 1 gather.go:144] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0629 14:20:54.950714 1 gather.go:181] gatherer "clusterconfig" function "support_secret" took 17.828989ms to process 0 records I0629 14:20:54.950814 1 tasks_processing.go:74] worker 3 stopped. I0629 14:20:54.950824 1 gather.go:181] gatherer "clusterconfig" function "olm_operators" took 18.324127ms to process 0 records I0629 14:20:54.951500 1 tasks_processing.go:74] worker 39 stopped. I0629 14:20:54.951511 1 gather.go:181] gatherer "clusterconfig" function "openstack_controlplanes" took 18.474485ms to process 0 records I0629 14:20:54.951793 1 tasks_processing.go:74] worker 18 stopped. I0629 14:20:54.951980 1 recorder.go:70] Recording config/network with fingerprint=5fdec96ebe8f8d9a09dd34751e16eb9163662b46e5fb1f7d5fd97ee1aa133050 I0629 14:20:54.951992 1 gather.go:181] gatherer "clusterconfig" function "networks" took 19.252691ms to process 1 records I0629 14:20:54.956469 1 tasks_processing.go:74] worker 28 stopped. I0629 14:20:54.956532 1 recorder.go:70] Recording config/proxy with fingerprint=af05ad5d257df868cf4dc6d123cf437076ca049b5557557524750046c49842f2 I0629 14:20:54.956543 1 gather.go:181] gatherer "clusterconfig" function "proxies" took 23.788294ms to process 1 records I0629 14:20:54.956623 1 tasks_processing.go:74] worker 45 stopped. I0629 14:20:54.956850 1 recorder.go:70] Recording config/oauth with fingerprint=c9dc6a9d7d18531976133529f5b4ec3105441f112dd9b4d18cdc26ca9b5577ac I0629 14:20:54.956865 1 gather.go:181] gatherer "clusterconfig" function "oauths" took 23.857167ms to process 1 records I0629 14:20:54.958808 1 tasks_processing.go:74] worker 48 stopped. I0629 14:20:54.958927 1 recorder.go:70] Recording config/apiserver with fingerprint=45c7b0a70d0b81498ba6a7b2207e1cb21fa1227c3ba0fc7a0e9be85989a77777 I0629 14:20:54.958940 1 gather.go:181] gatherer "clusterconfig" function "cluster_apiserver" took 25.946234ms to process 1 records I0629 14:20:54.959762 1 tasks_processing.go:74] worker 29 stopped. I0629 14:20:54.959772 1 gather.go:181] gatherer "clusterconfig" function "openstack_version" took 26.192009ms to process 0 records I0629 14:20:54.959777 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 26.562575ms to process 0 records I0629 14:20:54.959783 1 gather.go:181] gatherer "clusterconfig" function "sap_config" took 25.927514ms to process 0 records I0629 14:20:54.959788 1 gather.go:181] gatherer "clusterconfig" function "cost_management_metrics_configs" took 26.029146ms to process 0 records E0629 14:20:54.959794 1 gather.go:144] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0629 14:20:54.959798 1 tasks_processing.go:74] worker 56 stopped. I0629 14:20:54.959801 1 gather.go:181] gatherer "clusterconfig" function "machines" took 25.458161ms to process 0 records I0629 14:20:54.959804 1 tasks_processing.go:74] worker 53 stopped. I0629 14:20:54.959808 1 tasks_processing.go:74] worker 44 stopped. I0629 14:20:54.959808 1 gather.go:181] gatherer "clusterconfig" function "jaegers" took 26.284833ms to process 0 records I0629 14:20:54.959795 1 tasks_processing.go:74] worker 58 stopped. I0629 14:20:54.959814 1 tasks_processing.go:74] worker 22 stopped. I0629 14:20:54.959854 1 tasks_processing.go:74] worker 7 stopped. E0629 14:20:54.959867 1 gather.go:144] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0629 14:20:54.959890 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0629 14:20:54.959903 1 gather.go:181] gatherer "clusterconfig" function "machine_configs" took 26.727621ms to process 1 records I0629 14:20:54.959987 1 tasks_processing.go:74] worker 19 stopped. I0629 14:20:54.960120 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=091832ec1cd16a050bd09ae3436b9e99d51d40f5bb85b573073a52122bc55ada I0629 14:20:54.960150 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=7ac9d5cf38be37900af5a74421d735b8422aa585766fe908d17179856372bcab I0629 14:20:54.960179 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=ab9305185d8e7fedb711c40c608a034d01069e832f4288e22768e4f279e00758 I0629 14:20:54.960190 1 gather.go:181] gatherer "clusterconfig" function "mutating_webhook_configurations" took 27.298907ms to process 3 records I0629 14:20:54.960206 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 26.459147ms to process 0 records I0629 14:20:54.960221 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0629 14:20:54.960231 1 gather.go:181] gatherer "clusterconfig" function "overlapping_namespace_uids" took 27.258146ms to process 1 records I0629 14:20:54.960234 1 tasks_processing.go:74] worker 27 stopped. I0629 14:20:54.960241 1 tasks_processing.go:74] worker 8 stopped. I0629 14:20:54.960417 1 tasks_processing.go:74] worker 37 stopped. I0629 14:20:54.961462 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=3f0ce5d85f92e57bf277865a4be7c1650f51535f44e95320df9ba758222142be I0629 14:20:54.961517 1 gather.go:181] gatherer "clusterconfig" function "image_registries" took 27.40786ms to process 1 records I0629 14:20:54.962880 1 tasks_processing.go:74] worker 60 stopped. I0629 14:20:54.962893 1 gather.go:181] gatherer "clusterconfig" function "certificate_signing_requests" took 29.955963ms to process 0 records W0629 14:20:54.963309 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0629 14:20:54.964489 1 tasks_processing.go:74] worker 41 stopped. I0629 14:20:54.964582 1 recorder.go:70] Recording config/featuregate with fingerprint=1e4312d72c072b91859bf3af444f14cb5ce9bbe1cd3efc0be06e41e4b0e30cfe I0629 14:20:54.964591 1 gather.go:181] gatherer "clusterconfig" function "feature_gates" took 31.246345ms to process 1 records I0629 14:20:54.972733 1 tasks_processing.go:74] worker 42 stopped. I0629 14:20:54.974043 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-j4r4v with fingerprint=976ca952d016ef007841431c61acf6a197612e3b11f7b1b822799b926ac1fb1a I0629 14:20:54.974168 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-vthjt with fingerprint=651c594a5effcf6310d147c5cef8a4a15a46661ec3ce17bbfd73f36a44a32990 I0629 14:20:54.974209 1 recorder.go:70] Recording config/running_containers with fingerprint=69a7e6149ae21d609776c1e54525a40189911accc3e1a275c9eebaeb3c08d6f0 I0629 14:20:54.974221 1 gather.go:181] gatherer "clusterconfig" function "container_images" took 40.148327ms to process 3 records I0629 14:20:54.974281 1 tasks_processing.go:74] worker 61 stopped. I0629 14:20:54.974316 1 recorder.go:70] Recording config/image with fingerprint=40f23fc6f6685881540c1208ff9ded9a22b01b78c08b565d0e639b6a583907ba I0629 14:20:54.974324 1 gather.go:181] gatherer "clusterconfig" function "image" took 39.78892ms to process 1 records I0629 14:20:54.976086 1 tasks_processing.go:74] worker 20 stopped. I0629 14:20:54.976098 1 gather.go:181] gatherer "clusterconfig" function "openshift_machine_api_events" took 42.570919ms to process 0 records I0629 14:20:54.976292 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s W0629 14:20:54.976758 1 operator.go:288] started I0629 14:20:54.976791 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0629 14:20:54.976747 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0629 14:20:54.979182 1 tasks_processing.go:74] worker 55 stopped. I0629 14:20:54.979378 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=2b8280e87b3d7ccf9870b802663ca4e5ea841d0b8798b27e7eede74f9f3e5784 I0629 14:20:54.979461 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=b07a848548200d55a9cf550fd217e353bcf285fb2364e5694940f842ff4e1ef1 I0629 14:20:54.979473 1 gather.go:181] gatherer "clusterconfig" function "clusterroles" took 46.320771ms to process 2 records I0629 14:20:54.979563 1 tasks_processing.go:74] worker 35 stopped. I0629 14:20:54.979582 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=17492c8777e8646e7e4b3c4465b95cd9ae28cf1f4efd61b108f408e9da970ec0 I0629 14:20:54.979657 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=c0b6953200b5e2ae82735fe63abe07ebcff275cd2d57d99b7e3d09fe275a3bee I0629 14:20:54.979680 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=f77e3a8abde7cb45d36e0d2aa28f4aa7bed8ebf57805f964637c71afc6f94980 I0629 14:20:54.979703 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=dc12182bc3c0d2688486b94281784f1a95cea1ca1381b814af73c1e9ae4d9428 I0629 14:20:54.979725 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=f15a57b921507ade0942478a760d5a146f8b5b984811b5bc6dc4940ede6b603f I0629 14:20:54.979748 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=c41c501bdab6a304afa09f2f0fe603cccfe3d6c480292a08c0596284be35faaf I0629 14:20:54.979771 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=37ee65cf00d562f9cb73b653a05dd3945d93bc28c199e0dc76b6bba3f0e3fc44 I0629 14:20:54.979802 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=6f4b38a021fe42e89e46711abe212a687721ac0a1e53cc96b417c58f0247e3a3 I0629 14:20:54.979825 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=89fb7c061a948f14e10dc2135d4846051825b52ed3c354f880866ada20136897 I0629 14:20:54.979849 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=f1945f345dfcd09a513ca56b5b17a17affad986df0d1ac2edca1d24f375a2e40 I0629 14:20:54.979875 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=845a7cd5c27d179e43c7d5484a8c7b6854a4bdd3561b473469129148487d29e4 I0629 14:20:54.979886 1 gather.go:181] gatherer "clusterconfig" function "validating_webhook_configurations" took 46.349119ms to process 11 records I0629 14:20:54.985456 1 tasks_processing.go:74] worker 30 stopped. I0629 14:20:54.985656 1 recorder.go:70] Recording config/ingress with fingerprint=a0a5b2d4a2bc52aa44cab2b58d8cea98d08bbfe972a5b38894c508199dd9197b I0629 14:20:54.985674 1 gather.go:181] gatherer "clusterconfig" function "ingress" took 51.621851ms to process 1 records I0629 14:20:54.985681 1 gather.go:181] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 52.269516ms to process 0 records I0629 14:20:54.985711 1 tasks_processing.go:74] worker 33 stopped. I0629 14:20:54.985766 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=a48832fa9bb51458b8e36ba34436692dcac694cd4cb1613ef05f045d36e7de9f I0629 14:20:54.985775 1 gather.go:181] gatherer "clusterconfig" function "image_pruners" took 52.627914ms to process 1 records I0629 14:20:54.985792 1 tasks_processing.go:74] worker 38 stopped. I0629 14:20:54.985835 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=20b48f9803f0a11a30a5bc1caadcae15473716887e7253a4c1005944e21a1e52 I0629 14:20:54.985846 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=e4cfc030430d3178c14ea420d816fd03b4ca5f82a57d980e1a8723fb8e368b86 I0629 14:20:54.985847 1 tasks_processing.go:74] worker 36 stopped. I0629 14:20:54.985849 1 gather.go:181] gatherer "clusterconfig" function "storage_classes" took 52.726914ms to process 2 records I0629 14:20:54.985931 1 tasks_processing.go:74] worker 63 stopped. I0629 14:20:54.985992 1 recorder.go:70] Recording config/authentication with fingerprint=771ccd18f717686543cd0918618c844c330fff8b3444ad9dcb0fef67f1e72947 I0629 14:20:54.986004 1 gather.go:181] gatherer "clusterconfig" function "authentication" took 52.250493ms to process 1 records I0629 14:20:54.986244 1 tasks_processing.go:74] worker 47 stopped. I0629 14:20:54.986633 1 recorder.go:70] Recording config/infrastructure with fingerprint=7b30344818501b1b97eebf3a1c6f6e692e52014239ffeb33035df4e12f265496 I0629 14:20:54.986642 1 gather.go:181] gatherer "clusterconfig" function "infrastructures" took 52.512132ms to process 1 records I0629 14:20:54.987980 1 tasks_processing.go:74] worker 32 stopped. I0629 14:20:54.987985 1 gather.go:181] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 55.007322ms to process 0 records I0629 14:20:54.988152 1 tasks_processing.go:74] worker 62 stopped. I0629 14:20:54.988205 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=523adfee37133acc719ea65c2582037de6f184458d38e37f356b7a209f3ccf0d I0629 14:20:54.988366 1 gather.go:181] gatherer "clusterconfig" function "schedulers" took 54.721508ms to process 1 records I0629 14:20:54.988451 1 tasks_processing.go:74] worker 51 stopped. I0629 14:20:54.988628 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=6165e763237a09215c4508bb95ff5660b598a5a0e6735c0d7a85b9db7e83ff39 I0629 14:20:54.988702 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=35be8002954cb30270981619c7232c071146e6b216fb00f716ffbf830f24f5e5 I0629 14:20:54.988727 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=ed39a335a4e499164b7bd6e8ac3b21dcf54b9aef427291547f6f810220ad005d I0629 14:20:54.988742 1 gather.go:181] gatherer "clusterconfig" function "pdbs" took 55.013488ms to process 3 records I0629 14:20:54.993133 1 tasks_processing.go:74] worker 13 stopped. I0629 14:20:54.993147 1 gather.go:181] gatherer "clusterconfig" function "node_logs" took 58.962506ms to process 0 records I0629 14:20:54.993373 1 prometheus_rules.go:88] Prometheus rules successfully created I0629 14:20:54.993734 1 tasks_processing.go:74] worker 4 stopped. I0629 14:20:54.994002 1 recorder.go:70] Recording config/node/ip-10-0-137-89.ec2.internal with fingerprint=b0c12a9bd50865e9f139d353a2458efe25030c2d58b9d16e79521e928d2fc21c I0629 14:20:54.994044 1 recorder.go:70] Recording config/node/ip-10-0-147-231.ec2.internal with fingerprint=1265a55eec2cad0afcd526963907d068275ce10b969d86fa43e20b4479aa6c5c I0629 14:20:54.994077 1 recorder.go:70] Recording config/node/ip-10-0-175-58.ec2.internal with fingerprint=83700373b0676287a0bd9dd75d973cb913108bd5f6b253193a90bb4822556b67 I0629 14:20:54.994084 1 gather.go:181] gatherer "clusterconfig" function "nodes" took 60.707482ms to process 3 records I0629 14:20:54.994169 1 tasks_processing.go:74] worker 34 stopped. I0629 14:20:54.994429 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=881f617fae2af5e044970f56e5b6a2ffc62f4e3b639f7c432e59f5534a4ca818 I0629 14:20:54.994544 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=5a9bb49da14d36e94bbadc7f1c087e35fc982cea55a362162fdfd3f0f89aac82 I0629 14:20:54.994551 1 gather.go:181] gatherer "clusterconfig" function "crds" took 61.198212ms to process 2 records I0629 14:20:54.995622 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0629 14:20:54.995634 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0629 14:20:54.995639 1 controller.go:203] Source scaController *sca.Controller is not ready I0629 14:20:54.995642 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0629 14:20:54.995644 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0629 14:20:54.995656 1 controller.go:457] The operator is still being initialized I0629 14:20:54.995663 1 controller.go:482] The operator is healthy I0629 14:20:54.995716 1 tasks_processing.go:74] worker 15 stopped. I0629 14:20:54.995727 1 gather.go:181] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 63.118851ms to process 0 records I0629 14:20:55.001384 1 requests.go:204] Asking for SCA certificate for x86_64 architecture W0629 14:20:55.002350 1 sca.go:117] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.9:33841->172.30.0.10:53: read: connection refused E0629 14:20:55.002356 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%!d(MISSING)6d7-0021-45bf-84d3-affae14e6204%!+(MISSING)and+status+is+%!a(MISSING)ccepted%!"(MISSING): dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.9:33841->172.30.0.10:53: read: connection refused I0629 14:20:55.002361 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.9:33841->172.30.0.10:53: read: connection refused I0629 14:20:55.002365 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%276648d6d7-0021-45bf-84d3-affae14e6204%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.9:33841->172.30.0.10:53: read: connection refused I0629 14:20:55.008605 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0629 14:20:55.008617 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0629 14:20:55.008627 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0629 14:20:55.009843 1 tasks_processing.go:74] worker 11 stopped. E0629 14:20:55.009856 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0629 14:20:55.009861 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0629 14:20:55.009864 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0629 14:20:55.009890 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0629 14:20:55.009901 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0629 14:20:55.009905 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=e1a0ad594db3a5d5d50e9e25d7b235af20f84f5def41537f127febe525b834f2 I0629 14:20:55.009910 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0629 14:20:55.009926 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0629 14:20:55.009933 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0629 14:20:55.009937 1 gather.go:181] gatherer "clusterconfig" function "config_maps" took 77.27401ms to process 6 records I0629 14:20:55.012233 1 base_controller.go:73] Caches are synced for ConfigController I0629 14:20:55.012247 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0629 14:20:55.018659 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 14:20:55.053436 1 tasks_processing.go:74] worker 12 stopped. I0629 14:20:55.053853 1 recorder.go:70] Recording config/version with fingerprint=a3b12a26e311253e3f41916d91bbbcb9d2e021848dd6fecd93ba495876a49d68 I0629 14:20:55.053866 1 recorder.go:70] Recording config/id with fingerprint=7c49a1a5a768a4375b123803a27c3da03dd9cc6d9c91529967dc1726e7dfde84 I0629 14:20:55.053872 1 gather.go:181] gatherer "clusterconfig" function "version" took 120.574422ms to process 2 records I0629 14:20:55.077635 1 base_controller.go:73] Caches are synced for LoggingSyncer I0629 14:20:55.077660 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0629 14:20:55.083348 1 tasks_processing.go:74] worker 5 stopped. E0629 14:20:55.083365 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0629 14:20:55.083379 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2r82qc7oqufqt2f3ecmv6ipqtojbdvut-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2r82qc7oqufqt2f3ecmv6ipqtojbdvut-primary-cert-bundle-secret" not found I0629 14:20:55.083453 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=62d58e6f6c60764e192cf8151f69f20fa9c6f504746b17ca3f82c880b4001cf2 I0629 14:20:55.083466 1 gather.go:181] gatherer "clusterconfig" function "ingress_certificates" took 150.824467ms to process 1 records I0629 14:20:55.198797 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0629 14:20:55.398881 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W0629 14:20:55.961709 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0629 14:20:56.191773 1 gather_cluster_operator_pods_and_events.go:121] Found 20 pods with 24 containers I0629 14:20:56.191788 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1048576 bytes I0629 14:20:56.192382 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-bsx79 pod in namespace openshift-dns (previous: false). I0629 14:20:56.199801 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0629 14:20:56.425423 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bsx79 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-bsx79\" is waiting to start: ContainerCreating" I0629 14:20:56.425442 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-bsx79\" is waiting to start: ContainerCreating" I0629 14:20:56.425451 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-bsx79 pod in namespace openshift-dns (previous: false). I0629 14:20:56.596610 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-bsx79 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-bsx79\" is waiting to start: ContainerCreating" I0629 14:20:56.596631 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-bsx79\" is waiting to start: ContainerCreating" I0629 14:20:56.596643 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-hfddj pod in namespace openshift-dns (previous: false). I0629 14:20:56.802583 1 tasks_processing.go:74] worker 43 stopped. I0629 14:20:56.802639 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=3fe49c865c1562332e83248ca5b49ad5512aa4aa9ffd5f1aeebb70eaddce0321 I0629 14:20:56.802675 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=3db41fa0f7967e5aef70f4403f26ae073fe559e15729f56443dcc1a2f1df38bf I0629 14:20:56.802710 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0629 14:20:56.802742 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=4f9d87e2cea09da06a470c0f65a059b7264ba25534bbf7054c4b8fe225fedaea I0629 14:20:56.802766 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0629 14:20:56.802789 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=b053311bfc788a3604ffddc808ae2f796a75455129f520006ede538ab507774e I0629 14:20:56.802818 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=84266461da782b51bc5865df3ee35f32cee27d1d216df7ab0b34382520f0219f I0629 14:20:56.802849 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=706450cac35a5755e239c13565796b308a91a329838375577498e1d999e64ab2 I0629 14:20:56.802869 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=b19f97a5c8df281fd9eb218254cf604feb3afdd0b6172c8b70ffbc04b985f96d I0629 14:20:56.802888 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=13e40ba7da42b44a1d1758e5361aec607c13dd8942f716d9f41cc25af7e7f14c I0629 14:20:56.802901 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0629 14:20:56.802918 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=2201ae7c823270d6197bad3e6838a3258fb1bcc158cb905da5bd4888547ca46d I0629 14:20:56.802931 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0629 14:20:56.802947 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=8c0d4074d23222d2df4caec8b0035ce7997086adc37d476ea5e6d7cd5041beba I0629 14:20:56.802960 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0629 14:20:56.802978 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=b54926701734f4d8211ad1896e4332508b8fd9c93d62b7e1c831af3dfee58174 I0629 14:20:56.802989 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0629 14:20:56.803005 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=e31b0b089b90a27724a7076e5a20edfa905beefe9331f46b21ede52451e6db4d I0629 14:20:56.803083 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=1d8490f38b7eaa59f10b46a3509d135cc8f6221f4d3c5af285daa591e0cf3f49 I0629 14:20:56.803150 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0629 14:20:56.803175 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=b9e93155e05837c39bbe27a876a0cf8f143067b7aca8d1ebd9bec75120b06b50 I0629 14:20:56.803198 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=4c18d1b730ee0c9a41ac6f13830f94cd8a2f9c302c172765f455d23ca6851c9f I0629 14:20:56.803211 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0629 14:20:56.803227 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=98d075d2439a324401ec6075333903947d78cb6a1a9342e0c87c2e38634b651b I0629 14:20:56.803239 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0629 14:20:56.803252 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=88dc30b4f4b40b8c013524417979cf49021294dafc12bcfc2852397ad41e5484 I0629 14:20:56.803287 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=4d0e61de57c90f7c83e439c34b08ed5edfaf9567ab7ec76069d5df75f2ed81c0 I0629 14:20:56.803302 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=29c50d04747fa2cb6662e1d8ce6780843117ee968ff19084c065693df8878e8d I0629 14:20:56.803318 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=821dc6546f203e2a3cfaa4e9a057abde9bb51498e05b5071fecef90ffdfe8b53 I0629 14:20:56.803343 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=194845373598f6184abd27520ba1548ab24aef09e710292ff1730d87a14891ef I0629 14:20:56.803354 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0629 14:20:56.803374 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=d5ad4948891b90963c87de7999937de67fb42467a558f28f990143d6d861d188 I0629 14:20:56.803395 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0629 14:20:56.803406 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0629 14:20:56.803414 1 gather.go:181] gatherer "clusterconfig" function "operators" took 1.870009103s to process 34 records I0629 14:20:56.819182 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hfddj pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-hfddj\" is waiting to start: ContainerCreating" I0629 14:20:56.819198 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-hfddj\" is waiting to start: ContainerCreating" I0629 14:20:56.819205 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-hfddj pod in namespace openshift-dns (previous: false). W0629 14:20:56.961859 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0629 14:20:56.996331 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-hfddj pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-hfddj\" is waiting to start: ContainerCreating" I0629 14:20:56.996345 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-hfddj\" is waiting to start: ContainerCreating" I0629 14:20:56.996355 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-zhp68 pod in namespace openshift-dns (previous: false). I0629 14:20:57.214523 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-zhp68 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-zhp68\" is waiting to start: ContainerCreating" I0629 14:20:57.214542 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-zhp68\" is waiting to start: ContainerCreating" I0629 14:20:57.214549 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-zhp68 pod in namespace openshift-dns (previous: false). I0629 14:20:57.396191 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-zhp68 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-zhp68\" is waiting to start: ContainerCreating" I0629 14:20:57.396209 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-zhp68\" is waiting to start: ContainerCreating" I0629 14:20:57.396218 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-b29hw pod in namespace openshift-dns (previous: false). I0629 14:20:57.597205 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 14:20:57.597224 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-q4xjx pod in namespace openshift-dns (previous: false). I0629 14:20:57.797504 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 14:20:57.797521 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-qf5dw pod in namespace openshift-dns (previous: false). W0629 14:20:57.963979 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0629 14:20:57.999438 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 14:20:57.999461 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6bb68987cc-8pjr9 pod in namespace openshift-image-registry (previous: false). I0629 14:20:58.196753 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6bb68987cc-8pjr9 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6bb68987cc-8pjr9\" is waiting to start: ContainerCreating" I0629 14:20:58.196771 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6bb68987cc-8pjr9\" is waiting to start: ContainerCreating" I0629 14:20:58.196783 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6bb68987cc-zkbdc pod in namespace openshift-image-registry (previous: false). I0629 14:20:58.396040 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6bb68987cc-zkbdc pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6bb68987cc-zkbdc\" is waiting to start: ContainerCreating" I0629 14:20:58.396060 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6bb68987cc-zkbdc\" is waiting to start: ContainerCreating" I0629 14:20:58.396069 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-79555c95c4-22d69 pod in namespace openshift-image-registry (previous: false). I0629 14:20:58.620036 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-79555c95c4-22d69 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-79555c95c4-22d69\" is waiting to start: ContainerCreating" I0629 14:20:58.620056 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-79555c95c4-22d69\" is waiting to start: ContainerCreating" I0629 14:20:58.620066 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-h9m72 pod in namespace openshift-image-registry (previous: false). I0629 14:20:58.796702 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 14:20:58.796722 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-v8wtx pod in namespace openshift-image-registry (previous: false). W0629 14:20:58.962008 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0629 14:20:58.996366 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 14:20:58.996382 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-wj8tk pod in namespace openshift-image-registry (previous: false). I0629 14:20:59.195351 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0629 14:20:59.195368 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5f7587f555-7vkst pod in namespace openshift-ingress (previous: false). I0629 14:20:59.396438 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5f7587f555-7vkst pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5f7587f555-7vkst\" is waiting to start: ContainerCreating" I0629 14:20:59.396461 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5f7587f555-7vkst\" is waiting to start: ContainerCreating" I0629 14:20:59.396471 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-67fc45f5bb-jlssx pod in namespace openshift-ingress (previous: false). I0629 14:20:59.596542 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-67fc45f5bb-jlssx pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-67fc45f5bb-jlssx\" is waiting to start: ContainerCreating" I0629 14:20:59.596561 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-67fc45f5bb-jlssx\" is waiting to start: ContainerCreating" I0629 14:20:59.596598 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-67fc45f5bb-pvgjm pod in namespace openshift-ingress (previous: false). I0629 14:20:59.797333 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-67fc45f5bb-pvgjm pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-67fc45f5bb-pvgjm\" is waiting to start: ContainerCreating" I0629 14:20:59.797351 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-67fc45f5bb-pvgjm\" is waiting to start: ContainerCreating" I0629 14:20:59.797360 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-h6prs pod in namespace openshift-ingress-canary (previous: false). W0629 14:20:59.961456 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0629 14:20:59.961479 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0629 14:20:59.961490 1 tasks_processing.go:74] worker 40 stopped. E0629 14:20:59.961499 1 gather.go:144] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0629 14:20:59.961509 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0629 14:20:59.961520 1 gather.go:159] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0629 14:20:59.961530 1 gather.go:181] gatherer "clusterconfig" function "dvo_metrics" took 5.028408259s to process 1 records I0629 14:20:59.996957 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-h6prs pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-h6prs\" is waiting to start: ContainerCreating" I0629 14:20:59.996978 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-h6prs\" is waiting to start: ContainerCreating" I0629 14:20:59.996987 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-hqdfx pod in namespace openshift-ingress-canary (previous: false). I0629 14:21:00.197728 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-hqdfx pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-hqdfx\" is waiting to start: ContainerCreating" I0629 14:21:00.197745 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-hqdfx\" is waiting to start: ContainerCreating" I0629 14:21:00.197755 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-vkl4f pod in namespace openshift-ingress-canary (previous: false). I0629 14:21:00.399025 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-vkl4f pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-vkl4f\" is waiting to start: ContainerCreating" I0629 14:21:00.399041 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-vkl4f\" is waiting to start: ContainerCreating" I0629 14:21:00.399051 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-6cf78d8f89-6hq2q pod in namespace openshift-kube-storage-version-migrator (previous: false). I0629 14:21:00.596966 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-6cf78d8f89-6hq2q pod in namespace openshift-kube-storage-version-migrator (previous: false). I0629 14:21:00.796935 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-66d58888b9-r862s pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I0629 14:21:00.998736 1 tasks_processing.go:74] worker 49 stopped. I0629 14:21:00.998815 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=6fcb53ab10572aa018b9304b66922f159625432e1973708b3ce1b96b9b9e5f58 I0629 14:21:00.998853 1 recorder.go:70] Recording events/openshift-dns with fingerprint=cdac517dda22b972725a9e91070e8182d3cb4cfdb3d761e0cb1e42a21f10424e I0629 14:21:00.998902 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=4da1212a636803d85ce65e097fa1b119f04ee9a940fea97be92f40ee7e608900 I0629 14:21:00.998917 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=18bcf6896b8ba0330089163ec36bad0c25a3bc9e2610987a3d4f3e4161b05169 I0629 14:21:00.998942 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=5e70ad68e0c76c79211147c29d174fc0d73b3efe0a23bf14d373e2e6f27cc182 I0629 14:21:00.998954 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=ad329f0680b45afa1314304451a31cec815275496e6b34d045e9dd67c3db5c1d I0629 14:21:00.998962 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator with fingerprint=e8b8fad0f1ca100fa2cd608add25e28f0b5fe2e4b99373d224ef91b27f45ad3b I0629 14:21:00.998989 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=dd5c7838da9285e29e6bb416c2caae6e7df5f4237066c1c972ea944374cf7bd8 I0629 14:21:00.998997 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-6cf78d8f89-6hq2q/migrator_current.log with fingerprint=6f3c519b6fd54d9fc0a8b5262b5114f013c9b412d26515420bdc285cacc0b03a I0629 14:21:00.999001 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator/logs/migrator-6cf78d8f89-6hq2q/graceful-termination_current.log with fingerprint=62c20205902440266c9a1874faf7142f73a6bf18c49b64fc24db9614bbbc9ceb I0629 14:21:00.999024 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-66d58888b9-r862s/kube-storage-version-migrator-operator_current.log with fingerprint=d6cebda56518cbd5909c5db8f2e7639c1881bb2d181b03dc08b7a38d93246549 I0629 14:21:00.999032 1 gather.go:181] gatherer "clusterconfig" function "operators_pods_and_events" took 6.064778193s to process 11 records I0629 14:21:07.115254 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 14:21:07.314982 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 14:21:08.027817 1 tasks_processing.go:74] worker 54 stopped. I0629 14:21:08.027849 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I0629 14:21:08.027859 1 gather.go:181] gatherer "clusterconfig" function "install_plans" took 13.094176337s to process 1 records I0629 14:21:08.542108 1 tasks_processing.go:74] worker 10 stopped. I0629 14:21:08.542388 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=939ef323a6698d2e7e5b499f4ba67ba78f493d6a29f1c1cf0af4f66d3c654a96 I0629 14:21:08.542403 1 gather.go:181] gatherer "clusterconfig" function "service_accounts" took 13.609496752s to process 1 records E0629 14:21:08.542443 1 periodic.go:252] clusterconfig failed after 13.61s with: function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0629 14:21:08.542455 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0629 14:21:08.542461 1 periodic.go:214] Running workloads gatherer I0629 14:21:08.542472 1 tasks_processing.go:45] number of workers: 2 I0629 14:21:08.542477 1 tasks_processing.go:69] worker 1 listening for tasks. I0629 14:21:08.542479 1 tasks_processing.go:71] worker 1 working on workload_info task. I0629 14:21:08.542488 1 tasks_processing.go:69] worker 0 listening for tasks. I0629 14:21:08.542559 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0629 14:21:08.575603 1 gather_workloads_info.go:281] Loaded pods in 0s, will wait 21s for image data I0629 14:21:08.581127 1 tasks_processing.go:74] worker 0 stopped. I0629 14:21:08.581145 1 gather.go:181] gatherer "workloads" function "helmchart_info" took 38.548456ms to process 0 records I0629 14:21:08.593892 1 gather_workloads_info.go:390] No image sha256:0c1abef76d6d2832ddcff31e950ffafeb4e0f6fad80a5f5dca94591de0fc9581 (19ms) I0629 14:21:08.609428 1 gather_workloads_info.go:390] No image sha256:351ca92471647f383f3cd7f0b70f33f5fa11c39ab569c4948dff7d471a6c8be3 (16ms) I0629 14:21:08.624995 1 gather_workloads_info.go:390] No image sha256:3a2c82b772ea6072e1eca0efc5303f002189e80b0e985fb3e3b8ea9a12fe8060 (16ms) I0629 14:21:08.634255 1 gather_workloads_info.go:390] No image sha256:5bcfb1b739fa4e6ff9e21e4843f8520f29608135341f7d8dcc31084b9ba25f1d (9ms) I0629 14:21:08.643126 1 gather_workloads_info.go:390] No image sha256:3fea7db586d3236c1876a8b523af0d8d65c84d6f6cf5d0f4e41cafcffe6db5b5 (9ms) I0629 14:21:08.652406 1 gather_workloads_info.go:390] No image sha256:1eee856bde9bad71c4444c494225a0cf02d1f4a5293acf0bd6e7e1814efa0064 (9ms) I0629 14:21:08.662082 1 gather_workloads_info.go:390] No image sha256:41029e57ece558b2e0b12174ce924647fd9d5c5d83aadf4bba03d6916d3f9f54 (10ms) I0629 14:21:08.672154 1 gather_workloads_info.go:390] No image sha256:a7fc4d05c4a3c82c9f355ca985d6fd26033c0d6a98716f25fcd2f54bae1d2fa0 (10ms) I0629 14:21:08.679513 1 gather_workloads_info.go:390] No image sha256:4dcdadc14b7bdb2c00954d92e957d63aafbbe5f4047fe028e575d65725923cb0 (7ms) I0629 14:21:08.686584 1 gather_workloads_info.go:390] No image sha256:894452e6587de55d04e37163d3da53e11fced8fb08bd0acf61e6d49f7964284e (7ms) I0629 14:21:08.693872 1 gather_workloads_info.go:390] No image sha256:8562a483f4568254250f19fc68d79f88c94a48508aefe59a70c1021a3aad000a (7ms) I0629 14:21:08.784466 1 gather_workloads_info.go:390] No image sha256:48dff3fcb0da58eb9b2b500f89af8b7d0790ffa60da0b0e301feca971dbafcbb (91ms) I0629 14:21:08.883595 1 gather_workloads_info.go:390] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (99ms) I0629 14:21:08.983870 1 gather_workloads_info.go:390] No image sha256:80fdd5049bd2815e49c198a795a116976a852e8de630be74872439ba6c08758a (100ms) I0629 14:21:09.085613 1 gather_workloads_info.go:390] No image sha256:1c7c24111f1709d7648156873ced09462638aa4b3cf7e7aee13297e51bcdfb3e (102ms) I0629 14:21:09.184695 1 gather_workloads_info.go:390] No image sha256:6a9b4fd887fa7f1729302fb0330c3c9a483197bf78becdcfda4235ec823a2c39 (99ms) I0629 14:21:09.284845 1 gather_workloads_info.go:390] No image sha256:0c6b7f828184b16a5e6630111e0715e11d34dae9b0bf64619466543e6168e05c (100ms) I0629 14:21:09.384325 1 gather_workloads_info.go:390] No image sha256:0158b297aec0a66376c04d3c7cf4828db5e5d9f424e331ff7c7b796828036875 (99ms) I0629 14:21:09.484509 1 gather_workloads_info.go:390] No image sha256:788d16bfff4bd6bb3ce97acc643b56fae6e619674ab279535480e519b4d5b769 (100ms) I0629 14:21:09.584082 1 gather_workloads_info.go:390] No image sha256:02283a64c1936a5dd09d5c6bc0ecbcf9196fe4df6a4055c8be22cebd850aa7a3 (100ms) I0629 14:21:09.683913 1 gather_workloads_info.go:390] No image sha256:0242cefbf0bb876101c4d67ab4e07401cb0ba6c02be2b73a4f17ba33b2960005 (100ms) I0629 14:21:09.784961 1 gather_workloads_info.go:390] No image sha256:ed0c9631d6e424912cd8ce78ca7a2c4f76b3fc15e9e34fe00999170ccf19a611 (101ms) I0629 14:21:09.884876 1 gather_workloads_info.go:390] No image sha256:751bd7eb62f632c0eef0ca91b6c57c64d4f1279d4dbe1a9b875ac4020a7b693f (100ms) I0629 14:21:09.984031 1 gather_workloads_info.go:390] No image sha256:38787de16ee8c686305f93b501d891b50cde24136009863869d230c0d4eeee5c (99ms) I0629 14:21:10.083705 1 gather_workloads_info.go:390] No image sha256:13aabbaf260d634ff0e9ac1af88af075b5ba671fd51313e33e74d7d2f7e54128 (100ms) I0629 14:21:10.184341 1 gather_workloads_info.go:390] No image sha256:42b4c6bdf3081ec264bc5edbc4eb779151de9e4742d6fe59a316645891df649c (101ms) I0629 14:21:10.285079 1 gather_workloads_info.go:390] No image sha256:30ff5e5b72f274598704ca69f1832eba1040cc25da47386004fd59500b6e4c55 (101ms) I0629 14:21:10.383808 1 gather_workloads_info.go:390] No image sha256:4b9b7949d209e257a76053de4ac74193f747c0d42e25dcd270d655849a4e51aa (99ms) I0629 14:21:10.484522 1 gather_workloads_info.go:390] No image sha256:c7aa910ca06f8fd89cdf2519136e0f3533bdacfc6bd58a3f6683f9f08756c7b1 (101ms) I0629 14:21:10.484549 1 tasks_processing.go:74] worker 1 stopped. I0629 14:21:10.484786 1 recorder.go:70] Recording config/workload_info with fingerprint=5f5663efdfeb46c1b126d5d7c2ea0ff95763607511dd763ed071285fbce33702 I0629 14:21:10.484811 1 gather.go:181] gatherer "workloads" function "workload_info" took 1.942063705s to process 1 records I0629 14:21:10.484829 1 periodic.go:261] Periodic gather workloads completed in 1.942s I0629 14:21:10.484842 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0629 14:21:10.484848 1 periodic.go:214] Running conditional gatherer I0629 14:21:10.495035 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules I0629 14:21:10.500432 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.9:40519->172.30.0.10:53: read: connection refused E0629 14:21:10.500683 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0629 14:21:10.500733 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0629 14:21:10.508694 1 conditional_gatherer.go:390] cluster version is '4.18.9' E0629 14:21:10.508708 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:21:10.508713 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:21:10.508716 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:21:10.508718 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:21:10.508720 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:21:10.508723 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:21:10.508725 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:21:10.508727 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0629 14:21:10.508729 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0629 14:21:10.508741 1 tasks_processing.go:45] number of workers: 3 I0629 14:21:10.508752 1 tasks_processing.go:69] worker 2 listening for tasks. I0629 14:21:10.508756 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I0629 14:21:10.508763 1 tasks_processing.go:69] worker 0 listening for tasks. I0629 14:21:10.508777 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I0629 14:21:10.508780 1 tasks_processing.go:69] worker 1 listening for tasks. I0629 14:21:10.508796 1 tasks_processing.go:74] worker 1 stopped. I0629 14:21:10.508796 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0629 14:21:10.508816 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0629 14:21:10.508825 1 gather.go:181] gatherer "conditional" function "remote_configuration" took 1.008µs to process 1 records I0629 14:21:10.508877 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0629 14:21:10.508884 1 gather.go:181] gatherer "conditional" function "conditional_gatherer_rules" took 1.66µs to process 1 records I0629 14:21:10.508889 1 tasks_processing.go:74] worker 2 stopped. I0629 14:21:10.508956 1 tasks_processing.go:74] worker 0 stopped. I0629 14:21:10.508964 1 gather.go:181] gatherer "conditional" function "rapid_container_logs" took 172.63µs to process 0 records I0629 14:21:10.508982 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.9:40519->172.30.0.10:53: read: connection refused I0629 14:21:10.508990 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 W0629 14:21:10.529469 1 gather.go:213] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0629 14:21:10.529583 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=cacc6b0ad26f22dcdd0b60060b03d478f52baa17ee86987660ae50ce4351b887 I0629 14:21:10.529697 1 diskrecorder.go:70] Writing 104 records to /var/lib/insights-operator/insights-2026-06-29-142110.tar.gz I0629 14:21:10.535562 1 diskrecorder.go:51] Wrote 104 records to disk in 5ms I0629 14:21:10.535597 1 periodic.go:283] Gathering cluster info every 2h0m0s I0629 14:21:10.535613 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0629 14:21:23.333734 1 configmapobserver.go:84] configmaps "insights-config" not found I0629 14:22:14.429905 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="b18c455bfdb6cdd80157923158010579f220725183fa3ea0a2affcb17940d259") W0629 14:22:14.429937 1 builder.go:154] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0629 14:22:14.429970 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="971944ef7f671846d3ee56a398acfb3f58cf2342d3a6602f919f80530a348e1b") I0629 14:22:14.430020 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="8024770fe31548e526b25edff6fd8c884e85a17465abf2b7e094e89bb0232271") I0629 14:22:14.430045 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0629 14:22:14.430075 1 genericapiserver.go:670] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0629 14:22:14.430094 1 genericapiserver.go:527] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0629 14:22:14.430108 1 base_controller.go:172] Shutting down ConfigController ... I0629 14:22:14.430125 1 genericapiserver.go:628] "[graceful-termination] not going to wait for active watch request(s) to drain" I0629 14:22:14.430149 1 periodic.go:175] Shutting down