W0702 02:01:48.183871 1 cmd.go:254] Using insecure, self-signed certificates I0702 02:01:48.507291 1 start.go:223] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 02:01:48.507465 1 observer_polling.go:159] Starting file observer W0702 02:01:48.530253 1 builder.go:266] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-6fd96f47fd" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0702 02:01:48.769575 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0702 02:01:48.769727 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0702 02:01:48.770050 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0702 02:01:48.770263 1 secure_serving.go:57] Forcing use of http/1.1 only W0702 02:01:48.770285 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0702 02:01:48.770289 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0702 02:01:48.770293 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0702 02:01:48.770295 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0702 02:01:48.770297 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0702 02:01:48.770299 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0702 02:01:48.777497 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes ChunkSizeMiB CloudDualStackNodeIPs DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy PersistentIPsForVirtualization PrivateHostedZoneAWS SetEIPForNLBIngressController VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy AWSClusterHostedDNS AdditionalRoutingCapabilities AutomatedEtcdBackup BootcNodeManagement CSIDriverSharedResource ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ConsolePluginContentSecurityPolicy DNSNameResolver DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example GCPClusterHostedDNS GatewayAPI ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MetricsCollectionProfiles MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NodeSwap NutanixMultiSubnets OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0702 02:01:48.777512 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ConsolePluginContentSecurityPolicy", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0702 02:01:48.780269 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0702 02:01:48.780274 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0702 02:01:48.780291 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0702 02:01:48.780293 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0702 02:01:48.780303 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0702 02:01:48.780935 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 02:01:48.781227 1 secure_serving.go:213] Serving securely on [::]:8443 I0702 02:01:48.781277 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" E0702 02:01:48.781324 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18be5696f1393aed openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"SetEIPForNLBIngressController\", \"VSphereControlPlaneMachineSet\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"VSphereStaticIPs\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AdditionalRoutingCapabilities\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"CSIDriverSharedResource\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ConsolePluginContentSecurityPolicy\", \"DNSNameResolver\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"GCPClusterHostedDNS\", \"GatewayAPI\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MetricsCollectionProfiles\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OnClusterBuild\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SignatureStores\", \"SigstoreImageVerification\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-02 02:01:48.777437933 +0000 UTC m=+0.622601900,LastTimestamp:2026-07-02 02:01:48.777437933 +0000 UTC m=+0.622601900,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" I0702 02:01:48.781422 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/tmp/serving-cert-1060147137/tls.crt::/tmp/serving-cert-1060147137/tls.key" W0702 02:01:48.784377 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0702 02:01:48.784397 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 02:01:48.784489 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0702 02:01:48.791970 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:01:48.791985 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 02:01:48.798395 1 secretconfigobserver.go:119] support secret does not exist I0702 02:01:48.803675 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:01:48.805752 1 recorder.go:156] Pruning old reports every 4h48m40s, max age is 288h0m0s I0702 02:01:48.808838 1 secretconfigobserver.go:119] support secret does not exist I0702 02:01:48.812405 1 periodic.go:214] Running clusterconfig gatherer I0702 02:01:48.812407 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0702 02:01:48.812422 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0702 02:01:48.812437 1 tasks_processing.go:45] number of workers: 64 I0702 02:01:48.812441 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0702 02:01:48.812445 1 insightsreport.go:296] Starting report retriever I0702 02:01:48.812448 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0702 02:01:48.812452 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 02:01:48.812455 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 02:01:48.812461 1 tasks_processing.go:69] worker 20 listening for tasks. I0702 02:01:48.812462 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 02:01:48.812465 1 tasks_processing.go:69] worker 12 listening for tasks. I0702 02:01:48.812469 1 tasks_processing.go:69] worker 17 listening for tasks. I0702 02:01:48.812469 1 tasks_processing.go:69] worker 11 listening for tasks. I0702 02:01:48.812473 1 tasks_processing.go:71] worker 12 working on crds task. I0702 02:01:48.812477 1 tasks_processing.go:71] worker 17 working on pdbs task. I0702 02:01:48.812476 1 tasks_processing.go:69] worker 13 listening for tasks. I0702 02:01:48.812479 1 tasks_processing.go:69] worker 3 listening for tasks. I0702 02:01:48.812479 1 tasks_processing.go:69] worker 14 listening for tasks. I0702 02:01:48.812485 1 tasks_processing.go:69] worker 15 listening for tasks. I0702 02:01:48.812484 1 tasks_processing.go:69] worker 4 listening for tasks. I0702 02:01:48.812487 1 tasks_processing.go:69] worker 5 listening for tasks. I0702 02:01:48.812491 1 tasks_processing.go:69] worker 9 listening for tasks. I0702 02:01:48.812493 1 tasks_processing.go:69] worker 10 listening for tasks. I0702 02:01:48.812499 1 tasks_processing.go:69] worker 19 listening for tasks. I0702 02:01:48.812499 1 tasks_processing.go:69] worker 18 listening for tasks. I0702 02:01:48.812501 1 tasks_processing.go:69] worker 6 listening for tasks. I0702 02:01:48.812505 1 tasks_processing.go:69] worker 44 listening for tasks. I0702 02:01:48.812469 1 tasks_processing.go:69] worker 16 listening for tasks. I0702 02:01:48.812505 1 tasks_processing.go:69] worker 8 listening for tasks. I0702 02:01:48.812512 1 tasks_processing.go:69] worker 7 listening for tasks. I0702 02:01:48.812508 1 tasks_processing.go:69] worker 32 listening for tasks. I0702 02:01:48.812510 1 tasks_processing.go:69] worker 33 listening for tasks. I0702 02:01:48.812518 1 tasks_processing.go:69] worker 40 listening for tasks. I0702 02:01:48.812514 1 tasks_processing.go:69] worker 39 listening for tasks. I0702 02:01:48.812514 1 tasks_processing.go:69] worker 38 listening for tasks. I0702 02:01:48.812520 1 tasks_processing.go:69] worker 34 listening for tasks. I0702 02:01:48.812517 1 tasks_processing.go:69] worker 21 listening for tasks. I0702 02:01:48.812524 1 tasks_processing.go:69] worker 27 listening for tasks. I0702 02:01:48.812527 1 tasks_processing.go:69] worker 56 listening for tasks. I0702 02:01:48.812527 1 tasks_processing.go:69] worker 36 listening for tasks. I0702 02:01:48.812530 1 tasks_processing.go:69] worker 41 listening for tasks. I0702 02:01:48.812526 1 tasks_processing.go:69] worker 35 listening for tasks. I0702 02:01:48.812525 1 tasks_processing.go:69] worker 26 listening for tasks. I0702 02:01:48.812530 1 tasks_processing.go:69] worker 28 listening for tasks. I0702 02:01:48.812534 1 tasks_processing.go:69] worker 22 listening for tasks. I0702 02:01:48.812537 1 tasks_processing.go:69] worker 29 listening for tasks. I0702 02:01:48.812537 1 tasks_processing.go:69] worker 43 listening for tasks. I0702 02:01:48.812534 1 tasks_processing.go:69] worker 42 listening for tasks. I0702 02:01:48.812540 1 tasks_processing.go:69] worker 46 listening for tasks. I0702 02:01:48.812534 1 tasks_processing.go:69] worker 45 listening for tasks. I0702 02:01:48.812545 1 tasks_processing.go:69] worker 51 listening for tasks. I0702 02:01:48.812534 1 tasks_processing.go:69] worker 37 listening for tasks. I0702 02:01:48.812549 1 tasks_processing.go:69] worker 52 listening for tasks. I0702 02:01:48.812539 1 tasks_processing.go:69] worker 25 listening for tasks. I0702 02:01:48.812552 1 tasks_processing.go:69] worker 23 listening for tasks. I0702 02:01:48.812553 1 tasks_processing.go:69] worker 59 listening for tasks. I0702 02:01:48.812549 1 tasks_processing.go:69] worker 24 listening for tasks. I0702 02:01:48.812545 1 tasks_processing.go:69] worker 47 listening for tasks. I0702 02:01:48.812558 1 tasks_processing.go:69] worker 57 listening for tasks. I0702 02:01:48.812558 1 tasks_processing.go:69] worker 60 listening for tasks. I0702 02:01:48.812559 1 tasks_processing.go:69] worker 50 listening for tasks. I0702 02:01:48.812561 1 tasks_processing.go:69] worker 54 listening for tasks. I0702 02:01:48.812562 1 tasks_processing.go:69] worker 55 listening for tasks. I0702 02:01:48.812563 1 tasks_processing.go:71] worker 20 working on proxies task. I0702 02:01:48.812566 1 tasks_processing.go:69] worker 61 listening for tasks. I0702 02:01:48.812565 1 tasks_processing.go:71] worker 1 working on storage_cluster task. I0702 02:01:48.812567 1 tasks_processing.go:71] worker 2 working on image task. I0702 02:01:48.812564 1 tasks_processing.go:69] worker 62 listening for tasks. I0702 02:01:48.812573 1 tasks_processing.go:71] worker 11 working on version task. I0702 02:01:48.812578 1 tasks_processing.go:69] worker 63 listening for tasks. I0702 02:01:48.812582 1 tasks_processing.go:71] worker 62 working on metrics task. I0702 02:01:48.812583 1 tasks_processing.go:71] worker 19 working on ceph_cluster task. I0702 02:01:48.812586 1 tasks_processing.go:71] worker 63 working on openstack_dataplanedeployments task. I0702 02:01:48.812588 1 tasks_processing.go:71] worker 33 working on dvo_metrics task. I0702 02:01:48.812592 1 tasks_processing.go:71] worker 3 working on container_runtime_configs task. W0702 02:01:48.812604 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 02:01:48.812616 1 gather.go:181] gatherer "clusterconfig" function "metrics" took 25.07µs to process 0 records I0702 02:01:48.812584 1 tasks_processing.go:71] worker 32 working on clusterroles task. I0702 02:01:48.812623 1 tasks_processing.go:71] worker 56 working on sap_config task. I0702 02:01:48.812546 1 tasks_processing.go:69] worker 48 listening for tasks. I0702 02:01:48.812631 1 tasks_processing.go:71] worker 48 working on machine_sets task. I0702 02:01:48.812636 1 tasks_processing.go:71] worker 37 working on machine_config_pools task. I0702 02:01:48.812625 1 tasks_processing.go:71] worker 62 working on active_alerts task. I0702 02:01:48.812660 1 tasks_processing.go:71] worker 39 working on sap_pods task. I0702 02:01:48.812663 1 tasks_processing.go:71] worker 42 working on machine_healthchecks task. I0702 02:01:48.812663 1 tasks_processing.go:71] worker 40 working on openstack_controlplanes task. I0702 02:01:48.812669 1 tasks_processing.go:71] worker 15 working on node_logs task. I0702 02:01:48.812674 1 tasks_processing.go:71] worker 35 working on aggregated_monitoring_cr_names task. W0702 02:01:48.812675 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 02:01:48.812681 1 tasks_processing.go:71] worker 47 working on cost_management_metrics_configs task. I0702 02:01:48.812578 1 tasks_processing.go:71] worker 27 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0702 02:01:48.812690 1 gather.go:181] gatherer "clusterconfig" function "active_alerts" took 18.786µs to process 0 records I0702 02:01:48.812556 1 tasks_processing.go:69] worker 53 listening for tasks. I0702 02:01:48.812703 1 tasks_processing.go:71] worker 53 working on cluster_apiserver task. I0702 02:01:48.812665 1 tasks_processing.go:71] worker 14 working on image_pruners task. I0702 02:01:48.812716 1 tasks_processing.go:71] worker 5 working on lokistack task. I0702 02:01:48.812968 1 tasks_processing.go:71] worker 25 working on service_accounts task. I0702 02:01:48.813015 1 tasks_processing.go:71] worker 6 working on machine_configs task. I0702 02:01:48.812661 1 tasks_processing.go:71] worker 4 working on certificate_signing_requests task. I0702 02:01:48.812559 1 tasks_processing.go:69] worker 58 listening for tasks. I0702 02:01:48.812981 1 tasks_processing.go:71] worker 43 working on image_registries task. I0702 02:01:48.812670 1 tasks_processing.go:71] worker 41 working on mutating_webhook_configurations task. I0702 02:01:48.813204 1 tasks_processing.go:71] worker 24 working on ingress task. I0702 02:01:48.813229 1 tasks_processing.go:71] worker 50 working on openstack_dataplanenodesets task. I0702 02:01:48.813271 1 tasks_processing.go:71] worker 57 working on infrastructures task. I0702 02:01:48.813287 1 tasks_processing.go:71] worker 60 working on support_secret task. I0702 02:01:48.813362 1 tasks_processing.go:71] worker 55 working on openshift_machine_api_events task. I0702 02:01:48.812683 1 tasks_processing.go:71] worker 62 working on feature_gates task. I0702 02:01:48.812563 1 tasks_processing.go:71] worker 0 working on config_maps task. I0702 02:01:48.812584 1 tasks_processing.go:71] worker 10 working on operators task. I0702 02:01:48.813383 1 tasks_processing.go:71] worker 61 working on pod_network_connectivity_checks task. I0702 02:01:48.812651 1 tasks_processing.go:71] worker 38 working on oauths task. I0702 02:01:48.812572 1 tasks_processing.go:71] worker 13 working on authentication task. I0702 02:01:48.812662 1 tasks_processing.go:71] worker 22 working on nodenetworkstates task. I0702 02:01:48.812553 1 tasks_processing.go:69] worker 49 listening for tasks. I0702 02:01:48.813882 1 tasks_processing.go:71] worker 49 working on openshift_logging task. I0702 02:01:48.812716 1 tasks_processing.go:71] worker 52 working on nodenetworkconfigurationpolicies task. I0702 02:01:48.812551 1 tasks_processing.go:69] worker 31 listening for tasks. I0702 02:01:48.812912 1 tasks_processing.go:71] worker 45 working on nodes task. I0702 02:01:48.812579 1 tasks_processing.go:71] worker 7 working on overlapping_namespace_uids task. I0702 02:01:48.812916 1 tasks_processing.go:71] worker 51 working on jaegers task. I0702 02:01:48.812904 1 tasks_processing.go:71] worker 46 working on tsdb_status task. I0702 02:01:48.814032 1 tasks_processing.go:74] worker 31 stopped. I0702 02:01:48.812932 1 tasks_processing.go:71] worker 9 working on networks task. I0702 02:01:48.812933 1 tasks_processing.go:71] worker 21 working on silenced_alerts task. W0702 02:01:48.814109 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory W0702 02:01:48.814117 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 02:01:48.814119 1 tasks_processing.go:74] worker 46 stopped. I0702 02:01:48.813003 1 tasks_processing.go:71] worker 18 working on operators_pods_and_events task. I0702 02:01:48.814131 1 gather.go:181] gatherer "clusterconfig" function "tsdb_status" took 91.25µs to process 0 records I0702 02:01:48.814142 1 gather.go:181] gatherer "clusterconfig" function "silenced_alerts" took 14.901µs to process 0 records I0702 02:01:48.814150 1 tasks_processing.go:74] worker 21 stopped. I0702 02:01:48.813117 1 tasks_processing.go:71] worker 59 working on storage_classes task. I0702 02:01:48.813117 1 tasks_processing.go:71] worker 44 working on openstack_version task. I0702 02:01:48.812546 1 tasks_processing.go:69] worker 30 listening for tasks. I0702 02:01:48.814239 1 tasks_processing.go:74] worker 30 stopped. I0702 02:01:48.813191 1 tasks_processing.go:71] worker 16 working on machine_autoscalers task. I0702 02:01:48.813203 1 tasks_processing.go:71] worker 26 working on ingress_certificates task. I0702 02:01:48.813222 1 tasks_processing.go:71] worker 8 working on olm_operators task. I0702 02:01:48.813392 1 tasks_processing.go:71] worker 54 working on machines task. I0702 02:01:48.813499 1 tasks_processing.go:71] worker 58 working on validating_webhook_configurations task. I0702 02:01:48.812665 1 tasks_processing.go:71] worker 36 working on container_images task. I0702 02:01:48.812928 1 tasks_processing.go:71] worker 29 working on install_plans task. I0702 02:01:48.812927 1 tasks_processing.go:71] worker 34 working on sap_datahubs task. I0702 02:01:48.813108 1 tasks_processing.go:71] worker 28 working on monitoring_persistent_volumes task. I0702 02:01:48.813112 1 tasks_processing.go:71] worker 23 working on schedulers task. I0702 02:01:48.820658 1 tasks_processing.go:74] worker 48 stopped. I0702 02:01:48.820670 1 gather.go:181] gatherer "clusterconfig" function "machine_sets" took 8.016581ms to process 0 records I0702 02:01:48.829893 1 tasks_processing.go:74] worker 1 stopped. I0702 02:01:48.829904 1 gather.go:181] gatherer "clusterconfig" function "storage_cluster" took 17.318102ms to process 0 records I0702 02:01:48.829911 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 17.303691ms to process 0 records I0702 02:01:48.829915 1 gather.go:181] gatherer "clusterconfig" function "sap_config" took 17.267191ms to process 0 records I0702 02:01:48.829916 1 tasks_processing.go:74] worker 63 stopped. I0702 02:01:48.829919 1 gather.go:181] gatherer "clusterconfig" function "sap_pods" took 17.234422ms to process 0 records I0702 02:01:48.829922 1 tasks_processing.go:74] worker 56 stopped. I0702 02:01:48.829926 1 gather.go:181] gatherer "clusterconfig" function "ceph_cluster" took 17.318666ms to process 0 records I0702 02:01:48.829927 1 tasks_processing.go:74] worker 39 stopped. I0702 02:01:48.829932 1 gather.go:181] gatherer "clusterconfig" function "openstack_controlplanes" took 17.239802ms to process 0 records I0702 02:01:48.829936 1 gather.go:181] gatherer "clusterconfig" function "lokistack" took 16.971867ms to process 0 records I0702 02:01:48.829939 1 gather.go:181] gatherer "clusterconfig" function "container_runtime_configs" took 17.323891ms to process 0 records I0702 02:01:48.829943 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 16.662917ms to process 0 records I0702 02:01:48.829946 1 tasks_processing.go:74] worker 50 stopped. I0702 02:01:48.829949 1 tasks_processing.go:74] worker 19 stopped. I0702 02:01:48.829951 1 tasks_processing.go:74] worker 40 stopped. I0702 02:01:48.829953 1 tasks_processing.go:74] worker 5 stopped. I0702 02:01:48.829955 1 tasks_processing.go:74] worker 3 stopped. I0702 02:01:48.830004 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0702 02:01:48.830017 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 02:01:48.830021 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0702 02:01:48.830023 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0702 02:01:48.830033 1 controller.go:457] The operator is still being initialized I0702 02:01:48.830039 1 controller.go:482] The operator is healthy I0702 02:01:48.832341 1 tasks_processing.go:74] worker 61 stopped. E0702 02:01:48.832355 1 gather.go:144] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0702 02:01:48.832363 1 gather.go:181] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 18.730471ms to process 0 records I0702 02:01:48.844920 1 tasks_processing.go:74] worker 42 stopped. E0702 02:01:48.844934 1 gather.go:144] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0702 02:01:48.844943 1 gather.go:181] gatherer "clusterconfig" function "machine_healthchecks" took 32.244157ms to process 0 records I0702 02:01:48.845077 1 tasks_processing.go:74] worker 17 stopped. I0702 02:01:48.845192 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=9435e4aaad173e545e520bba148874cab003ce6c979e0cf8567de47c5aa44d14 I0702 02:01:48.845208 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=9dd2d482b8ba8893d1095350d5de2d0e798fe17cb82445238a175018d1f1fe2a I0702 02:01:48.845221 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=14c2753aad98d04bf16819d9ad2ae76f91631cb2e7bf0e5c6bf2d712a636242e I0702 02:01:48.845226 1 gather.go:181] gatherer "clusterconfig" function "pdbs" took 32.590881ms to process 3 records I0702 02:01:48.845231 1 gather.go:181] gatherer "clusterconfig" function "machine_config_pools" took 32.48448ms to process 0 records I0702 02:01:48.845234 1 gather.go:181] gatherer "clusterconfig" function "cost_management_metrics_configs" took 32.445457ms to process 0 records I0702 02:01:48.845238 1 gather.go:181] gatherer "clusterconfig" function "openshift_machine_api_events" took 31.732619ms to process 0 records I0702 02:01:48.845242 1 tasks_processing.go:74] worker 55 stopped. I0702 02:01:48.845245 1 tasks_processing.go:74] worker 37 stopped. I0702 02:01:48.845247 1 tasks_processing.go:74] worker 47 stopped. I0702 02:01:48.845278 1 tasks_processing.go:74] worker 22 stopped. I0702 02:01:48.845292 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkstates" took 31.522678ms to process 0 records I0702 02:01:48.845365 1 tasks_processing.go:74] worker 2 stopped. I0702 02:01:48.845408 1 recorder.go:70] Recording config/image with fingerprint=af2e08d846179d17dab484ad5bd613914ac68d7839e34ecf37aa77f90a6c6f69 I0702 02:01:48.845418 1 gather.go:181] gatherer "clusterconfig" function "image" took 32.711084ms to process 1 records I0702 02:01:48.845455 1 recorder.go:70] Recording config/proxy with fingerprint=a9bb0279a7bc1e899961449b26672cf48f646a2a303aade5d05c17df4e60f510 I0702 02:01:48.845462 1 gather.go:181] gatherer "clusterconfig" function "proxies" took 32.722984ms to process 1 records I0702 02:01:48.845487 1 tasks_processing.go:74] worker 20 stopped. I0702 02:01:48.845554 1 tasks_processing.go:74] worker 14 stopped. I0702 02:01:48.845683 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=9e37b14fb968bd5f3d5fc3775355f9244c10abc121db471e33ce7d71853af526 I0702 02:01:48.845694 1 gather.go:181] gatherer "clusterconfig" function "image_pruners" took 32.643917ms to process 1 records I0702 02:01:48.845705 1 gather.go:181] gatherer "clusterconfig" function "jaegers" took 31.51785ms to process 0 records I0702 02:01:48.845711 1 gather.go:181] gatherer "clusterconfig" function "openshift_logging" took 31.609411ms to process 0 records I0702 02:01:48.845720 1 tasks_processing.go:74] worker 49 stopped. I0702 02:01:48.845725 1 tasks_processing.go:74] worker 51 stopped. I0702 02:01:48.845755 1 tasks_processing.go:74] worker 16 stopped. I0702 02:01:48.845779 1 gather.go:181] gatherer "clusterconfig" function "machine_autoscalers" took 31.506903ms to process 0 records I0702 02:01:48.845786 1 gather.go:181] gatherer "clusterconfig" function "node_logs" took 33.084273ms to process 0 records I0702 02:01:48.845791 1 tasks_processing.go:74] worker 15 stopped. I0702 02:01:48.845801 1 tasks_processing.go:74] worker 44 stopped. I0702 02:01:48.845808 1 gather.go:181] gatherer "clusterconfig" function "openstack_version" took 31.572726ms to process 0 records I0702 02:01:48.845836 1 tasks_processing.go:74] worker 34 stopped. I0702 02:01:48.845843 1 gather.go:181] gatherer "clusterconfig" function "sap_datahubs" took 31.419406ms to process 0 records I0702 02:01:48.845866 1 tasks_processing.go:74] worker 53 stopped. I0702 02:01:48.846138 1 recorder.go:70] Recording config/apiserver with fingerprint=2db4bb8381e1b0868a54c8e0a127ab845c0c3854e6818ca4edee49f666778154 I0702 02:01:48.846152 1 gather.go:181] gatherer "clusterconfig" function "cluster_apiserver" took 33.156541ms to process 1 records I0702 02:01:48.846221 1 tasks_processing.go:74] worker 38 stopped. I0702 02:01:48.846504 1 recorder.go:70] Recording config/oauth with fingerprint=5d8130dd8751e4caeef1957638b4772c7dbe25dec557f23c4d63a926b7e7b776 I0702 02:01:48.846540 1 gather.go:181] gatherer "clusterconfig" function "oauths" took 32.19642ms to process 1 records I0702 02:01:48.846651 1 tasks_processing.go:74] worker 13 stopped. I0702 02:01:48.846827 1 recorder.go:70] Recording config/authentication with fingerprint=8e5af4548919007acd24ec5ab6f2437e896089520f2b97ebe35903951455b122 I0702 02:01:48.846841 1 gather.go:181] gatherer "clusterconfig" function "authentication" took 32.377264ms to process 1 records I0702 02:01:48.846916 1 tasks_processing.go:74] worker 57 stopped. I0702 02:01:48.847433 1 recorder.go:70] Recording config/infrastructure with fingerprint=0d11b3bcc4b5ce96844a21c1db477b642fd7344ae1b3b4e841a8e910bd20eeb8 I0702 02:01:48.847444 1 gather.go:181] gatherer "clusterconfig" function "infrastructures" took 32.853514ms to process 1 records E0702 02:01:48.847450 1 gather.go:144] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0702 02:01:48.847456 1 gather.go:181] gatherer "clusterconfig" function "support_secret" took 32.898334ms to process 0 records I0702 02:01:48.847522 1 tasks_processing.go:74] worker 60 stopped. I0702 02:01:48.847613 1 tasks_processing.go:74] worker 9 stopped. I0702 02:01:48.847708 1 recorder.go:70] Recording config/network with fingerprint=217c53be4d69bd032d986a635c804ababb3e8fed9bdcd0a3dba1af4ade36bab7 I0702 02:01:48.847735 1 gather.go:181] gatherer "clusterconfig" function "networks" took 32.522808ms to process 1 records E0702 02:01:48.847790 1 gather.go:144] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0702 02:01:48.847796 1 gather.go:181] gatherer "clusterconfig" function "machines" took 32.336561ms to process 0 records I0702 02:01:48.848014 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=3231bbbcb1112897135d63b0a11a291eaf06088116fa9ddf5c08911645e12571 I0702 02:01:48.848088 1 tasks_processing.go:74] worker 54 stopped. I0702 02:01:48.848095 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=d46a4ddf79f412fe8e7834f36122cb36cce72f14f540b3b4eb6324fb1afb9163 I0702 02:01:48.848103 1 gather.go:181] gatherer "clusterconfig" function "storage_classes" took 32.560513ms to process 2 records I0702 02:01:48.848112 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 33.059105ms to process 0 records I0702 02:01:48.848120 1 tasks_processing.go:74] worker 59 stopped. I0702 02:01:48.848133 1 tasks_processing.go:74] worker 52 stopped. I0702 02:01:48.848264 1 tasks_processing.go:74] worker 24 stopped. I0702 02:01:48.848545 1 recorder.go:70] Recording config/ingress with fingerprint=b822c6317624b85f302ec9859da9b1ed0378bfd1a8600d87c584f2a00f46dea7 I0702 02:01:48.848592 1 gather.go:181] gatherer "clusterconfig" function "ingress" took 33.893011ms to process 1 records I0702 02:01:48.849310 1 tasks_processing.go:74] worker 43 stopped. I0702 02:01:48.850551 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=9a255a8355bc1651c095f80a1fef61a380e75b70e9f7a80bef2be58912731594 I0702 02:01:48.850571 1 gather.go:181] gatherer "clusterconfig" function "image_registries" took 34.925833ms to process 1 records I0702 02:01:48.850655 1 tasks_processing.go:74] worker 41 stopped. I0702 02:01:48.850746 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=7a195bc55ca92acfeec24e1169a3a55ee0e39255df408643bad3b9b85823e716 I0702 02:01:48.850834 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=2b2df8cd3fb7d2e56788ddc721991d177f02b39df373015fdbccc3ef55f2fb6f I0702 02:01:48.850884 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=028161bfe03830d53d16f151f84d45b82a9198d60acb572e43ca112243d4fa47 I0702 02:01:48.850896 1 gather.go:181] gatherer "clusterconfig" function "mutating_webhook_configurations" took 35.170842ms to process 3 records E0702 02:01:48.850910 1 gather.go:144] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0702 02:01:48.850925 1 tasks_processing.go:74] worker 6 stopped. I0702 02:01:48.850930 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0702 02:01:48.850939 1 gather.go:181] gatherer "clusterconfig" function "machine_configs" took 35.505558ms to process 1 records W0702 02:01:48.851026 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 02:01:48.851035 1 tasks_processing.go:74] worker 62 stopped. I0702 02:01:48.851065 1 recorder.go:70] Recording config/featuregate with fingerprint=0b6ceab5038447835bada9a6d673a8b19e5f678e629cff5e9473b5d0b1dd376d I0702 02:01:48.851074 1 gather.go:181] gatherer "clusterconfig" function "feature_gates" took 36.235733ms to process 1 records I0702 02:01:48.851156 1 tasks_processing.go:74] worker 45 stopped. I0702 02:01:48.851384 1 recorder.go:70] Recording config/node/ip-10-0-132-14.ec2.internal with fingerprint=84f470cb70245560de7f73831ca81061c816a1de90d4ec794468c31aee359a52 I0702 02:01:48.851445 1 recorder.go:70] Recording config/node/ip-10-0-149-83.ec2.internal with fingerprint=00fffcf1fc14b95cb6623d05a05cf3e0aa1e41d5367abc46083bcfff1e56f9e6 I0702 02:01:48.851503 1 recorder.go:70] Recording config/node/ip-10-0-172-39.ec2.internal with fingerprint=c002212d090fa55bc5b9cdef256ce8a19a187b2abc739226889fbe54cb7f356f I0702 02:01:48.851512 1 gather.go:181] gatherer "clusterconfig" function "nodes" took 36.699018ms to process 3 records I0702 02:01:48.851528 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0702 02:01:48.851538 1 gather.go:181] gatherer "clusterconfig" function "overlapping_namespace_uids" took 36.987756ms to process 1 records I0702 02:01:48.851545 1 tasks_processing.go:74] worker 7 stopped. I0702 02:01:48.852062 1 tasks_processing.go:74] worker 4 stopped. I0702 02:01:48.852074 1 gather.go:181] gatherer "clusterconfig" function "certificate_signing_requests" took 38.929312ms to process 0 records I0702 02:01:48.854926 1 tasks_processing.go:74] worker 28 stopped. I0702 02:01:48.854936 1 gather.go:181] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 40.449577ms to process 0 records I0702 02:01:48.855427 1 tasks_processing.go:74] worker 23 stopped. I0702 02:01:48.855479 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=69ac5781dd9bbc44e99c598e1d49b9d51086b1d1ae147e243229ca9e4b065e65 I0702 02:01:48.855488 1 gather.go:181] gatherer "clusterconfig" function "schedulers" took 40.903365ms to process 1 records I0702 02:01:48.859618 1 tasks_processing.go:74] worker 58 stopped. I0702 02:01:48.859859 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=4a5503300671bc5536a3567b580478b485c09a3aeafad90bf7cee85c4b1997b2 I0702 02:01:48.859932 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=e448c45670ed74e4fe4a0d86f9fa32d617c1febc39a99a56fb4adaa994949c79 I0702 02:01:48.859963 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=676c712b5fbc03872d532f4446480d9fad432078e926b6cffb6e2e93c8512096 I0702 02:01:48.859991 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=d7808ebbc906c0fdd76732f5ed7302e120737110633b4b507209cb00974d1373 I0702 02:01:48.860021 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=bd174e940c6eca2457346717cc62e66b71298ca9a4f7e81ca7fd1b67efe4da62 I0702 02:01:48.860048 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=33801be132091aeb41f77fc797b944b91faf68beb039ba04ceb2c41a23a60ef3 I0702 02:01:48.860066 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=eacb6929826aaed3f3224dfa2e1d95ce8e68d77bafe0aa7dae104b0601134b10 I0702 02:01:48.860103 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=20a06b8683823e548df6b9aa72155eb863e3b8f19b62eeefb40a996149bfcc90 I0702 02:01:48.860129 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=fd5e3e219339c2bb521db017f18c6f25b72afa1b0c634696f2882c9529bbc93d I0702 02:01:48.860157 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=135337b8e60ed2878e8bd7d1be7cd64125810cc4d1b1867ba8ef9235a9cb60ff I0702 02:01:48.860183 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=5e91142173f94eac5f1e9c26c9546d1a0cc4e083c12c9dd0c22b48798c15d63d I0702 02:01:48.860194 1 gather.go:181] gatherer "clusterconfig" function "validating_webhook_configurations" took 45.241733ms to process 11 records I0702 02:01:48.868010 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s I0702 02:01:48.868060 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0702 02:01:48.868155 1 operator.go:288] started I0702 02:01:48.868169 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0702 02:01:48.868580 1 tasks_processing.go:74] worker 32 stopped. I0702 02:01:48.868699 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=0ceeb4a6d80e5bf0d66033006ba9b642786849f50f4e773882630c9324752596 I0702 02:01:48.868757 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=6d20024c09b83907b0a92830389e5a2483111bafa74c37b29904a406a6d2d81e I0702 02:01:48.868780 1 gather.go:181] gatherer "clusterconfig" function "clusterroles" took 55.952354ms to process 2 records I0702 02:01:48.869054 1 tasks_processing.go:74] worker 35 stopped. I0702 02:01:48.869066 1 gather.go:181] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 56.368339ms to process 0 records I0702 02:01:48.869156 1 tasks_processing.go:74] worker 12 stopped. I0702 02:01:48.870039 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=d97fda14efa0078bb904652ffc0846a15f73da4e276189a6866dddc1f5fd0642 I0702 02:01:48.870380 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=5634cd6e454a423c690c1b23ca005347d74af3ba85713526fe4680d526550add I0702 02:01:48.870415 1 gather.go:181] gatherer "clusterconfig" function "crds" took 56.672012ms to process 2 records I0702 02:01:48.871461 1 tasks_processing.go:74] worker 8 stopped. I0702 02:01:48.871520 1 recorder.go:70] Recording config/olm_operators with fingerprint=a190537a40c07a8e3325aca1f621d926d4374b441626c70465cb9bc70344d32f I0702 02:01:48.871535 1 gather.go:181] gatherer "clusterconfig" function "olm_operators" took 57.127125ms to process 1 records I0702 02:01:48.872044 1 tasks_processing.go:74] worker 36 stopped. I0702 02:01:48.873249 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-c2g45 with fingerprint=62d52695c6fd37902cc4047b45c45543d416baa4d14436a9a73fa01bf61960c8 I0702 02:01:48.873366 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-chwwx with fingerprint=9cfb121fc6aae307bbe62c93cedb1f5fa78d31f74f453fe442baaa1e260ab431 I0702 02:01:48.873496 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-rn8cz with fingerprint=f1cdb65720213ab0f26286e2a703ebd4634e0af1adf819672ee2bf2ab88a43c9 I0702 02:01:48.873536 1 recorder.go:70] Recording config/running_containers with fingerprint=4455728c59f204405ee77eefe7b8e248af4b246a18d58f3d9d4da43048babd5a I0702 02:01:48.873544 1 gather.go:181] gatherer "clusterconfig" function "container_images" took 57.647862ms to process 4 records I0702 02:01:48.875384 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 02:01:48.875392 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0702 02:01:48.875394 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0702 02:01:48.875397 1 controller.go:203] Source scaController *sca.Controller is not ready I0702 02:01:48.875405 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0702 02:01:48.875420 1 controller.go:457] The operator is still being initialized I0702 02:01:48.875427 1 controller.go:482] The operator is healthy I0702 02:01:48.877485 1 tasks_processing.go:74] worker 27 stopped. I0702 02:01:48.877498 1 gather.go:181] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 64.78218ms to process 0 records I0702 02:01:48.880572 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0702 02:01:48.880895 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0702 02:01:48.881225 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 02:01:48.882061 1 prometheus_rules.go:88] Prometheus rules successfully created I0702 02:01:48.885204 1 requests.go:204] Asking for SCA certificate for x86_64 architecture I0702 02:01:48.885239 1 base_controller.go:73] Caches are synced for ConfigController I0702 02:01:48.885247 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... E0702 02:01:48.887700 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%!f(MISSING)70534c1-847e-40a6-a825-4f267cf77771%!+(MISSING)and+status+is+%!a(MISSING)ccepted%!"(MISSING): dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:51383->172.30.0.10:53: read: connection refused I0702 02:01:48.887711 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27f70534c1-847e-40a6-a825-4f267cf77771%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:51383->172.30.0.10:53: read: connection refused W0702 02:01:48.887719 1 sca.go:117] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:51383->172.30.0.10:53: read: connection refused I0702 02:01:48.887731 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:51383->172.30.0.10:53: read: connection refused I0702 02:01:48.890643 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:01:48.894639 1 tasks_processing.go:74] worker 0 stopped. E0702 02:01:48.894650 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0702 02:01:48.894654 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0702 02:01:48.894657 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0702 02:01:48.894690 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0702 02:01:48.894698 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0702 02:01:48.894700 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=e1a0ad594db3a5d5d50e9e25d7b235af20f84f5def41537f127febe525b834f2 I0702 02:01:48.894703 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0702 02:01:48.894720 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0702 02:01:48.894727 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0702 02:01:48.894731 1 gather.go:181] gatherer "clusterconfig" function "config_maps" took 81.103108ms to process 6 records I0702 02:01:48.928145 1 tasks_processing.go:74] worker 11 stopped. I0702 02:01:48.928521 1 recorder.go:70] Recording config/version with fingerprint=2e9f2937f0d36442382c712fc577ec400ec747ac366bbd8ae842b9d3160c259f I0702 02:01:48.928531 1 recorder.go:70] Recording config/id with fingerprint=eaa267323b0844bf8817153d2ffadebf68cf113d343c5a5e36bb1f8e97951053 I0702 02:01:48.928541 1 gather.go:181] gatherer "clusterconfig" function "version" took 115.559712ms to process 2 records I0702 02:01:48.968405 1 base_controller.go:73] Caches are synced for LoggingSyncer I0702 02:01:48.968414 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0702 02:01:48.971806 1 tasks_processing.go:74] worker 26 stopped. E0702 02:01:48.971816 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0702 02:01:48.971821 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2r9n66vnbhip7n41m9fgmvp5ueq47ofd-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2r9n66vnbhip7n41m9fgmvp5ueq47ofd-primary-cert-bundle-secret" not found I0702 02:01:48.971863 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=8e4506aa87af6f51c475ffb33aca34919d91cd7c54b4e86c5f6f4c990efffcb2 I0702 02:01:48.971875 1 gather.go:181] gatherer "clusterconfig" function "ingress_certificates" took 157.488468ms to process 1 records I0702 02:01:49.080387 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0702 02:01:49.259669 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0702 02:01:49.259682 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0702 02:01:49.260161 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-5gm4r pod in namespace openshift-dns (previous: false). I0702 02:01:49.274785 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0702 02:01:49.490482 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-5gm4r pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-5gm4r\" is waiting to start: ContainerCreating" I0702 02:01:49.490498 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-5gm4r\" is waiting to start: ContainerCreating" I0702 02:01:49.490504 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-5gm4r pod in namespace openshift-dns (previous: false). I0702 02:01:49.664780 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-5gm4r pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-5gm4r\" is waiting to start: ContainerCreating" I0702 02:01:49.664795 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-5gm4r\" is waiting to start: ContainerCreating" I0702 02:01:49.664819 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-5n6w8 pod in namespace openshift-dns (previous: false). W0702 02:01:49.849366 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 02:01:49.884713 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-5n6w8 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-5n6w8\" is waiting to start: ContainerCreating" I0702 02:01:49.884725 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-5n6w8\" is waiting to start: ContainerCreating" I0702 02:01:49.884731 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-5n6w8 pod in namespace openshift-dns (previous: false). I0702 02:01:50.068015 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-5n6w8 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-5n6w8\" is waiting to start: ContainerCreating" I0702 02:01:50.068028 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-5n6w8\" is waiting to start: ContainerCreating" I0702 02:01:50.068069 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-zzzjs pod in namespace openshift-dns (previous: false). I0702 02:01:50.077923 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0702 02:01:50.283634 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-zzzjs pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-zzzjs\" is waiting to start: ContainerCreating" I0702 02:01:50.283646 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-zzzjs\" is waiting to start: ContainerCreating" I0702 02:01:50.283653 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-zzzjs pod in namespace openshift-dns (previous: false). I0702 02:01:50.462946 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-zzzjs pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-zzzjs\" is waiting to start: ContainerCreating" I0702 02:01:50.462957 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-zzzjs\" is waiting to start: ContainerCreating" I0702 02:01:50.462963 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-dx84g pod in namespace openshift-dns (previous: false). I0702 02:01:50.677087 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:01:50.677099 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-vczng pod in namespace openshift-dns (previous: false). I0702 02:01:50.684354 1 tasks_processing.go:74] worker 10 stopped. I0702 02:01:50.684389 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=f7e2806a895add725ff9869916786f53cf38ee17542564c70b57f0fb074aa1d0 I0702 02:01:50.684420 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=4ffb9f141739dca26c08f0013d11e1a7a7f385778b42c34c9de178fd4750ad67 I0702 02:01:50.684451 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0702 02:01:50.684473 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=4632041d14a99f2b6226a830b564eec3aa4fadc4e84e7922601fdd1a08957c6b I0702 02:01:50.684490 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0702 02:01:50.684504 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=31d20f33cd35581d5fd38ff98bfeb7c052c5917af035032fa39715f605b6aebe I0702 02:01:50.684527 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=c75879a6f9a3488dcd2c9099e2eeed2d356c2defaadce08a7c50f6355232d951 I0702 02:01:50.684550 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=dbcab9d908b79810b35a2c0e72bfbcb1457f8344bef366810c9955921cb57ba4 I0702 02:01:50.684563 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=df504ca6a7728f7e50872190269d853a8449788ea6d465a3e35b786941abdfe8 I0702 02:01:50.684576 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=4c6fc9a8363f9a5ae4c1d31ba9adce2c81e13ba51bb4ec9b214630f570775c65 I0702 02:01:50.684582 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0702 02:01:50.684593 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=8aa84288ce4835a90e27bbde52a1123aef27f60d668a7dbe8f1caaf97963cda4 I0702 02:01:50.684602 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0702 02:01:50.684612 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=6941fe37516476b806462d24a048a27553dc5b8f0695a2a07e1de9dc0dba68e1 I0702 02:01:50.684619 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0702 02:01:50.684628 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=84e5be9a0eb6670c2f934ebbccb5c7528d3d8ac7f2f1212f88c0fa5fb59ac8fe I0702 02:01:50.684636 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0702 02:01:50.684645 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=5b90205616b8f0dd9226b1dcaf21920779cfa459cc622114a1ae9815db28ad34 I0702 02:01:50.684706 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=199b06b169b4c83e83804afaf4b1895425c3a173664396651933905b0b55c8ec I0702 02:01:50.684728 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0702 02:01:50.684742 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=97250e0365684f1c129de6b07408fe378a3a9d8afb32ab791e29836674358554 I0702 02:01:50.684757 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=2ebe69b36da6299a71a20e356d1d5f5c47a926680c104f2ba3efb9f2da556032 I0702 02:01:50.684776 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0702 02:01:50.684785 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=ef6e0da182a1fc1fdcb901e6710fc88832114810e8499cef327f2c3c7ca8ad63 I0702 02:01:50.684791 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0702 02:01:50.684800 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=a2fc2d5edf8f8b693a200402416117d0d7f81cbc3da2ae9b81427ef4748c384d I0702 02:01:50.684812 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=44d54adb399ef5abb15f1f8c7f5d85057375d97733b4b393ea3814cd8d198152 I0702 02:01:50.684820 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=c0177b0789ae241ca44cca6411b7746e756bffe5fcd8207da6a690cfc46a34b5 I0702 02:01:50.684830 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=4da5bb3cdaf46a72127b5648b8843b490fb96311d30708c1525c698eac39f5fb I0702 02:01:50.684842 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=9f585beec9863e5a02fc481e6495d920f8ed86535dda6f2511d43b2da1c96026 I0702 02:01:50.684849 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0702 02:01:50.684865 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=d2ab4160e7ec64f0ddbe50e851d5f509989fb329326bbddf53e5e34f467c34e8 I0702 02:01:50.684879 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0702 02:01:50.684887 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0702 02:01:50.684892 1 gather.go:181] gatherer "clusterconfig" function "operators" took 1.870777342s to process 34 records W0702 02:01:50.849500 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 02:01:50.869314 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:01:50.869325 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-zvzm7 pod in namespace openshift-dns (previous: false). I0702 02:01:51.075893 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:01:51.075925 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-8668c76fb4-wzxxt pod in namespace openshift-image-registry (previous: false). I0702 02:01:51.270775 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-8668c76fb4-wzxxt pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-8668c76fb4-wzxxt\" is waiting to start: ContainerCreating" I0702 02:01:51.270789 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-8668c76fb4-wzxxt\" is waiting to start: ContainerCreating" I0702 02:01:51.270826 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-f9f9b67c5-g7vnz pod in namespace openshift-image-registry (previous: false). I0702 02:01:51.465214 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-f9f9b67c5-g7vnz pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-f9f9b67c5-g7vnz\" is waiting to start: ContainerCreating" I0702 02:01:51.465226 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-f9f9b67c5-g7vnz\" is waiting to start: ContainerCreating" I0702 02:01:51.465259 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-f9f9b67c5-vvct6 pod in namespace openshift-image-registry (previous: false). I0702 02:01:51.670526 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-f9f9b67c5-vvct6 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-f9f9b67c5-vvct6\" is waiting to start: ContainerCreating" I0702 02:01:51.670540 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-f9f9b67c5-vvct6\" is waiting to start: ContainerCreating" I0702 02:01:51.670549 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-8zqx2 pod in namespace openshift-image-registry (previous: false). W0702 02:01:51.848589 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 02:01:51.867089 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:01:51.867102 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-g4nsc pod in namespace openshift-image-registry (previous: false). I0702 02:01:52.072154 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:01:52.072167 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-ghdnl pod in namespace openshift-image-registry (previous: false). I0702 02:01:52.267450 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:01:52.267462 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5c46c9bb57-2nwlb pod in namespace openshift-ingress (previous: false). I0702 02:01:52.486231 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5c46c9bb57-2nwlb pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5c46c9bb57-2nwlb\" is waiting to start: ContainerCreating" I0702 02:01:52.486243 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5c46c9bb57-2nwlb\" is waiting to start: ContainerCreating" I0702 02:01:52.486250 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-845dffc4b9-c6j4b pod in namespace openshift-ingress (previous: false). I0702 02:01:52.677065 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-845dffc4b9-c6j4b pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-845dffc4b9-c6j4b\" is waiting to start: ContainerCreating" I0702 02:01:52.677077 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-845dffc4b9-c6j4b\" is waiting to start: ContainerCreating" I0702 02:01:52.677084 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-845dffc4b9-kjfc5 pod in namespace openshift-ingress (previous: false). W0702 02:01:52.849665 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0702 02:01:52.864306 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-845dffc4b9-kjfc5 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-845dffc4b9-kjfc5\" is waiting to start: ContainerCreating" I0702 02:01:52.864317 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-845dffc4b9-kjfc5\" is waiting to start: ContainerCreating" I0702 02:01:52.864338 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-2qjxv pod in namespace openshift-ingress-canary (previous: false). I0702 02:01:53.066179 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-2qjxv pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-2qjxv\" is waiting to start: ContainerCreating" I0702 02:01:53.066194 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-2qjxv\" is waiting to start: ContainerCreating" I0702 02:01:53.066216 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-2svds pod in namespace openshift-ingress-canary (previous: false). I0702 02:01:53.281496 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-2svds pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-2svds\" is waiting to start: ContainerCreating" I0702 02:01:53.281510 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-2svds\" is waiting to start: ContainerCreating" I0702 02:01:53.281547 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-wgptt pod in namespace openshift-ingress-canary (previous: false). I0702 02:01:53.463486 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-wgptt pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-wgptt\" is waiting to start: ContainerCreating" I0702 02:01:53.463500 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-wgptt\" is waiting to start: ContainerCreating" I0702 02:01:53.463514 1 tasks_processing.go:74] worker 18 stopped. I0702 02:01:53.463587 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=dd29d10c12676985a4be6196fbabed1ed55a19ebf01ceff14760b9ba08433cdd I0702 02:01:53.463623 1 recorder.go:70] Recording events/openshift-dns with fingerprint=97ba2f63c99007d80aa31911f42626639bacbeca63b2cde4cb57fa060b2ec130 I0702 02:01:53.463689 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=4a1cf99d59d769b4100c428ee5b7e69c0319a6fc93f9423c70b60ffacc25168f I0702 02:01:53.463704 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=ef30faa1c2d38be94da2bf4986ed36eb63d783ca0972c610dd2978228bed60b4 I0702 02:01:53.463728 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=d4a6a8c4823f320bd60b15e0aa901ad1ebfb9a87373522634941a0dbcb1c5ca4 I0702 02:01:53.463740 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=8f5fa930d6441dc0e87e4c8e29d1a22f0f933e6274f83691acc322912b3c04ad I0702 02:01:53.463851 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-5gm4r with fingerprint=a36d5de1500046100112b3426bc38050fb3d2f811cfdcee620e063effd9c23c5 I0702 02:01:53.463901 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-5n6w8 with fingerprint=2572ba73dc23b8594017ebfebf40362e3c37d509b0acc06678d6b46ed117bb4d I0702 02:01:53.463941 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-zzzjs with fingerprint=2d7329a6a16e6e7f4e51dd9e45bc97eb2e7ff833b50c45e3900837167605b9d8 I0702 02:01:53.464011 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-8668c76fb4-wzxxt with fingerprint=72c086971ccfc840d63c712990ba612abbb3f814b5e751068ac63b3412eca721 I0702 02:01:53.464064 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-f9f9b67c5-g7vnz with fingerprint=98006d4054dbbcdb3fcced5b5e08ebfa91296a1fce6f30d4baf847653c718a9d I0702 02:01:53.464113 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-f9f9b67c5-vvct6 with fingerprint=6af29ce213f0b4a47f118cbd014b7d740acae6cbcff2ed018ae40fdb11cb38fa I0702 02:01:53.464149 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-2qjxv with fingerprint=4dfab217e98a6e8ed56afe66ce8249912a339a001ffc4503c1a4956707ac7ba3 I0702 02:01:53.464182 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-2svds with fingerprint=827291396cd2a21aad21c82edb14c935e4989f963a61ea13657f6a7270f7277c I0702 02:01:53.464212 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-wgptt with fingerprint=1a94f0ed34cbca5a1f63ec4312fee108cdcd589bee8951f036690292a89ef103 I0702 02:01:53.464221 1 gather.go:181] gatherer "clusterconfig" function "operators_pods_and_events" took 4.649381299s to process 15 records W0702 02:01:53.849222 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0702 02:01:53.849245 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0702 02:01:53.849259 1 tasks_processing.go:74] worker 33 stopped. E0702 02:01:53.849268 1 gather.go:144] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0702 02:01:53.849276 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0702 02:01:53.849288 1 gather.go:159] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0702 02:01:53.849299 1 gather.go:181] gatherer "clusterconfig" function "dvo_metrics" took 5.036659952s to process 1 records I0702 02:02:01.077799 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:02:01.277368 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:02:01.545950 1 tasks_processing.go:74] worker 29 stopped. I0702 02:02:01.545982 1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0702 02:02:01.545996 1 gather.go:181] gatherer "clusterconfig" function "install_plans" took 12.731547733s to process 1 records I0702 02:02:02.222462 1 tasks_processing.go:74] worker 25 stopped. I0702 02:02:02.222681 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=765abbbb8353a910402ad1771e2ae09bfdf14a9dd166bdb2594893eccc550da6 I0702 02:02:02.222701 1 gather.go:181] gatherer "clusterconfig" function "service_accounts" took 13.409438422s to process 1 records E0702 02:02:02.222744 1 periodic.go:252] clusterconfig failed after 13.41s with: function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0702 02:02:02.222756 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0702 02:02:02.222782 1 periodic.go:214] Running workloads gatherer I0702 02:02:02.222793 1 tasks_processing.go:45] number of workers: 2 I0702 02:02:02.222797 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 02:02:02.222800 1 tasks_processing.go:71] worker 1 working on helmchart_info task. I0702 02:02:02.222817 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 02:02:02.222839 1 tasks_processing.go:71] worker 0 working on workload_info task. I0702 02:02:02.243165 1 gather_workloads_info.go:281] Loaded pods in 0s, will wait 22s for image data I0702 02:02:02.255341 1 gather_workloads_info.go:390] No image sha256:5bcfb1b739fa4e6ff9e21e4843f8520f29608135341f7d8dcc31084b9ba25f1d (13ms) I0702 02:02:02.256793 1 tasks_processing.go:74] worker 1 stopped. I0702 02:02:02.256809 1 gather.go:181] gatherer "workloads" function "helmchart_info" took 33.983218ms to process 0 records I0702 02:02:02.266471 1 gather_workloads_info.go:390] No image sha256:0c1abef76d6d2832ddcff31e950ffafeb4e0f6fad80a5f5dca94591de0fc9581 (11ms) I0702 02:02:02.278945 1 gather_workloads_info.go:390] No image sha256:02283a64c1936a5dd09d5c6bc0ecbcf9196fe4df6a4055c8be22cebd850aa7a3 (12ms) I0702 02:02:02.299321 1 gather_workloads_info.go:390] No image sha256:0c6b7f828184b16a5e6630111e0715e11d34dae9b0bf64619466543e6168e05c (20ms) I0702 02:02:02.318472 1 gather_workloads_info.go:390] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (19ms) I0702 02:02:02.333839 1 gather_workloads_info.go:390] No image sha256:30ff5e5b72f274598704ca69f1832eba1040cc25da47386004fd59500b6e4c55 (15ms) I0702 02:02:02.353091 1 gather_workloads_info.go:390] No image sha256:41029e57ece558b2e0b12174ce924647fd9d5c5d83aadf4bba03d6916d3f9f54 (19ms) I0702 02:02:02.374060 1 gather_workloads_info.go:390] No image sha256:4b9b7949d209e257a76053de4ac74193f747c0d42e25dcd270d655849a4e51aa (21ms) I0702 02:02:02.396271 1 gather_workloads_info.go:390] No image sha256:c7aa910ca06f8fd89cdf2519136e0f3533bdacfc6bd58a3f6683f9f08756c7b1 (22ms) I0702 02:02:02.408217 1 gather_workloads_info.go:390] No image sha256:80fdd5049bd2815e49c198a795a116976a852e8de630be74872439ba6c08758a (12ms) I0702 02:02:02.418749 1 gather_workloads_info.go:390] No image sha256:351ca92471647f383f3cd7f0b70f33f5fa11c39ab569c4948dff7d471a6c8be3 (11ms) I0702 02:02:02.455090 1 gather_workloads_info.go:390] No image sha256:0158b297aec0a66376c04d3c7cf4828db5e5d9f424e331ff7c7b796828036875 (36ms) I0702 02:02:02.554474 1 gather_workloads_info.go:390] No image sha256:1eee856bde9bad71c4444c494225a0cf02d1f4a5293acf0bd6e7e1814efa0064 (99ms) I0702 02:02:02.654523 1 gather_workloads_info.go:390] No image sha256:42b4c6bdf3081ec264bc5edbc4eb779151de9e4742d6fe59a316645891df649c (100ms) I0702 02:02:02.754407 1 gather_workloads_info.go:390] No image sha256:38787de16ee8c686305f93b501d891b50cde24136009863869d230c0d4eeee5c (100ms) I0702 02:02:02.853924 1 gather_workloads_info.go:390] No image sha256:788d16bfff4bd6bb3ce97acc643b56fae6e619674ab279535480e519b4d5b769 (100ms) I0702 02:02:02.954106 1 gather_workloads_info.go:390] No image sha256:0242cefbf0bb876101c4d67ab4e07401cb0ba6c02be2b73a4f17ba33b2960005 (100ms) I0702 02:02:03.054539 1 gather_workloads_info.go:390] No image sha256:3a2c82b772ea6072e1eca0efc5303f002189e80b0e985fb3e3b8ea9a12fe8060 (100ms) I0702 02:02:03.154839 1 gather_workloads_info.go:390] No image sha256:4dcdadc14b7bdb2c00954d92e957d63aafbbe5f4047fe028e575d65725923cb0 (100ms) I0702 02:02:03.255022 1 gather_workloads_info.go:390] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (100ms) I0702 02:02:03.359930 1 gather_workloads_info.go:390] No image sha256:751bd7eb62f632c0eef0ca91b6c57c64d4f1279d4dbe1a9b875ac4020a7b693f (105ms) I0702 02:02:03.454879 1 gather_workloads_info.go:390] No image sha256:13aabbaf260d634ff0e9ac1af88af075b5ba671fd51313e33e74d7d2f7e54128 (95ms) I0702 02:02:03.563890 1 gather_workloads_info.go:390] No image sha256:6a9b4fd887fa7f1729302fb0330c3c9a483197bf78becdcfda4235ec823a2c39 (109ms) I0702 02:02:03.658290 1 gather_workloads_info.go:390] No image sha256:1c7c24111f1709d7648156873ced09462638aa4b3cf7e7aee13297e51bcdfb3e (94ms) I0702 02:02:03.760625 1 gather_workloads_info.go:390] No image sha256:894452e6587de55d04e37163d3da53e11fced8fb08bd0acf61e6d49f7964284e (102ms) I0702 02:02:03.854840 1 gather_workloads_info.go:390] No image sha256:48dff3fcb0da58eb9b2b500f89af8b7d0790ffa60da0b0e301feca971dbafcbb (94ms) I0702 02:02:03.957977 1 gather_workloads_info.go:390] No image sha256:ed0c9631d6e424912cd8ce78ca7a2c4f76b3fc15e9e34fe00999170ccf19a611 (103ms) I0702 02:02:04.055697 1 gather_workloads_info.go:390] No image sha256:a7fc4d05c4a3c82c9f355ca985d6fd26033c0d6a98716f25fcd2f54bae1d2fa0 (98ms) I0702 02:02:04.154323 1 gather_workloads_info.go:390] No image sha256:3fea7db586d3236c1876a8b523af0d8d65c84d6f6cf5d0f4e41cafcffe6db5b5 (99ms) I0702 02:02:04.253907 1 gather_workloads_info.go:390] No image sha256:8562a483f4568254250f19fc68d79f88c94a48508aefe59a70c1021a3aad000a (100ms) I0702 02:02:04.253932 1 tasks_processing.go:74] worker 0 stopped. I0702 02:02:04.254167 1 recorder.go:70] Recording config/workload_info with fingerprint=294010ff03f0b74ab7fb6aeb5e3b70a5584335e7ee49fc5f0f27578ca202ef0b I0702 02:02:04.254188 1 gather.go:181] gatherer "workloads" function "workload_info" took 2.031080442s to process 1 records I0702 02:02:04.254203 1 periodic.go:261] Periodic gather workloads completed in 2.031s I0702 02:02:04.254209 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0702 02:02:04.254213 1 periodic.go:214] Running conditional gatherer I0702 02:02:04.263503 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules I0702 02:02:04.268178 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:41874->172.30.0.10:53: read: connection refused E0702 02:02:04.268404 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0702 02:02:04.268449 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0702 02:02:04.277488 1 conditional_gatherer.go:390] cluster version is '4.18.9' E0702 02:02:04.277499 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 02:02:04.277503 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 02:02:04.277507 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 02:02:04.277509 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 02:02:04.277512 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 02:02:04.277515 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 02:02:04.277517 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 02:02:04.277519 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0702 02:02:04.277521 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0702 02:02:04.277532 1 tasks_processing.go:45] number of workers: 3 I0702 02:02:04.277540 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 02:02:04.277543 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0702 02:02:04.277604 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 02:02:04.277610 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0702 02:02:04.277613 1 tasks_processing.go:71] worker 1 working on remote_configuration task. I0702 02:02:04.277606 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0702 02:02:04.277617 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 02:02:04.277623 1 tasks_processing.go:74] worker 0 stopped. I0702 02:02:04.277629 1 gather.go:181] gatherer "conditional" function "conditional_gatherer_rules" took 557ns to process 1 records I0702 02:02:04.277672 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0702 02:02:04.277683 1 gather.go:181] gatherer "conditional" function "remote_configuration" took 954ns to process 1 records I0702 02:02:04.277687 1 tasks_processing.go:74] worker 1 stopped. I0702 02:02:04.277748 1 tasks_processing.go:74] worker 2 stopped. I0702 02:02:04.277757 1 gather.go:181] gatherer "conditional" function "rapid_container_logs" took 133.255µs to process 0 records I0702 02:02:04.277791 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:41874->172.30.0.10:53: read: connection refused I0702 02:02:04.277800 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 W0702 02:02:04.302899 1 gather.go:213] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0702 02:02:04.302985 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=0f4d605982945291e5445390b249a28043482b6f85e4c3bb3d4e8c438d37c64e I0702 02:02:04.303079 1 diskrecorder.go:70] Writing 110 records to /var/lib/insights-operator/insights-2026-07-02-020204.tar.gz I0702 02:02:04.309008 1 diskrecorder.go:51] Wrote 110 records to disk in 5ms I0702 02:02:04.309037 1 periodic.go:283] Gathering cluster info every 2h0m0s I0702 02:02:04.309057 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0702 02:02:11.293349 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:03:18.508435 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="90fd359d2744c85c2fdfc2e2d6dd315d0292653b9a479d2a20b0fed069887e5b") W0702 02:03:18.508467 1 builder.go:154] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0702 02:03:18.508634 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="3508c0d1d4faefd4eeb5c33603b90c174003f4c13bca93d6879b1b8a87b59423") I0702 02:03:18.508679 1 base_controller.go:172] Shutting down LoggingSyncer ... I0702 02:03:18.508785 1 periodic.go:175] Shutting down I0702 02:03:18.508806 1 base_controller.go:172] Shutting down ConfigController ... I0702 02:03:18.508814 1 genericapiserver.go:527] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0702 02:03:18.508814 1 base_controller.go:114] Shutting down worker of LoggingSyncer controller ... E0702 02:03:18.508832 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled