I0702 02:03:19.442428 1 cmd.go:250] Using service-serving-cert provided certificates I0702 02:03:19.442779 1 observer_polling.go:159] Starting file observer W0702 02:03:19.464998 1 builder.go:266] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-6fd96f47fd" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0702 02:03:19.751251 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0702 02:03:19.751460 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0702 02:03:19.751897 1 secure_serving.go:57] Forcing use of http/1.1 only W0702 02:03:19.751915 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0702 02:03:19.751921 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0702 02:03:19.751925 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0702 02:03:19.751927 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0702 02:03:19.751928 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0702 02:03:19.751931 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0702 02:03:19.752221 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0702 02:03:19.756019 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes ChunkSizeMiB CloudDualStackNodeIPs DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy PersistentIPsForVirtualization PrivateHostedZoneAWS SetEIPForNLBIngressController VSphereControlPlaneMachineSet VSphereDriverConfiguration VSphereMultiVCenters VSphereStaticIPs ValidatingAdmissionPolicy AWSClusterHostedDNS AdditionalRoutingCapabilities AutomatedEtcdBackup BootcNodeManagement CSIDriverSharedResource ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ConsolePluginContentSecurityPolicy DNSNameResolver DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example GCPClusterHostedDNS GatewayAPI ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MetricsCollectionProfiles MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NodeSwap NutanixMultiSubnets OVNObservability OnClusterBuild OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements RouteExternalCertificate ServiceAccountTokenNodeBinding SignatureStores SigstoreImageVerification TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0702 02:03:19.756047 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "ChunkSizeMiB", "CloudDualStackNodeIPs", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "SetEIPForNLBIngressController", "VSphereControlPlaneMachineSet", "VSphereDriverConfiguration", "VSphereMultiVCenters", "VSphereStaticIPs", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AdditionalRoutingCapabilities", "AutomatedEtcdBackup", "BootcNodeManagement", "CSIDriverSharedResource", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ConsolePluginContentSecurityPolicy", "DNSNameResolver", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "GCPClusterHostedDNS", "GatewayAPI", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MetricsCollectionProfiles", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OnClusterBuild", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SignatureStores", "SigstoreImageVerification", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0702 02:03:19.757958 1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController I0702 02:03:19.757971 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0702 02:03:19.757976 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0702 02:03:19.757987 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 02:03:19.757991 1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0702 02:03:19.758000 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0702 02:03:19.758153 1 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I0702 02:03:19.758230 1 secure_serving.go:213] Serving securely on [::]:8443 I0702 02:03:19.758254 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" E0702 02:03:19.758641 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18be56ac1ff7cd90 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"SetEIPForNLBIngressController\", \"VSphereControlPlaneMachineSet\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"VSphereStaticIPs\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AdditionalRoutingCapabilities\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"CSIDriverSharedResource\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ConsolePluginContentSecurityPolicy\", \"DNSNameResolver\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"GCPClusterHostedDNS\", \"GatewayAPI\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MetricsCollectionProfiles\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OnClusterBuild\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SignatureStores\", \"SigstoreImageVerification\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-02 02:03:19.755992464 +0000 UTC m=+0.342758462,LastTimestamp:2026-07-02 02:03:19.755992464 +0000 UTC m=+0.342758462,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0702 02:03:19.762169 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0702 02:03:19.762187 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 02:03:19.762239 1 base_controller.go:67] Waiting for caches to sync for ConfigController I0702 02:03:19.768204 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:03:19.768218 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0702 02:03:19.774006 1 secretconfigobserver.go:119] support secret does not exist I0702 02:03:19.779557 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:03:19.781370 1 recorder.go:156] Pruning old reports every 4h55m37s, max age is 288h0m0s I0702 02:03:19.785077 1 secretconfigobserver.go:119] support secret does not exist I0702 02:03:19.787397 1 periodic.go:214] Running clusterconfig gatherer I0702 02:03:19.787406 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0702 02:03:19.787412 1 insightsreport.go:296] Starting report retriever I0702 02:03:19.787416 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0702 02:03:19.787432 1 tasks_processing.go:45] number of workers: 64 I0702 02:03:19.787460 1 tasks_processing.go:69] worker 12 listening for tasks. I0702 02:03:19.787471 1 tasks_processing.go:69] worker 63 listening for tasks. I0702 02:03:19.787472 1 tasks_processing.go:71] worker 12 working on sap_pods task. I0702 02:03:19.787476 1 tasks_processing.go:71] worker 63 working on proxies task. I0702 02:03:19.787488 1 tasks_processing.go:69] worker 37 listening for tasks. I0702 02:03:19.787494 1 tasks_processing.go:71] worker 37 working on machine_autoscalers task. I0702 02:03:19.787502 1 tasks_processing.go:69] worker 50 listening for tasks. I0702 02:03:19.787511 1 tasks_processing.go:69] worker 38 listening for tasks. I0702 02:03:19.787518 1 tasks_processing.go:69] worker 39 listening for tasks. I0702 02:03:19.787516 1 tasks_processing.go:69] worker 5 listening for tasks. I0702 02:03:19.787524 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 02:03:19.787527 1 tasks_processing.go:69] worker 40 listening for tasks. I0702 02:03:19.787529 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 02:03:19.787534 1 tasks_processing.go:69] worker 41 listening for tasks. I0702 02:03:19.787536 1 tasks_processing.go:69] worker 3 listening for tasks. I0702 02:03:19.787397 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0702 02:03:19.787539 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 02:03:19.787542 1 tasks_processing.go:69] worker 42 listening for tasks. I0702 02:03:19.787545 1 tasks_processing.go:69] worker 10 listening for tasks. I0702 02:03:19.787667 1 tasks_processing.go:71] worker 10 working on container_images task. I0702 02:03:19.787680 1 tasks_processing.go:69] worker 6 listening for tasks. I0702 02:03:19.787685 1 tasks_processing.go:69] worker 57 listening for tasks. I0702 02:03:19.787693 1 tasks_processing.go:69] worker 7 listening for tasks. I0702 02:03:19.787701 1 tasks_processing.go:69] worker 51 listening for tasks. I0702 02:03:19.787549 1 tasks_processing.go:69] worker 43 listening for tasks. I0702 02:03:19.787547 1 tasks_processing.go:69] worker 4 listening for tasks. I0702 02:03:19.787700 1 tasks_processing.go:69] worker 46 listening for tasks. I0702 02:03:19.787725 1 tasks_processing.go:71] worker 42 working on image_registries task. I0702 02:03:19.787817 1 tasks_processing.go:69] worker 44 listening for tasks. I0702 02:03:19.787833 1 tasks_processing.go:69] worker 60 listening for tasks. I0702 02:03:19.787841 1 tasks_processing.go:69] worker 58 listening for tasks. I0702 02:03:19.787846 1 tasks_processing.go:69] worker 52 listening for tasks. I0702 02:03:19.787909 1 tasks_processing.go:69] worker 55 listening for tasks. I0702 02:03:19.787962 1 tasks_processing.go:71] worker 55 working on overlapping_namespace_uids task. I0702 02:03:19.787980 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0702 02:03:19.788015 1 tasks_processing.go:69] worker 61 listening for tasks. I0702 02:03:19.788026 1 tasks_processing.go:71] worker 61 working on openstack_dataplanedeployments task. I0702 02:03:19.788269 1 tasks_processing.go:69] worker 30 listening for tasks. I0702 02:03:19.788274 1 tasks_processing.go:69] worker 62 listening for tasks. I0702 02:03:19.788322 1 tasks_processing.go:69] worker 31 listening for tasks. I0702 02:03:19.788326 1 tasks_processing.go:69] worker 8 listening for tasks. I0702 02:03:19.788339 1 tasks_processing.go:71] worker 39 working on tsdb_status task. I0702 02:03:19.788393 1 tasks_processing.go:71] worker 5 working on config_maps task. I0702 02:03:19.788417 1 tasks_processing.go:71] worker 8 working on machine_configs task. I0702 02:03:19.788450 1 tasks_processing.go:71] worker 62 working on machine_sets task. I0702 02:03:19.788520 1 tasks_processing.go:69] worker 59 listening for tasks. I0702 02:03:19.788531 1 tasks_processing.go:71] worker 59 working on dvo_metrics task. I0702 02:03:19.788544 1 tasks_processing.go:69] worker 11 listening for tasks. I0702 02:03:19.788562 1 tasks_processing.go:71] worker 11 working on infrastructures task. I0702 02:03:19.788566 1 tasks_processing.go:71] worker 30 working on openshift_machine_api_events task. I0702 02:03:19.788617 1 tasks_processing.go:71] worker 7 working on machines task. I0702 02:03:19.788632 1 tasks_processing.go:71] worker 43 working on service_accounts task. I0702 02:03:19.788659 1 tasks_processing.go:69] worker 14 listening for tasks. I0702 02:03:19.788579 1 tasks_processing.go:69] worker 47 listening for tasks. I0702 02:03:19.788733 1 tasks_processing.go:71] worker 1 working on networks task. I0702 02:03:19.788789 1 tasks_processing.go:69] worker 15 listening for tasks. I0702 02:03:19.788800 1 tasks_processing.go:69] worker 16 listening for tasks. I0702 02:03:19.788542 1 tasks_processing.go:71] worker 4 working on nodenetworkstates task. I0702 02:03:19.788899 1 tasks_processing.go:71] worker 6 working on schedulers task. I0702 02:03:19.788956 1 tasks_processing.go:69] worker 18 listening for tasks. I0702 02:03:19.788961 1 tasks_processing.go:71] worker 46 working on operators_pods_and_events task. I0702 02:03:19.788964 1 tasks_processing.go:71] worker 2 working on storage_cluster task. I0702 02:03:19.788969 1 tasks_processing.go:69] worker 48 listening for tasks. I0702 02:03:19.788983 1 tasks_processing.go:69] worker 9 listening for tasks. I0702 02:03:19.788987 1 tasks_processing.go:71] worker 57 working on operators task. I0702 02:03:19.789007 1 tasks_processing.go:71] worker 31 working on monitoring_persistent_volumes task. I0702 02:03:19.789056 1 tasks_processing.go:71] worker 9 working on mutating_webhook_configurations task. I0702 02:03:19.789087 1 tasks_processing.go:71] worker 41 working on certificate_signing_requests task. I0702 02:03:19.788617 1 tasks_processing.go:69] worker 13 listening for tasks. I0702 02:03:19.789117 1 tasks_processing.go:71] worker 44 working on image task. I0702 02:03:19.789120 1 tasks_processing.go:71] worker 13 working on storage_classes task. I0702 02:03:19.789133 1 tasks_processing.go:69] worker 29 listening for tasks. I0702 02:03:19.789140 1 tasks_processing.go:69] worker 56 listening for tasks. I0702 02:03:19.788903 1 tasks_processing.go:69] worker 17 listening for tasks. I0702 02:03:19.789144 1 tasks_processing.go:71] worker 15 working on node_logs task. I0702 02:03:19.789149 1 tasks_processing.go:69] worker 33 listening for tasks. I0702 02:03:19.789151 1 tasks_processing.go:71] worker 14 working on oauths task. I0702 02:03:19.789154 1 tasks_processing.go:71] worker 60 working on sap_config task. I0702 02:03:19.789161 1 tasks_processing.go:71] worker 16 working on sap_datahubs task. I0702 02:03:19.789178 1 tasks_processing.go:69] worker 27 listening for tasks. I0702 02:03:19.788553 1 tasks_processing.go:71] worker 51 working on version task. I0702 02:03:19.789186 1 tasks_processing.go:71] worker 58 working on silenced_alerts task. I0702 02:03:19.789189 1 tasks_processing.go:71] worker 47 working on machine_config_pools task. I0702 02:03:19.789191 1 tasks_processing.go:71] worker 29 working on ingress task. I0702 02:03:19.789213 1 tasks_processing.go:69] worker 32 listening for tasks. I0702 02:03:19.789248 1 tasks_processing.go:69] worker 26 listening for tasks. I0702 02:03:19.789204 1 tasks_processing.go:69] worker 49 listening for tasks. I0702 02:03:19.789186 1 tasks_processing.go:71] worker 27 working on openstack_dataplanenodesets task. I0702 02:03:19.789233 1 tasks_processing.go:71] worker 52 working on aggregated_monitoring_cr_names task. I0702 02:03:19.789322 1 tasks_processing.go:71] worker 33 working on ceph_cluster task. I0702 02:03:19.789353 1 tasks_processing.go:69] worker 45 listening for tasks. I0702 02:03:19.789383 1 tasks_processing.go:71] worker 45 working on crds task. I0702 02:03:19.789345 1 tasks_processing.go:69] worker 54 listening for tasks. I0702 02:03:19.789243 1 tasks_processing.go:71] worker 18 working on active_alerts task. I0702 02:03:19.789434 1 tasks_processing.go:71] worker 54 working on pod_network_connectivity_checks task. I0702 02:03:19.789251 1 tasks_processing.go:71] worker 17 working on jaegers task. I0702 02:03:19.789498 1 tasks_processing.go:71] worker 40 working on authentication task. I0702 02:03:19.789251 1 tasks_processing.go:71] worker 56 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0702 02:03:19.789352 1 tasks_processing.go:69] worker 20 listening for tasks. I0702 02:03:19.789353 1 tasks_processing.go:69] worker 25 listening for tasks. I0702 02:03:19.789357 1 tasks_processing.go:71] worker 0 working on olm_operators task. I0702 02:03:19.789191 1 tasks_processing.go:69] worker 23 listening for tasks. I0702 02:03:19.789570 1 tasks_processing.go:71] worker 23 working on clusterroles task. I0702 02:03:19.789242 1 tasks_processing.go:71] worker 48 working on cost_management_metrics_configs task. I0702 02:03:19.789369 1 tasks_processing.go:69] worker 19 listening for tasks. I0702 02:03:19.789369 1 tasks_processing.go:69] worker 35 listening for tasks. I0702 02:03:19.789471 1 tasks_processing.go:71] worker 50 working on nodenetworkconfigurationpolicies task. I0702 02:03:19.789368 1 tasks_processing.go:69] worker 36 listening for tasks. I0702 02:03:19.789897 1 tasks_processing.go:71] worker 36 working on support_secret task. I0702 02:03:19.789360 1 tasks_processing.go:69] worker 22 listening for tasks. I0702 02:03:19.789372 1 tasks_processing.go:71] worker 3 working on pdbs task. I0702 02:03:19.789372 1 tasks_processing.go:69] worker 21 listening for tasks. I0702 02:03:19.789919 1 tasks_processing.go:71] worker 49 working on openstack_version task. I0702 02:03:19.789376 1 tasks_processing.go:69] worker 28 listening for tasks. I0702 02:03:19.789959 1 tasks_processing.go:71] worker 32 working on lokistack task. I0702 02:03:19.790016 1 tasks_processing.go:71] worker 26 working on image_pruners task. I0702 02:03:19.790059 1 tasks_processing.go:69] worker 53 listening for tasks. I0702 02:03:19.789371 1 tasks_processing.go:69] worker 34 listening for tasks. I0702 02:03:19.789425 1 tasks_processing.go:69] worker 24 listening for tasks. I0702 02:03:19.790149 1 tasks_processing.go:71] worker 21 working on openstack_controlplanes task. I0702 02:03:19.790151 1 tasks_processing.go:71] worker 28 working on openshift_logging task. I0702 02:03:19.790153 1 tasks_processing.go:71] worker 24 working on validating_webhook_configurations task. I0702 02:03:19.790156 1 tasks_processing.go:71] worker 53 working on ingress_certificates task. I0702 02:03:19.790145 1 tasks_processing.go:71] worker 34 working on metrics task. I0702 02:03:19.790146 1 tasks_processing.go:71] worker 22 working on feature_gates task. I0702 02:03:19.790315 1 tasks_processing.go:71] worker 38 working on cluster_apiserver task. I0702 02:03:19.790780 1 tasks_processing.go:71] worker 20 working on machine_healthchecks task. I0702 02:03:19.790840 1 tasks_processing.go:71] worker 25 working on nodes task. I0702 02:03:19.791116 1 tasks_processing.go:71] worker 19 working on install_plans task. I0702 02:03:19.791142 1 tasks_processing.go:71] worker 35 working on container_runtime_configs task. I0702 02:03:19.791607 1 tasks_processing.go:74] worker 37 stopped. I0702 02:03:19.791619 1 gather.go:181] gatherer "clusterconfig" function "machine_autoscalers" took 4.1078ms to process 0 records I0702 02:03:19.791641 1 tasks_processing.go:74] worker 61 stopped. I0702 02:03:19.791655 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 3.602703ms to process 0 records I0702 02:03:19.793124 1 tasks_processing.go:74] worker 7 stopped. E0702 02:03:19.793135 1 gather.go:144] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0702 02:03:19.793143 1 gather.go:181] gatherer "clusterconfig" function "machines" took 4.492963ms to process 0 records E0702 02:03:19.793391 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.79.58:9091: connect: connection refused E0702 02:03:19.793398 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.79.58:9091: connect: connection refused I0702 02:03:19.793415 1 tasks_processing.go:74] worker 39 stopped. E0702 02:03:19.793428 1 gather.go:144] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.79.58:9091: connect: connection refused I0702 02:03:19.793435 1 gather.go:181] gatherer "clusterconfig" function "tsdb_status" took 5.059673ms to process 0 records E0702 02:03:19.793441 1 gather.go:144] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.79.58:9091: connect: connection refused I0702 02:03:19.793480 1 gather.go:181] gatherer "clusterconfig" function "metrics" took 3.233681ms to process 0 records I0702 02:03:19.793490 1 tasks_processing.go:74] worker 34 stopped. I0702 02:03:19.793839 1 tasks_processing.go:74] worker 2 stopped. I0702 02:03:19.793854 1 gather.go:181] gatherer "clusterconfig" function "storage_cluster" took 4.865695ms to process 0 records I0702 02:03:19.805274 1 tasks_processing.go:74] worker 12 stopped. I0702 02:03:19.805284 1 gather.go:181] gatherer "clusterconfig" function "sap_pods" took 17.79374ms to process 0 records I0702 02:03:19.805299 1 tasks_processing.go:74] worker 50 stopped. I0702 02:03:19.805310 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 15.432065ms to process 0 records I0702 02:03:19.805344 1 tasks_processing.go:74] worker 49 stopped. I0702 02:03:19.805355 1 gather.go:181] gatherer "clusterconfig" function "openstack_version" took 15.417696ms to process 0 records I0702 02:03:19.805366 1 gather.go:181] gatherer "clusterconfig" function "ceph_cluster" took 15.981683ms to process 0 records I0702 02:03:19.805372 1 gather.go:181] gatherer "clusterconfig" function "sap_config" took 16.186061ms to process 0 records I0702 02:03:19.805377 1 gather.go:181] gatherer "clusterconfig" function "lokistack" took 15.383539ms to process 0 records I0702 02:03:19.805380 1 gather.go:181] gatherer "clusterconfig" function "machine_config_pools" took 16.174639ms to process 0 records I0702 02:03:19.805381 1 tasks_processing.go:74] worker 60 stopped. I0702 02:03:19.805383 1 tasks_processing.go:74] worker 47 stopped. I0702 02:03:19.805385 1 tasks_processing.go:74] worker 4 stopped. I0702 02:03:19.805384 1 tasks_processing.go:74] worker 33 stopped. I0702 02:03:19.805387 1 tasks_processing.go:74] worker 32 stopped. I0702 02:03:19.805389 1 gather.go:181] gatherer "clusterconfig" function "nodenetworkstates" took 16.501848ms to process 0 records I0702 02:03:19.805394 1 gather.go:181] gatherer "clusterconfig" function "sap_datahubs" took 16.224347ms to process 0 records I0702 02:03:19.805397 1 tasks_processing.go:74] worker 16 stopped. I0702 02:03:19.805484 1 tasks_processing.go:74] worker 27 stopped. I0702 02:03:19.805494 1 gather.go:181] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 16.2142ms to process 0 records I0702 02:03:19.805508 1 tasks_processing.go:74] worker 54 stopped. E0702 02:03:19.805513 1 gather.go:144] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0702 02:03:19.805521 1 gather.go:181] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 16.066866ms to process 0 records I0702 02:03:19.805562 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0702 02:03:19.805573 1 controller.go:317] The initial operator extension status is healthy I0702 02:03:19.805579 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0702 02:03:19.805586 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 02:03:19.805589 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0702 02:03:19.805592 1 tasks_processing.go:74] worker 63 stopped. I0702 02:03:19.805605 1 controller.go:457] The operator is still being initialized I0702 02:03:19.805609 1 recorder.go:70] Recording config/proxy with fingerprint=a9bb0279a7bc1e899961449b26672cf48f646a2a303aade5d05c17df4e60f510 I0702 02:03:19.805616 1 controller.go:482] The operator is healthy I0702 02:03:19.805621 1 gather.go:181] gatherer "clusterconfig" function "proxies" took 18.030928ms to process 1 records I0702 02:03:19.805625 1 gather.go:181] gatherer "clusterconfig" function "machine_sets" took 17.048257ms to process 0 records E0702 02:03:19.805629 1 gather.go:144] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0702 02:03:19.805635 1 tasks_processing.go:74] worker 62 stopped. I0702 02:03:19.805637 1 gather.go:181] gatherer "clusterconfig" function "support_secret" took 15.624989ms to process 0 records I0702 02:03:19.805640 1 tasks_processing.go:74] worker 36 stopped. I0702 02:03:19.805647 1 gather.go:181] gatherer "clusterconfig" function "openstack_controlplanes" took 15.419493ms to process 0 records I0702 02:03:19.805657 1 gather.go:181] gatherer "clusterconfig" function "openshift_logging" took 15.432531ms to process 0 records E0702 02:03:19.805663 1 gather.go:144] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0702 02:03:19.805671 1 gather.go:181] gatherer "clusterconfig" function "machine_healthchecks" took 14.832445ms to process 0 records I0702 02:03:19.805679 1 gather.go:181] gatherer "clusterconfig" function "container_runtime_configs" took 14.486404ms to process 0 records I0702 02:03:19.805680 1 sca.go:98] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/certificates. Next check is in 8h0m0s I0702 02:03:19.805684 1 gather.go:181] gatherer "clusterconfig" function "cost_management_metrics_configs" took 16.077127ms to process 0 records I0702 02:03:19.805709 1 tasks_processing.go:74] worker 20 stopped. I0702 02:03:19.805714 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0702 02:03:19.805722 1 tasks_processing.go:74] worker 28 stopped. I0702 02:03:19.805730 1 tasks_processing.go:74] worker 35 stopped. I0702 02:03:19.805735 1 tasks_processing.go:74] worker 48 stopped. I0702 02:03:19.805719 1 tasks_processing.go:74] worker 21 stopped. W0702 02:03:19.805828 1 operator.go:288] started I0702 02:03:19.805915 1 tasks_processing.go:74] worker 26 stopped. I0702 02:03:19.805924 1 base_controller.go:67] Waiting for caches to sync for LoggingSyncer I0702 02:03:19.806020 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=9e37b14fb968bd5f3d5fc3775355f9244c10abc121db471e33ce7d71853af526 I0702 02:03:19.806035 1 gather.go:181] gatherer "clusterconfig" function "image_pruners" took 15.62307ms to process 1 records I0702 02:03:19.806046 1 gather.go:181] gatherer "clusterconfig" function "jaegers" took 16.354694ms to process 0 records I0702 02:03:19.806070 1 tasks_processing.go:74] worker 17 stopped. I0702 02:03:19.806136 1 tasks_processing.go:74] worker 1 stopped. I0702 02:03:19.806208 1 recorder.go:70] Recording config/network with fingerprint=217c53be4d69bd032d986a635c804ababb3e8fed9bdcd0a3dba1af4ade36bab7 I0702 02:03:19.806219 1 gather.go:181] gatherer "clusterconfig" function "networks" took 17.127726ms to process 1 records I0702 02:03:19.806304 1 tasks_processing.go:74] worker 14 stopped. I0702 02:03:19.806386 1 recorder.go:70] Recording config/oauth with fingerprint=5d8130dd8751e4caeef1957638b4772c7dbe25dec557f23c4d63a926b7e7b776 I0702 02:03:19.806394 1 gather.go:181] gatherer "clusterconfig" function "oauths" took 16.937025ms to process 1 records I0702 02:03:19.806475 1 tasks_processing.go:74] worker 11 stopped. I0702 02:03:19.806743 1 recorder.go:70] Recording config/infrastructure with fingerprint=0d11b3bcc4b5ce96844a21c1db477b642fd7344ae1b3b4e841a8e910bd20eeb8 I0702 02:03:19.806750 1 gather.go:181] gatherer "clusterconfig" function "infrastructures" took 17.809347ms to process 1 records I0702 02:03:19.813991 1 tasks_processing.go:74] worker 40 stopped. I0702 02:03:19.814167 1 recorder.go:70] Recording config/authentication with fingerprint=7b12b11ac041cd07a5a825bcdcdabf0742dbf7cf0eeebd7237c3f1a1b0350935 I0702 02:03:19.814181 1 gather.go:181] gatherer "clusterconfig" function "authentication" took 24.48041ms to process 1 records I0702 02:03:19.814350 1 tasks_processing.go:74] worker 6 stopped. I0702 02:03:19.814406 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=69ac5781dd9bbc44e99c598e1d49b9d51086b1d1ae147e243229ca9e4b065e65 I0702 02:03:19.814415 1 gather.go:181] gatherer "clusterconfig" function "schedulers" took 25.439558ms to process 1 records I0702 02:03:19.816308 1 tasks_processing.go:74] worker 42 stopped. I0702 02:03:19.816637 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=4a74174bd0d9b07f2f8257f687db4b228cd34ab81f0b8b127a6206d93c6b8791 I0702 02:03:19.816650 1 gather.go:181] gatherer "clusterconfig" function "image_registries" took 28.570313ms to process 1 records I0702 02:03:19.816730 1 tasks_processing.go:74] worker 38 stopped. I0702 02:03:19.816739 1 recorder.go:70] Recording config/apiserver with fingerprint=2db4bb8381e1b0868a54c8e0a127ab845c0c3854e6818ca4edee49f666778154 I0702 02:03:19.816746 1 gather.go:181] gatherer "clusterconfig" function "cluster_apiserver" took 26.142727ms to process 1 records I0702 02:03:19.816773 1 tasks_processing.go:74] worker 55 stopped. I0702 02:03:19.816779 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0702 02:03:19.816786 1 gather.go:181] gatherer "clusterconfig" function "overlapping_namespace_uids" took 28.763854ms to process 1 records I0702 02:03:19.817619 1 tasks_processing.go:74] worker 9 stopped. I0702 02:03:19.817757 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=7a195bc55ca92acfeec24e1169a3a55ee0e39255df408643bad3b9b85823e716 I0702 02:03:19.817795 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=2b2df8cd3fb7d2e56788ddc721991d177f02b39df373015fdbccc3ef55f2fb6f I0702 02:03:19.817810 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=028161bfe03830d53d16f151f84d45b82a9198d60acb572e43ca112243d4fa47 I0702 02:03:19.817815 1 gather.go:181] gatherer "clusterconfig" function "mutating_webhook_configurations" took 28.543355ms to process 3 records I0702 02:03:19.823074 1 tasks_processing.go:74] worker 13 stopped. I0702 02:03:19.823138 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=3231bbbcb1112897135d63b0a11a291eaf06088116fa9ddf5c08911645e12571 I0702 02:03:19.823171 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=d46a4ddf79f412fe8e7834f36122cb36cce72f14f540b3b4eb6324fb1afb9163 I0702 02:03:19.823179 1 gather.go:181] gatherer "clusterconfig" function "storage_classes" took 33.947806ms to process 2 records I0702 02:03:19.824008 1 tasks_processing.go:74] worker 3 stopped. I0702 02:03:19.824066 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=91eb7833d811b74bd83e98c335ea8aed4368dad63ce81e3565755898aba83d93 I0702 02:03:19.824079 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=957049b19023263ca6fdd8efbd201e3eb4ba0277fc0897c454a551ffaaebf953 I0702 02:03:19.824087 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=8973656397ccadeb3d9aebeb1c3ba1265d42a671d799cdca63bdcd4b61241744 I0702 02:03:19.824096 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=511b9391d57cdc98822c40bedf8f898ecbbf1c851a9f9c0217b1ee777979a048 I0702 02:03:19.824109 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=09e6923951e24125e6d36754cc39c8ef1209373380a9368ed3b8b41b52d1cbb8 I0702 02:03:19.824117 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=13ba0a313ce8444fcc0d51e93094d880206f288819852dce6aa8b035bcf5a859 I0702 02:03:19.824129 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=a3218be588d2338cdbd72cd88d72d0e9accf49ddcf6449a40e492eb597cce20e I0702 02:03:19.824166 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=61fb442868091bd997602c4a98f6e5cc38be25121a643f21f87c7294ce5a8785 I0702 02:03:19.824177 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=368eb4f690a1529d9e28f3861a54db1b39e00d51f8697f0c5f70cc6b58ac82c3 I0702 02:03:19.824186 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=cdb1615997d690e8a9a06d5059fc0b61ebb71e2da06fc4a2a5b1018295e38c98 I0702 02:03:19.824197 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=14c2753aad98d04bf16819d9ad2ae76f91631cb2e7bf0e5c6bf2d712a636242e I0702 02:03:19.824205 1 gather.go:181] gatherer "clusterconfig" function "pdbs" took 34.090576ms to process 11 records I0702 02:03:19.829453 1 tasks_processing.go:74] worker 59 stopped. I0702 02:03:19.829466 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=108780cb24f15bf572a4031966507398a0d0c6a28b3a008952f53b481dc191a9 I0702 02:03:19.829477 1 gather.go:181] gatherer "clusterconfig" function "dvo_metrics" took 40.911873ms to process 1 records I0702 02:03:19.831066 1 tasks_processing.go:74] worker 44 stopped. I0702 02:03:19.831136 1 recorder.go:70] Recording config/image with fingerprint=af2e08d846179d17dab484ad5bd613914ac68d7839e34ecf37aa77f90a6c6f69 I0702 02:03:19.831147 1 gather.go:181] gatherer "clusterconfig" function "image" took 41.941772ms to process 1 records I0702 02:03:19.831156 1 gather.go:181] gatherer "clusterconfig" function "openshift_machine_api_events" took 42.516026ms to process 0 records I0702 02:03:19.831161 1 tasks_processing.go:74] worker 30 stopped. I0702 02:03:19.831860 1 tasks_processing.go:74] worker 29 stopped. I0702 02:03:19.832288 1 recorder.go:70] Recording config/ingress with fingerprint=b822c6317624b85f302ec9859da9b1ed0378bfd1a8600d87c584f2a00f46dea7 I0702 02:03:19.832346 1 gather.go:181] gatherer "clusterconfig" function "ingress" took 42.660663ms to process 1 records I0702 02:03:19.832359 1 gather.go:181] gatherer "clusterconfig" function "node_logs" took 42.717966ms to process 0 records I0702 02:03:19.832374 1 tasks_processing.go:74] worker 15 stopped. I0702 02:03:19.833392 1 tasks_processing.go:74] worker 8 stopped. E0702 02:03:19.833405 1 gather.go:144] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0702 02:03:19.833433 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0702 02:03:19.833440 1 gather.go:181] gatherer "clusterconfig" function "machine_configs" took 44.963039ms to process 1 records I0702 02:03:19.833435 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0702 02:03:19.833448 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0702 02:03:19.833455 1 controller.go:203] Source scaController *sca.Controller is not ready I0702 02:03:19.833459 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0702 02:03:19.833464 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0702 02:03:19.833481 1 controller.go:457] The operator is still being initialized I0702 02:03:19.833492 1 controller.go:482] The operator is healthy I0702 02:03:19.833586 1 tasks_processing.go:74] worker 25 stopped. I0702 02:03:19.833952 1 recorder.go:70] Recording config/node/ip-10-0-132-14.ec2.internal with fingerprint=bea9c459ef0786674973029664a0db547a6e024672aafd9cf5b8d3d009eb7a93 I0702 02:03:19.834019 1 recorder.go:70] Recording config/node/ip-10-0-149-83.ec2.internal with fingerprint=0392438863ce30750d7a2870dbc7d53c4d5971e5b171a444d1a52df92ea8dcf6 I0702 02:03:19.834076 1 recorder.go:70] Recording config/node/ip-10-0-172-39.ec2.internal with fingerprint=65fce8c82eeffddfaffedfdefeea089da3b6861adacdd6f7274992dbbf7b3f37 I0702 02:03:19.834087 1 gather.go:181] gatherer "clusterconfig" function "nodes" took 42.735306ms to process 3 records I0702 02:03:19.834170 1 tasks_processing.go:74] worker 22 stopped. I0702 02:03:19.834196 1 recorder.go:70] Recording config/featuregate with fingerprint=0b6ceab5038447835bada9a6d673a8b19e5f678e629cff5e9473b5d0b1dd376d I0702 02:03:19.834204 1 gather.go:181] gatherer "clusterconfig" function "feature_gates" took 43.387217ms to process 1 records I0702 02:03:19.834283 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=ab8e798db05d425522d42c51ae9c480ad5b77fcc0d18c29fbd7bf6cce9834731 I0702 02:03:19.834290 1 tasks_processing.go:74] worker 24 stopped. I0702 02:03:19.834331 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=4a5503300671bc5536a3567b580478b485c09a3aeafad90bf7cee85c4b1997b2 I0702 02:03:19.834404 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=e448c45670ed74e4fe4a0d86f9fa32d617c1febc39a99a56fb4adaa994949c79 I0702 02:03:19.834427 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=a8a49283156cb258fd5df0c7d276bf99512233124e4aa4afa721bd5cb0d7e641 I0702 02:03:19.834448 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=d11f8662622d68e0d94b46d732f3e37524c5f498708faf2fcc5da6e5b5289c02 I0702 02:03:19.834469 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=d7808ebbc906c0fdd76732f5ed7302e120737110633b4b507209cb00974d1373 I0702 02:03:19.834491 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=bd174e940c6eca2457346717cc62e66b71298ca9a4f7e81ca7fd1b67efe4da62 I0702 02:03:19.834513 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=33801be132091aeb41f77fc797b944b91faf68beb039ba04ceb2c41a23a60ef3 I0702 02:03:19.834534 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=eacb6929826aaed3f3224dfa2e1d95ce8e68d77bafe0aa7dae104b0601134b10 I0702 02:03:19.834564 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=20a06b8683823e548df6b9aa72155eb863e3b8f19b62eeefb40a996149bfcc90 I0702 02:03:19.834586 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=fd5e3e219339c2bb521db017f18c6f25b72afa1b0c634696f2882c9529bbc93d I0702 02:03:19.834606 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=135337b8e60ed2878e8bd7d1be7cd64125810cc4d1b1867ba8ef9235a9cb60ff I0702 02:03:19.834627 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=5e91142173f94eac5f1e9c26c9546d1a0cc4e083c12c9dd0c22b48798c15d63d I0702 02:03:19.834636 1 gather.go:181] gatherer "clusterconfig" function "validating_webhook_configurations" took 43.479599ms to process 13 records I0702 02:03:19.836313 1 requests.go:204] Asking for SCA certificate for x86_64 architecture I0702 02:03:19.836573 1 tasks_processing.go:74] worker 31 stopped. I0702 02:03:19.836588 1 gather.go:181] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 47.550793ms to process 0 records I0702 02:03:19.844316 1 tasks_processing.go:74] worker 23 stopped. I0702 02:03:19.844448 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=2c374ab36d212b387f4e5c6fcc1e4ba83c8b6fb6ba88dd10b3f5e31ad0929a68 I0702 02:03:19.844499 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=9991dac68d52ff63811d506a30606a896148be3e41eb686ae9ca05a404cc8340 I0702 02:03:19.844507 1 gather.go:181] gatherer "clusterconfig" function "clusterroles" took 54.73585ms to process 2 records I0702 02:03:19.844611 1 tasks_processing.go:74] worker 45 stopped. I0702 02:03:19.844994 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=d97fda14efa0078bb904652ffc0846a15f73da4e276189a6866dddc1f5fd0642 I0702 02:03:19.845113 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=5634cd6e454a423c690c1b23ca005347d74af3ba85713526fe4680d526550add I0702 02:03:19.845121 1 gather.go:181] gatherer "clusterconfig" function "crds" took 55.173322ms to process 2 records I0702 02:03:19.848115 1 tasks_processing.go:74] worker 51 stopped. I0702 02:03:19.848389 1 recorder.go:70] Recording config/version with fingerprint=4cd91d7b7c350349778f6e80cf34beec2226008d2dcb2bd6c41782c7bfc3e1ba I0702 02:03:19.848400 1 recorder.go:70] Recording config/id with fingerprint=eaa267323b0844bf8817153d2ffadebf68cf113d343c5a5e36bb1f8e97951053 I0702 02:03:19.848409 1 gather.go:181] gatherer "clusterconfig" function "version" took 58.928192ms to process 2 records I0702 02:03:19.848444 1 recorder.go:70] Recording config/olm_operators with fingerprint=a190537a40c07a8e3325aca1f621d926d4374b441626c70465cb9bc70344d32f I0702 02:03:19.848453 1 gather.go:181] gatherer "clusterconfig" function "olm_operators" took 58.82506ms to process 1 records I0702 02:03:19.848457 1 tasks_processing.go:74] worker 0 stopped. I0702 02:03:19.849175 1 tasks_processing.go:74] worker 52 stopped. I0702 02:03:19.849189 1 gather.go:181] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 59.897606ms to process 0 records I0702 02:03:19.851280 1 tasks_processing.go:74] worker 41 stopped. I0702 02:03:19.851299 1 gather.go:181] gatherer "clusterconfig" function "certificate_signing_requests" took 62.174483ms to process 0 records I0702 02:03:19.853888 1 tasks_processing.go:74] worker 10 stopped. I0702 02:03:19.854888 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-7d4ddc79d6-vxpf5 with fingerprint=0dd7bc9a382d00b8e36cc2e8c1bc63b89ee8a2bcf71ecf4b92991cded93c1fca I0702 02:03:19.855034 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-c2g45 with fingerprint=62d52695c6fd37902cc4047b45c45543d416baa4d14436a9a73fa01bf61960c8 I0702 02:03:19.855142 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-chwwx with fingerprint=9cfb121fc6aae307bbe62c93cedb1f5fa78d31f74f453fe442baaa1e260ab431 I0702 02:03:19.855245 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-rn8cz with fingerprint=f1cdb65720213ab0f26286e2a703ebd4634e0af1adf819672ee2bf2ab88a43c9 I0702 02:03:19.855292 1 recorder.go:70] Recording config/running_containers with fingerprint=4ab0ebbb018548b47f88fc92e935011c67fdafc6d20655c7cde6f643a8650ee8 I0702 02:03:19.855299 1 gather.go:181] gatherer "clusterconfig" function "container_images" took 66.205172ms to process 5 records I0702 02:03:19.858166 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0702 02:03:19.858191 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0702 02:03:19.858201 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0702 02:03:19.862526 1 base_controller.go:73] Caches are synced for ConfigController I0702 02:03:19.862535 1 base_controller.go:110] Starting #1 worker of ConfigController controller ... I0702 02:03:19.869270 1 tasks_processing.go:74] worker 56 stopped. I0702 02:03:19.869281 1 gather.go:181] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 79.74939ms to process 0 records I0702 02:03:19.871914 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:03:19.872326 1 tasks_processing.go:74] worker 5 stopped. E0702 02:03:19.872337 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0702 02:03:19.872342 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0702 02:03:19.872345 1 gather.go:144] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0702 02:03:19.872368 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0702 02:03:19.872375 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0702 02:03:19.872378 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=e1a0ad594db3a5d5d50e9e25d7b235af20f84f5def41537f127febe525b834f2 I0702 02:03:19.872384 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I0702 02:03:19.872407 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0702 02:03:19.872413 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0702 02:03:19.872417 1 gather.go:181] gatherer "clusterconfig" function "config_maps" took 83.916449ms to process 6 records I0702 02:03:19.875043 1 cluster_transfer.go:102] no available accepted cluster transfer I0702 02:03:19.875053 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I0702 02:03:19.878826 1 tasks_processing.go:74] worker 53 stopped. E0702 02:03:19.878837 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0702 02:03:19.878846 1 gather.go:144] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2r9n66vnbhip7n41m9fgmvp5ueq47ofd-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2r9n66vnbhip7n41m9fgmvp5ueq47ofd-primary-cert-bundle-secret" not found I0702 02:03:19.878896 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=8e4506aa87af6f51c475ffb33aca34919d91cd7c54b4e86c5f6f4c990efffcb2 I0702 02:03:19.878906 1 gather.go:181] gatherer "clusterconfig" function "ingress_certificates" took 88.658404ms to process 1 records I0702 02:03:19.906468 1 base_controller.go:73] Caches are synced for LoggingSyncer I0702 02:03:19.906477 1 base_controller.go:110] Starting #1 worker of LoggingSyncer controller ... I0702 02:03:19.922435 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I0702 02:03:20.037642 1 sca.go:141] etc-pki-entitlement secret successfully updated I0702 02:03:20.037656 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated in the etc-pki-entitlement secret I0702 02:03:20.458973 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0702 02:03:20.648617 1 gather_cluster_operator_pods_and_events.go:121] Found 19 pods with 23 containers I0702 02:03:20.648628 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1094166 bytes I0702 02:03:20.648899 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-5gm4r pod in namespace openshift-dns (previous: false). I0702 02:03:20.654628 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0702 02:03:20.819472 1 tasks_processing.go:74] worker 58 stopped. I0702 02:03:20.819491 1 recorder.go:70] Recording config/silenced_alerts.json with fingerprint=37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570 I0702 02:03:20.819500 1 gather.go:181] gatherer "clusterconfig" function "silenced_alerts" took 1.030272229s to process 1 records I0702 02:03:20.819525 1 tasks_processing.go:74] worker 18 stopped. I0702 02:03:20.819574 1 recorder.go:70] Recording config/alerts with fingerprint=ebfe4fbb3d92e12e780c6b13e3b8b58366e24a7dfb511135a413a037eb2447ae I0702 02:03:20.819592 1 gather.go:181] gatherer "clusterconfig" function "active_alerts" took 1.030083148s to process 1 records I0702 02:03:20.862412 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-5gm4r pod in namespace openshift-dns (previous: false). I0702 02:03:21.050169 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-5n6w8 pod in namespace openshift-dns (previous: false). I0702 02:03:21.248570 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-5n6w8 pod in namespace openshift-dns (previous: false). I0702 02:03:21.449362 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-zzzjs pod in namespace openshift-dns (previous: false). I0702 02:03:21.649002 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-zzzjs pod in namespace openshift-dns (previous: false). I0702 02:03:21.848596 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-dx84g pod in namespace openshift-dns (previous: false). I0702 02:03:22.051131 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:03:22.051145 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-vczng pod in namespace openshift-dns (previous: false). I0702 02:03:22.060923 1 tasks_processing.go:74] worker 57 stopped. I0702 02:03:22.061066 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=a50895247aea98758060e8f203fe4470074a0a750bf3b928acc23518ac040afc I0702 02:03:22.061110 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=183539bbe89c989a326011f124cb26e91d4dc0406689baecde44742b1c4a8e80 I0702 02:03:22.061128 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=4ffb9f141739dca26c08f0013d11e1a7a7f385778b42c34c9de178fd4750ad67 I0702 02:03:22.061137 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0702 02:03:22.061151 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=77eee82accfed496d549c368630f970f9f9c2136753e2bea14d6e98e7ae299e6 I0702 02:03:22.061165 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0702 02:03:22.061179 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=31d20f33cd35581d5fd38ff98bfeb7c052c5917af035032fa39715f605b6aebe I0702 02:03:22.061195 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=9eb543b62a88ae990b205f57940963dabe87464b58ccdea056891e7eca74d5ba I0702 02:03:22.061214 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=dbcab9d908b79810b35a2c0e72bfbcb1457f8344bef366810c9955921cb57ba4 I0702 02:03:22.061236 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=0d01156986d46a4724d6c770f649c1142efc956027447da3cc4b1ccb052d0ed4 I0702 02:03:22.061430 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5b4681a19105530eed60f5216a10b41d8f164aa79da5ab815383d327f7ed117 I0702 02:03:22.061446 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=4c6fc9a8363f9a5ae4c1d31ba9adce2c81e13ba51bb4ec9b214630f570775c65 I0702 02:03:22.061455 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0702 02:03:22.061465 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=8aa84288ce4835a90e27bbde52a1123aef27f60d668a7dbe8f1caaf97963cda4 I0702 02:03:22.061475 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0702 02:03:22.061485 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=6941fe37516476b806462d24a048a27553dc5b8f0695a2a07e1de9dc0dba68e1 I0702 02:03:22.061493 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0702 02:03:22.061505 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=b10df7d89ed7e2c20bbb0a47594ac9e55c1ba6abef13bf4feb7d992ab513587b I0702 02:03:22.061513 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0702 02:03:22.061524 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=a8f3ef198529ec8e8c0cbd67290cd874db94967d11cc44170427b83e7618b2b8 I0702 02:03:22.061576 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=b6b1c052133f81d08e5bebfe5b137590955f506fb31bda6156dc9bcbb14f42c3 I0702 02:03:22.061594 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0702 02:03:22.061610 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=97250e0365684f1c129de6b07408fe378a3a9d8afb32ab791e29836674358554 I0702 02:03:22.061626 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=2ebe69b36da6299a71a20e356d1d5f5c47a926680c104f2ba3efb9f2da556032 I0702 02:03:22.061631 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0702 02:03:22.061641 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=ef6e0da182a1fc1fdcb901e6710fc88832114810e8499cef327f2c3c7ca8ad63 I0702 02:03:22.061649 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0702 02:03:22.061658 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=2cf3b8cfd7729d86fe589ec657b938acb0190306487f657ffe18f1e3582972c1 I0702 02:03:22.061667 1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I0702 02:03:22.061677 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=44d54adb399ef5abb15f1f8c7f5d85057375d97733b4b393ea3814cd8d198152 I0702 02:03:22.061687 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=c0177b0789ae241ca44cca6411b7746e756bffe5fcd8207da6a690cfc46a34b5 I0702 02:03:22.061697 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=4da5bb3cdaf46a72127b5648b8843b490fb96311d30708c1525c698eac39f5fb I0702 02:03:22.061710 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=a1bdbb492e5f644b411f5c324bcff65ed27f415d5b8748a21a2e1ffc65fbe210 I0702 02:03:22.061716 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0702 02:03:22.061733 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=d2ab4160e7ec64f0ddbe50e851d5f509989fb329326bbddf53e5e34f467c34e8 I0702 02:03:22.061747 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0702 02:03:22.061755 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0702 02:03:22.061779 1 gather.go:181] gatherer "clusterconfig" function "operators" took 2.271916523s to process 37 records I0702 02:03:22.257281 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:03:22.257293 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-zvzm7 pod in namespace openshift-dns (previous: false). I0702 02:03:22.458901 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0702 02:03:22.458944 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5f9496d7cf-kjl66 pod in namespace openshift-image-registry (previous: true). I0702 02:03:22.652819 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5f9496d7cf-kjl66 pod in namespace openshift-image-registry (previous: false). I0702 02:03:22.853256 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5f9496d7cf-v5mst pod in namespace openshift-image-registry (previous: false). I0702 02:03:23.053205 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-f9f9b67c5-vvct6 pod in namespace openshift-image-registry (previous: false). I0702 02:03:23.248075 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-8zqx2 pod in namespace openshift-image-registry (previous: false). I0702 02:03:23.455043 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-g4nsc pod in namespace openshift-image-registry (previous: false). I0702 02:03:23.653580 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-ghdnl pod in namespace openshift-image-registry (previous: false). I0702 02:03:23.848948 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5c46c9bb57-2nwlb pod in namespace openshift-ingress (previous: false). I0702 02:03:24.051344 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-845dffc4b9-c6j4b pod in namespace openshift-ingress (previous: false). I0702 02:03:24.248907 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-845dffc4b9-kjfc5 pod in namespace openshift-ingress (previous: false). I0702 02:03:24.448425 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-2qjxv pod in namespace openshift-ingress-canary (previous: false). I0702 02:03:24.651561 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-2svds pod in namespace openshift-ingress-canary (previous: false). I0702 02:03:24.850327 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-wgptt pod in namespace openshift-ingress-canary (previous: false). I0702 02:03:25.057628 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for cluster-samples-operator container cluster-samples-operator-695d9bb6bd-6jbs2 pod in namespace openshift-cluster-samples-operator (previous: false). I0702 02:03:25.254186 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for cluster-samples-operator-watch container cluster-samples-operator-695d9bb6bd-6jbs2 pod in namespace openshift-cluster-samples-operator (previous: false). I0702 02:03:25.449207 1 tasks_processing.go:74] worker 46 stopped. I0702 02:03:25.449284 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=dd29d10c12676985a4be6196fbabed1ed55a19ebf01ceff14760b9ba08433cdd I0702 02:03:25.449346 1 recorder.go:70] Recording events/openshift-dns with fingerprint=3961bb3a458e88c4bf50af554600d05b2f1c6a341e1f8e68af01a456224d979a I0702 02:03:25.449438 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=32a5269a14c66888628dba70318e4bed48e41bd8b6f604acfa3f2eab0dd83dab I0702 02:03:25.449455 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=ef30faa1c2d38be94da2bf4986ed36eb63d783ca0972c610dd2978228bed60b4 I0702 02:03:25.449495 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=69cbd5a32554b2ee88da9dec25eb70d54c591a9275e5ac84f42cf7c98366e569 I0702 02:03:25.449521 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=c6db1bb58ed9253dc0885434bb5afb67583d7052f6762847998abb189122bd4d I0702 02:03:25.449545 1 recorder.go:70] Recording events/openshift-cluster-samples-operator with fingerprint=d3a9127fb56c66920df23199a2cea6bfbc688950d79d019b1dbd90df1ad73945 I0702 02:03:25.449554 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-5gm4r/dns_current.log with fingerprint=400471d7006e09340c2156377e093b22ff9659cbc4a26e8766feec26801b7c32 I0702 02:03:25.449558 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-5gm4r/kube-rbac-proxy_current.log with fingerprint=535402d6173f338415c8bde2315d937112ac42f73d7f38a416b7fe8d886e2374 I0702 02:03:25.449564 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-5n6w8/dns_current.log with fingerprint=a48eef5663f8563311b31d1511952ad91d9b81554b147cf63daebbf516c7ef3b I0702 02:03:25.449571 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-5n6w8/kube-rbac-proxy_current.log with fingerprint=b1a50b298c4b6eabd6ff8cc577caee8e0eec58f90de0c5b03d4628c1a1559523 I0702 02:03:25.449575 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-zzzjs/dns_current.log with fingerprint=1061447e37acd546d43ccc268e2ebbfbc9ce6534617085da7bab3bfdec5e86d0 I0702 02:03:25.449578 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-zzzjs/kube-rbac-proxy_current.log with fingerprint=577d81edb7f3e91794bb1e21163e37467b45fb273537e8aedb89890684c33f0e I0702 02:03:25.449695 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-5f9496d7cf-kjl66 with fingerprint=d56cffdfc93725a795bf2aa6d149ef44df56455c1d0d56c98a14085448cf29d1 I0702 02:03:25.449713 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/image-registry-5f9496d7cf-kjl66/registry_previous.log with fingerprint=1cbe91cc61af7f7b005b8714778e9f1f17529267d0f945baa7e52619d9303f36 I0702 02:03:25.449721 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/image-registry-5f9496d7cf-kjl66/registry_current.log with fingerprint=c64f2943e481585edfcc9093fea284f1cb14b8e4c10eac8f7ff643e2e47bdc74 I0702 02:03:25.449726 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/image-registry-5f9496d7cf-v5mst/registry_current.log with fingerprint=47afa9d936818ce8664b9ffa737b9c677572814f071f765774a74faa3221c4d6 I0702 02:03:25.449732 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/image-registry-f9f9b67c5-vvct6/registry_current.log with fingerprint=63eb007f5158b26dfac40c61aef634a007eeb9547110d5b8738653a6297b6ed1 I0702 02:03:25.449738 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/node-ca-8zqx2/node-ca_current.log with fingerprint=138275050b38f9d8a4005f4679db095a1ab2f0e2ed918764189630d72f4e0eb0 I0702 02:03:25.449741 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/node-ca-g4nsc/node-ca_current.log with fingerprint=e083b8cc9d680ff34c1b58a53e020ca815c36a9d16dc7bc20bf88d42ea1998e1 I0702 02:03:25.449743 1 recorder.go:70] Recording config/pod/openshift-image-registry/logs/node-ca-ghdnl/node-ca_current.log with fingerprint=be911faaf774b93226f1a286998e3712de04fe2a779015d649903bdf12eba5a5 I0702 02:03:25.449750 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-5c46c9bb57-2nwlb/router_current.log with fingerprint=c955ec0bdc3ace3086687cc69a08958023b903b11ff32c819dd9f9ddb24650e9 I0702 02:03:25.449777 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-845dffc4b9-c6j4b/router_current.log with fingerprint=8b18916e8207638b8a81d9300bd98f8ef9c42302a59e05a180eb64b8c681c560 I0702 02:03:25.449786 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-845dffc4b9-kjfc5/router_current.log with fingerprint=8c3d64769876252307a6707444ec09999e23c57f32cab9f8b4749247c5492d63 I0702 02:03:25.449794 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-2qjxv/serve-healthcheck-canary_current.log with fingerprint=78947e6fd9cff9dd1b97bcb58a726728fa00b4d1093cbb7478b4182c195a4eca I0702 02:03:25.449797 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-2svds/serve-healthcheck-canary_current.log with fingerprint=a31a3d5b3905db2ccc303de263f8b514a394bc27ca19e35b37479474a71427ba I0702 02:03:25.449801 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-wgptt/serve-healthcheck-canary_current.log with fingerprint=27a6c4df8591351353078dd0cdfa6f0d08e07bde7f167a33a8be1b401024e1b3 I0702 02:03:25.449829 1 recorder.go:70] Recording config/pod/openshift-cluster-samples-operator/logs/cluster-samples-operator-695d9bb6bd-6jbs2/cluster-samples-operator_current.log with fingerprint=2745964983535f9815ddf376e4dd06d867ef2e13cfb097309b7e0b668e7f54cf I0702 02:03:25.449836 1 recorder.go:70] Recording config/pod/openshift-cluster-samples-operator/logs/cluster-samples-operator-695d9bb6bd-6jbs2/cluster-samples-operator-watch_current.log with fingerprint=7799c2719e598c4df6352a1d357246096409fe3a90c0e9f027764b1797497edc I0702 02:03:25.449843 1 gather.go:181] gatherer "clusterconfig" function "operators_pods_and_events" took 5.660230539s to process 29 records I0702 02:03:32.833225 1 tasks_processing.go:74] worker 19 stopped. I0702 02:03:32.833275 1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0702 02:03:32.833287 1 gather.go:181] gatherer "clusterconfig" function "install_plans" took 13.042083543s to process 1 records I0702 02:03:33.596114 1 tasks_processing.go:74] worker 43 stopped. I0702 02:03:33.596331 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=ba16ea6b4503917d33437d4d1999039313b5aa3c669ab94c714d5681918865aa I0702 02:03:33.596348 1 gather.go:181] gatherer "clusterconfig" function "service_accounts" took 13.807457701s to process 1 records E0702 02:03:33.596389 1 periodic.go:252] clusterconfig failed after 13.808s with: function "machines" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0702 02:03:33.596401 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "tsdb_status" failed with an error, function "metrics" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error I0702 02:03:33.596407 1 periodic.go:214] Running workloads gatherer I0702 02:03:33.596422 1 tasks_processing.go:45] number of workers: 2 I0702 02:03:33.596433 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 02:03:33.596436 1 tasks_processing.go:71] worker 1 working on workload_info task. I0702 02:03:33.596450 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 02:03:33.596525 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0702 02:03:33.621188 1 gather_workloads_info.go:281] Loaded pods in 0s, will wait 24s for image data I0702 02:03:33.635896 1 gather_workloads_info.go:390] No image sha256:0c1abef76d6d2832ddcff31e950ffafeb4e0f6fad80a5f5dca94591de0fc9581 (16ms) I0702 02:03:33.645727 1 tasks_processing.go:74] worker 0 stopped. I0702 02:03:33.645740 1 gather.go:181] gatherer "workloads" function "helmchart_info" took 49.183979ms to process 0 records I0702 02:03:33.649309 1 gather_workloads_info.go:390] No image sha256:3a2c82b772ea6072e1eca0efc5303f002189e80b0e985fb3e3b8ea9a12fe8060 (13ms) I0702 02:03:33.661644 1 gather_workloads_info.go:390] No image sha256:5bcfb1b739fa4e6ff9e21e4843f8520f29608135341f7d8dcc31084b9ba25f1d (12ms) I0702 02:03:33.672363 1 gather_workloads_info.go:390] No image sha256:351ca92471647f383f3cd7f0b70f33f5fa11c39ab569c4948dff7d471a6c8be3 (11ms) I0702 02:03:33.682805 1 gather_workloads_info.go:390] No image sha256:3fea7db586d3236c1876a8b523af0d8d65c84d6f6cf5d0f4e41cafcffe6db5b5 (10ms) I0702 02:03:33.693252 1 gather_workloads_info.go:390] No image sha256:0242cefbf0bb876101c4d67ab4e07401cb0ba6c02be2b73a4f17ba33b2960005 (10ms) I0702 02:03:33.705651 1 gather_workloads_info.go:390] No image sha256:c7aa910ca06f8fd89cdf2519136e0f3533bdacfc6bd58a3f6683f9f08756c7b1 (12ms) I0702 02:03:33.717351 1 gather_workloads_info.go:390] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (12ms) I0702 02:03:33.728944 1 gather_workloads_info.go:390] No image sha256:8562a483f4568254250f19fc68d79f88c94a48508aefe59a70c1021a3aad000a (12ms) I0702 02:03:33.740413 1 gather_workloads_info.go:390] No image sha256:4b9b7949d209e257a76053de4ac74193f747c0d42e25dcd270d655849a4e51aa (11ms) I0702 02:03:33.751361 1 gather_workloads_info.go:390] No image sha256:894452e6587de55d04e37163d3da53e11fced8fb08bd0acf61e6d49f7964284e (11ms) I0702 02:03:33.831634 1 gather_workloads_info.go:390] No image sha256:0c6b7f828184b16a5e6630111e0715e11d34dae9b0bf64619466543e6168e05c (80ms) I0702 02:03:33.931407 1 gather_workloads_info.go:390] No image sha256:4dcdadc14b7bdb2c00954d92e957d63aafbbe5f4047fe028e575d65725923cb0 (100ms) I0702 02:03:34.032819 1 gather_workloads_info.go:390] No image sha256:a7fc4d05c4a3c82c9f355ca985d6fd26033c0d6a98716f25fcd2f54bae1d2fa0 (101ms) I0702 02:03:34.131609 1 gather_workloads_info.go:390] No image sha256:09b3e9e6a4f382fb4bbdb67bc945bcf19d66f604b7c8ffd66d4d4a2c94224248 (99ms) I0702 02:03:34.231629 1 gather_workloads_info.go:390] No image sha256:c96b4bddf3dd7daaa797cbda4dd92e981de2f5fc3404c01381f31dc0414d5c8d (100ms) I0702 02:03:34.332084 1 gather_workloads_info.go:390] No image sha256:70f4702845ec5b627d49504a53a13d997c0578630cddffb89aba5cfebe04fc25 (100ms) I0702 02:03:34.431563 1 gather_workloads_info.go:390] No image sha256:751bd7eb62f632c0eef0ca91b6c57c64d4f1279d4dbe1a9b875ac4020a7b693f (99ms) I0702 02:03:34.532385 1 gather_workloads_info.go:390] No image sha256:24519dcc0e63cdc60a639dd474d06e7612e9b76966bc60322cd9026a0f1b878c (101ms) I0702 02:03:34.631776 1 gather_workloads_info.go:390] No image sha256:41029e57ece558b2e0b12174ce924647fd9d5c5d83aadf4bba03d6916d3f9f54 (99ms) I0702 02:03:34.731827 1 gather_workloads_info.go:390] No image sha256:1eee856bde9bad71c4444c494225a0cf02d1f4a5293acf0bd6e7e1814efa0064 (100ms) I0702 02:03:34.831041 1 gather_workloads_info.go:390] No image sha256:0158b297aec0a66376c04d3c7cf4828db5e5d9f424e331ff7c7b796828036875 (99ms) I0702 02:03:34.932393 1 gather_workloads_info.go:390] No image sha256:3969660e807e8ce5656a74e5816573656241946ef1d766a9d2e21d434356313c (101ms) I0702 02:03:35.031259 1 gather_workloads_info.go:390] No image sha256:586127c49e25052113263d8aeaf6a1623aef22987364f119a17b2848982ff716 (99ms) I0702 02:03:35.132487 1 gather_workloads_info.go:390] No image sha256:02283a64c1936a5dd09d5c6bc0ecbcf9196fe4df6a4055c8be22cebd850aa7a3 (101ms) I0702 02:03:35.231246 1 gather_workloads_info.go:390] No image sha256:788d16bfff4bd6bb3ce97acc643b56fae6e619674ab279535480e519b4d5b769 (99ms) I0702 02:03:35.331888 1 gather_workloads_info.go:390] No image sha256:8e158c83ec12b3e0237fab9a221630bd691e79c079a111f346354ff43b8199df (101ms) I0702 02:03:35.435354 1 gather_workloads_info.go:390] No image sha256:42b4c6bdf3081ec264bc5edbc4eb779151de9e4742d6fe59a316645891df649c (103ms) I0702 02:03:35.533247 1 gather_workloads_info.go:390] No image sha256:06821dfe231330e0eb5be915b9468cd13826a7ee59d1a732b89cb140548eade2 (98ms) I0702 02:03:35.632544 1 gather_workloads_info.go:390] No image sha256:194ee1155b87e110bc6c4a6e55667e41f3bdc8292e26a9561f9082fdfe467eec (99ms) I0702 02:03:35.731584 1 gather_workloads_info.go:390] No image sha256:ed0c9631d6e424912cd8ce78ca7a2c4f76b3fc15e9e34fe00999170ccf19a611 (99ms) I0702 02:03:35.831941 1 gather_workloads_info.go:390] No image sha256:68abf16a3b6c33fdd22a823c7d00f96aaaa8015d370116962a5835984908645a (100ms) I0702 02:03:35.934581 1 gather_workloads_info.go:390] No image sha256:50076d29400ecf9b704d8175509fc8cb7c28bea91d46a28dc37cbda1668c69f9 (103ms) I0702 02:03:36.031444 1 gather_workloads_info.go:390] No image sha256:221622a101db9797df0622b4534e3e42c4498df458f355a8a02fad8d65f8e3f2 (97ms) I0702 02:03:36.131921 1 gather_workloads_info.go:390] No image sha256:6a9b4fd887fa7f1729302fb0330c3c9a483197bf78becdcfda4235ec823a2c39 (100ms) I0702 02:03:36.232208 1 gather_workloads_info.go:390] No image sha256:b8781637560d49de9b8e8cdd59ec75f03d98921ea66950381849398128cc9cb9 (100ms) I0702 02:03:36.333810 1 gather_workloads_info.go:390] No image sha256:1c7c24111f1709d7648156873ced09462638aa4b3cf7e7aee13297e51bcdfb3e (102ms) I0702 02:03:36.431777 1 gather_workloads_info.go:390] No image sha256:13aabbaf260d634ff0e9ac1af88af075b5ba671fd51313e33e74d7d2f7e54128 (98ms) I0702 02:03:36.532674 1 gather_workloads_info.go:390] No image sha256:48dff3fcb0da58eb9b2b500f89af8b7d0790ffa60da0b0e301feca971dbafcbb (101ms) I0702 02:03:36.632147 1 gather_workloads_info.go:390] No image sha256:2897724cec17bc13acc133181f64ccb8d54ce5dc9582f9cecf704c2540e15600 (99ms) I0702 02:03:36.733202 1 gather_workloads_info.go:390] No image sha256:31a22f6ee061d0f6558664e580ec0f80f1927d4ec29626cf3e9420837f5d80e5 (101ms) I0702 02:03:36.831217 1 gather_workloads_info.go:390] No image sha256:bc829520eeec090b60d17abbad1a22b34ea99b426193395808a778d73a5fb57a (98ms) I0702 02:03:36.933664 1 gather_workloads_info.go:390] No image sha256:30ff5e5b72f274598704ca69f1832eba1040cc25da47386004fd59500b6e4c55 (102ms) I0702 02:03:37.031791 1 gather_workloads_info.go:390] No image sha256:38787de16ee8c686305f93b501d891b50cde24136009863869d230c0d4eeee5c (98ms) I0702 02:03:37.131923 1 gather_workloads_info.go:390] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (100ms) I0702 02:03:37.131947 1 tasks_processing.go:74] worker 1 stopped. I0702 02:03:37.132183 1 recorder.go:70] Recording config/workload_info with fingerprint=7d4e91d948df9e2d4162a644e581e616b243cd2af94783b4c1cc34290d07bd94 I0702 02:03:37.132196 1 gather.go:181] gatherer "workloads" function "workload_info" took 3.535505578s to process 1 records I0702 02:03:37.132206 1 periodic.go:261] Periodic gather workloads completed in 3.535s I0702 02:03:37.132212 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I0702 02:03:37.132218 1 periodic.go:214] Running conditional gatherer I0702 02:03:37.141672 1 requests.go:282] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.18.9/gathering_rules I0702 02:03:37.241861 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer I0702 02:03:38.289061 1 conditional_gatherer.go:372] alert "ClusterMonitoringOperatorReconciliationErrors" has state "pending" I0702 02:03:38.289076 1 conditional_gatherer.go:372] alert "KubePodNotScheduled" has state "pending" I0702 02:03:38.289078 1 conditional_gatherer.go:372] alert "TargetDown" has state "pending" I0702 02:03:38.289081 1 conditional_gatherer.go:372] alert "TargetDown" has state "pending" I0702 02:03:38.289102 1 conditional_gatherer.go:372] alert "Watchdog" has state "firing" I0702 02:03:38.289163 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0702 02:03:38.309515 1 conditional_gatherer.go:390] cluster version is '4.18.9' I0702 02:03:38.309539 1 tasks_processing.go:45] number of workers: 3 I0702 02:03:38.309545 1 tasks_processing.go:69] worker 2 listening for tasks. I0702 02:03:38.309548 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0702 02:03:38.309556 1 tasks_processing.go:69] worker 0 listening for tasks. I0702 02:03:38.309574 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0702 02:03:38.309579 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0702 02:03:38.309574 1 tasks_processing.go:69] worker 1 listening for tasks. I0702 02:03:38.309588 1 tasks_processing.go:74] worker 1 stopped. I0702 02:03:38.309614 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=c8d4892cd4f2eea27d57353c6055eeb530bc2d811bfe041f6984d90395255a8c I0702 02:03:38.309625 1 gather.go:181] gatherer "conditional" function "conditional_gatherer_rules" took 984ns to process 1 records I0702 02:03:38.309652 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I0702 02:03:38.309659 1 gather.go:181] gatherer "conditional" function "remote_configuration" took 1.041µs to process 1 records I0702 02:03:38.309663 1 tasks_processing.go:74] worker 0 stopped. I0702 02:03:38.309737 1 tasks_processing.go:74] worker 2 stopped. I0702 02:03:38.309747 1 gather.go:181] gatherer "conditional" function "rapid_container_logs" took 153.747µs to process 0 records I0702 02:03:38.309778 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I0702 02:03:38.309793 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f W0702 02:03:38.339955 1 gather.go:213] can't read cgroups memory usage data: open /sys/fs/cgroup/memory/memory.usage_in_bytes: no such file or directory I0702 02:03:38.340050 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=9991c545a8f33c30047242dbc0b0e62b3da711773890558dd044d6bde41325de I0702 02:03:38.340153 1 diskrecorder.go:70] Writing 140 records to /var/lib/insights-operator/insights-2026-07-02-020338.tar.gz I0702 02:03:38.347536 1 diskrecorder.go:51] Wrote 140 records to disk in 7ms I0702 02:03:38.347563 1 periodic.go:283] Gathering cluster info every 2h0m0s I0702 02:03:38.347580 1 periodic.go:284] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0702 02:04:49.788647 1 diskrecorder.go:170] Found files to send: insights-2026-07-02-020338.tar.gz I0702 02:04:49.788669 1 insightsuploader.go:150] Checking archives to upload periodically every 15m42.142565631s I0702 02:04:49.788676 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I0702 02:04:49.803570 1 requests.go:47] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I0702 02:04:50.007930 1 requests.go:88] Successfully reported id=2026-07-02T02:04:49Z x-rh-insights-request-id=bbba6cbdcdb84007b0f47b084021a45a, wrote=70423 I0702 02:04:50.007978 1 insightsuploader.go:187] Uploaded report successfully in 219.295181ms I0702 02:04:50.007996 1 controller.go:119] Initializing last reported time to 2026-07-02T02:04:49Z I0702 02:04:50.008007 1 insightsreport.go:304] Archive uploaded, starting pulling report... I0702 02:04:50.008019 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I0702 02:04:50.008025 1 insightsreport.go:221] Initial delay for pulling: 1m0s I0702 02:04:50.015693 1 controller.go:482] The operator is healthy I0702 02:05:19.814686 1 controller.go:482] The operator is healthy I0702 02:05:52.543402 1 insightsreport.go:137] Pulling report from smart-proxy I0702 02:05:52.543432 1 insightsreport.go:149] Retrieving report I0702 02:05:52.554492 1 requests.go:111] Retrieving report for cluster: f70534c1-847e-40a6-a825-4f267cf77771 I0702 02:05:52.554502 1 requests.go:112] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/f70534c1-847e-40a6-a825-4f267cf77771/reports I0702 02:05:52.556344 1 requests.go:122] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/f70534c1-847e-40a6-a825-4f267cf77771/reports I0702 02:05:52.776817 1 insightsreport.go:184] Report retrieved I0702 02:05:52.824455 1 insightsreport.go:239] Report retrieved correctly I0702 02:07:19.813669 1 controller.go:482] The operator is healthy I0702 02:08:19.785682 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 02:08:19.792509 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:08:19.792528 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 02:08:19.798567 1 secretconfigobserver.go:119] support secret does not exist I0702 02:09:19.816595 1 controller.go:482] The operator is healthy I0702 02:11:19.814340 1 controller.go:482] The operator is healthy I0702 02:13:19.781266 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:13:19.787751 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:13:19.798844 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 02:13:19.816750 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:13:19.816786 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 02:13:19.824523 1 secretconfigobserver.go:119] support secret does not exist I0702 02:13:19.824704 1 controller.go:482] The operator is healthy I0702 02:15:19.821331 1 controller.go:482] The operator is healthy I0702 02:17:19.814425 1 controller.go:482] The operator is healthy I0702 02:18:19.824959 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 02:18:19.831725 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:18:19.831746 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 02:18:19.840371 1 secretconfigobserver.go:119] support secret does not exist I0702 02:19:19.813003 1 controller.go:482] The operator is healthy I0702 02:20:37.152202 1 insightsuploader.go:146] Nothing to report since 2026-07-02T02:04:49Z I0702 02:21:19.814057 1 controller.go:482] The operator is healthy I0702 02:23:19.780684 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:23:19.812585 1 controller.go:482] The operator is healthy I0702 02:23:19.840638 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 02:23:19.846867 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:23:19.846887 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 02:23:19.852706 1 secretconfigobserver.go:119] support secret does not exist I0702 02:25:19.816223 1 controller.go:482] The operator is healthy I0702 02:27:19.814058 1 controller.go:482] The operator is healthy I0702 02:28:19.852795 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 02:28:19.860676 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:28:19.860692 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 02:28:19.866254 1 secretconfigobserver.go:119] support secret does not exist I0702 02:29:19.813044 1 controller.go:482] The operator is healthy I0702 02:31:19.813809 1 controller.go:482] The operator is healthy I0702 02:33:19.780988 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:33:19.812870 1 controller.go:482] The operator is healthy I0702 02:33:19.867023 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 02:33:19.873569 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:33:19.873582 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 02:33:19.879191 1 secretconfigobserver.go:119] support secret does not exist I0702 02:35:19.813047 1 controller.go:482] The operator is healthy I0702 02:36:15.814004 1 insightsuploader.go:146] Nothing to report since 2026-07-02T02:04:49Z I0702 02:37:19.814141 1 controller.go:482] The operator is healthy I0702 02:38:19.879386 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 02:38:19.885952 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:38:19.885968 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 02:38:19.891714 1 secretconfigobserver.go:119] support secret does not exist I0702 02:39:19.814174 1 controller.go:482] The operator is healthy I0702 02:41:19.815720 1 controller.go:482] The operator is healthy I0702 02:43:19.780708 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:43:19.812320 1 controller.go:482] The operator is healthy I0702 02:43:19.892531 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 02:43:19.898782 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:43:19.898799 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 02:43:19.904245 1 secretconfigobserver.go:119] support secret does not exist I0702 02:45:19.813257 1 controller.go:482] The operator is healthy I0702 02:47:19.816452 1 controller.go:482] The operator is healthy I0702 02:48:19.905243 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 02:48:19.912489 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:48:19.912508 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 02:48:19.918177 1 secretconfigobserver.go:119] support secret does not exist I0702 02:49:19.814319 1 controller.go:482] The operator is healthy I0702 02:51:19.814238 1 controller.go:482] The operator is healthy I0702 02:51:56.792975 1 insightsuploader.go:146] Nothing to report since 2026-07-02T02:04:49Z I0702 02:53:19.787533 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 02:53:19.815996 1 controller.go:482] The operator is healthy I0702 02:53:19.918234 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 02:53:19.924117 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:53:19.924135 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 02:53:19.929624 1 secretconfigobserver.go:119] support secret does not exist I0702 02:55:19.813474 1 controller.go:482] The operator is healthy I0702 02:57:19.817810 1 controller.go:482] The operator is healthy I0702 02:58:19.930145 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 02:58:19.940342 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 02:58:19.940360 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 02:58:19.946086 1 secretconfigobserver.go:119] support secret does not exist I0702 02:59:19.813689 1 controller.go:482] The operator is healthy I0702 03:01:19.814346 1 controller.go:482] The operator is healthy I0702 03:03:19.784853 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 03:03:19.813280 1 controller.go:482] The operator is healthy I0702 03:03:19.946607 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 03:03:19.955564 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 03:03:19.955580 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 03:03:19.961362 1 secretconfigobserver.go:119] support secret does not exist I0702 03:05:19.814410 1 controller.go:482] The operator is healthy I0702 03:07:19.817365 1 controller.go:482] The operator is healthy I0702 03:07:30.556530 1 insightsuploader.go:146] Nothing to report since 2026-07-02T02:04:49Z I0702 03:08:19.961422 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 03:08:19.971745 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 03:08:19.971782 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 03:08:19.977495 1 secretconfigobserver.go:119] support secret does not exist I0702 03:09:19.818276 1 controller.go:482] The operator is healthy I0702 03:11:19.815523 1 controller.go:482] The operator is healthy I0702 03:13:19.781677 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 03:13:19.812530 1 controller.go:482] The operator is healthy I0702 03:13:19.977939 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 03:13:19.983984 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 03:13:19.983999 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 03:13:19.991440 1 secretconfigobserver.go:119] support secret does not exist I0702 03:15:19.822930 1 controller.go:482] The operator is healthy I0702 03:17:19.813111 1 controller.go:482] The operator is healthy I0702 03:18:19.992270 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 03:18:20.001844 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 03:18:20.001861 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 03:18:20.007393 1 secretconfigobserver.go:119] support secret does not exist I0702 03:19:19.814254 1 controller.go:482] The operator is healthy I0702 03:21:19.813228 1 controller.go:482] The operator is healthy I0702 03:23:13.392244 1 insightsuploader.go:146] Nothing to report since 2026-07-02T02:04:49Z I0702 03:23:19.782655 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 03:23:19.812678 1 controller.go:482] The operator is healthy I0702 03:23:20.008125 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 03:23:20.014364 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 03:23:20.014379 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 03:23:20.019781 1 secretconfigobserver.go:119] support secret does not exist I0702 03:25:19.814184 1 controller.go:482] The operator is healthy I0702 03:27:19.816599 1 controller.go:482] The operator is healthy I0702 03:28:20.020375 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 03:28:20.027736 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 03:28:20.027753 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 03:28:20.033313 1 secretconfigobserver.go:119] support secret does not exist I0702 03:29:19.815228 1 controller.go:482] The operator is healthy I0702 03:31:19.813008 1 controller.go:482] The operator is healthy I0702 03:33:19.787094 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 03:33:19.814256 1 controller.go:482] The operator is healthy I0702 03:33:20.033781 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 03:33:20.043413 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 03:33:20.043430 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 03:33:20.051938 1 secretconfigobserver.go:119] support secret does not exist I0702 03:35:19.816445 1 controller.go:482] The operator is healthy I0702 03:37:19.814490 1 controller.go:482] The operator is healthy I0702 03:38:20.052657 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 03:38:20.060303 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 03:38:20.060323 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 03:38:20.066039 1 secretconfigobserver.go:119] support secret does not exist I0702 03:39:19.814205 1 controller.go:482] The operator is healthy I0702 03:39:43.192722 1 insightsuploader.go:146] Nothing to report since 2026-07-02T02:04:49Z I0702 03:41:19.817869 1 controller.go:482] The operator is healthy I0702 03:43:19.786360 1 configmapobserver.go:84] configmaps "insights-config" not found I0702 03:43:19.812981 1 controller.go:482] The operator is healthy I0702 03:43:20.066609 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 03:43:20.073006 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 03:43:20.073025 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 03:43:20.078504 1 secretconfigobserver.go:119] support secret does not exist I0702 03:45:19.816434 1 controller.go:482] The operator is healthy I0702 03:47:19.814121 1 controller.go:482] The operator is healthy I0702 03:48:20.079073 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I0702 03:48:20.084801 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0702 03:48:20.084816 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I0702 03:48:20.090117 1 secretconfigobserver.go:119] support secret does not exist I0702 03:49:19.813717 1 controller.go:482] The operator is healthy I0702 03:51:19.817510 1 controller.go:482] The operator is healthy