W0704 22:21:52.730071 1 cmd.go:257] Using insecure, self-signed certificates I0704 22:21:53.065412 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0704 22:21:53.065724 1 observer_polling.go:159] Starting file observer W0704 22:21:53.088668 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0704 22:21:53.352752 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0704 22:21:53.352974 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0704 22:21:53.353516 1 secure_serving.go:57] Forcing use of http/1.1 only W0704 22:21:53.353540 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0704 22:21:53.353545 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0704 22:21:53.353549 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0704 22:21:53.353553 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0704 22:21:53.353556 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0704 22:21:53.353559 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0704 22:21:53.353614 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I0704 22:21:53.360919 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0704 22:21:53.360982 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I0704 22:21:53.369478 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0704 22:21:53.369494 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0704 22:21:53.369510 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0704 22:21:53.369512 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0704 22:21:53.369528 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0704 22:21:53.369534 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0704 22:21:53.369775 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-554239058/tls.crt::/tmp/serving-cert-554239058/tls.key" I0704 22:21:53.370080 1 secure_serving.go:213] Serving securely on [::]:8443 I0704 22:21:53.370111 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" E0704 22:21:53.380312 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18bf365459089dec openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-07-04 22:21:53.360895468 +0000 UTC m=+0.668717758,LastTimestamp:2026-07-04 22:21:53.360895468 +0000 UTC m=+0.668717758,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0704 22:21:53.395334 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0704 22:21:53.395363 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0704 22:21:53.395453 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0704 22:21:53.416348 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0704 22:21:53.416377 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0704 22:21:53.432524 1 secretconfigobserver.go:119] support secret does not exist I0704 22:21:53.442836 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0704 22:21:53.449155 1 secretconfigobserver.go:119] support secret does not exist I0704 22:21:53.470273 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0704 22:21:53.470297 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0704 22:21:53.470285 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0704 22:21:53.471529 1 recorder.go:156] Pruning old reports every 7h33m37s, max age is 288h0m0s I0704 22:21:53.479811 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0704 22:21:53.479826 1 periodic.go:212] Running clusterconfig gatherer I0704 22:21:53.479835 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0704 22:21:53.479877 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0704 22:21:53.479885 1 tasks_processing.go:45] number of workers: 32 I0704 22:21:53.479887 1 insightsreport.go:296] Starting report retriever I0704 22:21:53.479894 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0704 22:21:53.479912 1 tasks_processing.go:69] worker 0 listening for tasks. I0704 22:21:53.479912 1 tasks_processing.go:69] worker 1 listening for tasks. I0704 22:21:53.479919 1 tasks_processing.go:71] worker 0 working on validating_webhook_configurations task. I0704 22:21:53.479914 1 tasks_processing.go:69] worker 31 listening for tasks. I0704 22:21:53.479922 1 tasks_processing.go:69] worker 15 listening for tasks. I0704 22:21:53.479924 1 tasks_processing.go:69] worker 14 listening for tasks. I0704 22:21:53.479929 1 tasks_processing.go:69] worker 27 listening for tasks. I0704 22:21:53.479935 1 tasks_processing.go:69] worker 24 listening for tasks. I0704 22:21:53.479935 1 tasks_processing.go:69] worker 2 listening for tasks. I0704 22:21:53.479935 1 tasks_processing.go:69] worker 23 listening for tasks. I0704 22:21:53.479943 1 tasks_processing.go:69] worker 20 listening for tasks. I0704 22:21:53.479943 1 tasks_processing.go:69] worker 3 listening for tasks. I0704 22:21:53.479943 1 tasks_processing.go:69] worker 28 listening for tasks. I0704 22:21:53.479947 1 tasks_processing.go:69] worker 25 listening for tasks. I0704 22:21:53.479954 1 tasks_processing.go:69] worker 26 listening for tasks. I0704 22:21:53.479957 1 tasks_processing.go:69] worker 30 listening for tasks. I0704 22:21:53.479950 1 tasks_processing.go:69] worker 29 listening for tasks. I0704 22:21:53.479951 1 tasks_processing.go:69] worker 4 listening for tasks. I0704 22:21:53.479962 1 tasks_processing.go:69] worker 22 listening for tasks. I0704 22:21:53.479966 1 tasks_processing.go:69] worker 17 listening for tasks. I0704 22:21:53.479967 1 tasks_processing.go:69] worker 19 listening for tasks. I0704 22:21:53.479971 1 tasks_processing.go:69] worker 18 listening for tasks. I0704 22:21:53.479976 1 tasks_processing.go:69] worker 9 listening for tasks. I0704 22:21:53.479974 1 tasks_processing.go:69] worker 21 listening for tasks. I0704 22:21:53.479974 1 tasks_processing.go:69] worker 16 listening for tasks. I0704 22:21:53.479984 1 tasks_processing.go:69] worker 6 listening for tasks. I0704 22:21:53.479984 1 tasks_processing.go:69] worker 12 listening for tasks. I0704 22:21:53.479986 1 tasks_processing.go:69] worker 13 listening for tasks. I0704 22:21:53.479990 1 tasks_processing.go:69] worker 10 listening for tasks. I0704 22:21:53.479988 1 tasks_processing.go:69] worker 7 listening for tasks. I0704 22:21:53.479992 1 tasks_processing.go:69] worker 8 listening for tasks. I0704 22:21:53.479996 1 tasks_processing.go:71] worker 15 working on mutating_webhook_configurations task. I0704 22:21:53.479986 1 tasks_processing.go:69] worker 11 listening for tasks. I0704 22:21:53.480001 1 tasks_processing.go:71] worker 31 working on openstack_controlplanes task. I0704 22:21:53.479999 1 tasks_processing.go:71] worker 1 working on cluster_apiserver task. I0704 22:21:53.480007 1 tasks_processing.go:71] worker 8 working on machines task. I0704 22:21:53.480011 1 tasks_processing.go:71] worker 11 working on authentication task. I0704 22:21:53.479960 1 tasks_processing.go:69] worker 5 listening for tasks. I0704 22:21:53.480059 1 tasks_processing.go:71] worker 4 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I0704 22:21:53.480090 1 tasks_processing.go:71] worker 5 working on overlapping_namespace_uids task. I0704 22:21:53.480947 1 tasks_processing.go:71] worker 16 working on support_secret task. I0704 22:21:53.481279 1 tasks_processing.go:71] worker 19 working on monitoring_persistent_volumes task. I0704 22:21:53.481357 1 tasks_processing.go:71] worker 20 working on sap_pods task. I0704 22:21:53.480137 1 tasks_processing.go:71] worker 21 working on machine_config_pools task. I0704 22:21:53.481591 1 tasks_processing.go:71] worker 24 working on openstack_dataplanenodesets task. I0704 22:21:53.481733 1 tasks_processing.go:71] worker 9 working on pod_network_connectivity_checks task. I0704 22:21:53.481797 1 tasks_processing.go:71] worker 2 working on service_accounts task. I0704 22:21:53.481502 1 tasks_processing.go:71] worker 14 working on install_plans task. I0704 22:21:53.481959 1 tasks_processing.go:71] worker 23 working on lokistack task. I0704 22:21:53.482105 1 tasks_processing.go:71] worker 6 working on networks task. I0704 22:21:53.482137 1 tasks_processing.go:71] worker 18 working on ingress_certificates task. I0704 22:21:53.482436 1 tasks_processing.go:71] worker 22 working on infrastructures task. I0704 22:21:53.482558 1 tasks_processing.go:71] worker 10 working on nodenetworkconfigurationpolicies task. I0704 22:21:53.482607 1 tasks_processing.go:71] worker 3 working on image_registries task. I0704 22:21:53.482904 1 tasks_processing.go:71] worker 17 working on oauths task. I0704 22:21:53.482972 1 tasks_processing.go:71] worker 26 working on jaegers task. I0704 22:21:53.483025 1 tasks_processing.go:71] worker 28 working on sap_config task. I0704 22:21:53.481524 1 tasks_processing.go:71] worker 27 working on clusterroles task. I0704 22:21:53.483188 1 tasks_processing.go:71] worker 30 working on ceph_cluster task. I0704 22:21:53.483788 1 tasks_processing.go:71] worker 25 working on tsdb_status task. I0704 22:21:53.482939 1 tasks_processing.go:71] worker 7 working on silenced_alerts task. I0704 22:21:53.482463 1 tasks_processing.go:71] worker 12 working on operators_pods_and_events task. W0704 22:21:53.483822 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory W0704 22:21:53.483827 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0704 22:21:53.483834 1 tasks_processing.go:71] worker 25 working on storage_cluster task. I0704 22:21:53.482470 1 tasks_processing.go:71] worker 13 working on ingress task. I0704 22:21:53.483290 1 tasks_processing.go:71] worker 29 working on feature_gates task. I0704 22:21:53.484410 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 30.496µs to process 0 records I0704 22:21:53.484428 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 31.299µs to process 0 records I0704 22:21:53.484438 1 tasks_processing.go:71] worker 7 working on active_alerts task. W0704 22:21:53.484469 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0704 22:21:53.484481 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 33.351µs to process 0 records I0704 22:21:53.484499 1 tasks_processing.go:71] worker 7 working on openstack_dataplanedeployments task. I0704 22:21:53.490437 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0704 22:21:53.490457 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0704 22:21:53.490461 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0704 22:21:53.490465 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0704 22:21:53.490477 1 controller.go:458] The operator is still being initialized I0704 22:21:53.490482 1 controller.go:481] The operator is healthy I0704 22:21:53.496369 1 base_controller.go:82] Caches are synced for ConfigController I0704 22:21:53.496400 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0704 22:21:53.502109 1 tasks_processing.go:71] worker 9 working on cost_management_metrics_configs task. E0704 22:21:53.502119 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0704 22:21:53.502136 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 20.314321ms to process 0 records I0704 22:21:53.502146 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 20.10964ms to process 0 records I0704 22:21:53.502155 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 20.589136ms to process 0 records E0704 22:21:53.502160 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0704 22:21:53.502165 1 gather.go:177] gatherer "clusterconfig" function "machines" took 22.146756ms to process 0 records I0704 22:21:53.502166 1 tasks_processing.go:71] worker 23 working on aggregated_monitoring_cr_names task. I0704 22:21:53.502174 1 tasks_processing.go:71] worker 21 working on node_logs task. I0704 22:21:53.502194 1 tasks_processing.go:71] worker 8 working on config_maps task. I0704 22:21:53.502378 1 tasks_processing.go:71] worker 1 working on sap_datahubs task. I0704 22:21:53.502626 1 recorder.go:70] Recording config/apiserver with fingerprint=ac583a0bfeae0102d1932e8f37d038f81c5db456fffbd20a045c2b75c747dcd0 I0704 22:21:53.502648 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 22.36096ms to process 1 records I0704 22:21:53.508408 1 tasks_processing.go:71] worker 31 working on image task. I0704 22:21:53.508420 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 28.39658ms to process 0 records I0704 22:21:53.508433 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 25.41743ms to process 0 records I0704 22:21:53.508450 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 25.367691ms to process 0 records I0704 22:21:53.508471 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 23.947897ms to process 0 records I0704 22:21:53.508480 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 26.83958ms to process 0 records I0704 22:21:53.508486 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 27.06557ms to process 0 records I0704 22:21:53.508494 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 25.888179ms to process 0 records E0704 22:21:53.508502 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0704 22:21:53.508511 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 27.494637ms to process 0 records I0704 22:21:53.508520 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 24.763867ms to process 0 records I0704 22:21:53.508526 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 24.673319ms to process 0 records I0704 22:21:53.508565 1 tasks_processing.go:71] worker 30 working on olm_operators task. I0704 22:21:53.508569 1 tasks_processing.go:71] worker 10 working on storage_classes task. I0704 22:21:53.508575 1 tasks_processing.go:71] worker 20 working on nodes task. I0704 22:21:53.508576 1 tasks_processing.go:71] worker 7 working on certificate_signing_requests task. I0704 22:21:53.508582 1 tasks_processing.go:71] worker 28 working on image_pruners task. I0704 22:21:53.508600 1 tasks_processing.go:71] worker 16 working on container_runtime_configs task. I0704 22:21:53.508567 1 tasks_processing.go:71] worker 24 working on pdbs task. I0704 22:21:53.508572 1 tasks_processing.go:71] worker 26 working on version task. I0704 22:21:53.508845 1 tasks_processing.go:71] worker 25 working on proxies task. I0704 22:21:53.514017 1 tasks_processing.go:71] worker 11 working on openshift_logging task. I0704 22:21:53.514259 1 recorder.go:70] Recording config/authentication with fingerprint=0687df484fe974a6cd68bd2854741bcaa6642e33a66bcbd19025344f439ff2e2 I0704 22:21:53.514281 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 33.996735ms to process 1 records I0704 22:21:53.514365 1 tasks_processing.go:71] worker 13 working on container_images task. I0704 22:21:53.514450 1 recorder.go:70] Recording config/ingress with fingerprint=0dc4780f0b8bb651799e3575d19b1127a76a6b597f7687da4425691dc97e4617 I0704 22:21:53.514461 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 30.230686ms to process 1 records I0704 22:21:53.514555 1 tasks_processing.go:71] worker 17 working on schedulers task. I0704 22:21:53.514738 1 recorder.go:70] Recording config/oauth with fingerprint=eeda301cfffa07a172763a79ae7c514139e91824e96a50c8c6a0dbca0d73fa2a I0704 22:21:53.514752 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 31.311236ms to process 1 records I0704 22:21:53.514834 1 tasks_processing.go:71] worker 3 working on dvo_metrics task. I0704 22:21:53.515243 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=60553a41eff526d68cc360ab5e856ef295e54c4c3fe76be1195fb326fc214aa7 I0704 22:21:53.515255 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 32.072198ms to process 1 records I0704 22:21:53.523141 1 tasks_processing.go:71] worker 6 working on operators task. I0704 22:21:53.523304 1 recorder.go:70] Recording config/network with fingerprint=8426e67895a3789a1a4f14d330faf13b83ea83a014db284e6849aaacfc0c3332 I0704 22:21:53.523320 1 gather.go:177] gatherer "clusterconfig" function "networks" took 40.986517ms to process 1 records I0704 22:21:53.523346 1 tasks_processing.go:71] worker 22 working on machine_healthchecks task. I0704 22:21:53.523973 1 recorder.go:70] Recording config/infrastructure with fingerprint=7e4a17e2e747edf92959963d0aae042011f3c6d83e59b024c48c9d90ab864834 I0704 22:21:53.523988 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 40.836335ms to process 1 records I0704 22:21:53.525166 1 tasks_processing.go:71] worker 29 working on machine_configs task. I0704 22:21:53.525278 1 recorder.go:70] Recording config/featuregate with fingerprint=40283d0b73f691158a070936a3c373f93dfe65ca6de749ecae3b4ad1280f46a4 I0704 22:21:53.525291 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 41.277069ms to process 1 records I0704 22:21:53.528892 1 configmapobserver.go:84] configmaps "insights-config" not found I0704 22:21:53.528988 1 tasks_processing.go:71] worker 15 working on nodenetworkstates task. I0704 22:21:53.529149 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=dc5bdc84bcc6d7e1a7ff5573211fb918fdcf8355736e3cb1ca40c343de7a842c I0704 22:21:53.529197 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=ec8df744cf1f1b204deb43da83441ecb1906b567a2ea190b03412eae41044aa1 I0704 22:21:53.529236 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=02957d6a5361ef7ef7798d7dc6b90b368f8b1019dce62fb5344427e4e9b6d736 I0704 22:21:53.529248 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 48.975872ms to process 3 records I0704 22:21:53.529914 1 tasks_processing.go:71] worker 11 working on machine_autoscalers task. I0704 22:21:53.529924 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 15.88008ms to process 0 records I0704 22:21:53.541164 1 tasks_processing.go:71] worker 9 working on openshift_machine_api_events task. I0704 22:21:53.541223 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 39.03777ms to process 0 records I0704 22:21:53.541251 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 38.833587ms to process 0 records I0704 22:21:53.541264 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 32.624749ms to process 0 records I0704 22:21:53.541275 1 tasks_processing.go:71] worker 16 working on crds task. I0704 22:21:53.541251 1 tasks_processing.go:71] worker 1 working on machine_sets task. I0704 22:21:53.551100 1 tasks_processing.go:71] worker 11 working on openstack_version task. I0704 22:21:53.551178 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 21.170471ms to process 0 records E0704 22:21:53.551322 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0704 22:21:53.551405 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 27.958018ms to process 0 records I0704 22:21:53.551603 1 tasks_processing.go:71] worker 22 working on metrics task. W0704 22:21:53.551675 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0704 22:21:53.551713 1 tasks_processing.go:74] worker 22 stopped. I0704 22:21:53.551729 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 60.363µs to process 0 records I0704 22:21:53.551762 1 tasks_processing.go:74] worker 1 stopped. I0704 22:21:53.551782 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 10.470015ms to process 0 records I0704 22:21:53.553451 1 tasks_processing.go:74] worker 25 stopped. I0704 22:21:53.553626 1 recorder.go:70] Recording config/proxy with fingerprint=1c5917d31aa7fc437594045ffb549a1c65540c800dbdf136cb27c8a901dff258 I0704 22:21:53.553673 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 44.50999ms to process 1 records I0704 22:21:53.554133 1 tasks_processing.go:74] worker 15 stopped. I0704 22:21:53.554146 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 25.131771ms to process 0 records I0704 22:21:53.554273 1 tasks_processing.go:74] worker 21 stopped. I0704 22:21:53.554290 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 52.091308ms to process 0 records I0704 22:21:53.554345 1 tasks_processing.go:74] worker 27 stopped. I0704 22:21:53.554540 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0704 22:21:53.554541 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I0704 22:21:53.554640 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=cede9eb212afaac7cc036347529aa964b837b12d403b10ff2b87062cbb3eca25 W0704 22:21:53.554716 1 operator.go:287] started I0704 22:21:53.554747 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0704 22:21:53.554818 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=35307c47a32fdc26301774662c43a44a47e4696f844bf89aa298bac43be115aa I0704 22:21:53.554839 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 71.132105ms to process 2 records I0704 22:21:53.554855 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 73.008873ms to process 0 records I0704 22:21:53.554870 1 tasks_processing.go:74] worker 19 stopped. I0704 22:21:53.554960 1 tasks_processing.go:74] worker 0 stopped. I0704 22:21:53.555012 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=348eb0860679c8409bdfaea5fcb3e920205ef4eb26faf7ba29f5d1c8f4b90b81 I0704 22:21:53.555116 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=70cecc8c74c0371f4bf81b282f3e2af1a071fbdea1f62cf3eeb23154e2c52027 I0704 22:21:53.555135 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=c90e9b57d0156b2e5dbbe28a9d74a2483f8907d1bba337aebfcaa11caa779fc1 I0704 22:21:53.555167 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=390f9f335f2db49fcbe340cbc1df997c3d939a0c377e749475a8432ff8ee0495 I0704 22:21:53.555198 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=8f2e3c37b142d756d67bd4d2f1bb482f3aaa8e1beb5202a050bae09fec843b60 I0704 22:21:53.555229 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=77c34f9599b8bd415cfae1ab20d8f95db2d8c5f93425f353b176a62ab26505c6 I0704 22:21:53.555259 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=ae9a09b491cb22d09a723a5fca372b0d3b5d13ce527e74eaffbb557e859ea12f I0704 22:21:53.555299 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=34a1d97895100751bc116d78c6994584dfd41b1b5e0a2c8a224feec2ea476a65 I0704 22:21:53.555330 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=d203dedb4a424ff14ebb1108866609fcac2f7bf02b425bfacc264944b6cc4180 I0704 22:21:53.555359 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=ad9bbd95d2fd2422d47a91406429384abf0c47e7dffee7ec4b3088114a503e97 I0704 22:21:53.555409 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=3a746ec2cf41bedb6f5a9eac83ef3afd8804b0c2a6fb11ff6d1cd2950d243f12 I0704 22:21:53.555419 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 74.493108ms to process 11 records I0704 22:21:53.555511 1 tasks_processing.go:74] worker 20 stopped. I0704 22:21:53.555711 1 recorder.go:70] Recording config/node/ip-10-0-0-90.ec2.internal with fingerprint=2e609f99ded9418bc166a3bf5df300be091cce2da0acbe25619b1e94f56565b4 I0704 22:21:53.555802 1 recorder.go:70] Recording config/node/ip-10-0-1-120.ec2.internal with fingerprint=980f357b801dc11b7d967236a4d96549d572812a9034998fe5414aaf7ad7b275 I0704 22:21:53.555875 1 recorder.go:70] Recording config/node/ip-10-0-2-131.ec2.internal with fingerprint=af07c47f8281e8f164494092430bad155506e8aed613ed08de1252dfa9e1365b I0704 22:21:53.555890 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 45.942815ms to process 3 records I0704 22:21:53.555916 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0704 22:21:53.555929 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 74.345871ms to process 1 records I0704 22:21:53.555984 1 tasks_processing.go:74] worker 5 stopped. I0704 22:21:53.556037 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=9df936f2c97bfe319c54080efc0ef8f1b90593254a20983d8003d81b4b6258b0 I0704 22:21:53.556049 1 tasks_processing.go:74] worker 28 stopped. I0704 22:21:53.556052 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 47.202722ms to process 1 records I0704 22:21:53.562033 1 tasks_processing.go:74] worker 11 stopped. I0704 22:21:53.562048 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 10.863028ms to process 0 records E0704 22:21:53.562061 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0704 22:21:53.562102 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0704 22:21:53.562114 1 tasks_processing.go:74] worker 29 stopped. I0704 22:21:53.562119 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 36.878087ms to process 1 records I0704 22:21:53.562206 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=b6288b5e98b95f37df5f4e24f1384d47ca11f14242948c331a56b9ca76b26925 I0704 22:21:53.562207 1 tasks_processing.go:74] worker 10 stopped. I0704 22:21:53.562229 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=18f22a295b86ea29ec1aeb57a28f0d56a1d52b109afb4127237f0845fb72be41 I0704 22:21:53.562239 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 53.529816ms to process 2 records I0704 22:21:53.562382 1 tasks_processing.go:74] worker 9 stopped. I0704 22:21:53.562416 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 21.201894ms to process 0 records I0704 22:21:53.562488 1 tasks_processing.go:74] worker 24 stopped. I0704 22:21:53.562615 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=db36abecd1e35a712785601f185d45d811cfc1075a278f53c91cd395ba17b5a5 I0704 22:21:53.562654 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=1c7b4fd6d7db82be9c8d74218e84adc621ddcf58a64821ae4101ac4a4b50d39e I0704 22:21:53.562685 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=27282bee0d9e7a043f89488319d3d87d700063425e7402fb3d8f9ca2cc04d7ed I0704 22:21:53.562695 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 53.853977ms to process 3 records I0704 22:21:53.564703 1 tasks_processing.go:74] worker 7 stopped. I0704 22:21:53.564721 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 56.10895ms to process 0 records I0704 22:21:53.571705 1 tasks_processing.go:74] worker 4 stopped. I0704 22:21:53.571720 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 91.630831ms to process 0 records I0704 22:21:53.571765 1 tasks_processing.go:74] worker 31 stopped. I0704 22:21:53.571952 1 recorder.go:70] Recording config/image with fingerprint=4f10d72757d3f9ef595b51c724d3b7e8f79febf236747296216c3b11e09647c1 I0704 22:21:53.571972 1 gather.go:177] gatherer "clusterconfig" function "image" took 63.340746ms to process 1 records I0704 22:21:53.572050 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=1943775f77bc42b1e7e4db4b3401743ab65b1919014b8ac86aaa76c225da9084 I0704 22:21:53.572056 1 tasks_processing.go:74] worker 17 stopped. I0704 22:21:53.572063 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 57.205274ms to process 1 records W0704 22:21:53.576132 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0704 22:21:53.576712 1 controller.go:203] Source scaController *sca.Controller is not ready I0704 22:21:53.576727 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0704 22:21:53.576732 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0704 22:21:53.576738 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0704 22:21:53.576744 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0704 22:21:53.576763 1 controller.go:458] The operator is still being initialized I0704 22:21:53.576769 1 controller.go:481] The operator is healthy I0704 22:21:53.576932 1 tasks_processing.go:74] worker 23 stopped. I0704 22:21:53.576954 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 74.754325ms to process 0 records I0704 22:21:53.584323 1 prometheus_rules.go:88] Prometheus rules successfully created I0704 22:21:53.587193 1 tasks_processing.go:74] worker 16 stopped. I0704 22:21:53.587729 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=5e8d4860b298977f6e98d23f4b2c361c9f6935010b72125df948cce3a8dec770 I0704 22:21:53.587922 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=4a19b9a00bac7a736a88ca392fe691c6a11e9cba506fe8d838d8c4d7c3de4d2d I0704 22:21:53.587932 1 gather.go:177] gatherer "clusterconfig" function "crds" took 45.909559ms to process 2 records I0704 22:21:53.589359 1 tasks_processing.go:74] worker 30 stopped. I0704 22:21:53.589490 1 recorder.go:70] Recording config/olm_operators with fingerprint=ebe327ba3bd7bb47f79dcef7207b7b9055eb612184f8cc484d075d64188e2710 I0704 22:21:53.589506 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 80.776486ms to process 1 records E0704 22:21:53.596687 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%278614a76f-d48e-43d2-a53f-b461e2fbb8d5%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:60774->172.30.0.10:53: read: connection refused I0704 22:21:53.596699 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%278614a76f-d48e-43d2-a53f-b461e2fbb8d5%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:60774->172.30.0.10:53: read: connection refused I0704 22:21:53.602563 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0704 22:21:53.605960 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:45489->172.30.0.10:53: read: connection refused I0704 22:21:53.605971 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.11:45489->172.30.0.10:53: read: connection refused I0704 22:21:53.609157 1 tasks_processing.go:74] worker 8 stopped. E0704 22:21:53.609170 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0704 22:21:53.609176 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0704 22:21:53.609179 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0704 22:21:53.609187 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I0704 22:21:53.609231 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0704 22:21:53.609239 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0704 22:21:53.609244 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I0704 22:21:53.609249 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0704 22:21:53.609285 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0704 22:21:53.609292 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0704 22:21:53.609298 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 106.943586ms to process 7 records I0704 22:21:53.611124 1 tasks_processing.go:74] worker 26 stopped. I0704 22:21:53.611585 1 recorder.go:70] Recording config/version with fingerprint=fd610da123fe6984aba2204ca7ea393e2dfb5f6758ccaab4fa287be36bfeb365 I0704 22:21:53.611597 1 recorder.go:70] Recording config/id with fingerprint=6b0aa8c6a7b069483b367f3b439d0537fc8b524515416759493183ee3739a117 I0704 22:21:53.611603 1 gather.go:177] gatherer "clusterconfig" function "version" took 102.333575ms to process 2 records I0704 22:21:53.625206 1 tasks_processing.go:74] worker 13 stopped. I0704 22:21:53.626855 1 recorder.go:70] Recording config/pod/openshift-ovn-kubernetes/ovnkube-node-ccsj6 with fingerprint=7765d5a7a76de440d91b23e5002a27c2ff91cb96ac973fa5c41dddf1b49c0a29 I0704 22:21:53.626908 1 recorder.go:70] Recording config/running_containers with fingerprint=376dea5485ea06196c82d5bb28bc932e8c107eac1ae2de3427f060ffbbbdb290 I0704 22:21:53.626918 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 110.81722ms to process 2 records I0704 22:21:53.654979 1 base_controller.go:82] Caches are synced for LoggingSyncer I0704 22:21:53.654992 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0704 22:21:53.668162 1 tasks_processing.go:74] worker 18 stopped. E0704 22:21:53.668177 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0704 22:21:53.668188 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2rbj8kks6i51bo7vb1cf526ol5phru77-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2rbj8kks6i51bo7vb1cf526ol5phru77-primary-cert-bundle-secret" not found I0704 22:21:53.668249 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=4d679c7bf336922c8d4d383f6fd068183aaa980ecc1a68f46559b963c8f8bf39 I0704 22:21:53.668266 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 185.962886ms to process 1 records I0704 22:21:53.979418 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I0704 22:21:53.979432 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I0704 22:21:53.979749 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-56ffv pod in namespace openshift-dns (previous: false). I0704 22:21:54.201278 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0704 22:21:54.208856 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-56ffv pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-56ffv\" is waiting to start: ContainerCreating" I0704 22:21:54.208875 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-56ffv\" is waiting to start: ContainerCreating" I0704 22:21:54.208886 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-56ffv pod in namespace openshift-dns (previous: false). I0704 22:21:54.399652 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-56ffv pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-56ffv\" is waiting to start: ContainerCreating" I0704 22:21:54.399671 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-56ffv\" is waiting to start: ContainerCreating" I0704 22:21:54.399683 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-f59dj pod in namespace openshift-dns (previous: false). I0704 22:21:54.401154 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W0704 22:21:54.575634 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0704 22:21:54.610509 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-f59dj pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-f59dj\" is waiting to start: ContainerCreating" I0704 22:21:54.610524 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-f59dj\" is waiting to start: ContainerCreating" I0704 22:21:54.610532 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-f59dj pod in namespace openshift-dns (previous: false). I0704 22:21:54.787204 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-f59dj pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-f59dj\" is waiting to start: ContainerCreating" I0704 22:21:54.787223 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-f59dj\" is waiting to start: ContainerCreating" I0704 22:21:54.787253 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-w6ngb pod in namespace openshift-dns (previous: false). I0704 22:21:55.011266 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-w6ngb pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-w6ngb\" is waiting to start: ContainerCreating" I0704 22:21:55.011286 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-w6ngb\" is waiting to start: ContainerCreating" I0704 22:21:55.011299 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-w6ngb pod in namespace openshift-dns (previous: false). I0704 22:21:55.185909 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-w6ngb pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-w6ngb\" is waiting to start: ContainerCreating" I0704 22:21:55.185927 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-w6ngb\" is waiting to start: ContainerCreating" I0704 22:21:55.185941 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-hglpr pod in namespace openshift-dns (previous: false). I0704 22:21:55.203043 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0704 22:21:55.390626 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0704 22:21:55.390645 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-szs2v pod in namespace openshift-dns (previous: false). W0704 22:21:55.576456 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0704 22:21:55.586784 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0704 22:21:55.586803 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-v5fq4 pod in namespace openshift-dns (previous: false). I0704 22:21:55.605294 1 tasks_processing.go:74] worker 6 stopped. I0704 22:21:55.605355 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=dba78eb988adeb18b06d021134527acf5f6b035f9506560cef7f10490340ead0 I0704 22:21:55.605420 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=4bc162efd4cbe5ab312c2e46ba668de25db8cd24f6c5886c5245f7d3bffd299b I0704 22:21:55.605459 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0704 22:21:55.605496 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=f114643693091b2cdf9fbca66a7450bd7f6867b0a19e48fb1e3a8ae2ec175a3f I0704 22:21:55.605518 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0704 22:21:55.605545 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=bbd0c9b3cbec748693001203083e22659898a754587f832efbc9174aaa98b443 I0704 22:21:55.605584 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=5875d288c7260c1a7c08d6667ef11569ce607186bf94c4a1698f83326fd14ffe I0704 22:21:55.605609 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=5925b3c8ce52900c976da222c065e5470f3f4027dc0c0eb260d4fabc703d4f2e I0704 22:21:55.605646 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=8cc95be79bb9152f1e9a54adf236620d215eba5857d2d5db1872397ea5c9453f I0704 22:21:55.605658 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5ff11d57817f84a678f6fa9565af55bd1120227c16a21933637ab62675a6d70 I0704 22:21:55.605678 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=0c6e1704308f984adb0b732ded9da0648413a0e68c9b9a63e4f7fc17c73c8325 I0704 22:21:55.605688 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0704 22:21:55.605706 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=ffa110184c7dea852218a06259bee2dfa43db4c662decf4a47f66b25c64948c1 I0704 22:21:55.605723 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0704 22:21:55.605741 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=818b042982e549a15dee70a99e05de1fbbaf179d537fd0ec4df53ba7f1a8e686 I0704 22:21:55.605752 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0704 22:21:55.605773 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=f3c0401815126474cf8592529c362bcbe40580a0308b30724873dc88ae2dbb71 I0704 22:21:55.605784 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0704 22:21:55.605807 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=25d638d368d0e0855dc32baeb262069b6aa12a8f1da0f201ff2100a6b7a3ef8b I0704 22:21:55.605937 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=b77a110962e0b2db79f1f93c48e0dd3a953d8cc30631831b9aea07add92ee831 I0704 22:21:55.605972 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0704 22:21:55.605996 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=1fedbde4acd537f661fa107752a0757c4939681bb9b0ac7c0a1767da4013614c I0704 22:21:55.606020 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=ab48d8e3b9100120f18cf2904cc460bea089acbda7b85808c3bf6bfbc4d81ca9 I0704 22:21:55.606035 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0704 22:21:55.606057 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=67407c022d692508609e0c4e6b2154fbe0eadfcffe7aab6224cf4fd14e9e4473 I0704 22:21:55.606068 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0704 22:21:55.606081 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=85fa762eed2b80237b0c82cdb5102e7c75509eea097b06424652cdaaa7841d9f I0704 22:21:55.606098 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=123c3c9962c5bd0c1c14c8f5bdcd0a6578880024a6463e97d17ec048139bf945 I0704 22:21:55.606120 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=3ce5c53ad96e8d8128d93b6960b861ced2f81847d49ade5d8c18b9350f39ed89 I0704 22:21:55.606139 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=a5f0cf94ecd01207c364bdd32271222ac8495ec26701b5b612c3d5d994be9872 I0704 22:21:55.606154 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=6832e363e7972093d1cbc101ed7c64366c983c93855c1f0c98ac58868826c64e I0704 22:21:55.606177 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=ebc0f41d7e702fdfe5f974c1666e2ebda559d9fe56f0fbaea1d39b51a53b9a06 I0704 22:21:55.606201 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0704 22:21:55.606212 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0704 22:21:55.606220 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.082127715s to process 34 records I0704 22:21:55.785363 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0704 22:21:55.785446 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-54c7b88cb4-6hmqs pod in namespace openshift-image-registry (previous: false). I0704 22:21:55.984930 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-54c7b88cb4-6hmqs pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-54c7b88cb4-6hmqs\" is waiting to start: ContainerCreating" I0704 22:21:55.984947 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-54c7b88cb4-6hmqs\" is waiting to start: ContainerCreating" I0704 22:21:55.984980 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-54c7b88cb4-76fsx pod in namespace openshift-image-registry (previous: false). I0704 22:21:56.188115 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-54c7b88cb4-76fsx pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-54c7b88cb4-76fsx\" is waiting to start: ContainerCreating" I0704 22:21:56.188134 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-54c7b88cb4-76fsx\" is waiting to start: ContainerCreating" I0704 22:21:56.188176 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-cccff6fb7-q22h7 pod in namespace openshift-image-registry (previous: false). I0704 22:21:56.387208 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-cccff6fb7-q22h7 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-cccff6fb7-q22h7\" is waiting to start: ContainerCreating" I0704 22:21:56.387225 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-cccff6fb7-q22h7\" is waiting to start: ContainerCreating" I0704 22:21:56.387236 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-7fbcs pod in namespace openshift-image-registry (previous: false). W0704 22:21:56.576413 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0704 22:21:56.588755 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0704 22:21:56.588774 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-7kxrt pod in namespace openshift-image-registry (previous: false). I0704 22:21:56.788737 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0704 22:21:56.788756 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-zsmgw pod in namespace openshift-image-registry (previous: false). I0704 22:21:56.988035 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0704 22:21:56.988053 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6797b8c565-d4t2w pod in namespace openshift-ingress (previous: false). I0704 22:21:57.192362 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6797b8c565-d4t2w pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6797b8c565-d4t2w\" is waiting to start: ContainerCreating" I0704 22:21:57.192378 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6797b8c565-d4t2w\" is waiting to start: ContainerCreating" I0704 22:21:57.192405 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6797b8c565-lphhb pod in namespace openshift-ingress (previous: false). I0704 22:21:57.386277 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6797b8c565-lphhb pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6797b8c565-lphhb\" is waiting to start: ContainerCreating" I0704 22:21:57.386292 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6797b8c565-lphhb\" is waiting to start: ContainerCreating" I0704 22:21:57.386303 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6dcdc5795-mxdmb pod in namespace openshift-ingress (previous: false). W0704 22:21:57.575415 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0704 22:21:57.586589 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6dcdc5795-mxdmb pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6dcdc5795-mxdmb\" is waiting to start: ContainerCreating" I0704 22:21:57.586606 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6dcdc5795-mxdmb\" is waiting to start: ContainerCreating" I0704 22:21:57.586618 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-7x5gj pod in namespace openshift-ingress-canary (previous: false). I0704 22:21:57.787829 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-7x5gj pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-7x5gj\" is waiting to start: ContainerCreating" I0704 22:21:57.787847 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-7x5gj\" is waiting to start: ContainerCreating" I0704 22:21:57.787878 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-t8jdf pod in namespace openshift-ingress-canary (previous: false). I0704 22:21:57.996515 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-t8jdf pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-t8jdf\" is waiting to start: ContainerCreating" I0704 22:21:57.996535 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-t8jdf\" is waiting to start: ContainerCreating" I0704 22:21:57.996564 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-zpsls pod in namespace openshift-ingress-canary (previous: false). I0704 22:21:58.184955 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-zpsls pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-zpsls\" is waiting to start: ContainerCreating" I0704 22:21:58.184974 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-zpsls\" is waiting to start: ContainerCreating" I0704 22:21:58.184990 1 tasks_processing.go:74] worker 12 stopped. I0704 22:21:58.185067 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=283d8ea38eb98498c6589d523a9cf6861faa6dd55588ec1a979c0af9eb70f5f9 I0704 22:21:58.185117 1 recorder.go:70] Recording events/openshift-dns with fingerprint=64cb66b9e191a28e64d93fb616f0053e8b90053956b57a94c82eba2f9b154cd0 I0704 22:21:58.185196 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=3dae27b15842288c6c63faceff44038a9ed88b9a5e1c3781910a39fe684cbed6 I0704 22:21:58.185223 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=dd679d131737a4ca691f3a70be696c4738e85ac1bfe2667384c7af2891bb9e56 I0704 22:21:58.185268 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=a796c9e477590aebe2f56d59e7cfc667ba520864d8dd8ed90a210b4db28d4cf9 I0704 22:21:58.185287 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=bad7a5411f70afdd2b69013f8f223d0813d28c2d99f05813018de67070171aa9 I0704 22:21:58.185436 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-56ffv with fingerprint=bea041d7975db2c1d65ed48674394ba82297694b7513a4bb96b7fb51bd1753f3 I0704 22:21:58.185517 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-w6ngb with fingerprint=93af5019fe9c630270de868c4213e2f8d2a7c8597801688bbb40fbdd90d6592a I0704 22:21:58.185623 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-54c7b88cb4-6hmqs with fingerprint=77fe1995ebfc5419902b1dd1c69580cc6dcdd76c67fe0df4b8615d044e363ddb I0704 22:21:58.185717 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-54c7b88cb4-76fsx with fingerprint=654315d1b2710998db0ad107e633047320ad90dba3f8122e47f75c66bf9b0875 I0704 22:21:58.185805 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-cccff6fb7-q22h7 with fingerprint=ee35fb9949e45d35f64570ad5beab5bacee0862144f236eeded1c83fd77ace25 I0704 22:21:58.185861 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-t8jdf with fingerprint=8e671ade75de8a0f023636e9cbc9b9e6f1dd62766c1f660a727773dd65a45878 I0704 22:21:58.185915 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-zpsls with fingerprint=e9b202e666ed84d6842dfb9a7c08b419efec7e1a3381e516757f9618c2c5228f I0704 22:21:58.185924 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.701158531s to process 13 records W0704 22:21:58.576092 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0704 22:21:58.576116 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0704 22:21:58.576130 1 tasks_processing.go:74] worker 3 stopped. E0704 22:21:58.576141 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0704 22:21:58.576153 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0704 22:21:58.576165 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0704 22:21:58.576178 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.061278065s to process 1 records I0704 22:22:03.117894 1 configmapobserver.go:84] configmaps "insights-config" not found I0704 22:22:06.359513 1 tasks_processing.go:74] worker 14 stopped. I0704 22:22:06.359570 1 recorder.go:70] Recording config/installplans with fingerprint=e3c18441424aaa81f54ea9723d194eacb5824eb47178047bd893de11825bc8a2 I0704 22:22:06.359588 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.877548974s to process 1 records I0704 22:22:07.090304 1 tasks_processing.go:74] worker 2 stopped. I0704 22:22:07.090627 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=40a83a894d0cf5587650f76f2ccfab0c74acdbf62accc67d33c8bf68f5833b03 I0704 22:22:07.090647 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.608445912s to process 1 records E0704 22:22:07.090729 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.61s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0704 22:22:07.091834 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0704 22:22:07.091850 1 periodic.go:212] Running workloads gatherer I0704 22:22:07.091866 1 tasks_processing.go:45] number of workers: 2 I0704 22:22:07.091876 1 tasks_processing.go:69] worker 1 listening for tasks. I0704 22:22:07.091880 1 tasks_processing.go:71] worker 1 working on workload_info task. I0704 22:22:07.091903 1 tasks_processing.go:69] worker 0 listening for tasks. I0704 22:22:07.091973 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0704 22:22:07.120007 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 22s for image data I0704 22:22:07.126424 1 tasks_processing.go:74] worker 0 stopped. I0704 22:22:07.126443 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 34.4248ms to process 0 records I0704 22:22:07.129443 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (11ms) I0704 22:22:07.139453 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (10ms) I0704 22:22:07.148905 1 gather_workloads_info.go:387] No image sha256:88437b35173fe2e8a4d9f148ec17c754bee4df3f723b3a5676955eef4f363d31 (9ms) I0704 22:22:07.160167 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (11ms) I0704 22:22:07.169436 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (9ms) I0704 22:22:07.178975 1 gather_workloads_info.go:387] No image sha256:95418d0ba6fc0aa96647d97cf6530967f7d7ae97a82ce7f7e41c8e44310b0b72 (10ms) I0704 22:22:07.188531 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (10ms) I0704 22:22:07.197798 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (9ms) I0704 22:22:07.207411 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (10ms) I0704 22:22:07.216851 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (9ms) I0704 22:22:07.228645 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (12ms) I0704 22:22:07.329268 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (101ms) I0704 22:22:07.429334 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (100ms) I0704 22:22:07.530058 1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (101ms) I0704 22:22:07.629720 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (100ms) I0704 22:22:07.729931 1 gather_workloads_info.go:387] No image sha256:d28734effaadd66434e77a1a5fbe2e8a4ca2066cd9f8868c22ade9475539bfd7 (100ms) I0704 22:22:07.829548 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (100ms) I0704 22:22:07.930192 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (101ms) I0704 22:22:08.029637 1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (99ms) I0704 22:22:08.130879 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (101ms) I0704 22:22:08.229303 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (98ms) I0704 22:22:08.329508 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (100ms) I0704 22:22:08.429376 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (100ms) I0704 22:22:08.530986 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (102ms) I0704 22:22:08.629861 1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (99ms) I0704 22:22:08.732371 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (102ms) I0704 22:22:08.830607 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (98ms) I0704 22:22:08.930038 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (99ms) I0704 22:22:09.029640 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (100ms) I0704 22:22:09.093914 1 configmapobserver.go:84] configmaps "insights-config" not found I0704 22:22:09.129500 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (100ms) I0704 22:22:09.229086 1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (100ms) I0704 22:22:09.295063 1 configmapobserver.go:84] configmaps "insights-config" not found I0704 22:22:09.329697 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (101ms) I0704 22:22:09.329727 1 tasks_processing.go:74] worker 1 stopped. E0704 22:22:09.329736 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0704 22:22:09.330009 1 recorder.go:70] Recording config/workload_info with fingerprint=8964a6673be44712200d4118f0eda11f925d5fe2360e409a79fcc1b0f1d293ec I0704 22:22:09.330023 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.23783982s to process 1 records E0704 22:22:09.330060 1 periodic.go:250] "Unhandled Error" err="workloads failed after 2.238s with: function \"workload_info\" failed with an error" I0704 22:22:09.331170 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0704 22:22:09.331185 1 periodic.go:212] Running conditional gatherer I0704 22:22:09.340457 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I0704 22:22:09.347248 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:45504->172.30.0.10:53: read: connection refused E0704 22:22:09.347623 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0704 22:22:09.347699 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0704 22:22:09.357273 1 conditional_gatherer.go:390] cluster version is '4.19.9' E0704 22:22:09.357292 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 22:22:09.357299 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 22:22:09.357303 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 22:22:09.357307 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 22:22:09.357311 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 22:22:09.357314 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 22:22:09.357317 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 22:22:09.357320 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0704 22:22:09.357324 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0704 22:22:09.357340 1 tasks_processing.go:45] number of workers: 3 I0704 22:22:09.357351 1 tasks_processing.go:69] worker 2 listening for tasks. I0704 22:22:09.357355 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0704 22:22:09.357363 1 tasks_processing.go:69] worker 0 listening for tasks. I0704 22:22:09.357380 1 tasks_processing.go:69] worker 1 listening for tasks. I0704 22:22:09.357408 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0704 22:22:09.357417 1 tasks_processing.go:71] worker 1 working on conditional_gatherer_rules task. I0704 22:22:09.357426 1 tasks_processing.go:74] worker 0 stopped. I0704 22:22:09.357492 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0704 22:22:09.357511 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.719µs to process 1 records I0704 22:22:09.357596 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0704 22:22:09.357597 1 tasks_processing.go:74] worker 1 stopped. I0704 22:22:09.357617 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.696µs to process 1 records I0704 22:22:09.357648 1 tasks_processing.go:74] worker 2 stopped. I0704 22:22:09.357659 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 287.416µs to process 0 records I0704 22:22:09.357691 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.11:45504->172.30.0.10:53: read: connection refused I0704 22:22:09.357710 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0704 22:22:09.382166 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=90e34f955569072b09ac51841807ab9c8228eb7344d966310c834f7629addae9 I0704 22:22:09.382312 1 diskrecorder.go:70] Writing 107 records to /var/lib/insights-operator/insights-2026-07-04-222209.tar.gz I0704 22:22:09.389585 1 diskrecorder.go:51] Wrote 107 records to disk in 7ms I0704 22:22:09.389623 1 periodic.go:281] Gathering cluster info every 2h0m0s I0704 22:22:09.389648 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0704 22:22:23.874923 1 configmapobserver.go:84] configmaps "insights-config" not found I0704 22:23:23.066574 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="10a29e50f9e5c3d83cc823c5d6ab79f8f62ffac9e06e5141a7f53c7e370ddb98") W0704 22:23:23.066609 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I0704 22:23:23.066658 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="1789a05fef78cec05e2628ac936de8db89f622fed7d8f0ec78b4aa7a2608f58a") I0704 22:23:23.066673 1 base_controller.go:181] Shutting down ConfigController ... I0704 22:23:23.066684 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I0704 22:23:23.066718 1 periodic.go:173] Shutting down I0704 22:23:23.066732 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I0704 22:23:23.066745 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I0704 22:23:23.066756 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="b8bd24247a931c4b1221317fcb9367f36b04c7169cb9ee064fd05f5541a4aaee") I0704 22:23:23.066761 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I0704 22:23:23.066689 1 base_controller.go:181] Shutting down LoggingSyncer ... I0704 22:23:23.066844 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I0704 22:23:23.066850 1 base_controller.go:113] All LoggingSyncer workers have been terminated E0704 22:23:23.066803 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled I0704 22:23:23.066882 1 dynamic_serving_content.go:149] "Shutting down controller" name="serving-cert::/tmp/serving-cert-554239058/tls.crt::/tmp/serving-cert-554239058/tls.key" E0704 22:23:23.066902 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled I0704 22:23:23.066804 1 requestheader_controller.go:194] Shutting down RequestHeaderAuthRequestController I0704 22:23:23.066810 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" E0704 22:23:23.066929 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled I0704 22:23:23.066816 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" E0704 22:23:23.066951 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled E0704 22:23:23.066976 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled E0704 22:23:23.066999 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled E0704 22:23:23.067036 1 controller.go:290] Unable to write cluster operator status: client rate limiter Wait returned an error: context canceled