W1009 01:57:06.134996 1 cmd.go:257] Using insecure, self-signed certificates I1009 01:57:06.381553 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1009 01:57:06.381847 1 observer_polling.go:159] Starting file observer W1009 01:57:06.408183 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I1009 01:57:06.751480 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I1009 01:57:06.751644 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I1009 01:57:06.752108 1 secure_serving.go:57] Forcing use of http/1.1 only W1009 01:57:06.752126 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W1009 01:57:06.752132 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W1009 01:57:06.752136 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W1009 01:57:06.752139 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W1009 01:57:06.752141 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W1009 01:57:06.752142 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I1009 01:57:06.752192 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I1009 01:57:06.755408 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I1009 01:57:06.755427 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I1009 01:57:06.757219 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I1009 01:57:06.757228 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I1009 01:57:06.757236 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I1009 01:57:06.757247 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1009 01:57:06.757239 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1009 01:57:06.757233 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I1009 01:57:06.757442 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3489336113/tls.crt::/tmp/serving-cert-3489336113/tls.key" I1009 01:57:06.757835 1 secure_serving.go:213] Serving securely on [::]:8443 I1009 01:57:06.757874 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" E1009 01:57:06.758323 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18dcb9c978f33ae8 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-10-09 01:57:06.755386088 +0000 UTC m=+0.650862382,LastTimestamp:2026-10-09 01:57:06.755386088 +0000 UTC m=+0.650862382,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W1009 01:57:06.759926 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I1009 01:57:06.759946 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1009 01:57:06.760043 1 base_controller.go:76] Waiting for caches to sync for ConfigController I1009 01:57:06.764152 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1009 01:57:06.764175 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1009 01:57:06.771236 1 secretconfigobserver.go:119] support secret does not exist I1009 01:57:06.775637 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1009 01:57:06.780297 1 secretconfigobserver.go:119] support secret does not exist I1009 01:57:06.782458 1 recorder.go:156] Pruning old reports every 8h45m34s, max age is 288h0m0s I1009 01:57:06.786587 1 periodic.go:212] Running clusterconfig gatherer I1009 01:57:06.786593 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I1009 01:57:06.786609 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I1009 01:57:06.786629 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I1009 01:57:06.786633 1 insightsreport.go:296] Starting report retriever I1009 01:57:06.786636 1 tasks_processing.go:45] number of workers: 64 I1009 01:57:06.786637 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I1009 01:57:06.786645 1 tasks_processing.go:69] worker 0 listening for tasks. I1009 01:57:06.786664 1 tasks_processing.go:69] worker 4 listening for tasks. I1009 01:57:06.786668 1 tasks_processing.go:69] worker 3 listening for tasks. I1009 01:57:06.786676 1 tasks_processing.go:69] worker 1 listening for tasks. I1009 01:57:06.786679 1 tasks_processing.go:69] worker 2 listening for tasks. I1009 01:57:06.786683 1 tasks_processing.go:69] worker 18 listening for tasks. I1009 01:57:06.786682 1 tasks_processing.go:69] worker 9 listening for tasks. I1009 01:57:06.786689 1 tasks_processing.go:69] worker 5 listening for tasks. I1009 01:57:06.786692 1 tasks_processing.go:69] worker 13 listening for tasks. I1009 01:57:06.786694 1 tasks_processing.go:69] worker 14 listening for tasks. I1009 01:57:06.786699 1 tasks_processing.go:69] worker 8 listening for tasks. I1009 01:57:06.786699 1 tasks_processing.go:69] worker 10 listening for tasks. I1009 01:57:06.786701 1 tasks_processing.go:69] worker 15 listening for tasks. I1009 01:57:06.786704 1 tasks_processing.go:69] worker 7 listening for tasks. I1009 01:57:06.786709 1 tasks_processing.go:71] worker 15 working on ceph_cluster task. I1009 01:57:06.786712 1 tasks_processing.go:69] worker 17 listening for tasks. I1009 01:57:06.786713 1 tasks_processing.go:69] worker 12 listening for tasks. I1009 01:57:06.786715 1 tasks_processing.go:69] worker 6 listening for tasks. I1009 01:57:06.786717 1 tasks_processing.go:69] worker 46 listening for tasks. I1009 01:57:06.786721 1 tasks_processing.go:69] worker 60 listening for tasks. I1009 01:57:06.786721 1 tasks_processing.go:69] worker 47 listening for tasks. I1009 01:57:06.786721 1 tasks_processing.go:69] worker 49 listening for tasks. I1009 01:57:06.786707 1 tasks_processing.go:69] worker 16 listening for tasks. I1009 01:57:06.786726 1 tasks_processing.go:69] worker 61 listening for tasks. I1009 01:57:06.786705 1 tasks_processing.go:69] worker 11 listening for tasks. I1009 01:57:06.786727 1 tasks_processing.go:69] worker 48 listening for tasks. I1009 01:57:06.786731 1 tasks_processing.go:69] worker 19 listening for tasks. I1009 01:57:06.786733 1 tasks_processing.go:69] worker 56 listening for tasks. I1009 01:57:06.786738 1 tasks_processing.go:71] worker 19 working on support_secret task. I1009 01:57:06.786739 1 tasks_processing.go:69] worker 58 listening for tasks. I1009 01:57:06.786735 1 tasks_processing.go:69] worker 62 listening for tasks. I1009 01:57:06.786721 1 tasks_processing.go:69] worker 45 listening for tasks. I1009 01:57:06.786745 1 tasks_processing.go:69] worker 63 listening for tasks. I1009 01:57:06.786746 1 tasks_processing.go:71] worker 17 working on machine_configs task. I1009 01:57:06.786734 1 tasks_processing.go:71] worker 48 working on operators_pods_and_events task. I1009 01:57:06.786752 1 tasks_processing.go:69] worker 57 listening for tasks. I1009 01:57:06.786752 1 tasks_processing.go:69] worker 59 listening for tasks. I1009 01:57:06.786749 1 tasks_processing.go:69] worker 53 listening for tasks. I1009 01:57:06.786759 1 tasks_processing.go:69] worker 51 listening for tasks. I1009 01:57:06.786769 1 tasks_processing.go:71] worker 3 working on storage_cluster task. I1009 01:57:06.786770 1 tasks_processing.go:69] worker 27 listening for tasks. I1009 01:57:06.786729 1 tasks_processing.go:69] worker 55 listening for tasks. I1009 01:57:06.786773 1 tasks_processing.go:69] worker 52 listening for tasks. I1009 01:57:06.786759 1 tasks_processing.go:69] worker 32 listening for tasks. I1009 01:57:06.786779 1 tasks_processing.go:69] worker 50 listening for tasks. I1009 01:57:06.786760 1 tasks_processing.go:71] worker 0 working on monitoring_persistent_volumes task. I1009 01:57:06.786787 1 tasks_processing.go:69] worker 22 listening for tasks. I1009 01:57:06.786795 1 tasks_processing.go:69] worker 21 listening for tasks. I1009 01:57:06.786801 1 tasks_processing.go:71] worker 22 working on container_images task. I1009 01:57:06.786802 1 tasks_processing.go:69] worker 23 listening for tasks. I1009 01:57:06.786805 1 tasks_processing.go:69] worker 30 listening for tasks. I1009 01:57:06.786804 1 tasks_processing.go:69] worker 29 listening for tasks. I1009 01:57:06.786792 1 tasks_processing.go:69] worker 25 listening for tasks. I1009 01:57:06.786809 1 tasks_processing.go:71] worker 23 working on version task. I1009 01:57:06.786764 1 tasks_processing.go:71] worker 4 working on pod_network_connectivity_checks task. I1009 01:57:06.786807 1 tasks_processing.go:69] worker 20 listening for tasks. I1009 01:57:06.786813 1 tasks_processing.go:69] worker 24 listening for tasks. I1009 01:57:06.786816 1 tasks_processing.go:69] worker 28 listening for tasks. I1009 01:57:06.786832 1 tasks_processing.go:71] worker 45 working on overlapping_namespace_uids task. I1009 01:57:06.786821 1 tasks_processing.go:71] worker 53 working on validating_webhook_configurations task. I1009 01:57:06.786837 1 tasks_processing.go:69] worker 34 listening for tasks. I1009 01:57:06.786840 1 tasks_processing.go:69] worker 31 listening for tasks. I1009 01:57:06.786741 1 tasks_processing.go:71] worker 7 working on cluster_apiserver task. I1009 01:57:06.786851 1 tasks_processing.go:69] worker 36 listening for tasks. I1009 01:57:06.786851 1 tasks_processing.go:71] worker 5 working on machine_healthchecks task. I1009 01:57:06.786856 1 tasks_processing.go:71] worker 12 working on nodenetworkconfigurationpolicies task. I1009 01:57:06.786865 1 tasks_processing.go:69] worker 38 listening for tasks. I1009 01:57:06.786872 1 tasks_processing.go:69] worker 39 listening for tasks. I1009 01:57:06.786878 1 tasks_processing.go:69] worker 40 listening for tasks. I1009 01:57:06.786885 1 tasks_processing.go:69] worker 41 listening for tasks. I1009 01:57:06.786824 1 tasks_processing.go:71] worker 58 working on storage_classes task. I1009 01:57:06.786891 1 tasks_processing.go:71] worker 13 working on image_registries task. I1009 01:57:06.786898 1 tasks_processing.go:69] worker 43 listening for tasks. I1009 01:57:06.786821 1 tasks_processing.go:71] worker 56 working on sap_config task. I1009 01:57:06.787157 1 tasks_processing.go:71] worker 41 working on openshift_machine_api_events task. I1009 01:57:06.786843 1 tasks_processing.go:71] worker 47 working on image task. I1009 01:57:06.787777 1 tasks_processing.go:71] worker 52 working on machine_config_pools task. I1009 01:57:06.787882 1 tasks_processing.go:71] worker 14 working on oauths task. I1009 01:57:06.786892 1 tasks_processing.go:69] worker 42 listening for tasks. I1009 01:57:06.787916 1 tasks_processing.go:71] worker 42 working on openshift_logging task. I1009 01:57:06.786757 1 tasks_processing.go:71] worker 18 working on networks task. I1009 01:57:06.786725 1 tasks_processing.go:69] worker 54 listening for tasks. I1009 01:57:06.786859 1 tasks_processing.go:69] worker 37 listening for tasks. I1009 01:57:06.787160 1 tasks_processing.go:71] worker 43 working on ingress_certificates task. I1009 01:57:06.787991 1 tasks_processing.go:71] worker 37 working on service_accounts task. I1009 01:57:06.787999 1 tasks_processing.go:71] worker 54 working on machines task. I1009 01:57:06.786801 1 tasks_processing.go:71] worker 21 working on cost_management_metrics_configs task. I1009 01:57:06.786921 1 tasks_processing.go:71] worker 61 working on image_pruners task. I1009 01:57:06.786709 1 tasks_processing.go:71] worker 10 working on silenced_alerts task. W1009 01:57:06.788249 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1009 01:57:06.786925 1 tasks_processing.go:71] worker 11 working on container_runtime_configs task. I1009 01:57:06.788261 1 tasks_processing.go:71] worker 10 working on sap_pods task. I1009 01:57:06.786827 1 tasks_processing.go:71] worker 62 working on node_logs task. I1009 01:57:06.788307 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 24.484µs to process 0 records I1009 01:57:06.786830 1 tasks_processing.go:69] worker 33 listening for tasks. I1009 01:57:06.786844 1 tasks_processing.go:69] worker 35 listening for tasks. I1009 01:57:06.786848 1 tasks_processing.go:71] worker 9 working on aggregated_monitoring_cr_names task. I1009 01:57:06.788529 1 tasks_processing.go:71] worker 35 working on schedulers task. I1009 01:57:06.788575 1 tasks_processing.go:71] worker 33 working on authentication task. I1009 01:57:06.786919 1 tasks_processing.go:71] worker 16 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I1009 01:57:06.786924 1 tasks_processing.go:71] worker 51 working on mutating_webhook_configurations task. I1009 01:57:06.786923 1 tasks_processing.go:71] worker 49 working on config_maps task. I1009 01:57:06.787160 1 tasks_processing.go:69] worker 44 listening for tasks. I1009 01:57:06.788680 1 tasks_processing.go:71] worker 44 working on openstack_dataplanenodesets task. I1009 01:57:06.787309 1 tasks_processing.go:71] worker 2 working on feature_gates task. I1009 01:57:06.787317 1 tasks_processing.go:71] worker 57 working on openstack_controlplanes task. I1009 01:57:06.787320 1 tasks_processing.go:71] worker 6 working on metrics task. I1009 01:57:06.787323 1 tasks_processing.go:71] worker 63 working on olm_operators task. I1009 01:57:06.787333 1 tasks_processing.go:71] worker 46 working on openstack_version task. I1009 01:57:06.787385 1 tasks_processing.go:71] worker 59 working on tsdb_status task. I1009 01:57:06.787396 1 tasks_processing.go:71] worker 60 working on pdbs task. I1009 01:57:06.786914 1 tasks_processing.go:71] worker 1 working on machine_autoscalers task. I1009 01:57:06.786764 1 tasks_processing.go:69] worker 26 listening for tasks. I1009 01:57:06.787454 1 tasks_processing.go:71] worker 32 working on proxies task. I1009 01:57:06.787511 1 tasks_processing.go:71] worker 50 working on machine_sets task. I1009 01:57:06.787523 1 tasks_processing.go:71] worker 30 working on crds task. I1009 01:57:06.787517 1 tasks_processing.go:71] worker 27 working on install_plans task. I1009 01:57:06.787536 1 tasks_processing.go:71] worker 55 working on infrastructures task. I1009 01:57:06.787552 1 tasks_processing.go:71] worker 34 working on jaegers task. I1009 01:57:06.787596 1 tasks_processing.go:71] worker 38 working on active_alerts task. I1009 01:57:06.787604 1 tasks_processing.go:71] worker 31 working on dvo_metrics task. I1009 01:57:06.787608 1 tasks_processing.go:71] worker 24 working on clusterroles task. I1009 01:57:06.787626 1 tasks_processing.go:71] worker 20 working on sap_datahubs task. I1009 01:57:06.787637 1 tasks_processing.go:71] worker 29 working on operators task. I1009 01:57:06.787641 1 tasks_processing.go:71] worker 8 working on nodenetworkstates task. I1009 01:57:06.787673 1 tasks_processing.go:71] worker 36 working on lokistack task. I1009 01:57:06.787680 1 tasks_processing.go:71] worker 28 working on nodes task. I1009 01:57:06.787680 1 tasks_processing.go:71] worker 39 working on certificate_signing_requests task. I1009 01:57:06.787719 1 tasks_processing.go:71] worker 40 working on openstack_dataplanedeployments task. I1009 01:57:06.787731 1 tasks_processing.go:71] worker 25 working on ingress task. W1009 01:57:06.788825 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1009 01:57:06.788833 1 tasks_processing.go:74] worker 38 stopped. I1009 01:57:06.788838 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 18.781µs to process 0 records I1009 01:57:06.788838 1 tasks_processing.go:74] worker 26 stopped. W1009 01:57:06.789478 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1009 01:57:06.789492 1 tasks_processing.go:74] worker 6 stopped. I1009 01:57:06.789500 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 23.979µs to process 0 records W1009 01:57:06.788895 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1009 01:57:06.789509 1 tasks_processing.go:74] worker 59 stopped. I1009 01:57:06.789513 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 627.93µs to process 0 records I1009 01:57:06.789967 1 tasks_processing.go:74] worker 15 stopped. I1009 01:57:06.789979 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 3.250132ms to process 0 records I1009 01:57:06.790096 1 tasks_processing.go:74] worker 12 stopped. I1009 01:57:06.790114 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 3.226136ms to process 0 records I1009 01:57:06.790453 1 tasks_processing.go:74] worker 3 stopped. I1009 01:57:06.790464 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 3.673142ms to process 0 records I1009 01:57:06.793419 1 tasks_processing.go:74] worker 56 stopped. I1009 01:57:06.793428 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 6.322356ms to process 0 records E1009 01:57:06.793440 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I1009 01:57:06.793447 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 6.599384ms to process 0 records I1009 01:57:06.793453 1 tasks_processing.go:74] worker 4 stopped. I1009 01:57:06.802826 1 tasks_processing.go:74] worker 42 stopped. I1009 01:57:06.802835 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 14.904756ms to process 0 records I1009 01:57:06.802856 1 tasks_processing.go:74] worker 50 stopped. I1009 01:57:06.802860 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 13.937707ms to process 0 records E1009 01:57:06.802864 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I1009 01:57:06.802869 1 gather.go:177] gatherer "clusterconfig" function "machines" took 14.851974ms to process 0 records I1009 01:57:06.802873 1 tasks_processing.go:74] worker 54 stopped. I1009 01:57:06.802882 1 tasks_processing.go:74] worker 21 stopped. I1009 01:57:06.802894 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 14.777819ms to process 0 records I1009 01:57:06.802900 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 15.094548ms to process 0 records I1009 01:57:06.802903 1 tasks_processing.go:74] worker 52 stopped. I1009 01:57:06.802917 1 tasks_processing.go:74] worker 41 stopped. I1009 01:57:06.802928 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 15.723017ms to process 0 records E1009 01:57:06.802934 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I1009 01:57:06.802941 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 16.07056ms to process 0 records I1009 01:57:06.802947 1 tasks_processing.go:74] worker 5 stopped. I1009 01:57:06.802984 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I1009 01:57:06.803002 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1009 01:57:06.803009 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1009 01:57:06.803012 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1009 01:57:06.803023 1 controller.go:458] The operator is still being initialized I1009 01:57:06.803029 1 controller.go:481] The operator is healthy I1009 01:57:06.803072 1 tasks_processing.go:74] worker 19 stopped. E1009 01:57:06.803080 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I1009 01:57:06.803088 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 16.328491ms to process 0 records I1009 01:57:06.803199 1 tasks_processing.go:74] worker 14 stopped. I1009 01:57:06.803417 1 recorder.go:70] Recording config/oauth with fingerprint=9d4652057631a1e2ff4b373d80564ee871cc559ee802284629a791af85bfa916 I1009 01:57:06.803427 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 15.304573ms to process 1 records I1009 01:57:06.803506 1 tasks_processing.go:74] worker 18 stopped. I1009 01:57:06.803537 1 recorder.go:70] Recording config/network with fingerprint=2c161081816e69cd94fcb07990dfd9137b13369ee44671429c22f979b880aa86 I1009 01:57:06.803544 1 gather.go:177] gatherer "clusterconfig" function "networks" took 15.283238ms to process 1 records I1009 01:57:06.803626 1 tasks_processing.go:74] worker 61 stopped. I1009 01:57:06.803711 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=45d27dab9530370de9a5518f3f0126704816eb704ec15da33d8f3c4a7f15d2b3 I1009 01:57:06.803719 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 15.330699ms to process 1 records I1009 01:57:06.812727 1 tasks_processing.go:74] worker 36 stopped. I1009 01:57:06.812738 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 23.900904ms to process 0 records I1009 01:57:06.812747 1 tasks_processing.go:74] worker 46 stopped. I1009 01:57:06.812751 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 23.856574ms to process 0 records I1009 01:57:06.812763 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 23.91198ms to process 0 records I1009 01:57:06.812769 1 tasks_processing.go:74] worker 34 stopped. I1009 01:57:06.812810 1 tasks_processing.go:74] worker 40 stopped. I1009 01:57:06.812821 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 23.293769ms to process 0 records I1009 01:57:06.812848 1 tasks_processing.go:74] worker 58 stopped. I1009 01:57:06.812912 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=5fd8234605f2b5fbc5d1c6426a6eda34593ce3de6a7b9cbdff746db65453294a I1009 01:57:06.812924 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=4066538a3396daf48ee31bad7192684246feb3aeee1f3cb5c7290367a691680d I1009 01:57:06.812931 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 25.957039ms to process 2 records I1009 01:57:06.812936 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 24.594379ms to process 0 records I1009 01:57:06.812940 1 tasks_processing.go:74] worker 11 stopped. I1009 01:57:06.813098 1 tasks_processing.go:74] worker 57 stopped. I1009 01:57:06.813107 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 23.738085ms to process 0 records I1009 01:57:06.813180 1 recorder.go:70] Recording config/image with fingerprint=a094fd59cb905714fc42093e0967608f4d2acc653728078365fc8d170c66a794 I1009 01:57:06.813189 1 gather.go:177] gatherer "clusterconfig" function "image" took 25.328027ms to process 1 records I1009 01:57:06.813198 1 tasks_processing.go:74] worker 47 stopped. I1009 01:57:06.813269 1 tasks_processing.go:74] worker 55 stopped. I1009 01:57:06.813560 1 recorder.go:70] Recording config/infrastructure with fingerprint=5b3ee3117a40ec7a6140cd0682f14828ebf92053c3bb38c2e314b274ef65c7f2 I1009 01:57:06.813568 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 24.322036ms to process 1 records I1009 01:57:06.813638 1 recorder.go:70] Recording config/apiserver with fingerprint=a8a1fde3f93595ccd14cad6edc58602c1cd0b4760237c6ff2d3ba3807ca04e71 I1009 01:57:06.813645 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 26.442773ms to process 1 records I1009 01:57:06.813645 1 tasks_processing.go:74] worker 7 stopped. I1009 01:57:06.817052 1 tasks_processing.go:74] worker 44 stopped. I1009 01:57:06.817058 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 28.239209ms to process 0 records I1009 01:57:06.817256 1 tasks_processing.go:74] worker 2 stopped. I1009 01:57:06.817365 1 recorder.go:70] Recording config/featuregate with fingerprint=f0bbe9fe2879e2eedba14fbac6699b98fcbe3c674b3c6e4232471f801ad0266e I1009 01:57:06.817381 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 28.019238ms to process 1 records I1009 01:57:06.817412 1 tasks_processing.go:74] worker 13 stopped. I1009 01:57:06.817750 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=97e5e4f7213218be4e27d5551cdf7a1b36735ef04671988f776a969d070850ec I1009 01:57:06.817764 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 30.51542ms to process 1 records I1009 01:57:06.817771 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 30.738257ms to process 0 records I1009 01:57:06.817836 1 tasks_processing.go:74] worker 0 stopped. I1009 01:57:06.818075 1 tasks_processing.go:74] worker 8 stopped. I1009 01:57:06.818087 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 29.253093ms to process 0 records I1009 01:57:06.818314 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=3f7df3a91b277dc78fad06315ae519e7895775b1434789f7603e2afdf235e49f I1009 01:57:06.818332 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=3474a50a6554740e70efb287c4ddfd9608835d594e279fb62db6432d5e7bccc5 I1009 01:57:06.818344 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=f9bac08651ce8e46d69bb309f4dd86a5c889f3e42debe0cd481affec83df43d5 I1009 01:57:06.818354 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 28.811214ms to process 3 records I1009 01:57:06.818315 1 tasks_processing.go:74] worker 60 stopped. I1009 01:57:06.818473 1 tasks_processing.go:74] worker 53 stopped. I1009 01:57:06.818730 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=ad678f4497970bdf3d6f6cc120f93eeb325b55204d890e15e7d3e79d2fc17597 I1009 01:57:06.819388 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=6caff25a20b8e37be813b1f64a017c649b61f63d16ffd605b76c5375599db878 I1009 01:57:06.819424 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=8efcc1811d3b081d041cbbde64d4fb0abeeee6529b510eefe78da91aa678e802 I1009 01:57:06.819448 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=69f4c41ebc9226ac7c75da1880d6e961f6a913e83dc55d4672658a387f5ee69d I1009 01:57:06.819466 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=53db23ffe7ce8debadc19fc72ebb6b0335c70d4669170ba3bbd3fe023ba09c35 I1009 01:57:06.819490 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=421794c7aa86424aec7cc78c2ada7ee2dc4e19123360a4c1fd617033d37273b7 I1009 01:57:06.819520 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=6e899fe0ae9d97d76f0728ac224bd56b435e71e01cdff6c861d647584365c327 I1009 01:57:06.819554 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=227c132aa710e8ba467156b97f4981883d2a423eb09dfaa462fed10caf18bd4e I1009 01:57:06.819673 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=a67bf3f81cc7c00715717e76e2497dba845e98ecabe4f424f5545211c6958b60 I1009 01:57:06.820008 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=ff5672605f310bba28dee49d612395efd9213910026c0d1048188080e8ee2ab0 I1009 01:57:06.820028 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=74fc521c92f44b99fc0a3215b331189406fb80f3bbfabac3b2ae2ab0ca8816df I1009 01:57:06.820034 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 31.432731ms to process 11 records I1009 01:57:06.820043 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 30.741228ms to process 0 records I1009 01:57:06.820051 1 tasks_processing.go:74] worker 20 stopped. I1009 01:57:06.820132 1 tasks_processing.go:74] worker 63 stopped. I1009 01:57:06.820148 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 31.278564ms to process 0 records I1009 01:57:06.820235 1 tasks_processing.go:74] worker 45 stopped. I1009 01:57:06.820256 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I1009 01:57:06.820265 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 33.391186ms to process 1 records I1009 01:57:06.821983 1 tasks_processing.go:74] worker 17 stopped. E1009 01:57:06.821993 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I1009 01:57:06.822011 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I1009 01:57:06.822020 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 35.230051ms to process 1 records W1009 01:57:06.822039 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1009 01:57:06.822066 1 tasks_processing.go:74] worker 10 stopped. I1009 01:57:06.822075 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 33.799433ms to process 0 records I1009 01:57:06.823846 1 tasks_processing.go:74] worker 1 stopped. I1009 01:57:06.823855 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 35.032431ms to process 0 records I1009 01:57:06.823953 1 tasks_processing.go:74] worker 32 stopped. I1009 01:57:06.824033 1 recorder.go:70] Recording config/proxy with fingerprint=e1226324234cb74664b922587f336d2fa4f5827aadfdd22e7724091965ef689d I1009 01:57:06.824045 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 35.113497ms to process 1 records I1009 01:57:06.824769 1 tasks_processing.go:74] worker 22 stopped. I1009 01:57:06.825864 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-89kn5 with fingerprint=1bb06e0ff2e932e8135d5a7d902f908ca7ff3f29497b0268f74aef65591d85f0 I1009 01:57:06.825905 1 recorder.go:70] Recording config/running_containers with fingerprint=8eef8dc6d95d840465649d79c3969d8021514e7d62f7ef70a08d7aff2bd980f4 I1009 01:57:06.825913 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 37.954364ms to process 2 records I1009 01:57:06.826014 1 tasks_processing.go:74] worker 25 stopped. I1009 01:57:06.826108 1 recorder.go:70] Recording config/ingress with fingerprint=db832591186d3c4a4a6fe58c054259212a456bfbe317d334dd6dd74f57bdc0c2 I1009 01:57:06.826121 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 37.181483ms to process 1 records I1009 01:57:06.826204 1 tasks_processing.go:74] worker 33 stopped. I1009 01:57:06.826238 1 recorder.go:70] Recording config/authentication with fingerprint=9351d59cffff1a9eb9b12313588753a293da4d69890a94f76c681a2977291ecb I1009 01:57:06.826246 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 37.489764ms to process 1 records I1009 01:57:06.827779 1 tasks_processing.go:74] worker 62 stopped. I1009 01:57:06.827796 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 39.469165ms to process 0 records I1009 01:57:06.828244 1 tasks_processing.go:74] worker 28 stopped. I1009 01:57:06.828609 1 recorder.go:70] Recording config/node/ip-10-0-141-108.ec2.internal with fingerprint=9e237ae8677544d05509085718a2cbe1eb60bcae189b526fb6beb1ae7350f7d1 I1009 01:57:06.828708 1 recorder.go:70] Recording config/node/ip-10-0-148-62.ec2.internal with fingerprint=bfe8ede779ee9b23f6169ad029bd098f1687a4c3f379db7d07eab3988329326c I1009 01:57:06.828778 1 recorder.go:70] Recording config/node/ip-10-0-166-66.ec2.internal with fingerprint=621a00e38fd1bd7b03892450fa7c098c0399f390446732d468ce7e51f36fc62b I1009 01:57:06.828788 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 38.855987ms to process 3 records I1009 01:57:06.832208 1 tasks_processing.go:74] worker 24 stopped. I1009 01:57:06.832318 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=b3731381d0e3d5711b6e215082dae371a135769422ac6ee50bd68ea3335a0691 I1009 01:57:06.832367 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=018d69318d1aca54b0191b991f6cb346a0b6f92e86a8da2eed2454496572954f I1009 01:57:06.832374 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 43.337265ms to process 2 records I1009 01:57:06.836326 1 tasks_processing.go:74] worker 35 stopped. I1009 01:57:06.836373 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=e27562a968f847c5f091abd269b90e77c689271c7c0adbc0cfb4ee8574766394 I1009 01:57:06.836383 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 47.789446ms to process 1 records I1009 01:57:06.836473 1 tasks_processing.go:74] worker 30 stopped. I1009 01:57:06.837386 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=b8e174be317f414bae47c4a8c4bca8594caaaaef0b2b31167ee9b69456097ff6 I1009 01:57:06.837674 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=64e2869f62fe8b74ce90ccc5ff95d708ae0b445d671034e386464260ca436db3 I1009 01:57:06.837707 1 gather.go:177] gatherer "clusterconfig" function "crds" took 47.095602ms to process 2 records I1009 01:57:06.837785 1 tasks_processing.go:74] worker 51 stopped. I1009 01:57:06.837872 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=9cb76d2b6af84de4ca8d774fa628852a8a5026e9c21eb99029a676fe5faa8414 I1009 01:57:06.837998 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=fcabf86b943a76aa9495e6a6da5ae85491c2e8d593eac106c8be39a4e00ab07e I1009 01:57:06.838270 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=8894d251ccb5d2c1631cd5c50ae252a6e1b5fb4c997642da229935094dbbc00f I1009 01:57:06.838281 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 47.884532ms to process 3 records I1009 01:57:06.838770 1 tasks_processing.go:74] worker 39 stopped. I1009 01:57:06.838785 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 49.230816ms to process 0 records I1009 01:57:06.840203 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I1009 01:57:06.840267 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W1009 01:57:06.840332 1 operator.go:287] started I1009 01:57:06.840347 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I1009 01:57:06.853054 1 controller.go:203] Source scaController *sca.Controller is not ready I1009 01:57:06.853066 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I1009 01:57:06.853069 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1009 01:57:06.853072 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1009 01:57:06.853074 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1009 01:57:06.853085 1 controller.go:458] The operator is still being initialized I1009 01:57:06.853090 1 controller.go:481] The operator is healthy I1009 01:57:06.857914 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1009 01:57:06.857923 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1009 01:57:06.857951 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I1009 01:57:06.860588 1 base_controller.go:82] Caches are synced for ConfigController I1009 01:57:06.860600 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I1009 01:57:06.860864 1 tasks_processing.go:74] worker 9 stopped. I1009 01:57:06.860881 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 72.331693ms to process 0 records I1009 01:57:06.864005 1 prometheus_rules.go:88] Prometheus rules successfully created E1009 01:57:06.873061 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27a6d51978-50c5-4110-b927-643297185bde%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:52093->172.30.0.10:53: read: connection refused I1009 01:57:06.873073 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27a6d51978-50c5-4110-b927-643297185bde%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:52093->172.30.0.10:53: read: connection refused I1009 01:57:06.876805 1 configmapobserver.go:84] configmaps "insights-config" not found I1009 01:57:06.889144 1 tasks_processing.go:74] worker 49 stopped. E1009 01:57:06.889155 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E1009 01:57:06.889159 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E1009 01:57:06.889162 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I1009 01:57:06.889168 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I1009 01:57:06.889191 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I1009 01:57:06.889198 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I1009 01:57:06.889201 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I1009 01:57:06.889204 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I1009 01:57:06.889219 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I1009 01:57:06.889226 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I1009 01:57:06.889230 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 100.465283ms to process 7 records I1009 01:57:06.912619 1 tasks_processing.go:74] worker 23 stopped. I1009 01:57:06.913002 1 recorder.go:70] Recording config/version with fingerprint=79ce8a8d136492b8bbc1c59b751813bbfd7272f6ef1827255e3e6a738f2d2e83 I1009 01:57:06.913016 1 recorder.go:70] Recording config/id with fingerprint=80c04d300eb9a788da177d8274c6838ce49dfa5a45482089140d0d9c5f8ff3a8 I1009 01:57:06.913022 1 gather.go:177] gatherer "clusterconfig" function "version" took 125.792326ms to process 2 records I1009 01:57:06.921775 1 tasks_processing.go:74] worker 16 stopped. I1009 01:57:06.921788 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 133.166886ms to process 0 records I1009 01:57:06.941426 1 base_controller.go:82] Caches are synced for LoggingSyncer I1009 01:57:06.941437 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I1009 01:57:06.956280 1 tasks_processing.go:74] worker 43 stopped. E1009 01:57:06.956296 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E1009 01:57:06.956305 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2tavcv29r9hv2nbl32s38p7cj92lkqpo-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2tavcv29r9hv2nbl32s38p7cj92lkqpo-primary-cert-bundle-secret" not found I1009 01:57:06.956313 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I1009 01:57:06.956355 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=54a2f6b87c8f78ecff776d5007a3abac1fd8c756c7bba44001a01bc653083815 I1009 01:57:06.956368 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 168.286334ms to process 1 records I1009 01:57:06.959253 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W1009 01:57:06.961913 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:54828->172.30.0.10:53: read: connection refused I1009 01:57:06.961924 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.130.0.13:54828->172.30.0.10:53: read: connection refused I1009 01:57:06.965380 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress" I1009 01:57:07.255693 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I1009 01:57:07.255706 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I1009 01:57:07.255811 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-57chk pod in namespace openshift-dns (previous: false). I1009 01:57:07.469298 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-57chk pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-57chk\" is waiting to start: ContainerCreating" I1009 01:57:07.469317 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-57chk\" is waiting to start: ContainerCreating" I1009 01:57:07.469324 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-57chk pod in namespace openshift-dns (previous: false). I1009 01:57:07.469347 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I1009 01:57:07.634263 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-57chk pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-57chk\" is waiting to start: ContainerCreating" I1009 01:57:07.634277 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-57chk\" is waiting to start: ContainerCreating" I1009 01:57:07.634286 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-dfqsk pod in namespace openshift-dns (previous: false). I1009 01:57:07.666013 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W1009 01:57:07.821821 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1009 01:57:07.876614 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dfqsk pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-dfqsk\" is waiting to start: ContainerCreating" I1009 01:57:07.876627 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-dfqsk\" is waiting to start: ContainerCreating" I1009 01:57:07.876633 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-dfqsk pod in namespace openshift-dns (previous: false). I1009 01:57:08.031267 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-dfqsk pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-dfqsk\" is waiting to start: ContainerCreating" I1009 01:57:08.031279 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-dfqsk\" is waiting to start: ContainerCreating" I1009 01:57:08.031288 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-q854v pod in namespace openshift-dns (previous: false). I1009 01:57:08.251150 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-q854v pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-q854v\" is waiting to start: ContainerCreating" I1009 01:57:08.251166 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-q854v\" is waiting to start: ContainerCreating" I1009 01:57:08.251174 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-q854v pod in namespace openshift-dns (previous: false). I1009 01:57:08.429146 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-q854v pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-q854v\" is waiting to start: ContainerCreating" I1009 01:57:08.429165 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-q854v\" is waiting to start: ContainerCreating" I1009 01:57:08.429176 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-4b5zf pod in namespace openshift-dns (previous: false). I1009 01:57:08.467765 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I1009 01:57:08.635237 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1009 01:57:08.635253 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-ch2rd pod in namespace openshift-dns (previous: false). W1009 01:57:08.821631 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1009 01:57:08.829365 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1009 01:57:08.829380 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-k5srw pod in namespace openshift-dns (previous: false). I1009 01:57:09.030737 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1009 01:57:09.030798 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6b66cc5ff4-29fjr pod in namespace openshift-image-registry (previous: false). I1009 01:57:09.068906 1 tasks_processing.go:74] worker 29 stopped. I1009 01:57:09.068959 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=622bc80579cd9b417f90681ea335a272092f337ecf8e970455626b5b4713972a I1009 01:57:09.068994 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=c755e1ac7f596a0cd5ae9f342f23c6029a55bf5718c090dd251bd48ec45b0881 I1009 01:57:09.069027 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I1009 01:57:09.069049 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=cc5afdde84af37eab7d7e0b230cd0dae971e94383b49355679d71a95ff752c14 I1009 01:57:09.069067 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I1009 01:57:09.069084 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=cdfe54c5f6a8ca44676fe1e9259b4dca035ebc313e199f126f5e6a3960a98ecb I1009 01:57:09.069105 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=549778c32aa5acf5e6ef5e782c7799b10dba75eadfc4af177efd261b45838321 I1009 01:57:09.069127 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=40a3a115f37585dfd8a59079f7fd73a79ccb4b664a5a4adb26e1e4511f4b9f9f I1009 01:57:09.069148 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=13fdcf8a4c3ede5158b23cbcdc8fc3eb4995e9d8b3d27e6f41b949d55f891d26 I1009 01:57:09.069157 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5ff11d57817f84a678f6fa9565af55bd1120227c16a21933637ab62675a6d70 I1009 01:57:09.069168 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=5970f4b4d5831f0b4c500be9981869c5d3bafcd91b1199472275ed1c742c2991 I1009 01:57:09.069178 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I1009 01:57:09.069188 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=3136c88b491c2349a9542757733f5700ec57c79fa9084e88ff9c8ab630372593 I1009 01:57:09.069197 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I1009 01:57:09.069208 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=6d3dcb66a7f8b1c3eeb6893ce0c86df99dd5316dc5b7dd966303668eb972cac2 I1009 01:57:09.069219 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I1009 01:57:09.069228 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=62d0627313d77d4608a881407a0a68814f7ce55fc4df750d952f6ac69bcd64d1 I1009 01:57:09.069235 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I1009 01:57:09.069245 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=77166521deeba030282e00998197edd8fb1b6c617dfbd9cc89183f6aff51d67a I1009 01:57:09.069308 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=bdd4a5acb3a63c2ae3708a80a96f4bf9e9deeb3bdc0cd637b863f593da6f896c I1009 01:57:09.069329 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I1009 01:57:09.069343 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=d9451b58dabd086b10bc13ca9752b130ad522858280ec7bb14523df87c844790 I1009 01:57:09.069355 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=aa7996e8040ee0dd09ae6309087dfc9e321f577515962b0a2392a1d6acc398ef I1009 01:57:09.069364 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I1009 01:57:09.069373 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=217cda41c325d433768c0dacbfc374831a3f38c136d6a39b875e2247d3c67edb I1009 01:57:09.069380 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I1009 01:57:09.069388 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=881da06b1062e3add3696b9bb139b811fc7100e5aeb12942f507dfd9da400e6b I1009 01:57:09.069399 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=77ec92ca66cf48cdc5f5dac22d70f9f666a269733d732ea32e1500c6d06a786c I1009 01:57:09.069409 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=a833e4d729199f19b9af250c9c97a58e0a24fefd0a43a7e1b65d9a7fffcc9826 I1009 01:57:09.069419 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=9326f966cc6b9e3222db531d3aa9a537d855f6a67a8b5445c1a6625269de9d7e I1009 01:57:09.069432 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=969a9971dfe66eaa458fac46b287ca2e8fd1ae07e609cecd630fa835bc753efb I1009 01:57:09.069439 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I1009 01:57:09.069454 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=38670386100d24671c0d762da8883c1ec2c39a3782c7a5b2cac46e4c6864c173 I1009 01:57:09.069469 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I1009 01:57:09.069475 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I1009 01:57:09.069481 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.280062921s to process 35 records I1009 01:57:09.232442 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6b66cc5ff4-29fjr pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6b66cc5ff4-29fjr\" is waiting to start: ContainerCreating" I1009 01:57:09.232459 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6b66cc5ff4-29fjr\" is waiting to start: ContainerCreating" I1009 01:57:09.232499 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-6b66cc5ff4-65w42 pod in namespace openshift-image-registry (previous: false). I1009 01:57:09.431129 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-6b66cc5ff4-65w42 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-6b66cc5ff4-65w42\" is waiting to start: ContainerCreating" I1009 01:57:09.431142 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-6b66cc5ff4-65w42\" is waiting to start: ContainerCreating" I1009 01:57:09.431180 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-7b647d946f-cbp2j pod in namespace openshift-image-registry (previous: false). I1009 01:57:09.630222 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-7b647d946f-cbp2j pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-7b647d946f-cbp2j\" is waiting to start: ContainerCreating" I1009 01:57:09.630236 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-7b647d946f-cbp2j\" is waiting to start: ContainerCreating" I1009 01:57:09.630244 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-m9gcb pod in namespace openshift-image-registry (previous: false). W1009 01:57:09.821053 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1009 01:57:09.834355 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1009 01:57:09.834370 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-nhsvm pod in namespace openshift-image-registry (previous: false). I1009 01:57:10.029634 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1009 01:57:10.029662 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-sg5vl pod in namespace openshift-image-registry (previous: false). I1009 01:57:10.230904 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1009 01:57:10.230918 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5b58cf56f6-46sqs pod in namespace openshift-ingress (previous: false). I1009 01:57:10.430290 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5b58cf56f6-46sqs pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5b58cf56f6-46sqs\" is waiting to start: ContainerCreating" I1009 01:57:10.430304 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5b58cf56f6-46sqs\" is waiting to start: ContainerCreating" I1009 01:57:10.430312 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5b58cf56f6-x9lq5 pod in namespace openshift-ingress (previous: false). I1009 01:57:10.630324 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5b58cf56f6-x9lq5 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5b58cf56f6-x9lq5\" is waiting to start: ContainerCreating" I1009 01:57:10.630337 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5b58cf56f6-x9lq5\" is waiting to start: ContainerCreating" I1009 01:57:10.630345 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6c8dc5dd47-cd8vt pod in namespace openshift-ingress (previous: false). W1009 01:57:10.821271 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1009 01:57:10.829814 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6c8dc5dd47-cd8vt pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6c8dc5dd47-cd8vt\" is waiting to start: ContainerCreating" I1009 01:57:10.829824 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6c8dc5dd47-cd8vt\" is waiting to start: ContainerCreating" I1009 01:57:10.829832 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-gfnmp pod in namespace openshift-ingress-canary (previous: false). I1009 01:57:11.029826 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-gfnmp pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-gfnmp\" is waiting to start: ContainerCreating" I1009 01:57:11.029838 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-gfnmp\" is waiting to start: ContainerCreating" I1009 01:57:11.029846 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-tftmf pod in namespace openshift-ingress-canary (previous: false). I1009 01:57:11.230645 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-tftmf pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-tftmf\" is waiting to start: ContainerCreating" I1009 01:57:11.230672 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-tftmf\" is waiting to start: ContainerCreating" I1009 01:57:11.230679 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-tl2wv pod in namespace openshift-ingress-canary (previous: false). I1009 01:57:11.429753 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-tl2wv pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-tl2wv\" is waiting to start: ContainerCreating" I1009 01:57:11.429767 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-tl2wv\" is waiting to start: ContainerCreating" I1009 01:57:11.429782 1 tasks_processing.go:74] worker 48 stopped. I1009 01:57:11.429848 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=f2682114c23012d876113b7d2f45832123c1459e28b638dc7e9d1c73602b4d6a I1009 01:57:11.429881 1 recorder.go:70] Recording events/openshift-dns with fingerprint=9feda32f3c079dee328efa44116e737387679fdedb352b07999d3583731c825b I1009 01:57:11.429944 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=bcecb4c18d66a2d976079b000de0674f8a07a20d03d740574a7bc0fc0bf0844e I1009 01:57:11.429961 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=b56682a273b22419b77576d3b73e72f350bec2ac8eece85c839f29174013e5de I1009 01:57:11.429988 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=2c54f59550cf9b34bcad8be6bf2414354b6732404e598ed19ba4c986f19bbfe0 I1009 01:57:11.430001 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=93d02e2c16d82a82ff5f2fd0d2a5c65fd5f4bac1a24848ea3dd3cd659ddb6166 I1009 01:57:11.430111 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-6b66cc5ff4-29fjr with fingerprint=b095870c10f5557e19e2dfb50d875d605398915b01c738e7c5e49b3227b8e443 I1009 01:57:11.430178 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-6b66cc5ff4-65w42 with fingerprint=96af10c7d35e9f02cd259dd0f36cd513253bf11e984653924e69be13408ef489 I1009 01:57:11.430230 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-7b647d946f-cbp2j with fingerprint=5e414ba0b76f61ee4a5c57f7eca773b7d025ae1b14f9de46f344734aa595d5cd I1009 01:57:11.430238 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.643023626s to process 9 records W1009 01:57:11.818412 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I1009 01:57:11.818433 1 tasks_processing.go:74] worker 31 stopped. E1009 01:57:11.818448 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I1009 01:57:11.818461 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W1009 01:57:11.818473 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I1009 01:57:11.818484 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.029572985s to process 1 records I1009 01:57:19.080365 1 configmapobserver.go:84] configmaps "insights-config" not found I1009 01:57:19.518812 1 tasks_processing.go:74] worker 27 stopped. I1009 01:57:19.518845 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I1009 01:57:19.518854 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.729992151s to process 1 records I1009 01:57:20.204447 1 tasks_processing.go:74] worker 37 stopped. I1009 01:57:20.204695 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=4a028e8a81776235f87357a783e151baf9592d8d96c64fa17fcfd7eeba70afa9 I1009 01:57:20.204710 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.416438454s to process 1 records E1009 01:57:20.204770 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.418s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I1009 01:57:20.205881 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I1009 01:57:20.205894 1 periodic.go:212] Running workloads gatherer I1009 01:57:20.205909 1 tasks_processing.go:45] number of workers: 2 I1009 01:57:20.205916 1 tasks_processing.go:69] worker 1 listening for tasks. I1009 01:57:20.205920 1 tasks_processing.go:71] worker 1 working on workload_info task. I1009 01:57:20.205930 1 tasks_processing.go:69] worker 0 listening for tasks. I1009 01:57:20.205983 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I1009 01:57:20.440428 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I1009 01:57:20.447276 1 tasks_processing.go:74] worker 0 stopped. I1009 01:57:20.447293 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 241.270825ms to process 0 records I1009 01:57:20.461705 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (22ms) I1009 01:57:20.481995 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (20ms) I1009 01:57:20.499412 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (17ms) I1009 01:57:20.510762 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (11ms) I1009 01:57:20.539733 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (29ms) I1009 01:57:20.553059 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (13ms) I1009 01:57:20.569574 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (17ms) I1009 01:57:20.587627 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (18ms) I1009 01:57:20.602877 1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (15ms) I1009 01:57:20.612206 1 gather_workloads_info.go:387] No image sha256:d28734effaadd66434e77a1a5fbe2e8a4ca2066cd9f8868c22ade9475539bfd7 (9ms) I1009 01:57:20.621610 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (9ms) I1009 01:57:20.648994 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (27ms) I1009 01:57:20.754320 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (105ms) I1009 01:57:20.849295 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (95ms) I1009 01:57:20.950206 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (101ms) I1009 01:57:21.050171 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (100ms) I1009 01:57:21.150004 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (100ms) I1009 01:57:21.248963 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (99ms) I1009 01:57:21.353091 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (104ms) I1009 01:57:21.387891 1 configmapobserver.go:84] configmaps "insights-config" not found I1009 01:57:21.449053 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (96ms) I1009 01:57:21.554339 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (105ms) I1009 01:57:21.585169 1 configmapobserver.go:84] configmaps "insights-config" not found I1009 01:57:21.649353 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (95ms) I1009 01:57:21.749671 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (100ms) I1009 01:57:21.849777 1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (100ms) I1009 01:57:21.949183 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (99ms) I1009 01:57:22.050181 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (101ms) I1009 01:57:22.149046 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (99ms) I1009 01:57:22.250067 1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (101ms) I1009 01:57:22.349269 1 gather_workloads_info.go:387] No image sha256:798001e24f1ed6a5621c442729a840ba2a2abc43433901e8450caa12b4bad5c5 (99ms) I1009 01:57:22.451719 1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (102ms) I1009 01:57:22.552286 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (101ms) I1009 01:57:22.552317 1 tasks_processing.go:74] worker 1 stopped. E1009 01:57:22.552327 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I1009 01:57:22.552539 1 recorder.go:70] Recording config/workload_info with fingerprint=b02ac8cce54a8efb85213d23473d46ecc3eacc43c9c4d2da4ede022515081fdf I1009 01:57:22.552555 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.346390234s to process 1 records E1009 01:57:22.552582 1 periodic.go:250] "Unhandled Error" err="workloads failed after 2.346s with: function \"workload_info\" failed with an error" I1009 01:57:22.553681 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I1009 01:57:22.553694 1 periodic.go:212] Running conditional gatherer I1009 01:57:22.562186 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I1009 01:57:22.566940 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.13:57013->172.30.0.10:53: read: connection refused E1009 01:57:22.567187 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1009 01:57:22.567239 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I1009 01:57:22.577048 1 conditional_gatherer.go:390] cluster version is '4.19.9' E1009 01:57:22.577061 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:57:22.577066 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:57:22.577070 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:57:22.577074 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:57:22.577077 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:57:22.577080 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:57:22.577084 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:57:22.577088 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1009 01:57:22.577091 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I1009 01:57:22.577105 1 tasks_processing.go:45] number of workers: 3 I1009 01:57:22.577112 1 tasks_processing.go:69] worker 2 listening for tasks. I1009 01:57:22.577116 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I1009 01:57:22.577121 1 tasks_processing.go:69] worker 0 listening for tasks. I1009 01:57:22.577130 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I1009 01:57:22.577134 1 tasks_processing.go:69] worker 1 listening for tasks. I1009 01:57:22.577143 1 tasks_processing.go:74] worker 1 stopped. I1009 01:57:22.577154 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I1009 01:57:22.577166 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I1009 01:57:22.577175 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.15µs to process 1 records I1009 01:57:22.577242 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I1009 01:57:22.577254 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.508µs to process 1 records I1009 01:57:22.577258 1 tasks_processing.go:74] worker 2 stopped. I1009 01:57:22.577351 1 tasks_processing.go:74] worker 0 stopped. I1009 01:57:22.577361 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 216.358µs to process 0 records I1009 01:57:22.577377 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.130.0.13:57013->172.30.0.10:53: read: connection refused I1009 01:57:22.577387 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I1009 01:57:22.600089 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=d6339d5bd43976b4b7818dea1cc59e2d203686cf4d03a896a366dcb6e86bc21c I1009 01:57:22.600356 1 diskrecorder.go:70] Writing 103 records to /var/lib/insights-operator/insights-2026-10-09-015722.tar.gz I1009 01:57:22.606359 1 diskrecorder.go:51] Wrote 103 records to disk in 6ms I1009 01:57:22.606383 1 periodic.go:281] Gathering cluster info every 2h0m0s I1009 01:57:22.606401 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I1009 01:57:31.686675 1 configmapobserver.go:84] configmaps "insights-config" not found I1009 01:58:21.382604 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="01ca27a7fc9faa55cfd715fd0383d1576c36643b1e340439a2b1adf4666082f8") W1009 01:58:21.382635 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I1009 01:58:21.382689 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="12d899a5722ff8b422387ff72b94929b27eb4b6c9f1f5561e9c0576dac5ff744") I1009 01:58:21.382739 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="1f05fa28c8267bae68a9172153d6d0a3dd9f725a895f9f1a060fd6f042ce8a1c") I1009 01:58:21.382753 1 periodic.go:173] Shutting down