W1006 06:24:51.790949 1 cmd.go:257] Using insecure, self-signed certificates I1006 06:24:52.281349 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1006 06:24:52.281625 1 observer_polling.go:159] Starting file observer W1006 06:24:52.306663 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I1006 06:24:52.820394 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I1006 06:24:52.820586 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I1006 06:24:52.821005 1 secure_serving.go:57] Forcing use of http/1.1 only W1006 06:24:52.821023 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W1006 06:24:52.821026 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W1006 06:24:52.821029 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W1006 06:24:52.821031 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W1006 06:24:52.821033 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W1006 06:24:52.821035 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I1006 06:24:52.821051 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I1006 06:24:52.851796 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I1006 06:24:52.851809 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I1006 06:24:52.851816 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I1006 06:24:52.851816 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I1006 06:24:52.851845 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1006 06:24:52.851865 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1006 06:24:52.852014 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-3186083530/tls.crt::/tmp/serving-cert-3186083530/tls.key" I1006 06:24:52.852109 1 secure_serving.go:213] Serving securely on [::]:8443 I1006 06:24:52.852138 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" I1006 06:24:52.857724 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I1006 06:24:52.857737 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} E1006 06:24:52.871566 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18dbdca8735819dd openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-10-06 06:24:52.857674205 +0000 UTC m=+1.098631485,LastTimestamp:2026-10-06 06:24:52.857674205 +0000 UTC m=+1.098631485,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W1006 06:24:52.873298 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I1006 06:24:52.873323 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1006 06:24:52.873434 1 base_controller.go:76] Waiting for caches to sync for ConfigController I1006 06:24:52.889911 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1006 06:24:52.889934 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1006 06:24:52.901061 1 secretconfigobserver.go:119] support secret does not exist I1006 06:24:52.918625 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1006 06:24:52.939554 1 secretconfigobserver.go:119] support secret does not exist I1006 06:24:52.943205 1 recorder.go:156] Pruning old reports every 7h0m55s, max age is 288h0m0s I1006 06:24:52.952125 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1006 06:24:52.952243 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I1006 06:24:52.952260 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1006 06:24:52.953688 1 periodic.go:212] Running clusterconfig gatherer I1006 06:24:52.953739 1 tasks_processing.go:45] number of workers: 64 I1006 06:24:52.953781 1 tasks_processing.go:69] worker 3 listening for tasks. I1006 06:24:52.953686 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I1006 06:24:52.953793 1 tasks_processing.go:69] worker 10 listening for tasks. I1006 06:24:52.953796 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I1006 06:24:52.953803 1 tasks_processing.go:69] worker 4 listening for tasks. I1006 06:24:52.953805 1 tasks_processing.go:69] worker 11 listening for tasks. I1006 06:24:52.953807 1 tasks_processing.go:69] worker 5 listening for tasks. I1006 06:24:52.953811 1 tasks_processing.go:69] worker 6 listening for tasks. I1006 06:24:52.953741 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I1006 06:24:52.953815 1 tasks_processing.go:69] worker 7 listening for tasks. I1006 06:24:52.953818 1 insightsreport.go:296] Starting report retriever I1006 06:24:52.953819 1 tasks_processing.go:71] worker 6 working on active_alerts task. I1006 06:24:52.953822 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I1006 06:24:52.953824 1 tasks_processing.go:69] worker 13 listening for tasks. I1006 06:24:52.953824 1 tasks_processing.go:69] worker 2 listening for tasks. I1006 06:24:52.953830 1 tasks_processing.go:69] worker 1 listening for tasks. I1006 06:24:52.953831 1 tasks_processing.go:69] worker 9 listening for tasks. I1006 06:24:52.953832 1 tasks_processing.go:71] worker 2 working on storage_cluster task. I1006 06:24:52.953826 1 tasks_processing.go:69] worker 8 listening for tasks. I1006 06:24:52.953835 1 tasks_processing.go:69] worker 20 listening for tasks. I1006 06:24:52.953799 1 tasks_processing.go:69] worker 21 listening for tasks. I1006 06:24:52.953813 1 tasks_processing.go:69] worker 0 listening for tasks. I1006 06:24:52.953838 1 tasks_processing.go:69] worker 15 listening for tasks. I1006 06:24:52.953840 1 tasks_processing.go:69] worker 19 listening for tasks. I1006 06:24:52.953819 1 tasks_processing.go:69] worker 12 listening for tasks. I1006 06:24:52.953828 1 tasks_processing.go:71] worker 13 working on networks task. I1006 06:24:52.953843 1 tasks_processing.go:69] worker 14 listening for tasks. I1006 06:24:52.953844 1 tasks_processing.go:69] worker 45 listening for tasks. I1006 06:24:52.953849 1 tasks_processing.go:69] worker 22 listening for tasks. I1006 06:24:52.953850 1 tasks_processing.go:69] worker 16 listening for tasks. W1006 06:24:52.953847 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1006 06:24:52.953854 1 tasks_processing.go:69] worker 23 listening for tasks. I1006 06:24:52.953856 1 tasks_processing.go:69] worker 63 listening for tasks. I1006 06:24:52.953858 1 tasks_processing.go:69] worker 24 listening for tasks. I1006 06:24:52.953860 1 tasks_processing.go:69] worker 58 listening for tasks. I1006 06:24:52.953855 1 tasks_processing.go:69] worker 17 listening for tasks. I1006 06:24:52.953865 1 tasks_processing.go:69] worker 59 listening for tasks. I1006 06:24:52.953863 1 tasks_processing.go:69] worker 25 listening for tasks. I1006 06:24:52.953870 1 tasks_processing.go:69] worker 60 listening for tasks. I1006 06:24:52.953861 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 32.271µs to process 0 records I1006 06:24:52.953874 1 tasks_processing.go:71] worker 4 working on openshift_machine_api_events task. I1006 06:24:52.953875 1 tasks_processing.go:69] worker 62 listening for tasks. I1006 06:24:52.953866 1 tasks_processing.go:69] worker 26 listening for tasks. I1006 06:24:52.953876 1 tasks_processing.go:69] worker 46 listening for tasks. I1006 06:24:52.953882 1 tasks_processing.go:69] worker 51 listening for tasks. I1006 06:24:52.953875 1 tasks_processing.go:69] worker 28 listening for tasks. I1006 06:24:52.953885 1 tasks_processing.go:69] worker 30 listening for tasks. I1006 06:24:52.953884 1 tasks_processing.go:71] worker 5 working on ceph_cluster task. I1006 06:24:52.953888 1 tasks_processing.go:69] worker 52 listening for tasks. I1006 06:24:52.953889 1 tasks_processing.go:69] worker 47 listening for tasks. I1006 06:24:52.953891 1 tasks_processing.go:69] worker 31 listening for tasks. I1006 06:24:52.953893 1 tasks_processing.go:69] worker 53 listening for tasks. I1006 06:24:52.953833 1 tasks_processing.go:69] worker 18 listening for tasks. I1006 06:24:52.953894 1 tasks_processing.go:69] worker 50 listening for tasks. I1006 06:24:52.953897 1 tasks_processing.go:69] worker 54 listening for tasks. I1006 06:24:52.953893 1 tasks_processing.go:69] worker 61 listening for tasks. I1006 06:24:52.953902 1 tasks_processing.go:69] worker 56 listening for tasks. I1006 06:24:52.953904 1 tasks_processing.go:69] worker 34 listening for tasks. I1006 06:24:52.953867 1 tasks_processing.go:69] worker 57 listening for tasks. I1006 06:24:52.953905 1 tasks_processing.go:69] worker 48 listening for tasks. I1006 06:24:52.953909 1 tasks_processing.go:69] worker 40 listening for tasks. I1006 06:24:52.953819 1 tasks_processing.go:71] worker 7 working on machines task. I1006 06:24:52.953908 1 tasks_processing.go:69] worker 49 listening for tasks. I1006 06:24:52.953912 1 tasks_processing.go:69] worker 35 listening for tasks. I1006 06:24:52.953915 1 tasks_processing.go:69] worker 37 listening for tasks. I1006 06:24:52.953871 1 tasks_processing.go:71] worker 10 working on machine_autoscalers task. I1006 06:24:52.953918 1 tasks_processing.go:69] worker 42 listening for tasks. I1006 06:24:52.953919 1 tasks_processing.go:69] worker 36 listening for tasks. I1006 06:24:52.953921 1 tasks_processing.go:69] worker 43 listening for tasks. I1006 06:24:52.953924 1 tasks_processing.go:69] worker 44 listening for tasks. I1006 06:24:52.953925 1 tasks_processing.go:71] worker 19 working on olm_operators task. I1006 06:24:52.953928 1 tasks_processing.go:71] worker 25 working on image_registries task. I1006 06:24:52.953929 1 tasks_processing.go:71] worker 63 working on infrastructures task. I1006 06:24:52.953933 1 tasks_processing.go:71] worker 44 working on crds task. I1006 06:24:52.953931 1 tasks_processing.go:69] worker 38 listening for tasks. I1006 06:24:52.953946 1 tasks_processing.go:71] worker 38 working on image task. I1006 06:24:52.953948 1 tasks_processing.go:71] worker 50 working on version task. I1006 06:24:52.953880 1 tasks_processing.go:69] worker 29 listening for tasks. I1006 06:24:52.953896 1 tasks_processing.go:69] worker 32 listening for tasks. I1006 06:24:52.953900 1 tasks_processing.go:69] worker 33 listening for tasks. I1006 06:24:52.953900 1 tasks_processing.go:69] worker 55 listening for tasks. I1006 06:24:52.953906 1 tasks_processing.go:69] worker 39 listening for tasks. I1006 06:24:52.953909 1 tasks_processing.go:71] worker 11 working on pdbs task. I1006 06:24:52.953982 1 tasks_processing.go:71] worker 12 working on container_runtime_configs task. I1006 06:24:52.953871 1 tasks_processing.go:69] worker 27 listening for tasks. I1006 06:24:52.953971 1 tasks_processing.go:71] worker 22 working on ingress task. I1006 06:24:52.953995 1 tasks_processing.go:71] worker 54 working on sap_config task. I1006 06:24:52.954016 1 tasks_processing.go:71] worker 60 working on dvo_metrics task. I1006 06:24:52.954243 1 tasks_processing.go:71] worker 27 working on validating_webhook_configurations task. I1006 06:24:52.954007 1 tasks_processing.go:71] worker 58 working on authentication task. I1006 06:24:52.954029 1 tasks_processing.go:71] worker 24 working on nodenetworkconfigurationpolicies task. I1006 06:24:52.954350 1 tasks_processing.go:71] worker 20 working on oauths task. I1006 06:24:52.953867 1 tasks_processing.go:71] worker 3 working on image_pruners task. I1006 06:24:52.954036 1 tasks_processing.go:71] worker 21 working on sap_pods task. I1006 06:24:52.954142 1 tasks_processing.go:71] worker 35 working on certificate_signing_requests task. I1006 06:24:52.954041 1 tasks_processing.go:71] worker 9 working on openstack_dataplanedeployments task. I1006 06:24:52.954034 1 tasks_processing.go:71] worker 0 working on operators task. I1006 06:24:52.954048 1 tasks_processing.go:71] worker 30 working on nodes task. I1006 06:24:52.954044 1 tasks_processing.go:71] worker 1 working on storage_classes task. I1006 06:24:52.954053 1 tasks_processing.go:71] worker 62 working on cluster_apiserver task. I1006 06:24:52.954060 1 tasks_processing.go:71] worker 46 working on pod_network_connectivity_checks task. I1006 06:24:52.954056 1 tasks_processing.go:71] worker 26 working on mutating_webhook_configurations task. I1006 06:24:52.954066 1 tasks_processing.go:71] worker 28 working on operators_pods_and_events task. I1006 06:24:52.954077 1 tasks_processing.go:71] worker 14 working on container_images task. I1006 06:24:52.954083 1 tasks_processing.go:71] worker 33 working on ingress_certificates task. I1006 06:24:52.954087 1 tasks_processing.go:71] worker 29 working on clusterroles task. I1006 06:24:52.954091 1 tasks_processing.go:71] worker 32 working on openshift_logging task. I1006 06:24:52.954097 1 tasks_processing.go:71] worker 15 working on monitoring_persistent_volumes task. I1006 06:24:52.954102 1 tasks_processing.go:71] worker 45 working on tsdb_status task. W1006 06:24:52.955099 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1006 06:24:52.955113 1 tasks_processing.go:74] worker 45 stopped. I1006 06:24:52.955123 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 28.069µs to process 0 records I1006 06:24:52.954107 1 tasks_processing.go:71] worker 31 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I1006 06:24:52.954110 1 tasks_processing.go:71] worker 52 working on jaegers task. I1006 06:24:52.954112 1 tasks_processing.go:71] worker 47 working on install_plans task. I1006 06:24:52.954117 1 tasks_processing.go:71] worker 6 working on openstack_version task. I1006 06:24:52.954120 1 tasks_processing.go:71] worker 16 working on feature_gates task. I1006 06:24:52.954125 1 tasks_processing.go:71] worker 40 working on node_logs task. I1006 06:24:52.954128 1 tasks_processing.go:71] worker 61 working on nodenetworkstates task. I1006 06:24:52.954128 1 tasks_processing.go:71] worker 17 working on silenced_alerts task. I1006 06:24:52.953914 1 tasks_processing.go:69] worker 41 listening for tasks. I1006 06:24:52.954131 1 tasks_processing.go:71] worker 56 working on sap_datahubs task. I1006 06:24:52.954135 1 tasks_processing.go:71] worker 34 working on machine_sets task. I1006 06:24:52.954137 1 tasks_processing.go:71] worker 49 working on service_accounts task. I1006 06:24:52.954135 1 tasks_processing.go:71] worker 59 working on support_secret task. I1006 06:24:52.954138 1 tasks_processing.go:71] worker 57 working on schedulers task. I1006 06:24:52.954143 1 tasks_processing.go:71] worker 42 working on lokistack task. I1006 06:24:52.954142 1 tasks_processing.go:71] worker 48 working on cost_management_metrics_configs task. I1006 06:24:52.954146 1 tasks_processing.go:71] worker 37 working on config_maps task. I1006 06:24:52.954147 1 tasks_processing.go:71] worker 53 working on openstack_controlplanes task. I1006 06:24:52.954153 1 tasks_processing.go:71] worker 18 working on proxies task. I1006 06:24:52.954152 1 tasks_processing.go:71] worker 23 working on machine_healthchecks task. I1006 06:24:52.954158 1 tasks_processing.go:71] worker 36 working on machine_configs task. I1006 06:24:52.954158 1 tasks_processing.go:71] worker 55 working on metrics task. I1006 06:24:52.954163 1 tasks_processing.go:71] worker 43 working on aggregated_monitoring_cr_names task. I1006 06:24:52.954164 1 tasks_processing.go:71] worker 8 working on openstack_dataplanenodesets task. I1006 06:24:52.954169 1 tasks_processing.go:71] worker 39 working on overlapping_namespace_uids task. I1006 06:24:52.954063 1 tasks_processing.go:71] worker 51 working on machine_config_pools task. I1006 06:24:52.955169 1 tasks_processing.go:74] worker 41 stopped. W1006 06:24:52.955229 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1006 06:24:52.955281 1 tasks_processing.go:74] worker 17 stopped. W1006 06:24:52.955292 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1006 06:24:52.955316 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 63.417µs to process 0 records I1006 06:24:52.955325 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 51.369µs to process 0 records I1006 06:24:52.955330 1 tasks_processing.go:74] worker 55 stopped. I1006 06:24:52.963482 1 tasks_processing.go:74] worker 2 stopped. I1006 06:24:52.963493 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 9.639602ms to process 0 records I1006 06:24:52.963724 1 tasks_processing.go:74] worker 10 stopped. I1006 06:24:52.963735 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 9.79636ms to process 0 records I1006 06:24:52.970061 1 tasks_processing.go:74] worker 7 stopped. E1006 06:24:52.970070 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I1006 06:24:52.970076 1 gather.go:177] gatherer "clusterconfig" function "machines" took 16.141703ms to process 0 records I1006 06:24:52.970438 1 tasks_processing.go:74] worker 54 stopped. I1006 06:24:52.970449 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 16.43236ms to process 0 records I1006 06:24:52.970549 1 tasks_processing.go:74] worker 9 stopped. I1006 06:24:52.970556 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 16.064661ms to process 0 records I1006 06:24:52.970561 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 16.131134ms to process 0 records E1006 06:24:52.970565 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I1006 06:24:52.970570 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 15.868964ms to process 0 records I1006 06:24:52.970574 1 tasks_processing.go:74] worker 46 stopped. I1006 06:24:52.970576 1 tasks_processing.go:74] worker 21 stopped. I1006 06:24:52.974486 1 base_controller.go:82] Caches are synced for ConfigController I1006 06:24:52.974496 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I1006 06:24:52.975523 1 tasks_processing.go:74] worker 12 stopped. I1006 06:24:52.975534 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 21.529516ms to process 0 records I1006 06:24:52.980196 1 tasks_processing.go:74] worker 62 stopped. I1006 06:24:52.980334 1 recorder.go:70] Recording config/apiserver with fingerprint=894afee059275c8a8d85cbb83caca911d247c3f3ea3831f19536f4742c80aa90 I1006 06:24:52.980345 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 25.576237ms to process 1 records I1006 06:24:52.980425 1 tasks_processing.go:74] worker 22 stopped. I1006 06:24:52.980471 1 recorder.go:70] Recording config/ingress with fingerprint=626c074d0c6cd9f7834121e3e04ce23cd2830a937abdd4b216e6d34db1e9b910 I1006 06:24:52.980478 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 26.226829ms to process 1 records I1006 06:24:52.980781 1 tasks_processing.go:74] worker 25 stopped. I1006 06:24:52.981178 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=6f367caa25a1a416e79c814183506a8d8192161629e61132d8887d43ee87fef8 I1006 06:24:52.981190 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 26.824808ms to process 1 records I1006 06:24:52.981245 1 recorder.go:70] Recording config/image with fingerprint=b397fe34cbd07ebcd66b8283a4516438c5e1a3c38e8eff01328dee74dbc81538 I1006 06:24:52.981252 1 gather.go:177] gatherer "clusterconfig" function "image" took 26.982101ms to process 1 records I1006 06:24:52.981257 1 tasks_processing.go:74] worker 38 stopped. I1006 06:24:52.990938 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I1006 06:24:52.990947 1 tasks_processing.go:74] worker 13 stopped. I1006 06:24:52.990954 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1006 06:24:52.990959 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1006 06:24:52.990962 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1006 06:24:52.990973 1 controller.go:458] The operator is still being initialized I1006 06:24:52.990977 1 controller.go:481] The operator is healthy I1006 06:24:52.991066 1 recorder.go:70] Recording config/network with fingerprint=fdb683a7d1547e39db72f4029d64629c1e5b796c95a365c22af0d6fc9e5446b5 I1006 06:24:52.991076 1 gather.go:177] gatherer "clusterconfig" function "networks" took 37.094425ms to process 1 records I1006 06:24:52.991349 1 tasks_processing.go:74] worker 63 stopped. I1006 06:24:52.991744 1 recorder.go:70] Recording config/infrastructure with fingerprint=ba9c47717e2215d873f435d6845aea74df4516106770076ba9c942d87a421861 I1006 06:24:52.991754 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 37.409417ms to process 1 records I1006 06:24:52.991817 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=a9c915ea33d6c9bb9a3a32fa1a40d65cd357a30ea3892f51c3c5649f885717c7 I1006 06:24:52.991828 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=0a9f2f1174c4d201fd77f0294c422bb2601301f89816d438d5a230a519fc4604 I1006 06:24:52.991832 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 37.150919ms to process 2 records I1006 06:24:52.991838 1 tasks_processing.go:74] worker 1 stopped. I1006 06:24:52.996847 1 tasks_processing.go:74] worker 32 stopped. I1006 06:24:52.996859 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 41.87242ms to process 0 records I1006 06:24:52.997111 1 tasks_processing.go:74] worker 52 stopped. I1006 06:24:52.997120 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 41.966143ms to process 0 records I1006 06:24:52.997177 1 tasks_processing.go:74] worker 4 stopped. I1006 06:24:52.997184 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 43.294857ms to process 0 records I1006 06:24:52.998253 1 tasks_processing.go:74] worker 61 stopped. I1006 06:24:52.998262 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 43.046078ms to process 0 records I1006 06:24:53.002551 1 tasks_processing.go:74] worker 53 stopped. I1006 06:24:53.002565 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 47.357745ms to process 0 records I1006 06:24:53.002596 1 tasks_processing.go:74] worker 56 stopped. I1006 06:24:53.002616 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 47.414493ms to process 0 records I1006 06:24:53.002621 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 47.364921ms to process 0 records I1006 06:24:53.002624 1 tasks_processing.go:74] worker 48 stopped. W1006 06:24:53.004840 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1006 06:24:53.066939 1 tasks_processing.go:74] worker 5 stopped. I1006 06:24:53.066957 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 113.04151ms to process 0 records I1006 06:24:53.066985 1 tasks_processing.go:74] worker 6 stopped. I1006 06:24:53.066994 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 111.727561ms to process 0 records I1006 06:24:53.067001 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 111.724437ms to process 0 records I1006 06:24:53.067005 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 111.625168ms to process 0 records I1006 06:24:53.067009 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 111.654902ms to process 0 records I1006 06:24:53.067013 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 111.641719ms to process 0 records I1006 06:24:53.067016 1 tasks_processing.go:74] worker 34 stopped. I1006 06:24:53.067017 1 tasks_processing.go:74] worker 8 stopped. I1006 06:24:53.067021 1 tasks_processing.go:74] worker 42 stopped. I1006 06:24:53.067022 1 tasks_processing.go:74] worker 51 stopped. I1006 06:24:53.067077 1 tasks_processing.go:74] worker 23 stopped. E1006 06:24:53.067087 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I1006 06:24:53.067096 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 111.735336ms to process 0 records E1006 06:24:53.067102 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I1006 06:24:53.067106 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 111.768004ms to process 0 records I1006 06:24:53.067109 1 tasks_processing.go:74] worker 59 stopped. I1006 06:24:53.067139 1 tasks_processing.go:74] worker 24 stopped. I1006 06:24:53.067153 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 112.765226ms to process 0 records I1006 06:24:53.082636 1 tasks_processing.go:74] worker 40 stopped. I1006 06:24:53.082649 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 127.459969ms to process 0 records I1006 06:24:53.082707 1 tasks_processing.go:74] worker 11 stopped. I1006 06:24:53.082846 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=18de914bfe8e968c63c984850626943b77f4ea83aa8f5561f6757e3b72f483e7 I1006 06:24:53.082870 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=da570fced5e5c18f78ae9b5a5b46d6a5b369aa563cdde4253eba1dde41cd5954 I1006 06:24:53.082887 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=16c503dd696f3b27a0f05bda052cf71d65b766fb48766a7168c4995c5426e0fd I1006 06:24:53.082895 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 128.724219ms to process 3 records I1006 06:24:53.083141 1 tasks_processing.go:74] worker 20 stopped. I1006 06:24:53.083325 1 recorder.go:70] Recording config/oauth with fingerprint=4309fee12dbe34ed192323c8a693f1e550ca24be6e34fad2c2858c8fcdc0f58d I1006 06:24:53.083338 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 128.769206ms to process 1 records I1006 06:24:53.083423 1 tasks_processing.go:74] worker 58 stopped. I1006 06:24:53.083483 1 recorder.go:70] Recording config/authentication with fingerprint=13a0d0ffc9507a2fe53ea3a7612721656cdacf63dbcc236e76c533e22b973d15 I1006 06:24:53.083492 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 128.848327ms to process 1 records I1006 06:24:53.084234 1 configmapobserver.go:84] configmaps "insights-config" not found I1006 06:24:53.084375 1 tasks_processing.go:74] worker 57 stopped. I1006 06:24:53.084445 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=1f7f92fff3c8160dad290944f66f33a7b973304b594273fbb4aa248f5169793b I1006 06:24:53.084458 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 129.147953ms to process 1 records I1006 06:24:53.084535 1 recorder.go:70] Recording config/featuregate with fingerprint=e5dcefa82be14ec3a0f9a1954c3ed174cad39b3c23c9bf3b8fccdddc1a649b55 I1006 06:24:53.084543 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 129.234644ms to process 1 records I1006 06:24:53.084549 1 tasks_processing.go:74] worker 16 stopped. I1006 06:24:53.085258 1 tasks_processing.go:74] worker 30 stopped. I1006 06:24:53.085506 1 recorder.go:70] Recording config/node/ip-10-0-134-149.ec2.internal with fingerprint=b3694d89f72004b4084c1e3da4eb43fa232e5c82e7b1e609a03951fb2e7d0542 I1006 06:24:53.085549 1 recorder.go:70] Recording config/node/ip-10-0-154-249.ec2.internal with fingerprint=019be91ec8ee09ce14587350d406c95a393ef4231cc0b384165465059e4171c7 I1006 06:24:53.085583 1 recorder.go:70] Recording config/node/ip-10-0-166-63.ec2.internal with fingerprint=e57483d11433d9aea97254fc042149377fd7591c58b4f9ae22d220d61825c7ff I1006 06:24:53.085589 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 130.72474ms to process 3 records I1006 06:24:53.133888 1 tasks_processing.go:74] worker 19 stopped. I1006 06:24:53.133904 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 179.954225ms to process 0 records I1006 06:24:53.134147 1 tasks_processing.go:74] worker 15 stopped. I1006 06:24:53.134156 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 179.079795ms to process 0 records I1006 06:24:53.134253 1 tasks_processing.go:74] worker 18 stopped. I1006 06:24:53.134321 1 recorder.go:70] Recording config/proxy with fingerprint=95fdfcc36624901ef608f8339f8877a90e3906317d4ca3aa9ed542eac50b2e91 I1006 06:24:53.134333 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 178.941351ms to process 1 records I1006 06:24:53.148355 1 tasks_processing.go:74] worker 26 stopped. I1006 06:24:53.148494 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=683a09f390ad5add06cd135406a0a401df15ebc2cd16b5846fb7d34a9e7c22d5 I1006 06:24:53.148515 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=22041fb9d91954fef380a0fa3de171a4cb9de931eedc79cf9485cba49ff2bab3 I1006 06:24:53.148529 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=e3fff097e1c56eafd6a1a031a01d45f78e288ec04624a719ea0b2dde0a3a5bae I1006 06:24:53.148536 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 193.649808ms to process 3 records I1006 06:24:53.148615 1 tasks_processing.go:74] worker 50 stopped. I1006 06:24:53.148860 1 recorder.go:70] Recording config/version with fingerprint=5b4045990329f73b2354329b1ef842979ab94747ec3ffb54f409cc80cbaa84a4 I1006 06:24:53.148870 1 recorder.go:70] Recording config/id with fingerprint=fc4622a2134c0ca9b48485bcda62460f5aabfbf51d78691d44450ddcd2f1aa2f I1006 06:24:53.148874 1 gather.go:177] gatherer "clusterconfig" function "version" took 194.430834ms to process 2 records E1006 06:24:53.148878 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I1006 06:24:53.148888 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I1006 06:24:53.148893 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 193.0606ms to process 1 records I1006 06:24:53.148951 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=3ed8599116c9456294e4abcf97c60ebf5cb2faddd5b1914aeb5c32193873aca2 I1006 06:24:53.148952 1 tasks_processing.go:74] worker 36 stopped. I1006 06:24:53.148993 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=a1123fb38c7966ba612e4aafbf89d40150c9ae2eb8d88f3291f5589ac847adee I1006 06:24:53.149012 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=aa033af45a3aa3ef11990e4881137e478e1850216a5c94a77e29849926b2c2fe I1006 06:24:53.149017 1 tasks_processing.go:74] worker 27 stopped. I1006 06:24:53.149029 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=a40f0c92baa7a2f1ad4e80d1522ad2e7fd8f5c06abfc282acc118c5a0fac89be I1006 06:24:53.149042 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=25c2c6206bb0483ae0e2dbbca20b2918b07f6eb743c1f9d821c7ea9f01119609 I1006 06:24:53.149057 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=88fb6397d74cce1bfbd084e43446d0e55a3026bc53e3ea378133e7c7b1ba5dce I1006 06:24:53.149069 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=3e0f0600dc47c108f1d0df63a5618172555702bb188aa289dc53f34947ec04f5 I1006 06:24:53.149090 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=c161c363787ceeb7b3080c28669248189cc97e105847574e2b7e635ea043bf47 I1006 06:24:53.149105 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=4148a2c3c40b1f4d49d7a153e204747047df71d3b2a95fefdf508d169def27a1 I1006 06:24:53.149116 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=ab79cc384a0ce070a292def3376808e0f17dbc3f050e29586828c19a81d9bc60 I1006 06:24:53.149129 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=152569887745d163408958251644d0284b6311e90f4467a16104fc98000528f0 I1006 06:24:53.149135 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 194.203575ms to process 11 records I1006 06:24:53.149209 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=fa875cd1e4510798875aa432d655e91d8e6c6382f7124826b09ad5ece940f964 I1006 06:24:53.149216 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 194.109863ms to process 1 records I1006 06:24:53.149219 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 193.259973ms to process 0 records I1006 06:24:53.149224 1 tasks_processing.go:74] worker 43 stopped. I1006 06:24:53.149227 1 tasks_processing.go:74] worker 3 stopped. I1006 06:24:53.149345 1 tasks_processing.go:74] worker 29 stopped. I1006 06:24:53.149450 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I1006 06:24:53.149493 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=6639beb4bad9b073da21ea80a8987bbda301da3bf8f958bc79a1232681f61e6f I1006 06:24:53.149505 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I1006 06:24:53.149542 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=bacabb2bd3cae4a844e30fb37169f510c7e9002b7b93611fc96c2be0d0623b44 I1006 06:24:53.149549 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 194.400903ms to process 2 records W1006 06:24:53.149598 1 operator.go:287] started I1006 06:24:53.149622 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I1006 06:24:53.149623 1 tasks_processing.go:74] worker 44 stopped. I1006 06:24:53.149913 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=38eb0d6ff8e51abd8cd722e2dc4bdc002f91b8d9c75a1481d34c7a176a6b76ea I1006 06:24:53.150030 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=fb2c6cbd6cf704865492c973c614da8c3f94d194abcbd488fd2f28190ba116b1 I1006 06:24:53.150037 1 gather.go:177] gatherer "clusterconfig" function "crds" took 195.419131ms to process 2 records I1006 06:24:53.150051 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I1006 06:24:53.150058 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 194.284911ms to process 1 records I1006 06:24:53.150061 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 195.373707ms to process 0 records I1006 06:24:53.150065 1 tasks_processing.go:74] worker 35 stopped. I1006 06:24:53.150068 1 tasks_processing.go:74] worker 39 stopped. I1006 06:24:53.172870 1 tasks_processing.go:74] worker 14 stopped. I1006 06:24:53.172920 1 recorder.go:70] Recording config/running_containers with fingerprint=9715de1b89ee025983a9dbad40e6a8336c2a3231fa3ab9b2b9ff4225dcf74df5 I1006 06:24:53.172929 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 218.072465ms to process 1 records I1006 06:24:53.179526 1 tasks_processing.go:74] worker 31 stopped. I1006 06:24:53.179538 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 224.382413ms to process 0 records I1006 06:24:53.196401 1 controller.go:203] Source scaController *sca.Controller is not ready I1006 06:24:53.196413 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I1006 06:24:53.196417 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1006 06:24:53.196419 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1006 06:24:53.196421 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1006 06:24:53.196434 1 controller.go:458] The operator is still being initialized I1006 06:24:53.196438 1 controller.go:481] The operator is healthy I1006 06:24:53.198518 1 prometheus_rules.go:88] Prometheus rules successfully created E1006 06:24:53.204539 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%272affe3e5-2549-4f93-9d46-4947513aa7bf%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:42325->172.30.0.10:53: read: connection refused I1006 06:24:53.204550 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%272affe3e5-2549-4f93-9d46-4947513aa7bf%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:42325->172.30.0.10:53: read: connection refused I1006 06:24:53.222977 1 tasks_processing.go:74] worker 37 stopped. E1006 06:24:53.222990 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E1006 06:24:53.222995 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E1006 06:24:53.222998 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I1006 06:24:53.223006 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I1006 06:24:53.223032 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I1006 06:24:53.223039 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I1006 06:24:53.223043 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I1006 06:24:53.223048 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I1006 06:24:53.223063 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I1006 06:24:53.223071 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I1006 06:24:53.223075 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 267.633677ms to process 7 records I1006 06:24:53.250508 1 base_controller.go:82] Caches are synced for LoggingSyncer I1006 06:24:53.250522 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I1006 06:24:53.273177 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I1006 06:24:53.278507 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress" I1006 06:24:53.282860 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W1006 06:24:53.285536 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:53846->172.30.0.10:53: read: connection refused I1006 06:24:53.285549 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.12:53846->172.30.0.10:53: read: connection refused I1006 06:24:53.296325 1 tasks_processing.go:74] worker 33 stopped. E1006 06:24:53.296338 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E1006 06:24:53.296343 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2t941bk1i56ammskps08r4utpoddn0mt-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2t941bk1i56ammskps08r4utpoddn0mt-primary-cert-bundle-secret" not found I1006 06:24:53.296405 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=30fc41c9a8253ece72734281f3f1468b2443668fe3e09e580e84d3a0e88cadc8 I1006 06:24:53.296415 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 341.494426ms to process 1 records I1006 06:24:53.588793 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I1006 06:24:53.789316 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W1006 06:24:54.005247 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1006 06:24:54.293638 1 gather_cluster_operator_pods_and_events.go:121] Found 18 pods with 21 containers I1006 06:24:54.293652 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1198372 bytes I1006 06:24:54.293938 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-44jsg pod in namespace openshift-dns (previous: false). I1006 06:24:54.522961 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-44jsg pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-44jsg\" is waiting to start: ContainerCreating" I1006 06:24:54.522979 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-44jsg\" is waiting to start: ContainerCreating" I1006 06:24:54.522986 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-44jsg pod in namespace openshift-dns (previous: false). I1006 06:24:54.591295 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I1006 06:24:54.699109 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-44jsg pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-44jsg\" is waiting to start: ContainerCreating" I1006 06:24:54.699125 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-44jsg\" is waiting to start: ContainerCreating" I1006 06:24:54.699134 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-jzcpw pod in namespace openshift-dns (previous: false). I1006 06:24:54.937255 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jzcpw pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-jzcpw\" is waiting to start: ContainerCreating" I1006 06:24:54.937273 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-jzcpw\" is waiting to start: ContainerCreating" I1006 06:24:54.937280 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-jzcpw pod in namespace openshift-dns (previous: false). I1006 06:24:54.993588 1 tasks_processing.go:74] worker 0 stopped. I1006 06:24:54.993633 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=e914ea789959b178f240307365cfdbc383fa5bb74acd9b63cb1edceacc42357f I1006 06:24:54.993658 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=50907d86df5141cfe7c6d613ae255f8c7cb7692f5dec7859acd7fc204f4bd5f7 I1006 06:24:54.993689 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I1006 06:24:54.993713 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=ee00c4f606dd18785c40390ea41e40394af9a0a4dea526aeb1fe5d7bd7a6d4b0 I1006 06:24:54.993731 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I1006 06:24:54.993746 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=15d6254a01dd0f52ad77a67afca94ab19ff66a50ec5cd8110a7dc3b6adf30db0 I1006 06:24:54.993793 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=fa1bfa79fa33399631de87c3126f761b577405ba266c1d2943ec1dd294790242 I1006 06:24:54.993809 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=7f7c662545e2092d1fee73131ba5d08ad6def5507c7f4fafe8fc32e21f84394b I1006 06:24:54.993821 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=3e7daba88400c89b37898a19eb8ec09ac33b1bcf4cb814484ecc1b067df1c27a I1006 06:24:54.993832 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=822b53f457ccbcf4f1fca7245cd529456bfe26ff28b3ced0626614e9d8a3cdf8 I1006 06:24:54.993842 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I1006 06:24:54.993853 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=cc200b03cdcbbe932e596004834ca68fb6e8e9bf9c18b093f779754c36d34d28 I1006 06:24:54.993863 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I1006 06:24:54.993875 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=9e32423097c47c434fbf4619cc7432b3eb5960d7767a0b49566977ca7e1c0e00 I1006 06:24:54.993884 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I1006 06:24:54.993898 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=b61757f5caa468e847b4248dd38e8a623b2235e12f4fcf275c18769e46619469 I1006 06:24:54.993906 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I1006 06:24:54.993917 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=ba0fc78ce303cd13adef651088e7068663bc9b7fbff747aa06b58e42fae2f8c2 I1006 06:24:54.993987 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=caa6b547f69149a10b8cc8b0d7a4f5ebd4fc861ab30151722945f18772e7fd35 I1006 06:24:54.994007 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I1006 06:24:54.994021 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=74777ff4860fb381976cdfa539f753f7b5e02b6bfff6f4fc747b5f9a9a3446a8 I1006 06:24:54.994037 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=589c3438d344c8a8247f3e84d85817a44795cb5523024a06cb862f6fc4da2a07 I1006 06:24:54.994045 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I1006 06:24:54.994054 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=204c56b610a57ca2dc6fc4dfad93ae6d290ec85c7c5863039b8c71d6413905d2 I1006 06:24:54.994062 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I1006 06:24:54.994075 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=807a0f13008dd0ff3c515fa6e5d4e2d118d6888979517728a2dcecb884ec3f1c I1006 06:24:54.994087 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=318b79488462c81258f3c8771e1b64d07ae48f540271e231e218ef7a1f442d73 I1006 06:24:54.994098 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=3f5761f7da10e94c6bad99f2a546431c56c44583ee8360aa1cd06036f271fbc0 I1006 06:24:54.994106 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=929d2ef7cb918b7939cc0331e9893d7c1dad9b6695eda47e9f5975e77b801e1e I1006 06:24:54.994117 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=64f2d00c31d0dd8b3dbfbc791612eadcd5268f6f86488d1710267228bb3d6f8e I1006 06:24:54.994132 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=e62539179f81b9a3936f96fe8579a46fda6258b3c13ffc70834b971e6a0901c8 I1006 06:24:54.994145 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I1006 06:24:54.994152 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I1006 06:24:54.994158 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.039089738s to process 33 records W1006 06:24:55.004847 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1006 06:24:55.100660 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-jzcpw pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-jzcpw\" is waiting to start: ContainerCreating" I1006 06:24:55.100678 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-jzcpw\" is waiting to start: ContainerCreating" I1006 06:24:55.100688 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-4cjw8 pod in namespace openshift-dns (previous: false). I1006 06:24:55.298440 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1006 06:24:55.298456 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-b59qz pod in namespace openshift-dns (previous: false). I1006 06:24:55.523842 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1006 06:24:55.523871 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-f66n7 pod in namespace openshift-dns (previous: false). I1006 06:24:55.707226 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1006 06:24:55.707242 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5d5d598787-57rxs pod in namespace openshift-image-registry (previous: false). I1006 06:24:55.898475 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-5d5d598787-57rxs pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-5d5d598787-57rxs\" is waiting to start: ContainerCreating" I1006 06:24:55.898492 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-5d5d598787-57rxs\" is waiting to start: ContainerCreating" I1006 06:24:55.898501 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-5d5d598787-5cjkz pod in namespace openshift-image-registry (previous: false). W1006 06:24:56.005445 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1006 06:24:56.093046 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1006 06:24:56.093062 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-65dd7cc6cb-gkjs5 pod in namespace openshift-image-registry (previous: false). I1006 06:24:56.304693 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-65dd7cc6cb-gkjs5 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-65dd7cc6cb-gkjs5\" is waiting to start: ContainerCreating" I1006 06:24:56.304711 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-65dd7cc6cb-gkjs5\" is waiting to start: ContainerCreating" I1006 06:24:56.304720 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-blxk4 pod in namespace openshift-image-registry (previous: false). I1006 06:24:56.498595 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1006 06:24:56.498611 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-pnjxb pod in namespace openshift-image-registry (previous: false). I1006 06:24:56.698528 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1006 06:24:56.698547 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-vj6s6 pod in namespace openshift-image-registry (previous: false). I1006 06:24:56.898797 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1006 06:24:56.898813 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6c65445988-jpsqv pod in namespace openshift-ingress (previous: false). W1006 06:24:57.004950 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1006 06:24:57.100430 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6c65445988-jpsqv pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6c65445988-jpsqv\" is waiting to start: ContainerCreating" I1006 06:24:57.100445 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6c65445988-jpsqv\" is waiting to start: ContainerCreating" I1006 06:24:57.100454 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-6c65445988-jwrgk pod in namespace openshift-ingress (previous: false). I1006 06:24:57.304992 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-6c65445988-jwrgk pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-6c65445988-jwrgk\" is waiting to start: ContainerCreating" I1006 06:24:57.305007 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-6c65445988-jwrgk\" is waiting to start: ContainerCreating" I1006 06:24:57.305015 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-d8c86b7df-n22vg pod in namespace openshift-ingress (previous: false). I1006 06:24:57.503268 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-d8c86b7df-n22vg pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-d8c86b7df-n22vg\" is waiting to start: ContainerCreating" I1006 06:24:57.503283 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-d8c86b7df-n22vg\" is waiting to start: ContainerCreating" I1006 06:24:57.503293 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-8mcnp pod in namespace openshift-ingress-canary (previous: false). I1006 06:24:57.710049 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-8mcnp pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-8mcnp\" is waiting to start: ContainerCreating" I1006 06:24:57.710064 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-8mcnp\" is waiting to start: ContainerCreating" I1006 06:24:57.710074 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-kbxlc pod in namespace openshift-ingress-canary (previous: false). I1006 06:24:57.925270 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-kbxlc pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-kbxlc\" is waiting to start: ContainerCreating" I1006 06:24:57.925285 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-kbxlc\" is waiting to start: ContainerCreating" I1006 06:24:57.925296 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for migrator container migrator-949fdd477-5qw6q pod in namespace openshift-kube-storage-version-migrator (previous: false). W1006 06:24:58.004672 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W1006 06:24:58.004692 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I1006 06:24:58.004704 1 tasks_processing.go:74] worker 60 stopped. E1006 06:24:58.004714 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I1006 06:24:58.004724 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W1006 06:24:58.004736 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I1006 06:24:58.004745 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.050503296s to process 1 records I1006 06:24:58.100653 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for migrator-949fdd477-5qw6q pod in namespace openshift-kube-storage-version-migrator for failing operator migrator (previous: false): "container \"migrator\" in pod \"migrator-949fdd477-5qw6q\" is waiting to start: ContainerCreating" I1006 06:24:58.100667 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"migrator\" in pod \"migrator-949fdd477-5qw6q\" is waiting to start: ContainerCreating" I1006 06:24:58.100675 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for graceful-termination container migrator-949fdd477-5qw6q pod in namespace openshift-kube-storage-version-migrator (previous: false). I1006 06:24:58.299279 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for migrator-949fdd477-5qw6q pod in namespace openshift-kube-storage-version-migrator for failing operator graceful-termination (previous: false): "container \"graceful-termination\" in pod \"migrator-949fdd477-5qw6q\" is waiting to start: ContainerCreating" I1006 06:24:58.299294 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"graceful-termination\" in pod \"migrator-949fdd477-5qw6q\" is waiting to start: ContainerCreating" I1006 06:24:58.299302 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-storage-version-migrator-operator container kube-storage-version-migrator-operator-7944b9f44d-zg6v8 pod in namespace openshift-kube-storage-version-migrator-operator (previous: false). I1006 06:24:58.500358 1 tasks_processing.go:74] worker 28 stopped. I1006 06:24:58.500429 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=52ba9744dc698178186ae53d7c24925fd33f7ae2c310babeca382e987902f88c I1006 06:24:58.500461 1 recorder.go:70] Recording events/openshift-dns with fingerprint=4a72e49e84edb61ee0f71b1c7d35ac005ad849290497c6a96e1cb1a084ec3535 I1006 06:24:58.500506 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=28b1eccbdc240464c6cf457e4b98da17cc3549dd51e156614d18d2e08ada8c8f I1006 06:24:58.500523 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=ce5f2e4b6db9e53ea9fc6f69400549e9f1df7c915f39ee706c4da934d1158d4f I1006 06:24:58.500548 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=5580922c2881f609f7809e372da2696a0dd7ba3068bfa4f89c88bd7a3a466f73 I1006 06:24:58.500559 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=eacf45c283592bcad0648f8abf948a7c043c19437c8a1c0545d48f559e182f88 I1006 06:24:58.500566 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator with fingerprint=530e6044b04fcb462b7ecdebab036d20bfe6ac3c4d437d74c3668da6962960c1 I1006 06:24:58.500594 1 recorder.go:70] Recording events/openshift-kube-storage-version-migrator-operator with fingerprint=a77a5185d85ccbd03734c1aba4c3fcb76bf519820591ea83ad0d71f7aad09d84 I1006 06:24:58.500617 1 recorder.go:70] Recording config/pod/openshift-kube-storage-version-migrator-operator/logs/kube-storage-version-migrator-operator-7944b9f44d-zg6v8/kube-storage-version-migrator-operator_current.log with fingerprint=ce25ec6f50f54a02ea747b0379220b1a46d66ae3af1b3ea7f3543aebf8a2945a I1006 06:24:58.500625 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 5.545630537s to process 9 records I1006 06:25:05.085668 1 configmapobserver.go:84] configmaps "insights-config" not found I1006 06:25:05.893551 1 tasks_processing.go:74] worker 47 stopped. I1006 06:25:05.893586 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I1006 06:25:05.893597 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.938353068s to process 1 records I1006 06:25:06.563961 1 tasks_processing.go:74] worker 49 stopped. I1006 06:25:06.564169 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=0e15902d75958c6ece09dbb74d031a849762e6d8787c810476e01f34a975078d I1006 06:25:06.564183 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.60869054s to process 1 records E1006 06:25:06.564230 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.61s with: function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I1006 06:25:06.565327 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I1006 06:25:06.565339 1 periodic.go:212] Running workloads gatherer I1006 06:25:06.565352 1 tasks_processing.go:45] number of workers: 2 I1006 06:25:06.565357 1 tasks_processing.go:69] worker 1 listening for tasks. I1006 06:25:06.565361 1 tasks_processing.go:71] worker 1 working on workload_info task. I1006 06:25:06.565371 1 tasks_processing.go:69] worker 0 listening for tasks. I1006 06:25:06.565447 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I1006 06:25:06.593694 1 configmapobserver.go:84] configmaps "insights-config" not found I1006 06:25:06.611723 1 tasks_processing.go:74] worker 0 stopped. I1006 06:25:06.611741 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 46.26094ms to process 0 records I1006 06:25:06.686272 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I1006 06:25:06.697143 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (11ms) I1006 06:25:06.707681 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (11ms) I1006 06:25:06.720583 1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (13ms) I1006 06:25:06.730643 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (10ms) I1006 06:25:06.740317 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (10ms) I1006 06:25:06.751511 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (11ms) I1006 06:25:06.762009 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (10ms) I1006 06:25:06.772417 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (10ms) I1006 06:25:06.783127 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (11ms) I1006 06:25:06.793496 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (10ms) I1006 06:25:06.793717 1 configmapobserver.go:84] configmaps "insights-config" not found I1006 06:25:06.803935 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (10ms) I1006 06:25:06.897386 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (93ms) I1006 06:25:06.998487 1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (101ms) I1006 06:25:07.097886 1 gather_workloads_info.go:387] No image sha256:798001e24f1ed6a5621c442729a840ba2a2abc43433901e8450caa12b4bad5c5 (99ms) I1006 06:25:07.196863 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (99ms) I1006 06:25:07.296721 1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (100ms) I1006 06:25:07.398330 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (102ms) I1006 06:25:07.498789 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (100ms) I1006 06:25:07.596486 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (98ms) I1006 06:25:07.701714 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (105ms) I1006 06:25:07.796652 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (95ms) I1006 06:25:07.897550 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (101ms) I1006 06:25:08.004511 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (107ms) I1006 06:25:08.098201 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (94ms) I1006 06:25:08.196973 1 gather_workloads_info.go:387] No image sha256:f6e156f39b06d196b46d8ed3a03ca337e939dba0060e40de4455b4e77b90929e (99ms) I1006 06:25:08.298905 1 gather_workloads_info.go:387] No image sha256:d28734effaadd66434e77a1a5fbe2e8a4ca2066cd9f8868c22ade9475539bfd7 (102ms) I1006 06:25:08.397610 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (99ms) I1006 06:25:08.497467 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (100ms) I1006 06:25:08.599067 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (102ms) I1006 06:25:08.700684 1 gather_workloads_info.go:387] No image sha256:d93441b88bd020cae0a819977b23ca7be19e037d9bf634c16710864a08a4929f (102ms) I1006 06:25:08.801431 1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (101ms) I1006 06:25:08.897251 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (96ms) I1006 06:25:08.997972 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (101ms) I1006 06:25:08.998001 1 tasks_processing.go:74] worker 1 stopped. E1006 06:25:08.998011 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I1006 06:25:08.998231 1 recorder.go:70] Recording config/workload_info with fingerprint=c0a661e9e5b18a79e612380a0198e4237beb303e68ffa2f52564f779a0ebd2f1 I1006 06:25:08.998244 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.432635192s to process 1 records E1006 06:25:08.998274 1 periodic.go:250] "Unhandled Error" err="workloads failed after 2.432s with: function \"workload_info\" failed with an error" I1006 06:25:08.999373 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I1006 06:25:08.999384 1 periodic.go:212] Running conditional gatherer I1006 06:25:09.010556 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I1006 06:25:09.015359 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:56966->172.30.0.10:53: read: connection refused E1006 06:25:09.015584 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1006 06:25:09.015632 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I1006 06:25:09.025845 1 conditional_gatherer.go:390] cluster version is '4.19.9' E1006 06:25:09.025858 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1006 06:25:09.025863 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1006 06:25:09.025865 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1006 06:25:09.025868 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1006 06:25:09.025870 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1006 06:25:09.025873 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1006 06:25:09.025875 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1006 06:25:09.025877 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1006 06:25:09.025879 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I1006 06:25:09.025892 1 tasks_processing.go:45] number of workers: 3 I1006 06:25:09.025900 1 tasks_processing.go:69] worker 2 listening for tasks. I1006 06:25:09.025903 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I1006 06:25:09.025906 1 tasks_processing.go:69] worker 0 listening for tasks. I1006 06:25:09.025919 1 tasks_processing.go:69] worker 1 listening for tasks. I1006 06:25:09.025934 1 tasks_processing.go:71] worker 1 working on conditional_gatherer_rules task. I1006 06:25:09.025940 1 tasks_processing.go:74] worker 1 stopped. I1006 06:25:09.025979 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I1006 06:25:09.026016 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I1006 06:25:09.026028 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 1.27µs to process 1 records I1006 06:25:09.026055 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I1006 06:25:09.026063 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.002µs to process 1 records I1006 06:25:09.026067 1 tasks_processing.go:74] worker 0 stopped. I1006 06:25:09.026112 1 tasks_processing.go:74] worker 2 stopped. I1006 06:25:09.026122 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 205.087µs to process 0 records I1006 06:25:09.026139 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.12:56966->172.30.0.10:53: read: connection refused I1006 06:25:09.026151 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I1006 06:25:09.051504 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=68aafe9f8fed3880ae70fbe9b0998db6f4617b1c523db414eb46ee6eea41dbd2 I1006 06:25:09.051618 1 diskrecorder.go:70] Writing 100 records to /var/lib/insights-operator/insights-2026-10-06-062509.tar.gz I1006 06:25:09.056707 1 diskrecorder.go:51] Wrote 100 records to disk in 5ms I1006 06:25:09.056731 1 periodic.go:281] Gathering cluster info every 2h0m0s I1006 06:25:09.056744 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I1006 06:25:21.260406 1 configmapobserver.go:84] configmaps "insights-config" not found I1006 06:26:07.281871 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="210619f6ca0bdab47386230c176225b34a224aa9d24b19a0bb202446c9fbd9db") W1006 06:26:07.281908 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I1006 06:26:07.281940 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="530a74523ff4f7fb855031d0018661a4ca727924911b28b4689d3c611b6aab90") I1006 06:26:07.281963 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="e4a952d4a69e2ccfb2bc553b9574a839ae5fdc7f86436f65d05e30baace16da6") I1006 06:26:07.281975 1 base_controller.go:181] Shutting down ConfigController ... I1006 06:26:07.281980 1 genericapiserver.go:693] "[graceful-termination] pre-shutdown hooks completed" name="PreShutdownHooksStopped" I1006 06:26:07.281988 1 genericapiserver.go:548] "[graceful-termination] shutdown event" name="ShutdownInitiated" I1006 06:26:07.282022 1 object_count_tracker.go:151] "StorageObjectCountTracker pruner is exiting" I1006 06:26:07.281997 1 simple_featuregate_reader.go:177] Shutting down feature-gate-detector I1006 06:26:07.282034 1 periodic.go:173] Shutting down I1006 06:26:07.282052 1 genericapiserver.go:651] "[graceful-termination] not going to wait for active watch request(s) to drain" I1006 06:26:07.282078 1 base_controller.go:123] Shutting down worker of LoggingSyncer controller ... I1006 06:26:07.282081 1 base_controller.go:123] Shutting down worker of ConfigController controller ... I1006 06:26:07.282092 1 base_controller.go:113] All ConfigController workers have been terminated I1006 06:26:07.282098 1 configmap_cafile_content.go:226] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I1006 06:26:07.282123 1 tlsconfig.go:258] "Shutting down DynamicServingCertificateController"