W1001 01:56:23.152347 1 cmd.go:257] Using insecure, self-signed certificates I1001 01:56:23.651370 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1001 01:56:23.651649 1 observer_polling.go:159] Starting file observer W1001 01:56:23.672138 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I1001 01:56:24.079390 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I1001 01:56:24.079560 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I1001 01:56:24.079964 1 secure_serving.go:57] Forcing use of http/1.1 only W1001 01:56:24.079982 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W1001 01:56:24.079989 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W1001 01:56:24.079992 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W1001 01:56:24.079995 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W1001 01:56:24.079997 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W1001 01:56:24.079999 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I1001 01:56:24.080004 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I1001 01:56:24.083221 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I1001 01:56:24.083228 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} E1001 01:56:24.085778 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18da451aff056a79 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-10-01 01:56:24.083204729 +0000 UTC m=+0.967375862,LastTimestamp:2026-10-01 01:56:24.083204729 +0000 UTC m=+0.967375862,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" I1001 01:56:24.087872 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I1001 01:56:24.087888 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I1001 01:56:24.087886 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I1001 01:56:24.087898 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I1001 01:56:24.087910 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1001 01:56:24.087902 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1001 01:56:24.087995 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1661501662/tls.crt::/tmp/serving-cert-1661501662/tls.key" I1001 01:56:24.088013 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" I1001 01:56:24.088002 1 secure_serving.go:213] Serving securely on [::]:8443 W1001 01:56:24.089493 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I1001 01:56:24.089514 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1001 01:56:24.089616 1 base_controller.go:76] Waiting for caches to sync for ConfigController I1001 01:56:24.096822 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1001 01:56:24.096840 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1001 01:56:24.102165 1 secretconfigobserver.go:119] support secret does not exist I1001 01:56:24.112196 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1001 01:56:24.118411 1 secretconfigobserver.go:119] support secret does not exist I1001 01:56:24.122073 1 recorder.go:156] Pruning old reports every 6h57m5s, max age is 288h0m0s I1001 01:56:24.127592 1 periodic.go:212] Running clusterconfig gatherer I1001 01:56:24.127597 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I1001 01:56:24.127611 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I1001 01:56:24.127632 1 tasks_processing.go:45] number of workers: 64 I1001 01:56:24.127637 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I1001 01:56:24.127643 1 insightsreport.go:296] Starting report retriever I1001 01:56:24.127646 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I1001 01:56:24.127646 1 tasks_processing.go:69] worker 2 listening for tasks. I1001 01:56:24.127652 1 tasks_processing.go:69] worker 0 listening for tasks. I1001 01:56:24.127656 1 tasks_processing.go:69] worker 1 listening for tasks. I1001 01:56:24.127658 1 tasks_processing.go:69] worker 20 listening for tasks. I1001 01:56:24.127661 1 tasks_processing.go:69] worker 33 listening for tasks. I1001 01:56:24.127663 1 tasks_processing.go:69] worker 12 listening for tasks. I1001 01:56:24.127666 1 tasks_processing.go:69] worker 21 listening for tasks. I1001 01:56:24.127667 1 tasks_processing.go:69] worker 13 listening for tasks. I1001 01:56:24.127669 1 tasks_processing.go:71] worker 12 working on authentication task. I1001 01:56:24.127672 1 tasks_processing.go:69] worker 14 listening for tasks. I1001 01:56:24.127673 1 tasks_processing.go:71] worker 13 working on clusterroles task. I1001 01:56:24.127675 1 tasks_processing.go:71] worker 14 working on openstack_controlplanes task. I1001 01:56:24.127677 1 tasks_processing.go:69] worker 11 listening for tasks. I1001 01:56:24.127689 1 tasks_processing.go:69] worker 17 listening for tasks. I1001 01:56:24.127692 1 tasks_processing.go:69] worker 3 listening for tasks. I1001 01:56:24.127699 1 tasks_processing.go:69] worker 8 listening for tasks. I1001 01:56:24.127703 1 tasks_processing.go:69] worker 15 listening for tasks. I1001 01:56:24.127707 1 tasks_processing.go:69] worker 9 listening for tasks. I1001 01:56:24.127708 1 tasks_processing.go:69] worker 16 listening for tasks. I1001 01:56:24.127705 1 tasks_processing.go:69] worker 7 listening for tasks. I1001 01:56:24.127714 1 tasks_processing.go:69] worker 5 listening for tasks. I1001 01:56:24.127714 1 tasks_processing.go:69] worker 10 listening for tasks. I1001 01:56:24.127719 1 tasks_processing.go:69] worker 4 listening for tasks. I1001 01:56:24.127719 1 tasks_processing.go:69] worker 6 listening for tasks. I1001 01:56:24.127717 1 tasks_processing.go:69] worker 18 listening for tasks. I1001 01:56:24.127722 1 tasks_processing.go:69] worker 60 listening for tasks. I1001 01:56:24.127727 1 tasks_processing.go:69] worker 19 listening for tasks. I1001 01:56:24.127728 1 tasks_processing.go:69] worker 52 listening for tasks. I1001 01:56:24.127724 1 tasks_processing.go:69] worker 42 listening for tasks. I1001 01:56:24.127733 1 tasks_processing.go:69] worker 38 listening for tasks. I1001 01:56:24.127727 1 tasks_processing.go:69] worker 34 listening for tasks. I1001 01:56:24.127732 1 tasks_processing.go:69] worker 39 listening for tasks. I1001 01:56:24.127731 1 tasks_processing.go:69] worker 51 listening for tasks. I1001 01:56:24.127742 1 tasks_processing.go:69] worker 41 listening for tasks. I1001 01:56:24.127743 1 tasks_processing.go:69] worker 54 listening for tasks. I1001 01:56:24.127738 1 tasks_processing.go:69] worker 40 listening for tasks. I1001 01:56:24.127745 1 tasks_processing.go:71] worker 2 working on cluster_apiserver task. I1001 01:56:24.127737 1 tasks_processing.go:69] worker 53 listening for tasks. I1001 01:56:24.127740 1 tasks_processing.go:69] worker 37 listening for tasks. I1001 01:56:24.127746 1 tasks_processing.go:69] worker 36 listening for tasks. I1001 01:56:24.127746 1 tasks_processing.go:69] worker 46 listening for tasks. I1001 01:56:24.127751 1 tasks_processing.go:69] worker 55 listening for tasks. I1001 01:56:24.127753 1 tasks_processing.go:69] worker 43 listening for tasks. I1001 01:56:24.127760 1 tasks_processing.go:69] worker 30 listening for tasks. I1001 01:56:24.127760 1 tasks_processing.go:69] worker 47 listening for tasks. I1001 01:56:24.127754 1 tasks_processing.go:69] worker 44 listening for tasks. I1001 01:56:24.127765 1 tasks_processing.go:69] worker 35 listening for tasks. I1001 01:56:24.127767 1 tasks_processing.go:69] worker 58 listening for tasks. I1001 01:56:24.127769 1 tasks_processing.go:69] worker 29 listening for tasks. I1001 01:56:24.127757 1 tasks_processing.go:69] worker 56 listening for tasks. I1001 01:56:24.127772 1 tasks_processing.go:69] worker 50 listening for tasks. I1001 01:56:24.127773 1 tasks_processing.go:71] worker 1 working on version task. I1001 01:56:24.127759 1 tasks_processing.go:69] worker 45 listening for tasks. I1001 01:56:24.127765 1 tasks_processing.go:69] worker 28 listening for tasks. I1001 01:56:24.127762 1 tasks_processing.go:69] worker 27 listening for tasks. I1001 01:56:24.127780 1 tasks_processing.go:69] worker 31 listening for tasks. I1001 01:56:24.127781 1 tasks_processing.go:69] worker 25 listening for tasks. I1001 01:56:24.127781 1 tasks_processing.go:69] worker 26 listening for tasks. I1001 01:56:24.127785 1 tasks_processing.go:69] worker 62 listening for tasks. I1001 01:56:24.127765 1 tasks_processing.go:69] worker 57 listening for tasks. I1001 01:56:24.127774 1 tasks_processing.go:69] worker 24 listening for tasks. I1001 01:56:24.127784 1 tasks_processing.go:69] worker 49 listening for tasks. I1001 01:56:24.127792 1 tasks_processing.go:69] worker 61 listening for tasks. I1001 01:56:24.127791 1 tasks_processing.go:69] worker 32 listening for tasks. I1001 01:56:24.127795 1 tasks_processing.go:71] worker 20 working on service_accounts task. I1001 01:56:24.127801 1 tasks_processing.go:71] worker 11 working on certificate_signing_requests task. I1001 01:56:24.127803 1 tasks_processing.go:71] worker 8 working on container_runtime_configs task. I1001 01:56:24.127806 1 tasks_processing.go:71] worker 52 working on mutating_webhook_configurations task. I1001 01:56:24.127810 1 tasks_processing.go:71] worker 32 working on feature_gates task. I1001 01:56:24.127809 1 tasks_processing.go:69] worker 63 listening for tasks. I1001 01:56:24.127822 1 tasks_processing.go:71] worker 63 working on lokistack task. I1001 01:56:24.127818 1 tasks_processing.go:71] worker 44 working on cost_management_metrics_configs task. I1001 01:56:24.127670 1 tasks_processing.go:71] worker 21 working on networks task. I1001 01:56:24.127858 1 tasks_processing.go:71] worker 9 working on monitoring_persistent_volumes task. I1001 01:56:24.127862 1 tasks_processing.go:71] worker 17 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I1001 01:56:24.127867 1 tasks_processing.go:71] worker 40 working on support_secret task. I1001 01:56:24.127890 1 tasks_processing.go:71] worker 46 working on ingress_certificates task. I1001 01:56:24.127786 1 tasks_processing.go:71] worker 0 working on openstack_version task. I1001 01:56:24.127945 1 tasks_processing.go:71] worker 27 working on image_pruners task. I1001 01:56:24.127963 1 tasks_processing.go:71] worker 57 working on machine_healthchecks task. I1001 01:56:24.127772 1 tasks_processing.go:69] worker 59 listening for tasks. I1001 01:56:24.127984 1 tasks_processing.go:71] worker 59 working on openshift_logging task. I1001 01:56:24.127788 1 tasks_processing.go:69] worker 48 listening for tasks. I1001 01:56:24.128003 1 tasks_processing.go:71] worker 43 working on tsdb_status task. I1001 01:56:24.128009 1 tasks_processing.go:71] worker 49 working on config_maps task. W1001 01:56:24.128023 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1001 01:56:24.128029 1 tasks_processing.go:71] worker 25 working on operators_pods_and_events task. I1001 01:56:24.128035 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 18.983µs to process 0 records I1001 01:56:24.128041 1 tasks_processing.go:71] worker 30 working on pod_network_connectivity_checks task. I1001 01:56:24.128089 1 tasks_processing.go:71] worker 31 working on ingress task. I1001 01:56:24.128104 1 tasks_processing.go:71] worker 43 working on nodenetworkstates task. I1001 01:56:24.128137 1 tasks_processing.go:71] worker 26 working on schedulers task. I1001 01:56:24.128152 1 tasks_processing.go:71] worker 47 working on container_images task. I1001 01:56:24.127779 1 tasks_processing.go:69] worker 23 listening for tasks. I1001 01:56:24.128219 1 tasks_processing.go:71] worker 48 working on openstack_dataplanenodesets task. I1001 01:56:24.128228 1 tasks_processing.go:71] worker 38 working on validating_webhook_configurations task. I1001 01:56:24.128230 1 tasks_processing.go:71] worker 36 working on image task. I1001 01:56:24.128230 1 tasks_processing.go:71] worker 61 working on machines task. I1001 01:56:24.128280 1 tasks_processing.go:71] worker 42 working on silenced_alerts task. I1001 01:56:24.128357 1 tasks_processing.go:71] worker 34 working on openstack_dataplanedeployments task. I1001 01:56:24.128393 1 tasks_processing.go:71] worker 41 working on oauths task. I1001 01:56:24.128414 1 tasks_processing.go:71] worker 28 working on node_logs task. I1001 01:56:24.128470 1 tasks_processing.go:71] worker 54 working on aggregated_monitoring_cr_names task. I1001 01:56:24.128476 1 tasks_processing.go:71] worker 51 working on overlapping_namespace_uids task. I1001 01:56:24.128291 1 tasks_processing.go:71] worker 62 working on openshift_machine_api_events task. I1001 01:56:24.128560 1 tasks_processing.go:71] worker 58 working on storage_cluster task. I1001 01:56:24.128615 1 tasks_processing.go:71] worker 35 working on sap_datahubs task. I1001 01:56:24.127999 1 tasks_processing.go:71] worker 55 working on operators task. I1001 01:56:24.128187 1 tasks_processing.go:71] worker 16 working on dvo_metrics task. I1001 01:56:24.128191 1 tasks_processing.go:71] worker 7 working on olm_operators task. I1001 01:56:24.128195 1 tasks_processing.go:71] worker 5 working on install_plans task. I1001 01:56:24.127772 1 tasks_processing.go:69] worker 22 listening for tasks. I1001 01:56:24.128754 1 tasks_processing.go:74] worker 22 stopped. I1001 01:56:24.128202 1 tasks_processing.go:71] worker 4 working on machine_configs task. I1001 01:56:24.128206 1 tasks_processing.go:71] worker 6 working on storage_classes task. I1001 01:56:24.128210 1 tasks_processing.go:71] worker 18 working on image_registries task. I1001 01:56:24.128213 1 tasks_processing.go:71] worker 60 working on infrastructures task. I1001 01:56:24.128216 1 tasks_processing.go:71] worker 19 working on active_alerts task. W1001 01:56:24.128845 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1001 01:56:24.128853 1 tasks_processing.go:74] worker 19 stopped. I1001 01:56:24.128858 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 16.88µs to process 0 records I1001 01:56:24.128221 1 tasks_processing.go:71] worker 37 working on sap_config task. I1001 01:56:24.128225 1 tasks_processing.go:71] worker 23 working on machine_config_pools task. I1001 01:56:24.127855 1 tasks_processing.go:71] worker 15 working on sap_pods task. I1001 01:56:24.128225 1 tasks_processing.go:71] worker 53 working on proxies task. I1001 01:56:24.128370 1 tasks_processing.go:71] worker 24 working on nodenetworkconfigurationpolicies task. I1001 01:56:24.128375 1 tasks_processing.go:71] worker 3 working on machine_autoscalers task. W1001 01:56:24.128375 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1001 01:56:24.128382 1 tasks_processing.go:71] worker 45 working on jaegers task. I1001 01:56:24.128387 1 tasks_processing.go:71] worker 50 working on metrics task. W1001 01:56:24.129499 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1001 01:56:24.128674 1 tasks_processing.go:71] worker 29 working on machine_sets task. I1001 01:56:24.127792 1 tasks_processing.go:71] worker 33 working on crds task. I1001 01:56:24.128199 1 tasks_processing.go:71] worker 10 working on pdbs task. I1001 01:56:24.129349 1 tasks_processing.go:71] worker 39 working on ceph_cluster task. I1001 01:56:24.130655 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 607.861µs to process 0 records I1001 01:56:24.130668 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 53.696µs to process 0 records I1001 01:56:24.130674 1 tasks_processing.go:74] worker 50 stopped. I1001 01:56:24.130795 1 tasks_processing.go:74] worker 42 stopped. I1001 01:56:24.130857 1 tasks_processing.go:71] worker 56 working on nodes task. I1001 01:56:24.133585 1 tasks_processing.go:74] worker 14 stopped. I1001 01:56:24.133595 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 5.904309ms to process 0 records I1001 01:56:24.134891 1 tasks_processing.go:74] worker 44 stopped. I1001 01:56:24.134904 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 7.056952ms to process 0 records I1001 01:56:24.134924 1 tasks_processing.go:74] worker 57 stopped. E1001 01:56:24.134933 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I1001 01:56:24.134939 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 6.942873ms to process 0 records I1001 01:56:24.136092 1 tasks_processing.go:74] worker 59 stopped. I1001 01:56:24.136101 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 8.099151ms to process 0 records I1001 01:56:24.138398 1 tasks_processing.go:74] worker 30 stopped. E1001 01:56:24.138408 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I1001 01:56:24.138415 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 10.348753ms to process 0 records I1001 01:56:24.139214 1 tasks_processing.go:74] worker 63 stopped. I1001 01:56:24.139222 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 11.373389ms to process 0 records I1001 01:56:24.140798 1 tasks_processing.go:74] worker 61 stopped. E1001 01:56:24.140808 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I1001 01:56:24.140815 1 gather.go:177] gatherer "clusterconfig" function "machines" took 12.552634ms to process 0 records I1001 01:56:24.140936 1 tasks_processing.go:74] worker 43 stopped. I1001 01:56:24.140950 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 12.826098ms to process 0 records I1001 01:56:24.140975 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I1001 01:56:24.140988 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1001 01:56:24.140995 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1001 01:56:24.140998 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1001 01:56:24.141008 1 controller.go:458] The operator is still being initialized I1001 01:56:24.141013 1 controller.go:481] The operator is healthy I1001 01:56:24.141123 1 tasks_processing.go:74] worker 12 stopped. I1001 01:56:24.141324 1 recorder.go:70] Recording config/authentication with fingerprint=3762ef8f15aaa35c0e4024e21a8aeb2c28e590d8333774c5eba26e6a847a717e I1001 01:56:24.141336 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 13.444143ms to process 1 records I1001 01:56:24.141417 1 tasks_processing.go:74] worker 21 stopped. I1001 01:56:24.141447 1 recorder.go:70] Recording config/network with fingerprint=bce03be13403ce8724680325593caf9f2d744ecb386026c83db7d728a8fd6e8b I1001 01:56:24.141453 1 gather.go:177] gatherer "clusterconfig" function "networks" took 13.404006ms to process 1 records I1001 01:56:24.142841 1 tasks_processing.go:74] worker 48 stopped. I1001 01:56:24.142848 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 14.608651ms to process 0 records I1001 01:56:24.146653 1 tasks_processing.go:74] worker 39 stopped. I1001 01:56:24.146663 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 16.556953ms to process 0 records I1001 01:56:24.146668 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 17.136916ms to process 0 records I1001 01:56:24.146672 1 tasks_processing.go:74] worker 29 stopped. I1001 01:56:24.147418 1 tasks_processing.go:74] worker 58 stopped. I1001 01:56:24.147426 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 18.84695ms to process 0 records I1001 01:56:24.147470 1 tasks_processing.go:74] worker 8 stopped. I1001 01:56:24.147476 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 19.660556ms to process 0 records I1001 01:56:24.149687 1 tasks_processing.go:74] worker 23 stopped. I1001 01:56:24.149696 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 20.813473ms to process 0 records I1001 01:56:24.149703 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 21.756836ms to process 0 records I1001 01:56:24.149706 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 20.459894ms to process 0 records I1001 01:56:24.149710 1 tasks_processing.go:74] worker 45 stopped. I1001 01:56:24.149712 1 tasks_processing.go:74] worker 0 stopped. I1001 01:56:24.151576 1 tasks_processing.go:74] worker 24 stopped. I1001 01:56:24.151584 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 22.651288ms to process 0 records I1001 01:56:24.152042 1 tasks_processing.go:74] worker 3 stopped. I1001 01:56:24.152050 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 23.096896ms to process 0 records I1001 01:56:24.155565 1 tasks_processing.go:74] worker 26 stopped. I1001 01:56:24.155620 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=6f5aebc046f8acb20c1a934c9bbef8c2b13086a75170537dfe60d77f69473b84 I1001 01:56:24.155630 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 27.412759ms to process 1 records I1001 01:56:24.155703 1 tasks_processing.go:74] worker 9 stopped. I1001 01:56:24.155718 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 27.833446ms to process 0 records I1001 01:56:24.155970 1 tasks_processing.go:74] worker 4 stopped. E1001 01:56:24.155981 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I1001 01:56:24.155999 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I1001 01:56:24.156008 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 27.198135ms to process 1 records I1001 01:56:24.156564 1 tasks_processing.go:74] worker 11 stopped. I1001 01:56:24.156574 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 28.757205ms to process 0 records I1001 01:56:24.157454 1 tasks_processing.go:74] worker 32 stopped. I1001 01:56:24.157563 1 recorder.go:70] Recording config/featuregate with fingerprint=0bf87b29f0a9af6f6e667fbc2e1939c3eee4952d4474c13cb7b6984c8088b5d7 I1001 01:56:24.157574 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 29.632902ms to process 1 records I1001 01:56:24.158374 1 tasks_processing.go:74] worker 34 stopped. I1001 01:56:24.158385 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 29.975255ms to process 0 records I1001 01:56:24.158393 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 29.762166ms to process 0 records I1001 01:56:24.158398 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 29.522983ms to process 0 records I1001 01:56:24.158403 1 tasks_processing.go:74] worker 37 stopped. I1001 01:56:24.158407 1 tasks_processing.go:74] worker 35 stopped. I1001 01:56:24.158787 1 tasks_processing.go:74] worker 51 stopped. I1001 01:56:24.158809 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I1001 01:56:24.158818 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 30.297376ms to process 1 records I1001 01:56:24.159119 1 tasks_processing.go:74] worker 15 stopped. I1001 01:56:24.159131 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 30.242964ms to process 0 records I1001 01:56:24.159290 1 tasks_processing.go:74] worker 36 stopped. I1001 01:56:24.159388 1 recorder.go:70] Recording config/image with fingerprint=50669e0dd755cca6a00da134534bb6e50efd3a432fcd5d0396587edd2d89f43b I1001 01:56:24.159400 1 gather.go:177] gatherer "clusterconfig" function "image" took 31.046384ms to process 1 records I1001 01:56:24.159480 1 tasks_processing.go:74] worker 31 stopped. I1001 01:56:24.159498 1 recorder.go:70] Recording config/ingress with fingerprint=6f7b2e7a90ab35152dfe971ceb58491359483d2989175f9dba3051bf94af5e08 I1001 01:56:24.159504 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 31.273314ms to process 1 records I1001 01:56:24.166652 1 tasks_processing.go:74] worker 40 stopped. E1001 01:56:24.166662 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I1001 01:56:24.166671 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 38.775702ms to process 0 records I1001 01:56:24.166716 1 tasks_processing.go:74] worker 13 stopped. I1001 01:56:24.166828 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=07e7de3d7b5f12b072c52735005a9e2fa1ca399332b59b0019f371d99ece8b02 I1001 01:56:24.166877 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=1b5695a9b75172038df83ccbc9aa1521b2444118229165c2f7801ebb533aa16c I1001 01:56:24.166884 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 39.037276ms to process 2 records I1001 01:56:24.166972 1 tasks_processing.go:74] worker 27 stopped. I1001 01:56:24.167060 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=155fccc1958c397b4ab2e7d45d84001e11e44ae6d00dfb3abcc77c1a778539e7 I1001 01:56:24.167068 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 38.780279ms to process 1 records I1001 01:56:24.167109 1 recorder.go:70] Recording config/proxy with fingerprint=4656fcde46de36ddafda8b8e09cae075b17dd518f5fb49589ea8f7a9fc9d7326 I1001 01:56:24.167116 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 37.855709ms to process 1 records I1001 01:56:24.167120 1 tasks_processing.go:74] worker 53 stopped. I1001 01:56:24.174932 1 tasks_processing.go:74] worker 60 stopped. I1001 01:56:24.175399 1 recorder.go:70] Recording config/infrastructure with fingerprint=09c4547fe54236a7267c97a62f92f51af411456423bc438f5f6ce44e7b7f5c5b I1001 01:56:24.175410 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 46.109493ms to process 1 records I1001 01:56:24.175504 1 tasks_processing.go:74] worker 41 stopped. I1001 01:56:24.175546 1 recorder.go:70] Recording config/oauth with fingerprint=898923a3746c8e42e76cf2bb6504b91540c7faab717449d4993b6c12d766a00f I1001 01:56:24.175556 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 46.634145ms to process 1 records I1001 01:56:24.175645 1 tasks_processing.go:74] worker 18 stopped. I1001 01:56:24.175830 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=7ec260232664f89efa60feec62cc7b3908766cca13e7aed28f73373bbc6f25f3 I1001 01:56:24.175838 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 46.48072ms to process 1 records I1001 01:56:24.176631 1 tasks_processing.go:74] worker 2 stopped. I1001 01:56:24.176857 1 recorder.go:70] Recording config/apiserver with fingerprint=f49acd968e70c52ec859943568139635d58195eae2e975203b4716876287c04a I1001 01:56:24.176871 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 48.877266ms to process 1 records I1001 01:56:24.182039 1 tasks_processing.go:74] worker 6 stopped. I1001 01:56:24.182142 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=860fd109e08922a78f8e76730f334864764ebedb638872ff7af24055ff1057ca I1001 01:56:24.182159 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=7bb768a7f3215d0c93072d47a7cfbfad81ce61909f527781403007b404b00c62 I1001 01:56:24.182168 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 53.250542ms to process 2 records I1001 01:56:24.182327 1 tasks_processing.go:74] worker 7 stopped. I1001 01:56:24.182338 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 53.583847ms to process 0 records I1001 01:56:24.182427 1 tasks_processing.go:74] worker 52 stopped. I1001 01:56:24.182566 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=65552ec1bfc7239102e17bc277c2bb302149d2ba512e368dc7ec1a2120263ab2 I1001 01:56:24.182593 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=0d2eba0f63e0ef683e79c90f8a84aafb42fa881299aa7515f6c00a9d5c45a6d8 I1001 01:56:24.182616 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=91c998d1d273fce3708bcd548fd509786b700dc42136e84c705cd2ab657ea63c I1001 01:56:24.182626 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 54.614336ms to process 3 records I1001 01:56:24.182708 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=a595046145ee42f8d18c29e25a814dd5ac7280d17a0382016b5287c2dbdeadce I1001 01:56:24.182715 1 tasks_processing.go:74] worker 38 stopped. I1001 01:56:24.182753 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=4cb97a959eb374e59c86ebca057aaa692c71f4c7b7a5342f0e9968dc179cb33a I1001 01:56:24.182770 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=5a9ca31c042081df8f845b16d58405cefafb2b5e0c7d597afce0224faac4ec2d I1001 01:56:24.182793 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=2af6bc6837170d2b8e40872e8efd86c641f029cb5a3b70ce27c4b866c7092810 I1001 01:56:24.182810 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=04344b55bd9ec83490ed1eaefddda600b007bb8b3b59e5823c3368bb4af7d253 I1001 01:56:24.182827 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=e903a2b9789e02a7ba399852a14ccfc712176bf65231ea2dd2be1698c55e1ce9 I1001 01:56:24.182850 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=a8493c897a7a7abefab7dc521c4ff3d05a518c6292f0515e5d32e2ff8323d7fe I1001 01:56:24.182881 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=bd689b4534b53bf05b03d5971a9c133c25cfa1cf56247ff5fe768e4386b3583c I1001 01:56:24.182897 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=d0629ce826f00d3a4f59f017e809c7551e9d9839785075690843b4aeac3e4448 I1001 01:56:24.182933 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=dc283a65fd87c12b3ba3b9db717ec3fcd52be49c7a8af1f1f320bb5ea4fc626b I1001 01:56:24.182955 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=55bd1e067e6e91ae0a54f78c4cda3586988c1ab6fa79e1589df3b946543cc947 I1001 01:56:24.182964 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 54.199843ms to process 11 records I1001 01:56:24.182971 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 54.433598ms to process 0 records I1001 01:56:24.182982 1 tasks_processing.go:74] worker 62 stopped. I1001 01:56:24.183026 1 tasks_processing.go:74] worker 10 stopped. I1001 01:56:24.183088 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=b49b655126fc5795a4a87ce409fde45cb2ccd0e25c05b7b3ad41bc0490e4f5ec I1001 01:56:24.183101 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=9e7d8afcc3167b42cfcad2c007fefdd9f17775eb9514f5f647ea8561d80efd48 I1001 01:56:24.183116 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=10988d332cbc4b6eff0e6159bbea030df80a9781b88de2902342ec506a5ba2d2 I1001 01:56:24.183122 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 53.080309ms to process 3 records I1001 01:56:24.183260 1 tasks_processing.go:74] worker 28 stopped. I1001 01:56:24.183275 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 54.833104ms to process 0 records I1001 01:56:24.183326 1 tasks_processing.go:74] worker 56 stopped. I1001 01:56:24.183527 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I1001 01:56:24.183586 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I1001 01:56:24.183626 1 recorder.go:70] Recording config/node/ip-10-0-128-27.ec2.internal with fingerprint=41b10d3fcb127e8b2aab80401b27200cfc1aa8ccb68168fcbc4157e12fcd898f W1001 01:56:24.183640 1 operator.go:287] started I1001 01:56:24.183642 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 52.390195ms to process 1 records I1001 01:56:24.183664 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer W1001 01:56:24.187032 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1001 01:56:24.187162 1 tasks_processing.go:74] worker 47 stopped. I1001 01:56:24.187206 1 recorder.go:70] Recording config/running_containers with fingerprint=a454fa279d364b9d1c14edba99d0dfdbd30ee1f12f8204a1c2856ffc0475ebdc I1001 01:56:24.187215 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 58.998137ms to process 1 records I1001 01:56:24.188484 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1001 01:56:24.188497 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1001 01:56:24.188526 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I1001 01:56:24.190429 1 base_controller.go:82] Caches are synced for ConfigController I1001 01:56:24.190438 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I1001 01:56:24.208328 1 prometheus_rules.go:88] Prometheus rules successfully created I1001 01:56:24.208889 1 tasks_processing.go:74] worker 17 stopped. I1001 01:56:24.208900 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 81.013442ms to process 0 records I1001 01:56:24.208954 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 01:56:24.209058 1 controller.go:203] Source scaController *sca.Controller is not ready I1001 01:56:24.209069 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I1001 01:56:24.209072 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1001 01:56:24.209074 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1001 01:56:24.209077 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1001 01:56:24.209090 1 controller.go:458] The operator is still being initialized I1001 01:56:24.209094 1 controller.go:481] The operator is healthy I1001 01:56:24.211213 1 tasks_processing.go:74] worker 33 stopped. I1001 01:56:24.211672 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=ba0f8b0f61ea0210353ecf43c910575d495cf500331acec84992399f78a7fd11 I1001 01:56:24.211804 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=6d15c9f7c7ad2e61bb378fe67ebc01c08967f5d9108966a2583cf22bd2adc5b1 I1001 01:56:24.211815 1 gather.go:177] gatherer "clusterconfig" function "crds" took 81.381553ms to process 2 records I1001 01:56:24.213906 1 tasks_processing.go:74] worker 54 stopped. I1001 01:56:24.213917 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 85.420389ms to process 0 records E1001 01:56:24.221259 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27c3d07005-1618-4b40-a949-3ff6efb2a718%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.8:48576->172.30.0.10:53: read: connection refused I1001 01:56:24.221270 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%27c3d07005-1618-4b40-a949-3ff6efb2a718%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.8:48576->172.30.0.10:53: read: connection refused I1001 01:56:24.256565 1 tasks_processing.go:74] worker 49 stopped. E1001 01:56:24.256581 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E1001 01:56:24.256590 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E1001 01:56:24.256593 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I1001 01:56:24.256599 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I1001 01:56:24.256626 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I1001 01:56:24.256631 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I1001 01:56:24.256634 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I1001 01:56:24.256638 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I1001 01:56:24.256654 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I1001 01:56:24.256661 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I1001 01:56:24.256665 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 128.542842ms to process 7 records I1001 01:56:24.275762 1 tasks_processing.go:74] worker 1 stopped. I1001 01:56:24.276126 1 recorder.go:70] Recording config/version with fingerprint=b761f86f91302a62701761547b9f0bb0a55072ac59fbbd8318849df764356e82 I1001 01:56:24.276141 1 recorder.go:70] Recording config/id with fingerprint=13dec79d50b0ce8d196dbf719b280e1d15426d2122ac1e8a7f8fd12cb5dbf5f0 I1001 01:56:24.276147 1 gather.go:177] gatherer "clusterconfig" function "version" took 147.978942ms to process 2 records I1001 01:56:24.284582 1 base_controller.go:82] Caches are synced for LoggingSyncer I1001 01:56:24.284593 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I1001 01:56:24.303414 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W1001 01:56:24.306064 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.8:45149->172.30.0.10:53: read: connection refused I1001 01:56:24.306074 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.8:45149->172.30.0.10:53: read: connection refused I1001 01:56:24.325210 1 tasks_processing.go:74] worker 46 stopped. E1001 01:56:24.325222 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E1001 01:56:24.325227 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2t5mlbhu6dsd9qbr6l9l79hb036oumvs-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2t5mlbhu6dsd9qbr6l9l79hb036oumvs-primary-cert-bundle-secret" not found I1001 01:56:24.325273 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=de528dde28311af3f905d1b53580f112c7864c0b9a92096033768cd11721cbe1 I1001 01:56:24.325282 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 197.306107ms to process 1 records I1001 01:56:24.591716 1 gather_cluster_operator_pods_and_events.go:121] Found 10 pods with 11 containers I1001 01:56:24.591730 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 2287802 bytes I1001 01:56:24.592338 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-vnpj2 pod in namespace openshift-dns (previous: false). I1001 01:56:24.608508 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I1001 01:56:24.813526 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I1001 01:56:24.874811 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vnpj2 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-vnpj2\" is waiting to start: ContainerCreating" I1001 01:56:24.874829 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-vnpj2\" is waiting to start: ContainerCreating" I1001 01:56:24.874835 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-vnpj2 pod in namespace openshift-dns (previous: false). I1001 01:56:25.001354 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-vnpj2 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-vnpj2\" is waiting to start: ContainerCreating" I1001 01:56:25.001370 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-vnpj2\" is waiting to start: ContainerCreating" I1001 01:56:25.001380 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-l5c9h pod in namespace openshift-dns (previous: false). W1001 01:56:25.185939 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1001 01:56:25.198396 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1001 01:56:25.198410 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-846dc9b995-nx5t6 pod in namespace openshift-image-registry (previous: false). I1001 01:56:25.396199 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-846dc9b995-nx5t6 pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-846dc9b995-nx5t6\" is waiting to start: ContainerCreating" I1001 01:56:25.396217 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-846dc9b995-nx5t6\" is waiting to start: ContainerCreating" I1001 01:56:25.396225 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-846dc9b995-xr98c pod in namespace openshift-image-registry (previous: false). I1001 01:56:25.589403 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1001 01:56:25.589418 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-9dfc89bf6-rtpgt pod in namespace openshift-image-registry (previous: false). I1001 01:56:25.605917 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I1001 01:56:25.792151 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1001 01:56:25.792167 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-rhhz8 pod in namespace openshift-image-registry (previous: false). I1001 01:56:25.997915 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1001 01:56:25.997930 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5f4f68d75f-7jbzl pod in namespace openshift-ingress (previous: false). W1001 01:56:26.186297 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1001 01:56:26.196008 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-5f4f68d75f-7jbzl pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-5f4f68d75f-7jbzl\" is waiting to start: ContainerCreating" I1001 01:56:26.196020 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-5f4f68d75f-7jbzl\" is waiting to start: ContainerCreating" I1001 01:56:26.196028 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-84f998589c-49nv9 pod in namespace openshift-ingress (previous: false). I1001 01:56:26.207397 1 tasks_processing.go:74] worker 55 stopped. I1001 01:56:26.207447 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=ce95ec9fd2870b51399a6d34cdefa723d03485e0e6e58b2cf8e6b850056cfd1a I1001 01:56:26.207476 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=7873f3d206a28751d359a70caf9a053981be3be2b09a3f21539bb7b5d430f017 I1001 01:56:26.207504 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I1001 01:56:26.207522 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=585c4fc4f014d6a137197f4fe8bed947ad213e8812b27bee2933d8e21ad56e4e I1001 01:56:26.207542 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I1001 01:56:26.207563 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=fdf96320d7e4f6484288539884d0c00917cd6719472dd5210f6b3f40b40714bf I1001 01:56:26.207588 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=2a65ca296605d4cffcec26d196fcd5aecf79e5b0f715f746b317ff96a387169d I1001 01:56:26.207611 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=e3f6666de9dcb512f159595b04b2964a797086b6ebf1b9fa558a7269febdbf93 I1001 01:56:26.207623 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=8fe17833319adbb849b5cd0f775368ff15c5937eff06c78a362791df45d16207 I1001 01:56:26.207638 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=69be1167ffb2a0bff4de1148f29d26833198e5c7fda7bb59fd9f558bc3bce52b I1001 01:56:26.207646 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I1001 01:56:26.207659 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=b5192aa1f71d94eef8acdef3265d1f46e66c7556a1bf2365f69f3a175cad53a2 I1001 01:56:26.207668 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I1001 01:56:26.207678 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=f33415f39c5b9cedee762b705c144674ead58569d57a7c0624a08fa0190597be I1001 01:56:26.207687 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I1001 01:56:26.207699 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=41cef0ed6c98517166e628d0a651a3951d86cf3959e43cd4e73609fa5e82bbcd I1001 01:56:26.207707 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I1001 01:56:26.207717 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=d270a23b11e45c0b34b2f0b83dbdb757e105e6846467162ea01f038636f30a46 I1001 01:56:26.207786 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=e8eddd80e4338cace440a9fac454bf8e6cc1997e2122aa70ac5f2bcf19cbe43b I1001 01:56:26.207806 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I1001 01:56:26.207823 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=5b661fe8ebd768c07bc405878020a5177e954bc2e9feba0d21ea0127a39fd172 I1001 01:56:26.207838 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=deff0a3c1d589f06b4a598da987485673a472e3684da444e30117eff560e7c42 I1001 01:56:26.207843 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I1001 01:56:26.207853 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=a0b7cc0bfe86e067a3ea9f0cacf3ed74f1a49ae7dcb7fd7842aa3c2feace03bf I1001 01:56:26.207862 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I1001 01:56:26.207870 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=db70e481795fd0b6443dad53fe6a0eed6ce8c3707d7477f5b40c54d9f97433de I1001 01:56:26.207882 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=5c7f709898dc8f9d0f6280da77d883bceb9d7a7387d366be201b07dcc111661b I1001 01:56:26.207892 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=356b7061e947bea793c07c6db1ce4fc4527fbbde86694453aaea4b6754c26c9a I1001 01:56:26.207901 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=4b1d52ace469597b9194bd4f39eaa731a50ba79a9c0d1a1ec44231bf043aad11 I1001 01:56:26.207916 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=cc98451b6b5bf890ac77952d180410b4395bad79c7f969b6840410dd71087231 I1001 01:56:26.207922 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I1001 01:56:26.207937 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=5d7cd53af31d196d3310e769215eb1a1d96c5ccb7abb85ea01b1ebcb75339e4e I1001 01:56:26.207950 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I1001 01:56:26.207958 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I1001 01:56:26.207963 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.0787047s to process 34 records I1001 01:56:26.403268 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-84f998589c-49nv9 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-84f998589c-49nv9\" is waiting to start: ContainerCreating" I1001 01:56:26.403283 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-84f998589c-49nv9\" is waiting to start: ContainerCreating" I1001 01:56:26.403291 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-84f998589c-9d4vf pod in namespace openshift-ingress (previous: false). I1001 01:56:26.593189 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1001 01:56:26.593211 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-n2265 pod in namespace openshift-ingress-canary (previous: false). I1001 01:56:26.795941 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-n2265 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-n2265\" is waiting to start: ContainerCreating" I1001 01:56:26.795957 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-n2265\" is waiting to start: ContainerCreating" I1001 01:56:26.795971 1 tasks_processing.go:74] worker 25 stopped. I1001 01:56:26.796032 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=06a252b77c361b05b4605c3eab3fbcd040c691f2644029d322615f8fd52d1b90 I1001 01:56:26.796050 1 recorder.go:70] Recording events/openshift-dns with fingerprint=bdde0d6ca4e2de6dc3eb8e3f7e988b9ff0dacf1df35ddb3d17bc933d346c1605 I1001 01:56:26.796086 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=5e5f3896c34640bf4de38183a8bc042f5ec065ea5973fed58e7ce09c0cf7bd72 I1001 01:56:26.796105 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=a9a0d96d83e9b74adc09c6a7af86c9b2df7ec4e0737109d1cd8b04769a68e276 I1001 01:56:26.796133 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=761f85eb06c44b5698adffb673f2f2528f042cfda7513e56e2ceddba55b3b2f6 I1001 01:56:26.796142 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=d0d0989cf06ff9f758cac41e6afd83bd178426cce8a82f99cc3de72b9c433605 I1001 01:56:26.796147 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 2.667930955s to process 6 records W1001 01:56:27.186037 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W1001 01:56:28.186968 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W1001 01:56:29.183192 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I1001 01:56:29.183216 1 tasks_processing.go:74] worker 16 stopped. E1001 01:56:29.183227 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I1001 01:56:29.183240 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W1001 01:56:29.183255 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I1001 01:56:29.183267 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.054512276s to process 1 records I1001 01:56:36.319967 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 01:56:36.788794 1 tasks_processing.go:74] worker 5 stopped. I1001 01:56:36.788825 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I1001 01:56:36.788836 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.660041063s to process 1 records I1001 01:56:37.540288 1 tasks_processing.go:74] worker 20 stopped. I1001 01:56:37.540505 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=4a028e8a81776235f87357a783e151baf9592d8d96c64fa17fcfd7eeba70afa9 I1001 01:56:37.540525 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.412478693s to process 1 records E1001 01:56:37.540586 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.412s with: function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"support_secret\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I1001 01:56:37.541681 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "support_secret" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I1001 01:56:37.541692 1 periodic.go:212] Running workloads gatherer I1001 01:56:37.541705 1 tasks_processing.go:45] number of workers: 2 I1001 01:56:37.541713 1 tasks_processing.go:69] worker 1 listening for tasks. I1001 01:56:37.541717 1 tasks_processing.go:71] worker 1 working on workload_info task. I1001 01:56:37.541727 1 tasks_processing.go:69] worker 0 listening for tasks. I1001 01:56:37.541796 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I1001 01:56:37.566005 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 18s for image data I1001 01:56:37.577430 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (12ms) I1001 01:56:37.579080 1 tasks_processing.go:74] worker 0 stopped. I1001 01:56:37.579092 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 37.270713ms to process 0 records I1001 01:56:37.589415 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (12ms) I1001 01:56:37.591637 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 01:56:37.599961 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (11ms) I1001 01:56:37.610468 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (10ms) I1001 01:56:37.619542 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (9ms) I1001 01:56:37.628782 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (9ms) I1001 01:56:37.638050 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (9ms) I1001 01:56:37.651663 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (14ms) I1001 01:56:37.665393 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (14ms) I1001 01:56:37.679510 1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (14ms) I1001 01:56:37.692086 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (13ms) I1001 01:56:37.776349 1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (84ms) I1001 01:56:37.794813 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 01:56:37.879964 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (104ms) I1001 01:56:37.981340 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (101ms) I1001 01:56:38.076116 1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (95ms) I1001 01:56:38.175875 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (100ms) I1001 01:56:38.276521 1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (101ms) I1001 01:56:38.377820 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (101ms) I1001 01:56:38.476702 1 gather_workloads_info.go:387] No image sha256:798001e24f1ed6a5621c442729a840ba2a2abc43433901e8450caa12b4bad5c5 (99ms) I1001 01:56:38.576244 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (100ms) I1001 01:56:38.675574 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (99ms) I1001 01:56:38.775646 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (100ms) I1001 01:56:38.876525 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (101ms) I1001 01:56:38.977709 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (101ms) I1001 01:56:39.077214 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (99ms) I1001 01:56:39.175542 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (98ms) I1001 01:56:39.276741 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (101ms) I1001 01:56:39.378779 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (102ms) I1001 01:56:39.476323 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (98ms) I1001 01:56:39.577177 1 gather_workloads_info.go:387] No image sha256:d28734effaadd66434e77a1a5fbe2e8a4ca2066cd9f8868c22ade9475539bfd7 (101ms) I1001 01:56:39.676717 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (100ms) I1001 01:56:39.676742 1 tasks_processing.go:74] worker 1 stopped. E1001 01:56:39.676752 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I1001 01:56:39.676955 1 recorder.go:70] Recording config/workload_info with fingerprint=07c413b65dca0b74eb6ecfde7151042877d388bc464780b39147205f7dbcf929 I1001 01:56:39.676967 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.135019958s to process 1 records E1001 01:56:39.676988 1 periodic.go:250] "Unhandled Error" err="workloads failed after 2.135s with: function \"workload_info\" failed with an error" I1001 01:56:39.678086 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I1001 01:56:39.678098 1 periodic.go:212] Running conditional gatherer I1001 01:56:39.687564 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I1001 01:56:39.692485 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.8:43581->172.30.0.10:53: read: connection refused E1001 01:56:39.692698 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I1001 01:56:39.692749 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I1001 01:56:39.702190 1 conditional_gatherer.go:390] cluster version is '4.19.9' E1001 01:56:39.702203 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 01:56:39.702207 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 01:56:39.702210 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 01:56:39.702212 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 01:56:39.702214 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 01:56:39.702216 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 01:56:39.702220 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 01:56:39.702222 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 01:56:39.702224 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I1001 01:56:39.702236 1 tasks_processing.go:45] number of workers: 3 I1001 01:56:39.702248 1 tasks_processing.go:69] worker 2 listening for tasks. I1001 01:56:39.702251 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I1001 01:56:39.702256 1 tasks_processing.go:69] worker 0 listening for tasks. I1001 01:56:39.702262 1 tasks_processing.go:69] worker 1 listening for tasks. I1001 01:56:39.702273 1 tasks_processing.go:74] worker 1 stopped. I1001 01:56:39.702281 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I1001 01:56:39.702316 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I1001 01:56:39.702355 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I1001 01:56:39.702366 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 536ns to process 1 records I1001 01:56:39.702388 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I1001 01:56:39.702396 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.444µs to process 1 records I1001 01:56:39.702400 1 tasks_processing.go:74] worker 0 stopped. I1001 01:56:39.702507 1 tasks_processing.go:74] worker 2 stopped. I1001 01:56:39.702517 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 220.975µs to process 0 records I1001 01:56:39.702538 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.8:43581->172.30.0.10:53: read: connection refused I1001 01:56:39.702550 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I1001 01:56:39.726245 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=686340cb8ced9241b06e23b947ae5f4e62491b3cbfbf0eda596d775497086012 I1001 01:56:39.726362 1 diskrecorder.go:70] Writing 96 records to /var/lib/insights-operator/insights-2026-10-01-015639.tar.gz I1001 01:56:39.730962 1 diskrecorder.go:51] Wrote 96 records to disk in 4ms I1001 01:56:39.730985 1 periodic.go:281] Gathering cluster info every 2h0m0s I1001 01:56:39.731007 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I1001 01:56:47.258422 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 01:57:43.652696 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="b1af17545a65678dd30d4fe51cd8ad46ce395ffb627687b4fe4f0fad9c2d75ba") W1001 01:57:43.652725 1 builder.go:160] Restart triggered because of file /var/run/secrets/serving-cert/tls.crt was created I1001 01:57:43.652754 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="fd33b1b56fcd8af3e7311cf88196247eea02df7a34586f0cd8525055cc384228") I1001 01:57:43.652804 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="3e5e9bebebcde0f6bd919c6cfa3d5c6c0b4c5a4226b402f0f6369265a0f13d8e")