I1001 02:13:49.429298 1 cmd.go:253] Using service-serving-cert provided certificates I1001 02:13:49.430784 1 observer_polling.go:159] Starting file observer W1001 02:13:49.472164 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I1001 02:13:49.704935 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I1001 02:13:49.705099 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I1001 02:13:49.705531 1 secure_serving.go:57] Forcing use of http/1.1 only W1001 02:13:49.705550 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W1001 02:13:49.705554 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W1001 02:13:49.705558 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W1001 02:13:49.705560 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W1001 02:13:49.705562 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W1001 02:13:49.705564 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I1001 02:13:49.705594 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I1001 02:13:49.709648 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I1001 02:13:49.709658 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I1001 02:13:49.710831 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I1001 02:13:49.710841 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I1001 02:13:49.710856 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I1001 02:13:49.710845 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I1001 02:13:49.710900 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1001 02:13:49.710906 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1001 02:13:49.710977 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I1001 02:13:49.711067 1 secure_serving.go:213] Serving securely on [::]:8443 I1001 02:13:49.711114 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" E1001 02:13:49.712878 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18da460e7335c3cd openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-10-01 02:13:49.709583309 +0000 UTC m=+0.309092850,LastTimestamp:2026-10-01 02:13:49.709583309 +0000 UTC m=+0.309092850,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W1001 02:13:49.715446 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I1001 02:13:49.715470 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1001 02:13:49.715546 1 base_controller.go:76] Waiting for caches to sync for ConfigController I1001 02:13:49.721151 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1001 02:13:49.721166 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1001 02:13:49.725933 1 secretconfigobserver.go:119] support secret does not exist I1001 02:13:49.731913 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1001 02:13:49.736820 1 secretconfigobserver.go:119] support secret does not exist I1001 02:13:49.738194 1 recorder.go:156] Pruning old reports every 4h44m7s, max age is 288h0m0s I1001 02:13:49.743534 1 periodic.go:212] Running clusterconfig gatherer I1001 02:13:49.743543 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I1001 02:13:49.743554 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I1001 02:13:49.743567 1 tasks_processing.go:45] number of workers: 64 I1001 02:13:49.743568 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I1001 02:13:49.743572 1 insightsreport.go:296] Starting report retriever I1001 02:13:49.743575 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I1001 02:13:49.743582 1 tasks_processing.go:69] worker 7 listening for tasks. I1001 02:13:49.743583 1 tasks_processing.go:69] worker 1 listening for tasks. I1001 02:13:49.743590 1 tasks_processing.go:69] worker 0 listening for tasks. I1001 02:13:49.743593 1 tasks_processing.go:69] worker 2 listening for tasks. I1001 02:13:49.743597 1 tasks_processing.go:69] worker 3 listening for tasks. I1001 02:13:49.743602 1 tasks_processing.go:69] worker 6 listening for tasks. I1001 02:13:49.743605 1 tasks_processing.go:71] worker 6 working on schedulers task. I1001 02:13:49.743605 1 tasks_processing.go:71] worker 3 working on cost_management_metrics_configs task. I1001 02:13:49.743608 1 tasks_processing.go:69] worker 5 listening for tasks. I1001 02:13:49.743607 1 tasks_processing.go:69] worker 31 listening for tasks. I1001 02:13:49.743613 1 tasks_processing.go:69] worker 4 listening for tasks. I1001 02:13:49.743618 1 tasks_processing.go:69] worker 20 listening for tasks. I1001 02:13:49.743619 1 tasks_processing.go:69] worker 49 listening for tasks. I1001 02:13:49.743623 1 tasks_processing.go:69] worker 32 listening for tasks. I1001 02:13:49.743627 1 tasks_processing.go:69] worker 33 listening for tasks. I1001 02:13:49.743629 1 tasks_processing.go:69] worker 21 listening for tasks. I1001 02:13:49.743628 1 tasks_processing.go:69] worker 19 listening for tasks. I1001 02:13:49.743635 1 tasks_processing.go:69] worker 22 listening for tasks. I1001 02:13:49.743636 1 tasks_processing.go:69] worker 35 listening for tasks. I1001 02:13:49.743632 1 tasks_processing.go:69] worker 34 listening for tasks. I1001 02:13:49.743637 1 tasks_processing.go:69] worker 58 listening for tasks. I1001 02:13:49.743641 1 tasks_processing.go:69] worker 8 listening for tasks. I1001 02:13:49.743640 1 tasks_processing.go:69] worker 23 listening for tasks. I1001 02:13:49.743644 1 tasks_processing.go:69] worker 24 listening for tasks. I1001 02:13:49.743645 1 tasks_processing.go:69] worker 36 listening for tasks. I1001 02:13:49.743645 1 tasks_processing.go:69] worker 50 listening for tasks. I1001 02:13:49.743648 1 tasks_processing.go:69] worker 14 listening for tasks. I1001 02:13:49.743649 1 tasks_processing.go:69] worker 25 listening for tasks. I1001 02:13:49.743651 1 tasks_processing.go:69] worker 37 listening for tasks. I1001 02:13:49.743651 1 tasks_processing.go:69] worker 13 listening for tasks. I1001 02:13:49.743655 1 tasks_processing.go:69] worker 38 listening for tasks. I1001 02:13:49.743653 1 tasks_processing.go:69] worker 15 listening for tasks. I1001 02:13:49.743660 1 tasks_processing.go:69] worker 52 listening for tasks. I1001 02:13:49.743662 1 tasks_processing.go:69] worker 28 listening for tasks. I1001 02:13:49.743663 1 tasks_processing.go:69] worker 39 listening for tasks. I1001 02:13:49.743663 1 tasks_processing.go:69] worker 63 listening for tasks. I1001 02:13:49.743667 1 tasks_processing.go:69] worker 9 listening for tasks. I1001 02:13:49.743659 1 tasks_processing.go:69] worker 16 listening for tasks. I1001 02:13:49.743669 1 tasks_processing.go:69] worker 18 listening for tasks. I1001 02:13:49.743671 1 tasks_processing.go:69] worker 40 listening for tasks. I1001 02:13:49.743672 1 tasks_processing.go:71] worker 16 working on machine_configs task. I1001 02:13:49.743665 1 tasks_processing.go:69] worker 17 listening for tasks. I1001 02:13:49.743658 1 tasks_processing.go:69] worker 27 listening for tasks. I1001 02:13:49.743688 1 tasks_processing.go:69] worker 12 listening for tasks. I1001 02:13:49.743690 1 tasks_processing.go:71] worker 24 working on authentication task. I1001 02:13:49.743691 1 tasks_processing.go:69] worker 43 listening for tasks. I1001 02:13:49.743687 1 tasks_processing.go:69] worker 60 listening for tasks. I1001 02:13:49.743696 1 tasks_processing.go:71] worker 35 working on monitoring_persistent_volumes task. I1001 02:13:49.743698 1 tasks_processing.go:69] worker 56 listening for tasks. I1001 02:13:49.743700 1 tasks_processing.go:71] worker 8 working on certificate_signing_requests task. I1001 02:13:49.743699 1 tasks_processing.go:71] worker 2 working on infrastructures task. I1001 02:13:49.743703 1 tasks_processing.go:71] worker 39 working on machines task. I1001 02:13:49.743705 1 tasks_processing.go:69] worker 45 listening for tasks. I1001 02:13:49.743707 1 tasks_processing.go:69] worker 47 listening for tasks. I1001 02:13:49.743653 1 tasks_processing.go:69] worker 51 listening for tasks. I1001 02:13:49.743712 1 tasks_processing.go:69] worker 48 listening for tasks. I1001 02:13:49.743701 1 tasks_processing.go:71] worker 28 working on crds task. I1001 02:13:49.743710 1 tasks_processing.go:69] worker 61 listening for tasks. I1001 02:13:49.743717 1 tasks_processing.go:71] worker 19 working on container_runtime_configs task. I1001 02:13:49.743721 1 tasks_processing.go:71] worker 13 working on config_maps task. I1001 02:13:49.743723 1 tasks_processing.go:71] worker 22 working on proxies task. I1001 02:13:49.743722 1 tasks_processing.go:69] worker 57 listening for tasks. I1001 02:13:49.743736 1 tasks_processing.go:71] worker 38 working on storage_classes task. I1001 02:13:49.743741 1 tasks_processing.go:71] worker 14 working on mutating_webhook_configurations task. I1001 02:13:49.743748 1 tasks_processing.go:71] worker 63 working on openshift_logging task. I1001 02:13:49.743697 1 tasks_processing.go:71] worker 58 working on active_alerts task. I1001 02:13:49.743689 1 tasks_processing.go:71] worker 23 working on version task. I1001 02:13:49.743973 1 tasks_processing.go:71] worker 37 working on overlapping_namespace_uids task. I1001 02:13:49.744056 1 tasks_processing.go:71] worker 50 working on image task. I1001 02:13:49.744071 1 tasks_processing.go:69] worker 62 listening for tasks. I1001 02:13:49.743691 1 tasks_processing.go:71] worker 33 working on pod_network_connectivity_checks task. I1001 02:13:49.743669 1 tasks_processing.go:71] worker 5 working on image_registries task. I1001 02:13:49.743670 1 tasks_processing.go:69] worker 29 listening for tasks. I1001 02:13:49.743674 1 tasks_processing.go:71] worker 31 working on ceph_cluster task. I1001 02:13:49.743666 1 tasks_processing.go:71] worker 52 working on clusterroles task. I1001 02:13:49.744240 1 tasks_processing.go:71] worker 29 working on nodenetworkstates task. I1001 02:13:49.743674 1 tasks_processing.go:69] worker 10 listening for tasks. I1001 02:13:49.744262 1 tasks_processing.go:71] worker 10 working on ingress task. I1001 02:13:49.743675 1 tasks_processing.go:69] worker 30 listening for tasks. I1001 02:13:49.743677 1 tasks_processing.go:71] worker 4 working on dvo_metrics task. I1001 02:13:49.743677 1 tasks_processing.go:69] worker 41 listening for tasks. I1001 02:13:49.743680 1 tasks_processing.go:71] worker 1 working on sap_config task. I1001 02:13:49.744390 1 tasks_processing.go:71] worker 56 working on openstack_dataplanenodesets task. I1001 02:13:49.744418 1 tasks_processing.go:71] worker 45 working on openshift_machine_api_events task. I1001 02:13:49.744426 1 tasks_processing.go:71] worker 48 working on image_pruners task. I1001 02:13:49.744855 1 tasks_processing.go:71] worker 51 working on service_accounts task. I1001 02:13:49.744939 1 tasks_processing.go:71] worker 30 working on metrics task. I1001 02:13:49.745018 1 tasks_processing.go:71] worker 60 working on tsdb_status task. I1001 02:13:49.744427 1 tasks_processing.go:71] worker 47 working on install_plans task. I1001 02:13:49.745236 1 tasks_processing.go:71] worker 36 working on machine_autoscalers task. I1001 02:13:49.744866 1 tasks_processing.go:71] worker 41 working on cluster_apiserver task. I1001 02:13:49.743683 1 tasks_processing.go:69] worker 42 listening for tasks. I1001 02:13:49.743731 1 tasks_processing.go:71] worker 25 working on machine_config_pools task. I1001 02:13:49.744942 1 tasks_processing.go:71] worker 40 working on sap_pods task. I1001 02:13:49.745663 1 tasks_processing.go:71] worker 42 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I1001 02:13:49.743683 1 tasks_processing.go:71] worker 7 working on nodenetworkconfigurationpolicies task. I1001 02:13:49.743681 1 tasks_processing.go:69] worker 11 listening for tasks. I1001 02:13:49.745668 1 tasks_processing.go:71] worker 62 working on operators_pods_and_events task. I1001 02:13:49.743654 1 tasks_processing.go:69] worker 26 listening for tasks. I1001 02:13:49.743692 1 tasks_processing.go:69] worker 55 listening for tasks. I1001 02:13:49.743693 1 tasks_processing.go:71] worker 21 working on operators task. I1001 02:13:49.743695 1 tasks_processing.go:71] worker 34 working on openstack_controlplanes task. I1001 02:13:49.743693 1 tasks_processing.go:71] worker 0 working on machine_healthchecks task. I1001 02:13:49.743690 1 tasks_processing.go:69] worker 59 listening for tasks. I1001 02:13:49.743699 1 tasks_processing.go:69] worker 44 listening for tasks. I1001 02:13:49.743715 1 tasks_processing.go:69] worker 46 listening for tasks. I1001 02:13:49.743672 1 tasks_processing.go:71] worker 9 working on ingress_certificates task. I1001 02:13:49.744483 1 tasks_processing.go:71] worker 57 working on lokistack task. I1001 02:13:49.743681 1 tasks_processing.go:71] worker 20 working on container_images task. I1001 02:13:49.743666 1 tasks_processing.go:71] worker 15 working on networks task. I1001 02:13:49.744873 1 tasks_processing.go:71] worker 61 working on olm_operators task. I1001 02:13:49.744878 1 tasks_processing.go:71] worker 18 working on nodes task. I1001 02:13:49.744946 1 tasks_processing.go:71] worker 17 working on openstack_dataplanedeployments task. I1001 02:13:49.744949 1 tasks_processing.go:71] worker 27 working on jaegers task. I1001 02:13:49.746251 1 tasks_processing.go:71] worker 11 working on openstack_version task. I1001 02:13:49.746377 1 tasks_processing.go:71] worker 26 working on support_secret task. I1001 02:13:49.744953 1 tasks_processing.go:71] worker 12 working on aggregated_monitoring_cr_names task. I1001 02:13:49.744957 1 tasks_processing.go:71] worker 43 working on storage_cluster task. I1001 02:13:49.743679 1 tasks_processing.go:69] worker 53 listening for tasks. I1001 02:13:49.743684 1 tasks_processing.go:69] worker 54 listening for tasks. I1001 02:13:49.743684 1 tasks_processing.go:71] worker 49 working on feature_gates task. I1001 02:13:49.743687 1 tasks_processing.go:71] worker 32 working on validating_webhook_configurations task. I1001 02:13:49.746512 1 tasks_processing.go:71] worker 54 working on oauths task. I1001 02:13:49.746647 1 tasks_processing.go:71] worker 53 working on pdbs task. I1001 02:13:49.746650 1 tasks_processing.go:71] worker 55 working on machine_sets task. I1001 02:13:49.746755 1 tasks_processing.go:71] worker 59 working on silenced_alerts task. I1001 02:13:49.746765 1 tasks_processing.go:71] worker 44 working on node_logs task. I1001 02:13:49.746808 1 tasks_processing.go:71] worker 46 working on sap_datahubs task. E1001 02:13:49.749598 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.223.64:9094: connect: connection refused I1001 02:13:49.749611 1 tasks_processing.go:74] worker 58 stopped. E1001 02:13:49.749617 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.223.64:9094: connect: connection refused I1001 02:13:49.749624 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 5.849581ms to process 0 records E1001 02:13:49.749621 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.173.227:9091: connect: connection refused E1001 02:13:49.749632 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.173.227:9091: connect: connection refused I1001 02:13:49.749638 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 4.568986ms to process 0 records E1001 02:13:49.749635 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.223.64:9094: connect: connection refused I1001 02:13:49.749644 1 tasks_processing.go:74] worker 60 stopped. I1001 02:13:49.749646 1 tasks_processing.go:74] worker 59 stopped. E1001 02:13:49.749649 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.223.64:9094: connect: connection refused I1001 02:13:49.749655 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 2.879605ms to process 0 records E1001 02:13:49.749667 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.173.227:9091: connect: connection refused I1001 02:13:49.749680 1 tasks_processing.go:74] worker 30 stopped. E1001 02:13:49.749686 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.173.227:9091: connect: connection refused I1001 02:13:49.749697 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 4.696205ms to process 0 records I1001 02:13:49.765317 1 tasks_processing.go:74] worker 63 stopped. I1001 02:13:49.765326 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 21.563761ms to process 0 records I1001 02:13:49.765572 1 tasks_processing.go:74] worker 24 stopped. I1001 02:13:49.765637 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I1001 02:13:49.765669 1 controller.go:317] The initial operator extension status is healthy I1001 02:13:49.765678 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1001 02:13:49.765683 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1001 02:13:49.765686 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1001 02:13:49.765699 1 controller.go:458] The operator is still being initialized I1001 02:13:49.765707 1 controller.go:481] The operator is healthy I1001 02:13:49.765764 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I1001 02:13:49.765766 1 recorder.go:70] Recording config/authentication with fingerprint=57081f22640cd5de65f7381b08d4c94a4d1a5a48a1a0def2353f59cbb0857b89 I1001 02:13:49.765819 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 21.870108ms to process 1 records I1001 02:13:49.765860 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I1001 02:13:49.765877 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer W1001 02:13:49.765861 1 operator.go:287] started I1001 02:13:49.767113 1 tasks_processing.go:74] worker 3 stopped. I1001 02:13:49.767123 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 23.500461ms to process 0 records E1001 02:13:49.767129 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I1001 02:13:49.767133 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 23.035779ms to process 0 records I1001 02:13:49.767136 1 tasks_processing.go:74] worker 33 stopped. I1001 02:13:49.767148 1 tasks_processing.go:74] worker 19 stopped. I1001 02:13:49.767159 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 23.423091ms to process 0 records I1001 02:13:49.767173 1 tasks_processing.go:74] worker 31 stopped. I1001 02:13:49.767182 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 22.956859ms to process 0 records I1001 02:13:49.767189 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 22.931558ms to process 0 records I1001 02:13:49.767192 1 tasks_processing.go:74] worker 29 stopped. I1001 02:13:49.767199 1 tasks_processing.go:74] worker 56 stopped. I1001 02:13:49.767206 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 22.79353ms to process 0 records I1001 02:13:49.767563 1 tasks_processing.go:74] worker 36 stopped. I1001 02:13:49.767570 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 22.286808ms to process 0 records I1001 02:13:49.767656 1 tasks_processing.go:74] worker 25 stopped. I1001 02:13:49.767666 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 22.03139ms to process 0 records I1001 02:13:49.767679 1 tasks_processing.go:74] worker 10 stopped. I1001 02:13:49.767874 1 recorder.go:70] Recording config/ingress with fingerprint=a9f6929810638d0b2a28da33ea00ae4f54b8ee35e54082de9bd81f56c1568e6e I1001 02:13:49.767889 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 23.399958ms to process 1 records I1001 02:13:49.767937 1 recorder.go:70] Recording config/proxy with fingerprint=bd568fe6b26e5cbf62b81e749d7ad3c481a4a7e9f8b727cd43143c9bf206681f I1001 02:13:49.767944 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 24.010553ms to process 1 records E1001 02:13:49.767956 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I1001 02:13:49.767962 1 gather.go:177] gatherer "clusterconfig" function "machines" took 24.034603ms to process 0 records I1001 02:13:49.767969 1 tasks_processing.go:74] worker 22 stopped. I1001 02:13:49.767978 1 tasks_processing.go:74] worker 39 stopped. I1001 02:13:49.768042 1 tasks_processing.go:74] worker 2 stopped. I1001 02:13:49.768964 1 recorder.go:70] Recording config/infrastructure with fingerprint=da56cead4b48e48ee54fd19cbedb58b6b65373376f89381372b1b04c0fd96404 I1001 02:13:49.768984 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 24.06556ms to process 1 records I1001 02:13:49.769072 1 tasks_processing.go:74] worker 48 stopped. I1001 02:13:49.769788 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=90e6f1635cb5aa95ff03df9aa19dcff2e9a733c98efaedccc1a9bd997b17999d I1001 02:13:49.769806 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 23.013223ms to process 1 records I1001 02:13:49.769885 1 tasks_processing.go:74] worker 41 stopped. I1001 02:13:49.769902 1 recorder.go:70] Recording config/apiserver with fingerprint=2c8b10d2f3346de120f77554bc5519f4ed46cbcf7caa3a42632b2ebc7b4e6a6c I1001 02:13:49.769915 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 22.46317ms to process 1 records I1001 02:13:49.769921 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 21.612502ms to process 0 records I1001 02:13:49.769927 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 22.306448ms to process 0 records I1001 02:13:49.769933 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 24.166008ms to process 0 records I1001 02:13:49.769939 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 22.77505ms to process 0 records I1001 02:13:49.769940 1 tasks_processing.go:74] worker 11 stopped. I1001 02:13:49.769944 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 22.171061ms to process 0 records I1001 02:13:49.769947 1 tasks_processing.go:74] worker 17 stopped. I1001 02:13:49.769949 1 tasks_processing.go:74] worker 45 stopped. I1001 02:13:49.769952 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 25.088051ms to process 0 records I1001 02:13:49.769955 1 tasks_processing.go:74] worker 34 stopped. I1001 02:13:49.769956 1 tasks_processing.go:74] worker 43 stopped. I1001 02:13:49.769957 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 24.189867ms to process 0 records I1001 02:13:49.769959 1 tasks_processing.go:74] worker 35 stopped. I1001 02:13:49.769963 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 23.697641ms to process 0 records I1001 02:13:49.769965 1 tasks_processing.go:74] worker 7 stopped. I1001 02:13:49.769970 1 tasks_processing.go:74] worker 27 stopped. I1001 02:13:49.770095 1 tasks_processing.go:74] worker 38 stopped. I1001 02:13:49.770193 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=ec926ba8310e07252ebe0aa387f2204c8898206019827ecc587f69c495511f87 I1001 02:13:49.770212 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=b8466ba6ce5e4e59d4fab934f389667e0b7a8af4bd72be0a3e77e7b9f7d3d4b7 I1001 02:13:49.770217 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 26.341614ms to process 2 records I1001 02:13:49.770284 1 tasks_processing.go:74] worker 6 stopped. I1001 02:13:49.770374 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=04df77fcec878547a973da664d39c9303e224e8891b9ce12b08720f5073eb27e I1001 02:13:49.770397 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 26.673555ms to process 1 records I1001 02:13:49.770405 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 25.971283ms to process 0 records W1001 02:13:49.770374 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1001 02:13:49.770460 1 recorder.go:70] Recording config/image with fingerprint=8e916af0c0385bbb0fc61ff108e944e94727d4ab4c76e1347ec292f0e1473555 I1001 02:13:49.770465 1 tasks_processing.go:74] worker 50 stopped. I1001 02:13:49.770468 1 tasks_processing.go:74] worker 1 stopped. I1001 02:13:49.770469 1 gather.go:177] gatherer "clusterconfig" function "image" took 26.297183ms to process 1 records I1001 02:13:49.771628 1 tasks_processing.go:74] worker 14 stopped. I1001 02:13:49.771736 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=c80e6fbdad8dfcc539b0534fe2c8831361293bfd0ecfd63c9e2e664a653f8158 I1001 02:13:49.771755 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=bfb3e39f31ea938657fbaba0a5a9bcc2f58cdc30c9faafc92ce47d7f4e2617dc I1001 02:13:49.771770 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=df4321dc50eec5e0110032fa8e648c4349f15bc04151685859722312bde046f8 I1001 02:13:49.771775 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 27.873873ms to process 3 records I1001 02:13:49.771854 1 tasks_processing.go:74] worker 18 stopped. I1001 02:13:49.771983 1 recorder.go:70] Recording config/node/ip-10-0-134-228.ec2.internal with fingerprint=017cacdcbcec5cb8b2c144d8fefc49589c60df193154e1a46dae524554aac101 I1001 02:13:49.772020 1 recorder.go:70] Recording config/node/ip-10-0-150-177.ec2.internal with fingerprint=5ec5881c8ccf6a900d5e295918f369b5c41bd2dca78a06dfc484acdfca481c5b I1001 02:13:49.772051 1 recorder.go:70] Recording config/node/ip-10-0-163-184.ec2.internal with fingerprint=ef1e3f1c7ee2e67b4f48c343eae4fbfe00cf21573c02ddc8abe58944e6045de4 I1001 02:13:49.772058 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 25.768259ms to process 3 records I1001 02:13:49.772076 1 tasks_processing.go:74] worker 8 stopped. I1001 02:13:49.772088 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 28.36292ms to process 0 records I1001 02:13:49.772153 1 tasks_processing.go:74] worker 37 stopped. I1001 02:13:49.772178 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I1001 02:13:49.772190 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 28.159628ms to process 1 records I1001 02:13:49.772266 1 tasks_processing.go:74] worker 5 stopped. I1001 02:13:49.772548 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=9b75c783bafd6f021b0cce88bf4ddf748a7cf1202df3071627a0b4b9fbdbbae6 I1001 02:13:49.772558 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 28.076297ms to process 1 records I1001 02:13:49.773652 1 tasks_processing.go:74] worker 40 stopped. I1001 02:13:49.773664 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 27.980802ms to process 0 records I1001 02:13:49.778520 1 tasks_processing.go:74] worker 55 stopped. I1001 02:13:49.778532 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 31.832379ms to process 0 records I1001 02:13:49.778962 1 tasks_processing.go:74] worker 57 stopped. I1001 02:13:49.778972 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 33.102509ms to process 0 records I1001 02:13:49.778988 1 tasks_processing.go:74] worker 46 stopped. I1001 02:13:49.778998 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 32.15741ms to process 0 records I1001 02:13:49.779005 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 32.22162ms to process 0 records I1001 02:13:49.779011 1 tasks_processing.go:74] worker 44 stopped. I1001 02:13:49.779027 1 tasks_processing.go:74] worker 0 stopped. E1001 02:13:49.779037 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I1001 02:13:49.779042 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 33.19753ms to process 0 records I1001 02:13:49.780603 1 tasks_processing.go:74] worker 49 stopped. I1001 02:13:49.780721 1 recorder.go:70] Recording config/featuregate with fingerprint=87bea83484166814cbb4cc1371decfbaa2ca7e590a4594cfe793f0e833b8b7a1 I1001 02:13:49.780734 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 34.070943ms to process 1 records I1001 02:13:49.780819 1 tasks_processing.go:74] worker 54 stopped. I1001 02:13:49.780982 1 recorder.go:70] Recording config/oauth with fingerprint=0bfb617e287fe8ab4a21e6bdf4eebc6a233a17e5b5a248e7e009812f7fad750e I1001 02:13:49.780993 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 34.120679ms to process 1 records I1001 02:13:49.781170 1 tasks_processing.go:74] worker 15 stopped. I1001 02:13:49.781288 1 recorder.go:70] Recording config/network with fingerprint=8121a645ae64e22f88918b88132f9e3b5643ae05c24342afe14eb55694e2435c I1001 02:13:49.781301 1 gather.go:177] gatherer "clusterconfig" function "networks" took 35.291097ms to process 1 records I1001 02:13:49.781387 1 tasks_processing.go:74] worker 26 stopped. E1001 02:13:49.781400 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I1001 02:13:49.781408 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 34.885127ms to process 0 records I1001 02:13:49.782670 1 tasks_processing.go:74] worker 16 stopped. E1001 02:13:49.782684 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I1001 02:13:49.782716 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I1001 02:13:49.782724 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 38.988555ms to process 1 records I1001 02:13:49.784927 1 tasks_processing.go:74] worker 61 stopped. I1001 02:13:49.784937 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 39.045339ms to process 0 records I1001 02:13:49.788047 1 tasks_processing.go:74] worker 52 stopped. I1001 02:13:49.788152 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I1001 02:13:49.788196 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1001 02:13:49.788220 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1001 02:13:49.788236 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1001 02:13:49.788256 1 controller.go:203] Source scaController *sca.Controller is not ready I1001 02:13:49.788288 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=4a627db4e7dc8fb70f4b8a833f833e91135619d073b1fc7c91df2cc2dceaea78 I1001 02:13:49.788294 1 controller.go:458] The operator is still being initialized I1001 02:13:49.788427 1 controller.go:481] The operator is healthy I1001 02:13:49.788424 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=8c5d4f12959fb0dedaa0f86c40bc3603abd0ada42c3b46cea4aaa64b6875fc4a I1001 02:13:49.788442 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 43.824269ms to process 2 records I1001 02:13:49.798041 1 tasks_processing.go:74] worker 23 stopped. I1001 02:13:49.798392 1 recorder.go:70] Recording config/version with fingerprint=fc49bfce916fca63d76d995df3b09e32888a9edc258add420d489166465004ad I1001 02:13:49.798402 1 recorder.go:70] Recording config/id with fingerprint=3ecfa74d1f3d34e0f682c19f4d4b0db62f737e3d85e0c714ba04528ec7e561db I1001 02:13:49.798407 1 gather.go:177] gatherer "clusterconfig" function "version" took 54.186559ms to process 2 records I1001 02:13:49.799745 1 tasks_processing.go:74] worker 53 stopped. I1001 02:13:49.799818 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=9bd7ed31d9dc45a3231c61e81a9ed1fa65ae4432bf92d6f2f4ad4d58fa5ae65d I1001 02:13:49.799834 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=125c0eb51630e51f327c2cfd291bf130280fdeb714f1dcf4dd0440d920685b87 I1001 02:13:49.799845 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=d2e37620c7b3be85aa797c4c4029963e1df5c8bb1e12c542ba5b1a60751ffe51 I1001 02:13:49.799856 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=f79745789c65130fc68e35d19c22ed9d2eb515dadfee7f2a426a960459ec2c68 I1001 02:13:49.799867 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=072296e8aacc0082e00bce092047ae1a5207c61cd523659abd3cb9f5a47e55ac I1001 02:13:49.799878 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/metrics-server with fingerprint=2c56d04ccc0f24c6dda8c9e27809f735688be81265c35d5f8a7ab5ec324d60dd I1001 02:13:49.799887 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=bee90dc97667f0d03c7c167806b4f57739d4132c529ec2b90ed5dd17746cde32 I1001 02:13:49.799899 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=40bbaf298cd0449d93787528af011be36cc7d0a0746d8798a2790444e7eabcba I1001 02:13:49.799908 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=9a6b6a7e1fa250b2a48c4244b3b6362760df8d899e4b9ed0cb1f071cf47386d5 I1001 02:13:49.799917 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=390244e699679fd0a40b92f01f2f7de058461c4300f9c6d0ed71c2d24a197767 I1001 02:13:49.800085 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=e438bae2cac35c8cd4686d4585f62c2644fe156639727e04b0707f42fad82930 I1001 02:13:49.800101 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 53.080962ms to process 11 records I1001 02:13:49.805688 1 tasks_processing.go:74] worker 32 stopped. I1001 02:13:49.805788 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=281ff0c8d9326ff86acd586ddd382c5207718a20fed99ef2eec909344db840fc I1001 02:13:49.805838 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=17c2c45af306af243fad216e15f553220e305193480edea46f414b2d1dcb30df I1001 02:13:49.805884 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=a6b27c310238c580a40a3a3c123f2276b975125bf5216b429804abc87bc0590d I1001 02:13:49.805900 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=eea22e1e75e93dab18054b095ae9bac148f5ecfb0506ec70e358f308256e4ad5 I1001 02:13:49.805912 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=9c50e2917e2d9e7f23a36a39efaa2e8263fcdef7a44a7d1cebb2517c9b3e6f3c I1001 02:13:49.805925 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=5409820196c9b3e4b7e4814fb6fc8a6446ec4284f299dad366b91a8688ad5784 I1001 02:13:49.805939 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=3b337e87fdf05c6ab24fe8e352e8d78ebf4e3c7d0e1205689afe0e7d67bd23a8 I1001 02:13:49.805954 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=ee46637e4c62c42ceb691db89a6e10b0ca140c86147cafaf544ecb6494b4a339 I1001 02:13:49.805965 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=a9506f16163688b9218a11b1dc3f0f4dc6687e643a9aa1688f89d5895b463b0d I1001 02:13:49.805985 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=5c3611432a0ba05cf6bcb3e876e51db5e86ed6ba6752e3135d2e79aa981c927d I1001 02:13:49.805999 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=87579cd39ecf84b29a70d8b4330222396103f901f8d826dc642dfe9a93e26568 I1001 02:13:49.806013 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=637111333deb109c9b284d206dc3b9d6fe4cb5a5aac9d763d8c6f578007bbff5 I1001 02:13:49.806028 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=0c0afa6251a7b8986326a61a54ac82293464881becf807cf4783e83efa5d9f7a I1001 02:13:49.806035 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 59.245971ms to process 13 records I1001 02:13:49.806133 1 tasks_processing.go:74] worker 28 stopped. I1001 02:13:49.806426 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=3b8d53b7ab07d4ec9946f06cbfc39dbfad1cce55df8fe161ce61bee00a336a58 I1001 02:13:49.806578 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=00a8d06fac2a6fa13a489cba9c2dc9916442de934b4e0e6f6166077d04cb82d3 I1001 02:13:49.806589 1 gather.go:177] gatherer "clusterconfig" function "crds" took 62.126261ms to process 2 records I1001 02:13:49.810964 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1001 02:13:49.811152 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1001 02:13:49.811150 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I1001 02:13:49.815923 1 base_controller.go:82] Caches are synced for ConfigController I1001 02:13:49.815936 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I1001 02:13:49.821425 1 tasks_processing.go:74] worker 12 stopped. I1001 02:13:49.821440 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 74.873705ms to process 0 records I1001 02:13:49.821767 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I1001 02:13:49.822566 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 02:13:49.823206 1 tasks_processing.go:74] worker 20 stopped. I1001 02:13:49.824236 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-kj4b2 with fingerprint=45b35e5f7083ef2b57d164f290fc5fe76fc623bfbd3e404dfadf3191ae6a59d6 I1001 02:13:49.824292 1 recorder.go:70] Recording config/pod/openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-150-177.ec2.internal with fingerprint=ded4ecc36ffb2906b01eb37d0a15a41f20a8840a42d311839ce7c6d706bc941c I1001 02:13:49.824360 1 recorder.go:70] Recording config/running_containers with fingerprint=83c92793611bff27282d99976cf3d3479cf379fd074d90f799c209e6c5013676 I1001 02:13:49.824370 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 77.307258ms to process 3 records I1001 02:13:49.824946 1 tasks_processing.go:74] worker 13 stopped. E1001 02:13:49.824957 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E1001 02:13:49.824961 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E1001 02:13:49.824963 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I1001 02:13:49.824969 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I1001 02:13:49.824993 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I1001 02:13:49.825000 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I1001 02:13:49.825003 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I1001 02:13:49.825009 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I1001 02:13:49.825039 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I1001 02:13:49.825045 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I1001 02:13:49.825049 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 81.212846ms to process 7 records I1001 02:13:49.825460 1 tasks_processing.go:74] worker 42 stopped. I1001 02:13:49.825473 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 79.767759ms to process 0 records I1001 02:13:49.830157 1 tasks_processing.go:74] worker 9 stopped. E1001 02:13:49.830166 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E1001 02:13:49.830171 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2t5mt58eht1q6nosrbag33iqdnqc206h-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2t5mt58eht1q6nosrbag33iqdnqc206h-primary-cert-bundle-secret" not found I1001 02:13:49.830206 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=e6ed6c0f9fc609de0d4d1e5ed30ce3e949eb82c969371c8a0ba55f8123e31da9 I1001 02:13:49.830215 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 84.297319ms to process 1 records I1001 02:13:49.866807 1 base_controller.go:82] Caches are synced for LoggingSyncer I1001 02:13:49.866819 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I1001 02:13:49.868522 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I1001 02:13:49.869370 1 cluster_transfer.go:102] no available accepted cluster transfer I1001 02:13:49.869384 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I1001 02:13:49.871615 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress" I1001 02:13:49.877635 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-5dd46cb9d9-rp4l2 pod in namespace openshift-ingress (previous: false). I1001 02:13:49.890621 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-7f869476d9-zsmlp pod in namespace openshift-ingress (previous: false). I1001 02:13:49.901834 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-525ds pod in namespace openshift-ingress-canary (previous: false). I1001 02:13:49.932176 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-drfj7 pod in namespace openshift-ingress-canary (previous: false). I1001 02:13:50.020551 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-sjghd pod in namespace openshift-ingress-canary (previous: false). I1001 02:13:50.113944 1 sca.go:266] etc-pki-entitlement secret successfully created I1001 02:13:50.113956 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I1001 02:13:50.223095 1 tasks_processing.go:74] worker 62 stopped. I1001 02:13:50.223181 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=b1831dc69dc5cec47fcb81494f21fbce58472c2039ff19d39f15b49a64284d3e I1001 02:13:50.223230 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=fdb4e638743c900d869a239aa0acfb7325f44737cec4fa0d39ca32d6dab9217e I1001 02:13:50.223255 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=e831b92709ce6ef840eb1f5e76a899c63abb6ba3b1dfc577d72781f82067c4d9 I1001 02:13:50.223271 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-5dd46cb9d9-98pzf/router_current.log with fingerprint=34c87743c2d8dfd61bea38bfb8ad9c78f1267e8a598434ced0569348e422a0d2 I1001 02:13:50.223286 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-5dd46cb9d9-rp4l2/router_current.log with fingerprint=fe029f654426f2e48acecdb0263bd484ec09754969d2dde7ef0b9ccb3c7b61fd I1001 02:13:50.223297 1 recorder.go:70] Recording config/pod/openshift-ingress/logs/router-default-7f869476d9-zsmlp/router_current.log with fingerprint=53fe6ed655e7cb2a40953b3618f49c09717153ea958e1ec591af9d2a5880c2fb I1001 02:13:50.223300 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-525ds/serve-healthcheck-canary_current.log with fingerprint=cd854382b6c11967d329dff320d59f2c560a339d8a991fdd888072e1f32a0021 I1001 02:13:50.223303 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-drfj7/serve-healthcheck-canary_current.log with fingerprint=0072eeac4a5cdc5898574b655cb36993506115b2a3cc6492363fe8e91f86ce1f I1001 02:13:50.223323 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/logs/ingress-canary-sjghd/serve-healthcheck-canary_current.log with fingerprint=b0c814aaada4510539b4672df693b2a9a553854416682a2cad450e343d283ab3 I1001 02:13:50.223331 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 477.315194ms to process 9 records I1001 02:13:50.624508 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W1001 02:13:50.770289 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1001 02:13:50.824581 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W1001 02:13:51.769699 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1001 02:13:52.229152 1 tasks_processing.go:74] worker 21 stopped. I1001 02:13:52.229250 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=d5fcfcb7dd0c3f390b5967754a2faf281625778e718f290a4a3db3ead358939a I1001 02:13:52.229292 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I1001 02:13:52.229311 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=ae8ea25b6ec4d71ac7605ac9a6f5a927729c1250a431ef2b742430bbfc84d549 I1001 02:13:52.229320 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I1001 02:13:52.229335 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=41919f4375a55b23ca9a4a63c7669a64a1ab275adacd8482884794df284cbdae I1001 02:13:52.229366 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I1001 02:13:52.229384 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=85c983e025191fe7e294957b8e3479136131ca4429945d0eef7501cfbbfb25a6 I1001 02:13:52.229402 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=8e1273d9cb4923ee2a2622e88330a8d089235679c614510015157b71e5d1d586 I1001 02:13:52.229422 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=9b8c3ac5fbe414e7be9830fc18b9243fe880982069e6abfc3879fc90d2c5b0ad I1001 02:13:52.229442 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=20d15a1478e0f5faa356e282a437b833487decc513569fe7e0efd504240af2a9 I1001 02:13:52.229628 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=42261825bc8083f32158b66ca80d54b105271aa7fb5e463ce253a4ac87e98602 I1001 02:13:52.229642 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=0b52c699eaa366e6ce8f5e0b7f21328cd9aa211a82fa40a431808e0780953255 I1001 02:13:52.229650 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I1001 02:13:52.229661 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=f951aca92f40993dc307f3fb205a9844a4e58747c80c83d5887e55d5c11d569d I1001 02:13:52.229670 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I1001 02:13:52.229679 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=2880dac573cb95b359a4fef2367d5c2db8e94f8832e7c14b905305bcf56d274c I1001 02:13:52.229687 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I1001 02:13:52.229698 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=e79c165138bc6c4d49f67931ffb729103247f1120ece965a0c117246f0d4cb86 I1001 02:13:52.229706 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I1001 02:13:52.229718 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=43dc78c573879e32daf7e2d5c5b5c5886338d85c9d065130c6b5820eaeea61cc I1001 02:13:52.229773 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=17b189e3bd17132adc0bb7d8af88f4020f8bf49c14667ab47c4a33c1e9fc51a8 I1001 02:13:52.229792 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I1001 02:13:52.229806 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=1cb00e54c93dc850db730540b7f10c1c830ae447f0129f1b21f1568b3425a06a I1001 02:13:52.229821 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=b337b90dc91a33adb171c25d37fbe0672ce4f9bdd8df2c584413f0db5cad59dd I1001 02:13:52.229830 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I1001 02:13:52.229839 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=d0cf4686ba52f27488ad126bc83a104bfe2e0bb0533aed9ac1a6c361afc63525 I1001 02:13:52.229847 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I1001 02:13:52.229858 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=bc67adb39028b1ad0a32d218ddf8161b41a412f36f83e20bfd4a78cfc4526a73 I1001 02:13:52.229868 1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I1001 02:13:52.229877 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=261ce8eaef5a3a2a453833da8d9b38f258431caa3ad10b759c712d112242917c I1001 02:13:52.229888 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=87c1884287425c4fb994250f09b9131bd1775afa1f2251ee4ea341b8a359eedf I1001 02:13:52.229899 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=9f8a5ee3d4b8e37329b5cd2ea94ad59ce9f5db2e29c122dc271b93506469a2b4 I1001 02:13:52.229911 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=0d284afa2c11383151b6f6d0fd21ed54428d7adf7c32c67e13ab96da573df946 I1001 02:13:52.229925 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I1001 02:13:52.229953 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=decdec026b26c6009e5763f9e75d7965a86d993101cd00ed2d4e1103d49a9fa0 I1001 02:13:52.229968 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I1001 02:13:52.229977 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I1001 02:13:52.229983 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.483319767s to process 37 records W1001 02:13:52.770432 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W1001 02:13:53.770273 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W1001 02:13:54.767946 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I1001 02:13:54.767970 1 tasks_processing.go:74] worker 4 stopped. E1001 02:13:54.767988 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I1001 02:13:54.768002 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I1001 02:13:54.768015 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.023655317s to process 1 records I1001 02:14:02.778574 1 tasks_processing.go:74] worker 47 stopped. I1001 02:14:02.778613 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I1001 02:14:02.778629 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.033396906s to process 1 records I1001 02:14:03.553612 1 tasks_processing.go:74] worker 51 stopped. I1001 02:14:03.553827 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=8d7634ec7e79b5bc851f26f32aebd5dad854fd11e42dde9b5852dfaf215bb193 I1001 02:14:03.553844 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.808704616s to process 1 records E1001 02:14:03.553905 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.81s with: function \"active_alerts\" failed with an error, function \"tsdb_status\" failed with an error, function \"silenced_alerts\" failed with an error, function \"metrics\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I1001 02:14:03.555004 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "active_alerts" failed with an error, function "tsdb_status" failed with an error, function "silenced_alerts" failed with an error, function "metrics" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I1001 02:14:03.555016 1 periodic.go:212] Running workloads gatherer I1001 02:14:03.555031 1 tasks_processing.go:45] number of workers: 2 I1001 02:14:03.555041 1 tasks_processing.go:69] worker 1 listening for tasks. I1001 02:14:03.555045 1 tasks_processing.go:71] worker 1 working on workload_info task. I1001 02:14:03.555109 1 tasks_processing.go:69] worker 0 listening for tasks. I1001 02:14:03.555191 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I1001 02:14:03.562161 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-134-228.ec2.internal... I1001 02:14:03.562172 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-163-184.ec2.internal... I1001 02:14:03.562180 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-150-177.ec2.internal... I1001 02:14:03.583939 1 tasks_processing.go:74] worker 0 stopped. I1001 02:14:03.583953 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 28.727003ms to process 0 records I1001 02:14:07.307007 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 4s I1001 02:14:07.347075 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 24s for image data I1001 02:14:07.356449 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (10ms) I1001 02:14:07.365430 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (9ms) I1001 02:14:07.373894 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (8ms) I1001 02:14:07.382103 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (8ms) I1001 02:14:07.390474 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (8ms) I1001 02:14:07.398307 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (8ms) I1001 02:14:07.406386 1 gather_workloads_info.go:387] No image sha256:6277dac65decba0ea094146bb99600f479eaf804696842e724de1f1b436f9a38 (8ms) I1001 02:14:07.414698 1 gather_workloads_info.go:387] No image sha256:a3d34d8f38a540ce79d34a5248b1965346155497db57b72cb4758d659418059c (8ms) I1001 02:14:07.426123 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (11ms) I1001 02:14:07.435185 1 gather_workloads_info.go:387] No image sha256:e40bbab1e52f580ab471bd7ab19ae23a4bcbaf1893243a05238af6bede7ba9cc (9ms) I1001 02:14:07.458026 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (23ms) I1001 02:14:07.555585 1 gather_workloads_info.go:387] No image sha256:68d8e92046969bcfcbca2d2b3dcf4dcad5f6edc5fcb44861eb22f8079a43ea4d (98ms) I1001 02:14:07.656325 1 gather_workloads_info.go:387] No image sha256:38dd36da63b1f01316a02daf6c18b821318c6ec313712147292d74abf955e0da (101ms) I1001 02:14:07.756188 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (100ms) I1001 02:14:07.855627 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (99ms) I1001 02:14:07.956225 1 gather_workloads_info.go:387] No image sha256:46c2c396ca651699738c3f26b79b10af2922123dd27c2e32382d2a31a87e92c7 (101ms) I1001 02:14:08.056307 1 gather_workloads_info.go:398] Found image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (100ms) I1001 02:14:08.156031 1 gather_workloads_info.go:387] No image sha256:270a7bac889ed64d75ce11ae26e8634a6209ff718b83fae2c888cfc758316aa3 (100ms) I1001 02:14:08.255880 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (100ms) I1001 02:14:08.356527 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (101ms) I1001 02:14:08.455565 1 gather_workloads_info.go:387] No image sha256:1f2aa1e1026570162984f7fbb634635bcf319e408cafa8f9034ee842a2f193ab (99ms) I1001 02:14:08.556134 1 gather_workloads_info.go:387] No image sha256:7854174b4b98e9b10d9c8e9b43113df1217ab21db4b2395d9399af0c3d7911a3 (101ms) I1001 02:14:08.655915 1 gather_workloads_info.go:387] No image sha256:1d471ad866b8564b209214d7dd3a7363c47e9535211d660b63b46abb278af7ab (100ms) I1001 02:14:08.757521 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (102ms) I1001 02:14:08.856287 1 gather_workloads_info.go:387] No image sha256:039479f355d6903e1018abf8427fece3465c4348d4de2144ec38114b51bec27e (99ms) I1001 02:14:08.955507 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (99ms) I1001 02:14:09.056732 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (101ms) I1001 02:14:09.160411 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (104ms) I1001 02:14:09.256274 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (96ms) I1001 02:14:09.356062 1 gather_workloads_info.go:387] No image sha256:5cba745f09f3bd6b8028c6773597cbb30bf3639a84f2b4b6493fe20642339a2c (100ms) I1001 02:14:09.455584 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (100ms) I1001 02:14:09.556521 1 gather_workloads_info.go:398] Found image sha256:59db91eadf1e1e5343777be43ff25fb712f300f9341be48ba05f45270944536f (101ms) I1001 02:14:09.656651 1 gather_workloads_info.go:387] No image sha256:099b3af427b8e1eb44765283a640446c3225151baa06eed789623206151a60cd (100ms) I1001 02:14:09.755609 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (99ms) I1001 02:14:09.856526 1 gather_workloads_info.go:387] No image sha256:bcca5c17371caa2dce7e28da4c9fe30163c340fa172187f94db90ea1bd6ab80d (101ms) I1001 02:14:09.956069 1 gather_workloads_info.go:387] No image sha256:798001e24f1ed6a5621c442729a840ba2a2abc43433901e8450caa12b4bad5c5 (100ms) I1001 02:14:10.056259 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (100ms) I1001 02:14:10.157967 1 gather_workloads_info.go:387] No image sha256:1cc2f3c83068c8c67d9070f67677e1bb6b4feff7ac5744cad08711893e56b55f (102ms) I1001 02:14:10.257260 1 gather_workloads_info.go:387] No image sha256:ce3d8211c0bde5788a4fd04c3eff31ae591437ceab2b3168dbbdfe408673c8b1 (99ms) I1001 02:14:10.358326 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (101ms) I1001 02:14:10.457485 1 gather_workloads_info.go:387] No image sha256:527ed405bf66234718321996dacf51f91c64c746de9f1509416ef6ce89c90a50 (99ms) I1001 02:14:10.556009 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (99ms) I1001 02:14:10.655359 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (99ms) I1001 02:14:10.756078 1 gather_workloads_info.go:387] No image sha256:799f5628c18e77a49c08645c03179046b5200c8cbcfd65737fb59668132f393e (101ms) I1001 02:14:10.855546 1 gather_workloads_info.go:387] No image sha256:929a4a9c96a08b57fe4c315deca55c30d1990c83e34b8b5692f7646d29f715c8 (99ms) I1001 02:14:10.957013 1 gather_workloads_info.go:387] No image sha256:6c3c7f77d7a3815bbb69cad5f6f1742c17d9597bc135ba3d116c9736d98fae33 (101ms) I1001 02:14:11.055662 1 gather_workloads_info.go:387] No image sha256:00f977c2275f5bf03d423911159a39ca44fabc1862ecb7ae492198ec8c46c6bb (99ms) I1001 02:14:11.055689 1 tasks_processing.go:74] worker 1 stopped. I1001 02:14:11.055912 1 recorder.go:70] Recording config/workload_info with fingerprint=d3c77e2d4ef13abc550d52ed27d7e87b0252170775afe8d5409f0193e4c5e71e I1001 02:14:11.055929 1 gather.go:177] gatherer "workloads" function "workload_info" took 7.500635253s to process 1 records I1001 02:14:11.055942 1 periodic.go:259] Periodic gather workloads completed in 7.5s I1001 02:14:11.055950 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I1001 02:14:11.055953 1 periodic.go:212] Running conditional gatherer I1001 02:14:11.066018 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I1001 02:14:11.206263 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer E1001 02:14:11.208507 1 conditional_gatherer.go:322] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.173.227:9091: connect: connection refused I1001 02:14:11.208569 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I1001 02:14:11.218332 1 conditional_gatherer.go:390] cluster version is '4.19.9' E1001 02:14:11.218428 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 02:14:11.218451 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 02:14:11.218466 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 02:14:11.218500 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 02:14:11.218516 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 02:14:11.218532 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 02:14:11.218547 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 02:14:11.218579 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 02:14:11.218595 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1001 02:14:11.218613 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I1001 02:14:11.218655 1 tasks_processing.go:45] number of workers: 3 I1001 02:14:11.218672 1 tasks_processing.go:69] worker 2 listening for tasks. I1001 02:14:11.218677 1 tasks_processing.go:71] worker 2 working on remote_configuration task. I1001 02:14:11.218748 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I1001 02:14:11.218774 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 1.411µs to process 1 records I1001 02:14:11.218786 1 tasks_processing.go:69] worker 0 listening for tasks. I1001 02:14:11.218790 1 tasks_processing.go:69] worker 1 listening for tasks. I1001 02:14:11.218796 1 tasks_processing.go:74] worker 1 stopped. I1001 02:14:11.218800 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I1001 02:14:11.218810 1 tasks_processing.go:74] worker 2 stopped. I1001 02:14:11.218814 1 tasks_processing.go:71] worker 0 working on rapid_container_logs task. I1001 02:14:11.218934 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I1001 02:14:11.218953 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 910ns to process 1 records I1001 02:14:11.219356 1 tasks_processing.go:74] worker 0 stopped. I1001 02:14:11.219372 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 480.289µs to process 0 records I1001 02:14:11.219386 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I1001 02:14:11.219393 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I1001 02:14:11.246761 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=f82326131ff6b7e77e7865bdf703b098087bdbbc9f1feb7e1459e727ed18d361 I1001 02:14:11.246868 1 diskrecorder.go:70] Writing 116 records to /var/lib/insights-operator/insights-2026-10-01-021411.tar.gz I1001 02:14:11.252995 1 diskrecorder.go:51] Wrote 116 records to disk in 6ms I1001 02:14:11.253018 1 periodic.go:281] Gathering cluster info every 2h0m0s I1001 02:14:11.253033 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I1001 02:15:19.743966 1 diskrecorder.go:223] Found files to send: insights-2026-10-01-021411.tar.gz I1001 02:15:19.743993 1 insightsuploader.go:150] Checking archives to upload periodically every 16m13.575783479s I1001 02:15:19.744002 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I1001 02:15:19.757310 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I1001 02:15:19.890547 1 requests.go:87] Successfully reported id=2026-10-01T02:15:19Z x-rh-insights-request-id=99b910488e1149958b13b19cb03a9121, wrote=59210 I1001 02:15:19.890670 1 insightsuploader.go:187] Uploaded report successfully in 146.653636ms I1001 02:15:19.890692 1 controller.go:119] Initializing last reported time to 2026-10-01T02:15:19Z I1001 02:15:19.890765 1 insightsreport.go:304] Archive uploaded, starting pulling report... I1001 02:15:19.890776 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I1001 02:15:19.890783 1 insightsreport.go:221] Initial delay for pulling: 1m0s I1001 02:15:19.896778 1 controller.go:481] The operator is healthy I1001 02:15:49.772796 1 controller.go:481] The operator is healthy I1001 02:16:20.603012 1 insightsreport.go:137] Pulling report from smart-proxy I1001 02:16:20.603035 1 insightsreport.go:149] Retrieving report I1001 02:16:20.613070 1 requests.go:110] Retrieving report for cluster: 4ea4e338-755a-4a35-9c4d-579c25b1cf17 I1001 02:16:20.613083 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/4ea4e338-755a-4a35-9c4d-579c25b1cf17/reports I1001 02:16:20.616198 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/4ea4e338-755a-4a35-9c4d-579c25b1cf17/reports I1001 02:16:20.906185 1 insightsreport.go:184] Report retrieved I1001 02:16:20.952834 1 insightsreport.go:239] Report retrieved correctly I1001 02:17:49.772489 1 controller.go:481] The operator is healthy I1001 02:18:49.737366 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1001 02:18:49.746969 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1001 02:18:49.747004 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1001 02:18:49.751543 1 secretconfigobserver.go:119] support secret does not exist I1001 02:19:49.773144 1 controller.go:481] The operator is healthy I1001 02:21:49.775600 1 controller.go:481] The operator is healthy I1001 02:23:49.730746 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 02:23:49.735123 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 02:23:49.752219 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1001 02:23:49.757051 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1001 02:23:49.757064 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1001 02:23:49.761527 1 secretconfigobserver.go:119] support secret does not exist I1001 02:23:49.772104 1 controller.go:481] The operator is healthy I1001 02:25:49.776390 1 controller.go:481] The operator is healthy I1001 02:27:49.776491 1 controller.go:481] The operator is healthy I1001 02:28:49.762149 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1001 02:28:49.780356 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1001 02:28:49.780385 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1001 02:28:49.787386 1 secretconfigobserver.go:119] support secret does not exist I1001 02:29:49.776989 1 controller.go:481] The operator is healthy I1001 02:31:38.468439 1 insightsuploader.go:146] Nothing to report since 2026-10-01T02:15:19Z I1001 02:31:49.776893 1 controller.go:481] The operator is healthy I1001 02:33:49.732268 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 02:33:49.737385 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 02:33:49.772973 1 controller.go:481] The operator is healthy I1001 02:33:49.788112 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1001 02:33:49.792983 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1001 02:33:49.793000 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1001 02:33:49.797475 1 secretconfigobserver.go:119] support secret does not exist I1001 02:35:49.775745 1 controller.go:481] The operator is healthy I1001 02:37:49.774541 1 controller.go:481] The operator is healthy I1001 02:38:49.798353 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1001 02:38:49.803781 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1001 02:38:49.803798 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1001 02:38:49.808121 1 secretconfigobserver.go:119] support secret does not exist I1001 02:39:49.776305 1 controller.go:481] The operator is healthy I1001 02:41:49.772784 1 controller.go:481] The operator is healthy I1001 02:43:49.734112 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 02:43:49.738614 1 configmapobserver.go:84] configmaps "insights-config" not found I1001 02:43:49.772223 1 controller.go:481] The operator is healthy I1001 02:43:49.808317 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1001 02:43:49.812872 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1001 02:43:49.812889 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1001 02:43:49.819922 1 secretconfigobserver.go:119] support secret does not exist I1001 02:45:49.775429 1 controller.go:481] The operator is healthy I1001 02:46:44.513638 1 insightsuploader.go:146] Nothing to report since 2026-10-01T02:15:19Z I1001 02:47:49.774731 1 controller.go:481] The operator is healthy