I1002 02:25:18.199703 1 cmd.go:253] Using service-serving-cert provided certificates I1002 02:25:18.200065 1 observer_polling.go:159] Starting file observer W1002 02:25:18.226767 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I1002 02:25:18.539535 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I1002 02:25:18.539703 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I1002 02:25:18.540154 1 secure_serving.go:57] Forcing use of http/1.1 only W1002 02:25:18.540177 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W1002 02:25:18.540181 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W1002 02:25:18.540184 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W1002 02:25:18.540185 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W1002 02:25:18.540187 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W1002 02:25:18.540189 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I1002 02:25:18.540257 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I1002 02:25:18.547590 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I1002 02:25:18.547580 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I1002 02:25:18.547893 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I1002 02:25:18.547910 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I1002 02:25:18.547912 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I1002 02:25:18.547913 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I1002 02:25:18.547925 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1002 02:25:18.547927 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1002 02:25:18.548108 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I1002 02:25:18.548177 1 secure_serving.go:213] Serving securely on [::]:8443 I1002 02:25:18.548203 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" E1002 02:25:18.554613 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18da954366760eb8 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-10-02 02:25:18.547553976 +0000 UTC m=+0.379146509,LastTimestamp:2026-10-02 02:25:18.547553976 +0000 UTC m=+0.379146509,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W1002 02:25:18.557641 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I1002 02:25:18.557661 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1002 02:25:18.557764 1 base_controller.go:76] Waiting for caches to sync for ConfigController I1002 02:25:18.567466 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:25:18.567480 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1002 02:25:18.573916 1 secretconfigobserver.go:119] support secret does not exist I1002 02:25:18.581658 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:25:18.587935 1 secretconfigobserver.go:119] support secret does not exist I1002 02:25:18.589567 1 recorder.go:156] Pruning old reports every 6h19m36s, max age is 288h0m0s I1002 02:25:18.596407 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I1002 02:25:18.596414 1 periodic.go:212] Running clusterconfig gatherer I1002 02:25:18.596423 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I1002 02:25:18.596438 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I1002 02:25:18.596442 1 insightsreport.go:296] Starting report retriever I1002 02:25:18.596445 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I1002 02:25:18.596450 1 tasks_processing.go:45] number of workers: 64 I1002 02:25:18.596482 1 tasks_processing.go:69] worker 6 listening for tasks. I1002 02:25:18.596492 1 tasks_processing.go:69] worker 19 listening for tasks. I1002 02:25:18.596495 1 tasks_processing.go:69] worker 0 listening for tasks. I1002 02:25:18.596514 1 tasks_processing.go:71] worker 19 working on machine_healthchecks task. I1002 02:25:18.596515 1 tasks_processing.go:69] worker 7 listening for tasks. I1002 02:25:18.596521 1 tasks_processing.go:71] worker 7 working on cluster_apiserver task. I1002 02:25:18.596525 1 tasks_processing.go:69] worker 4 listening for tasks. I1002 02:25:18.596523 1 tasks_processing.go:69] worker 1 listening for tasks. I1002 02:25:18.596522 1 tasks_processing.go:69] worker 5 listening for tasks. I1002 02:25:18.596532 1 tasks_processing.go:69] worker 2 listening for tasks. I1002 02:25:18.596532 1 tasks_processing.go:69] worker 13 listening for tasks. I1002 02:25:18.596539 1 tasks_processing.go:69] worker 11 listening for tasks. I1002 02:25:18.596542 1 tasks_processing.go:69] worker 8 listening for tasks. I1002 02:25:18.596544 1 tasks_processing.go:69] worker 16 listening for tasks. I1002 02:25:18.596546 1 tasks_processing.go:69] worker 12 listening for tasks. I1002 02:25:18.596550 1 tasks_processing.go:69] worker 9 listening for tasks. I1002 02:25:18.596551 1 tasks_processing.go:69] worker 18 listening for tasks. I1002 02:25:18.596515 1 tasks_processing.go:69] worker 3 listening for tasks. I1002 02:25:18.596551 1 tasks_processing.go:69] worker 14 listening for tasks. I1002 02:25:18.596549 1 tasks_processing.go:69] worker 10 listening for tasks. I1002 02:25:18.596555 1 tasks_processing.go:69] worker 17 listening for tasks. I1002 02:25:18.596567 1 tasks_processing.go:69] worker 43 listening for tasks. I1002 02:25:18.596567 1 tasks_processing.go:69] worker 20 listening for tasks. I1002 02:25:18.596561 1 tasks_processing.go:69] worker 47 listening for tasks. I1002 02:25:18.596561 1 tasks_processing.go:69] worker 53 listening for tasks. I1002 02:25:18.596575 1 tasks_processing.go:69] worker 45 listening for tasks. I1002 02:25:18.596559 1 tasks_processing.go:69] worker 42 listening for tasks. I1002 02:25:18.596719 1 tasks_processing.go:69] worker 21 listening for tasks. I1002 02:25:18.596724 1 tasks_processing.go:69] worker 46 listening for tasks. I1002 02:25:18.596783 1 tasks_processing.go:69] worker 37 listening for tasks. I1002 02:25:18.596790 1 tasks_processing.go:69] worker 33 listening for tasks. I1002 02:25:18.596790 1 tasks_processing.go:69] worker 32 listening for tasks. I1002 02:25:18.596796 1 tasks_processing.go:69] worker 38 listening for tasks. I1002 02:25:18.596983 1 tasks_processing.go:69] worker 48 listening for tasks. I1002 02:25:18.597006 1 tasks_processing.go:69] worker 63 listening for tasks. I1002 02:25:18.597015 1 tasks_processing.go:69] worker 54 listening for tasks. I1002 02:25:18.597113 1 tasks_processing.go:69] worker 57 listening for tasks. I1002 02:25:18.597285 1 tasks_processing.go:69] worker 58 listening for tasks. I1002 02:25:18.597346 1 tasks_processing.go:71] worker 6 working on openstack_dataplanenodesets task. I1002 02:25:18.596868 1 tasks_processing.go:69] worker 62 listening for tasks. I1002 02:25:18.596872 1 tasks_processing.go:69] worker 60 listening for tasks. I1002 02:25:18.596916 1 tasks_processing.go:69] worker 61 listening for tasks. I1002 02:25:18.597517 1 tasks_processing.go:69] worker 22 listening for tasks. I1002 02:25:18.597525 1 tasks_processing.go:69] worker 26 listening for tasks. I1002 02:25:18.597533 1 tasks_processing.go:69] worker 31 listening for tasks. I1002 02:25:18.597532 1 tasks_processing.go:69] worker 52 listening for tasks. I1002 02:25:18.596514 1 tasks_processing.go:71] worker 0 working on openshift_logging task. I1002 02:25:18.597540 1 tasks_processing.go:69] worker 35 listening for tasks. I1002 02:25:18.597557 1 tasks_processing.go:69] worker 15 listening for tasks. I1002 02:25:18.597566 1 tasks_processing.go:71] worker 31 working on machine_configs task. I1002 02:25:18.597571 1 tasks_processing.go:71] worker 15 working on openstack_dataplanedeployments task. I1002 02:25:18.597576 1 tasks_processing.go:69] worker 23 listening for tasks. I1002 02:25:18.597618 1 tasks_processing.go:69] worker 27 listening for tasks. I1002 02:25:18.597628 1 tasks_processing.go:69] worker 30 listening for tasks. I1002 02:25:18.597630 1 tasks_processing.go:69] worker 36 listening for tasks. I1002 02:25:18.597641 1 tasks_processing.go:69] worker 28 listening for tasks. I1002 02:25:18.597658 1 tasks_processing.go:69] worker 40 listening for tasks. I1002 02:25:18.597682 1 tasks_processing.go:69] worker 24 listening for tasks. I1002 02:25:18.597691 1 tasks_processing.go:69] worker 29 listening for tasks. I1002 02:25:18.597698 1 tasks_processing.go:71] worker 10 working on monitoring_persistent_volumes task. I1002 02:25:18.597716 1 tasks_processing.go:69] worker 25 listening for tasks. I1002 02:25:18.597723 1 tasks_processing.go:69] worker 44 listening for tasks. I1002 02:25:18.597723 1 tasks_processing.go:69] worker 50 listening for tasks. I1002 02:25:18.597730 1 tasks_processing.go:71] worker 2 working on schedulers task. I1002 02:25:18.597735 1 tasks_processing.go:71] worker 18 working on networks task. I1002 02:25:18.597743 1 tasks_processing.go:71] worker 12 working on certificate_signing_requests task. I1002 02:25:18.597762 1 tasks_processing.go:71] worker 1 working on authentication task. I1002 02:25:18.597764 1 tasks_processing.go:71] worker 53 working on image_registries task. I1002 02:25:18.597796 1 tasks_processing.go:71] worker 48 working on openstack_version task. I1002 02:25:18.597835 1 tasks_processing.go:71] worker 5 working on service_accounts task. I1002 02:25:18.597915 1 tasks_processing.go:69] worker 49 listening for tasks. I1002 02:25:18.597953 1 tasks_processing.go:71] worker 35 working on pdbs task. I1002 02:25:18.597930 1 tasks_processing.go:69] worker 51 listening for tasks. I1002 02:25:18.597973 1 tasks_processing.go:71] worker 51 working on dvo_metrics task. I1002 02:25:18.598009 1 tasks_processing.go:71] worker 13 working on sap_config task. I1002 02:25:18.598017 1 tasks_processing.go:71] worker 3 working on openstack_controlplanes task. I1002 02:25:18.598018 1 tasks_processing.go:69] worker 34 listening for tasks. I1002 02:25:18.597958 1 tasks_processing.go:71] worker 49 working on olm_operators task. I1002 02:25:18.597810 1 tasks_processing.go:71] worker 17 working on nodenetworkstates task. I1002 02:25:18.598037 1 tasks_processing.go:69] worker 39 listening for tasks. I1002 02:25:18.598039 1 tasks_processing.go:71] worker 54 working on mutating_webhook_configurations task. I1002 02:25:18.598044 1 tasks_processing.go:71] worker 57 working on machine_sets task. I1002 02:25:18.597826 1 tasks_processing.go:71] worker 20 working on version task. I1002 02:25:18.598019 1 tasks_processing.go:71] worker 63 working on image_pruners task. I1002 02:25:18.597820 1 tasks_processing.go:71] worker 43 working on node_logs task. I1002 02:25:18.598209 1 tasks_processing.go:71] worker 58 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I1002 02:25:18.598211 1 tasks_processing.go:71] worker 61 working on overlapping_namespace_uids task. I1002 02:25:18.598298 1 tasks_processing.go:71] worker 34 working on openshift_machine_api_events task. I1002 02:25:18.598300 1 tasks_processing.go:71] worker 16 working on pod_network_connectivity_checks task. I1002 02:25:18.598303 1 tasks_processing.go:71] worker 26 working on ingress task. I1002 02:25:18.598307 1 tasks_processing.go:71] worker 60 working on machines task. I1002 02:25:18.598302 1 tasks_processing.go:71] worker 62 working on lokistack task. I1002 02:25:18.598311 1 tasks_processing.go:71] worker 33 working on operators_pods_and_events task. I1002 02:25:18.598315 1 tasks_processing.go:71] worker 28 working on storage_cluster task. I1002 02:25:18.598316 1 tasks_processing.go:71] worker 40 working on operators task. I1002 02:25:18.598304 1 tasks_processing.go:71] worker 38 working on crds task. I1002 02:25:18.598329 1 tasks_processing.go:71] worker 44 working on validating_webhook_configurations task. I1002 02:25:18.598331 1 tasks_processing.go:71] worker 29 working on nodenetworkconfigurationpolicies task. I1002 02:25:18.598328 1 tasks_processing.go:71] worker 25 working on sap_pods task. I1002 02:25:18.598130 1 tasks_processing.go:71] worker 4 working on nodes task. I1002 02:25:18.598312 1 tasks_processing.go:71] worker 36 working on image task. I1002 02:25:18.597929 1 tasks_processing.go:69] worker 55 listening for tasks. I1002 02:25:18.598349 1 tasks_processing.go:71] worker 55 working on proxies task. I1002 02:25:18.598011 1 tasks_processing.go:71] worker 14 working on infrastructures task. I1002 02:25:18.598009 1 tasks_processing.go:71] worker 8 working on support_secret task. I1002 02:25:18.597948 1 tasks_processing.go:71] worker 50 working on metrics task. I1002 02:25:18.597702 1 tasks_processing.go:71] worker 9 working on machine_config_pools task. I1002 02:25:18.598133 1 tasks_processing.go:71] worker 39 working on container_images task. I1002 02:25:18.597932 1 tasks_processing.go:69] worker 59 listening for tasks. I1002 02:25:18.598284 1 tasks_processing.go:71] worker 52 working on silenced_alerts task. I1002 02:25:18.598284 1 tasks_processing.go:69] worker 41 listening for tasks. I1002 02:25:18.598453 1 tasks_processing.go:71] worker 41 working on ingress_certificates task. I1002 02:25:18.598288 1 tasks_processing.go:71] worker 23 working on machine_autoscalers task. I1002 02:25:18.598291 1 tasks_processing.go:71] worker 27 working on jaegers task. I1002 02:25:18.598292 1 tasks_processing.go:71] worker 21 working on feature_gates task. I1002 02:25:18.598294 1 tasks_processing.go:71] worker 30 working on install_plans task. I1002 02:25:18.598296 1 tasks_processing.go:71] worker 46 working on config_maps task. I1002 02:25:18.598301 1 tasks_processing.go:71] worker 37 working on ceph_cluster task. I1002 02:25:18.597829 1 tasks_processing.go:71] worker 47 working on sap_datahubs task. I1002 02:25:18.598305 1 tasks_processing.go:71] worker 32 working on container_runtime_configs task. I1002 02:25:18.598307 1 tasks_processing.go:71] worker 24 working on clusterroles task. I1002 02:25:18.599038 1 tasks_processing.go:71] worker 42 working on aggregated_monitoring_cr_names task. I1002 02:25:18.599107 1 tasks_processing.go:71] worker 45 working on oauths task. I1002 02:25:18.598306 1 tasks_processing.go:71] worker 22 working on tsdb_status task. I1002 02:25:18.597934 1 tasks_processing.go:71] worker 11 working on active_alerts task. I1002 02:25:18.597932 1 tasks_processing.go:69] worker 56 listening for tasks. I1002 02:25:18.598432 1 tasks_processing.go:71] worker 59 working on storage_classes task. I1002 02:25:18.599271 1 tasks_processing.go:71] worker 56 working on cost_management_metrics_configs task. I1002 02:25:18.602185 1 tasks_processing.go:74] worker 6 stopped. I1002 02:25:18.602195 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 4.825404ms to process 0 records I1002 02:25:18.602878 1 tasks_processing.go:74] worker 15 stopped. I1002 02:25:18.602889 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 5.295923ms to process 0 records I1002 02:25:18.603516 1 tasks_processing.go:74] worker 19 stopped. E1002 02:25:18.603526 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I1002 02:25:18.603531 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 6.97573ms to process 0 records E1002 02:25:18.604930 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.124.247:9094: connect: connection refused I1002 02:25:18.604950 1 tasks_processing.go:74] worker 11 stopped. E1002 02:25:18.604948 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.239.20:9091: connect: connection refused E1002 02:25:18.604933 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.124.247:9094: connect: connection refused E1002 02:25:18.604957 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.124.247:9094: connect: connection refused I1002 02:25:18.604968 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 5.688065ms to process 0 records E1002 02:25:18.604966 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.239.20:9091: connect: connection refused E1002 02:25:18.604983 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.239.20:9091: connect: connection refused I1002 02:25:18.605001 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I1002 02:25:18.605006 1 tasks_processing.go:74] worker 50 stopped. I1002 02:25:18.605011 1 controller.go:317] The initial operator extension status is healthy I1002 02:25:18.605018 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1002 02:25:18.605025 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1002 02:25:18.605027 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1002 02:25:18.605040 1 controller.go:458] The operator is still being initialized I1002 02:25:18.605046 1 controller.go:481] The operator is healthy I1002 02:25:18.605001 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 6.587473ms to process 0 records E1002 02:25:18.605165 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.124.247:9094: connect: connection refused I1002 02:25:18.605193 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 6.524955ms to process 0 records E1002 02:25:18.605208 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.239.20:9091: connect: connection refused I1002 02:25:18.605215 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I1002 02:25:18.605221 1 tasks_processing.go:74] worker 22 stopped. I1002 02:25:18.605222 1 tasks_processing.go:74] worker 52 stopped. W1002 02:25:18.605199 1 operator.go:287] started I1002 02:25:18.605142 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I1002 02:25:18.605138 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I1002 02:25:18.605216 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 5.7847ms to process 0 records I1002 02:25:18.607318 1 tasks_processing.go:74] worker 56 stopped. I1002 02:25:18.607331 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 8.001267ms to process 0 records I1002 02:25:18.609186 1 tasks_processing.go:74] worker 63 stopped. I1002 02:25:18.609387 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=73056e46637c030e00d08a17d683aa9b42d2caf7020f92682716e48abcda1f0b I1002 02:25:18.609397 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 11.041617ms to process 1 records I1002 02:25:18.610167 1 tasks_processing.go:74] worker 3 stopped. I1002 02:25:18.610178 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 12.139556ms to process 0 records I1002 02:25:18.610571 1 tasks_processing.go:74] worker 57 stopped. I1002 02:25:18.610578 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 12.520956ms to process 0 records I1002 02:25:18.610773 1 tasks_processing.go:74] worker 26 stopped. I1002 02:25:18.610904 1 recorder.go:70] Recording config/ingress with fingerprint=c78cbf6a07ff6458d28172734de05fea4e1606edb13f070ab705f1ec439b8d5e I1002 02:25:18.610913 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 12.455379ms to process 1 records I1002 02:25:18.612985 1 tasks_processing.go:74] worker 18 stopped. I1002 02:25:18.613074 1 recorder.go:70] Recording config/network with fingerprint=f71d3492375ea4ea835772c193c57b91b10e73162759dca7649c345425d32d51 I1002 02:25:18.613083 1 gather.go:177] gatherer "clusterconfig" function "networks" took 15.243611ms to process 1 records I1002 02:25:18.613132 1 tasks_processing.go:74] worker 1 stopped. I1002 02:25:18.613245 1 recorder.go:70] Recording config/authentication with fingerprint=4a48e9e6c3e72cf406b99519d4d93a0912f39bd62a0a70bac3fc094c2035532c I1002 02:25:18.613252 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 15.360664ms to process 1 records I1002 02:25:18.615215 1 tasks_processing.go:74] worker 55 stopped. I1002 02:25:18.615263 1 recorder.go:70] Recording config/proxy with fingerprint=1c1927938019278db540ae5147048e1693c1ca9d5e127472a029be88b1775746 I1002 02:25:18.615273 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 16.856192ms to process 1 records I1002 02:25:18.615337 1 recorder.go:70] Recording config/image with fingerprint=8e036cd3a4f6efc85011060d4864ac42a3d242b49fbe32387ceaea31f570d750 I1002 02:25:18.615344 1 gather.go:177] gatherer "clusterconfig" function "image" took 16.895207ms to process 1 records I1002 02:25:18.615351 1 tasks_processing.go:74] worker 36 stopped. I1002 02:25:18.615555 1 tasks_processing.go:74] worker 34 stopped. I1002 02:25:18.615566 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 17.249565ms to process 0 records I1002 02:25:18.615798 1 tasks_processing.go:74] worker 54 stopped. I1002 02:25:18.615922 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=bb58d173a030a218fbbcba8cc9e16f0100b80629e1caa556220df9a394c6dc2d I1002 02:25:18.615945 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=5cc726d9103b7e1d55c61791b79957771eb8a48338eb5c16d3f7183cb18d1a02 I1002 02:25:18.615964 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=1e86da1f4367512228bbb2569da30f192e64bcf64c34ba1cab8a8937ec06401b I1002 02:25:18.615973 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 17.746182ms to process 3 records I1002 02:25:18.618168 1 tasks_processing.go:74] worker 13 stopped. I1002 02:25:18.618196 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 20.144455ms to process 0 records I1002 02:25:18.618310 1 tasks_processing.go:74] worker 35 stopped. I1002 02:25:18.618482 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=e11c74f5fac48884ce3e2bd22e6010190c414a70f07d7749f2d8cd4ad8d94760 I1002 02:25:18.618535 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=3a35e18a8ee05c3e4c455f565e3eed46e16f5576d6cf6a9b9579deee624d538e I1002 02:25:18.618602 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=20893a4a2a33b8cb6736fc7f0e713ef43569481c47f0c92463769cfc1b024b7d I1002 02:25:18.618620 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=c09c1fc3e9aba128adebd0c61094a75aac17506123a89914ca5ee3b4579f6a47 I1002 02:25:18.618644 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=8de35ffbbc3203bb6ef042aaebe53bb41e119806fa2e95b20c91e4dcfc608c11 I1002 02:25:18.618674 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=7f70fe3c11a0239ee8740ea32db96f49935e016494f51c6723e18a8dcf2ce809 I1002 02:25:18.618695 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=967ab8bdbe2e3bd6bc85905988d23e57fdbe24609f7b2d7c00ed71488384be4f I1002 02:25:18.618716 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=1d028322c8f1f48d7be31ca67a5d12ee8f6337654ab2e35f9ae90fb49e6b1c09 I1002 02:25:18.618756 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=5d363381c9193186e4d32b73ab9e6367ec6432047ed1a5eed5e1d61d17fdedaf I1002 02:25:18.618797 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=761194418a908a273e9bead1e398111a5bc42c430e2330fd3b68f029508a6d12 I1002 02:25:18.618832 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 20.341324ms to process 10 records I1002 02:25:18.621657 1 tasks_processing.go:74] worker 0 stopped. I1002 02:25:18.621668 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 24.106925ms to process 0 records E1002 02:25:18.621677 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I1002 02:25:18.621682 1 gather.go:177] gatherer "clusterconfig" function "machines" took 23.356893ms to process 0 records I1002 02:25:18.621687 1 tasks_processing.go:74] worker 60 stopped. I1002 02:25:18.622528 1 tasks_processing.go:74] worker 16 stopped. E1002 02:25:18.622539 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I1002 02:25:18.622545 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 24.211589ms to process 0 records I1002 02:25:18.623277 1 tasks_processing.go:74] worker 4 stopped. I1002 02:25:18.623554 1 recorder.go:70] Recording config/node/ip-10-0-133-218.ec2.internal with fingerprint=95212770b89e51700e711a022012e77c9d2097e9a1e2f5e52f6e07306d521941 I1002 02:25:18.623596 1 recorder.go:70] Recording config/node/ip-10-0-145-223.ec2.internal with fingerprint=75ba6f2467208c3508215f5d8c19e551785b2ba4cc41ea54a90189cccd0b5b2a I1002 02:25:18.623628 1 recorder.go:70] Recording config/node/ip-10-0-171-12.ec2.internal with fingerprint=cf6971e637f93ce332475e464d881f7f069c4989d4d2de69e180aa3325766216 I1002 02:25:18.623635 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 24.92772ms to process 3 records I1002 02:25:18.623645 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 25.065333ms to process 0 records I1002 02:25:18.623653 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 24.704074ms to process 0 records I1002 02:25:18.623658 1 tasks_processing.go:74] worker 29 stopped. I1002 02:25:18.623659 1 tasks_processing.go:74] worker 32 stopped. I1002 02:25:18.625287 1 tasks_processing.go:74] worker 12 stopped. I1002 02:25:18.625317 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 27.520621ms to process 0 records W1002 02:25:18.627229 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:25:18.630355 1 tasks_processing.go:74] worker 10 stopped. I1002 02:25:18.630367 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 32.644142ms to process 0 records I1002 02:25:18.631099 1 tasks_processing.go:74] worker 61 stopped. I1002 02:25:18.631120 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I1002 02:25:18.631129 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 32.792088ms to process 1 records I1002 02:25:18.633229 1 tasks_processing.go:74] worker 8 stopped. E1002 02:25:18.633238 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I1002 02:25:18.633244 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 34.860038ms to process 0 records I1002 02:25:18.633488 1 tasks_processing.go:74] worker 37 stopped. I1002 02:25:18.633518 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 34.83951ms to process 0 records I1002 02:25:18.633651 1 tasks_processing.go:74] worker 21 stopped. I1002 02:25:18.633766 1 recorder.go:70] Recording config/featuregate with fingerprint=9bd50247fd2a323538e67e8ff79c7cad1488b9ca410667cb82ef3473b4871a4e I1002 02:25:18.633780 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 35.111236ms to process 1 records I1002 02:25:18.635571 1 tasks_processing.go:74] worker 62 stopped. I1002 02:25:18.635584 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 37.253496ms to process 0 records I1002 02:25:18.635627 1 tasks_processing.go:74] worker 48 stopped. I1002 02:25:18.635640 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 37.787978ms to process 0 records I1002 02:25:18.635716 1 tasks_processing.go:74] worker 7 stopped. I1002 02:25:18.635808 1 recorder.go:70] Recording config/apiserver with fingerprint=fb63e88df9072fa4d4e5633c61c2e4c9a8da476d2fad19dd0aa9c1436161e8b2 I1002 02:25:18.635818 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 39.180038ms to process 1 records I1002 02:25:18.636240 1 tasks_processing.go:74] worker 25 stopped. I1002 02:25:18.636251 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 37.900962ms to process 0 records I1002 02:25:18.636282 1 tasks_processing.go:74] worker 23 stopped. I1002 02:25:18.636290 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 37.806203ms to process 0 records I1002 02:25:18.636295 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 37.964704ms to process 0 records I1002 02:25:18.636298 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 38.253314ms to process 0 records I1002 02:25:18.636301 1 tasks_processing.go:74] worker 28 stopped. I1002 02:25:18.636304 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 37.620372ms to process 0 records I1002 02:25:18.636306 1 tasks_processing.go:74] worker 17 stopped. I1002 02:25:18.636307 1 tasks_processing.go:74] worker 47 stopped. I1002 02:25:18.636308 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 37.779545ms to process 0 records I1002 02:25:18.636312 1 tasks_processing.go:74] worker 27 stopped. I1002 02:25:18.636439 1 tasks_processing.go:74] worker 2 stopped. I1002 02:25:18.636539 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=a22659498950297a3b3180541074c25cfc8eaa2a59d89cc16a661a42e830172c I1002 02:25:18.636555 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 38.694842ms to process 1 records I1002 02:25:18.636572 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 38.104949ms to process 0 records I1002 02:25:18.636583 1 tasks_processing.go:74] worker 9 stopped. I1002 02:25:18.638468 1 tasks_processing.go:74] worker 31 stopped. E1002 02:25:18.638480 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I1002 02:25:18.638518 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I1002 02:25:18.638537 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 40.895627ms to process 1 records I1002 02:25:18.638790 1 tasks_processing.go:74] worker 44 stopped. I1002 02:25:18.638868 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=0f0a60526227279b81703547839435151393fc75fe578dd7e3b0b2ad2e5ffc94 I1002 02:25:18.638904 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=1d0bf9432951c87b68db1f78e1b008e00a2a9da4c2571e6f5c7ae83edf3b3f98 I1002 02:25:18.638948 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=362067e6651f60ac884876fefead9444ab89b919987b6ca9cd862c42333e9086 I1002 02:25:18.638963 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=c2e80ce08dc58f39f5ef5e08575304ad56a31e273b7fcd437f67d12203f04682 I1002 02:25:18.638975 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=df9c6e67e0cfd709da2ef8ea5220d70ab2aa61701f304d2e3fb2d08bd66f7914 I1002 02:25:18.638994 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=e3d590dd9b57ca252d7e33220c546e27123082dabd64dc77386bb157fb60f0f5 I1002 02:25:18.639013 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=c0bf28e9be27670169a5244894773dcb4659dabb0a3318fcf90a6b98c0322343 I1002 02:25:18.639030 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=4dfec7efb35390af81de39922ca314c67164d19b3b519393697b9df3e805804d I1002 02:25:18.639046 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=a9930f0de0f84f5ed6df53eb9914d2c4e3938c98edb9a4a2c4c6d3ecfbc4ffeb I1002 02:25:18.639069 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=84f9cecd1256e955c20bd8bddedb21dd6bc1ea5445e7fa5ea1fc6a6352c4f3bf I1002 02:25:18.639085 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=0a12d060160668db1ecbbb07bc187ea5863e76af1d9bd1ca80c5c96cbcfb460c I1002 02:25:18.639106 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=4106781c6311d64ae2f682c0e9450b7101b1b7542695ed249ff5854e848cf898 I1002 02:25:18.639123 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=2bf7713a3b20be119d1302c0e5e4b1b8e1ed07ccb565123279c7d3a8619fcc07 I1002 02:25:18.639130 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 40.449026ms to process 13 records I1002 02:25:18.639136 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 40.602366ms to process 0 records I1002 02:25:18.639165 1 tasks_processing.go:74] worker 43 stopped. I1002 02:25:18.639182 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=d176451c27c07eed23e81de7782cefad236b13436593f2bbecda42821cb58e11 I1002 02:25:18.639191 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=ee786debaea90c2f1d08c84fe10afbe33025431dbed722ec6a95b5b41f3b4ddd I1002 02:25:18.639198 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 39.579598ms to process 2 records I1002 02:25:18.639202 1 tasks_processing.go:74] worker 59 stopped. I1002 02:25:18.639416 1 tasks_processing.go:74] worker 45 stopped. I1002 02:25:18.639669 1 recorder.go:70] Recording config/oauth with fingerprint=e3c6d554ddc7ee2f6f364e90d28746da9297cc0f51b0bf3550f2ec62a0c1e3ae I1002 02:25:18.639681 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 40.293233ms to process 1 records I1002 02:25:18.647936 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I1002 02:25:18.647953 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1002 02:25:18.647967 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1002 02:25:18.651626 1 tasks_processing.go:74] worker 53 stopped. I1002 02:25:18.652044 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=5c73c2946a6773964d8414563c226c5477f51b778a5966951e7149b4cd94bbd9 I1002 02:25:18.652059 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 53.853755ms to process 1 records I1002 02:25:18.652525 1 tasks_processing.go:74] worker 49 stopped. I1002 02:25:18.652538 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 54.482291ms to process 0 records I1002 02:25:18.653152 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1002 02:25:18.653161 1 controller.go:203] Source scaController *sca.Controller is not ready I1002 02:25:18.653164 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I1002 02:25:18.653167 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1002 02:25:18.653168 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1002 02:25:18.653181 1 controller.go:458] The operator is still being initialized I1002 02:25:18.653188 1 controller.go:481] The operator is healthy I1002 02:25:18.653180 1 tasks_processing.go:74] worker 14 stopped. I1002 02:25:18.653625 1 recorder.go:70] Recording config/infrastructure with fingerprint=9e6e40d5346f3938414f980953a87bf328a5805d8ddda17a116ba286bc951c12 I1002 02:25:18.653638 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 54.817444ms to process 1 records I1002 02:25:18.653720 1 tasks_processing.go:74] worker 38 stopped. I1002 02:25:18.653960 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=e68fc0d094c8d0314b6571c486d5f1fe8badc7efee8e9601058dc87c7c0b9c97 I1002 02:25:18.654073 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=9561deb29f50d39ccce6b65e1264f08dce6246ae598bf8315d5a13b8a92fbfcc I1002 02:25:18.654080 1 gather.go:177] gatherer "clusterconfig" function "crds" took 55.134038ms to process 2 records I1002 02:25:18.657858 1 base_controller.go:82] Caches are synced for ConfigController I1002 02:25:18.657873 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I1002 02:25:18.658350 1 tasks_processing.go:74] worker 24 stopped. I1002 02:25:18.658468 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=77b973bd6d69bbc883904a407df23ab4fe5dd67056be731de81563112c1dee6f I1002 02:25:18.658539 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=0273e49fff2e0956fa8a12be52ff7e3ff4e7f40e2359ec73522ece522f56222b I1002 02:25:18.658548 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 59.363605ms to process 2 records I1002 02:25:18.662941 1 tasks_processing.go:74] worker 58 stopped. I1002 02:25:18.662954 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 64.718337ms to process 0 records I1002 02:25:18.664179 1 tasks_processing.go:74] worker 39 stopped. I1002 02:25:18.665266 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-qbqh6 with fingerprint=85613ba49636a425ddf806c84d61fbca9fcc3c988159c7f4d9810606554ddf6d I1002 02:25:18.665321 1 recorder.go:70] Recording config/running_containers with fingerprint=2a5c88d8439e3b52d3b075741788165dd90caf47ff2145470863a8fb28a24010 I1002 02:25:18.665329 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 65.789035ms to process 2 records I1002 02:25:18.665612 1 tasks_processing.go:74] worker 42 stopped. I1002 02:25:18.665627 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 66.556319ms to process 0 records I1002 02:25:18.666887 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:25:18.688141 1 tasks_processing.go:74] worker 46 stopped. E1002 02:25:18.688161 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E1002 02:25:18.688170 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E1002 02:25:18.688173 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I1002 02:25:18.688180 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I1002 02:25:18.688214 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I1002 02:25:18.688225 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I1002 02:25:18.688231 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I1002 02:25:18.688241 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I1002 02:25:18.688271 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I1002 02:25:18.688279 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I1002 02:25:18.688283 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 89.520382ms to process 7 records I1002 02:25:18.705743 1 base_controller.go:82] Caches are synced for LoggingSyncer I1002 02:25:18.705755 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I1002 02:25:18.714154 1 cluster_transfer.go:102] no available accepted cluster transfer I1002 02:25:18.714166 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I1002 02:25:18.720655 1 tasks_processing.go:74] worker 20 stopped. I1002 02:25:18.721010 1 recorder.go:70] Recording config/version with fingerprint=84b8cbde2217418bc794dd3bf4ab7aae190ae72a7fa32ff5b4600f4e875eaa9d I1002 02:25:18.721030 1 recorder.go:70] Recording config/id with fingerprint=a18f192a26cfb4192e145c8c39c788e996419c7e042eaf12fd970fe148197eca I1002 02:25:18.721034 1 gather.go:177] gatherer "clusterconfig" function "version" took 122.568009ms to process 2 records I1002 02:25:18.728610 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I1002 02:25:18.733978 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress" I1002 02:25:18.736825 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I1002 02:25:18.768039 1 tasks_processing.go:74] worker 41 stopped. E1002 02:25:18.768050 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E1002 02:25:18.768054 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2t6c64unp49hmnk1vhu8d86e9f8mboal-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2t6c64unp49hmnk1vhu8d86e9f8mboal-primary-cert-bundle-secret" not found I1002 02:25:18.768106 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=a3a240ab9b48b3e5f187a38ef37cb701b3c8b659bab34a584a4e2c4374c47b65 I1002 02:25:18.768117 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 169.57545ms to process 1 records I1002 02:25:18.827920 1 gather_cluster_operator_pods_and_events.go:121] Found 7 pods with 11 containers I1002 02:25:18.827936 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 2287802 bytes I1002 02:25:18.828716 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-7z6q2 pod in namespace openshift-dns (previous: false). I1002 02:25:18.864653 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-7z6q2 pod in namespace openshift-dns (previous: false). I1002 02:25:18.881143 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-fqx86 pod in namespace openshift-dns (previous: false). I1002 02:25:18.909707 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-fqx86 pod in namespace openshift-dns (previous: false). I1002 02:25:18.919405 1 sca.go:266] etc-pki-entitlement secret successfully created I1002 02:25:18.919420 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I1002 02:25:18.923320 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-qjqjx pod in namespace openshift-dns (previous: false). I1002 02:25:18.959001 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-qjqjx pod in namespace openshift-dns (previous: false). I1002 02:25:19.046724 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-4zkvh pod in namespace openshift-dns (previous: false). I1002 02:25:19.247651 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-9lvtx pod in namespace openshift-dns (previous: false). I1002 02:25:19.445421 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-n75fn pod in namespace openshift-dns (previous: false). I1002 02:25:19.464458 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W1002 02:25:19.627426 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:25:19.661763 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:25:19.661781 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for cluster-samples-operator container cluster-samples-operator-687f774f9f-fjh95 pod in namespace openshift-cluster-samples-operator (previous: false). I1002 02:25:19.665038 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I1002 02:25:19.853767 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for cluster-samples-operator-watch container cluster-samples-operator-687f774f9f-fjh95 pod in namespace openshift-cluster-samples-operator (previous: false). I1002 02:25:20.050106 1 tasks_processing.go:74] worker 33 stopped. I1002 02:25:20.050194 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=8b2d59449151fb0691b4171786945672121a5b17981b8853f622615c4cb636d1 I1002 02:25:20.050255 1 recorder.go:70] Recording events/openshift-dns with fingerprint=874b061aab9c0fdbbb405cf4ee5786569d85ec71838c4273928f550831641ded I1002 02:25:20.050278 1 recorder.go:70] Recording events/openshift-cluster-samples-operator with fingerprint=015454215c3beaa0aa7bfcc4328da09bf9210a4b0832b810c19181261cf9c7e8 I1002 02:25:20.050286 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-7z6q2/dns_current.log with fingerprint=2e337c11c8173360e542fac48110fe260e027c9ed998ad4db412977eed90a267 I1002 02:25:20.050292 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-7z6q2/kube-rbac-proxy_current.log with fingerprint=abd5a0d3cd453d6ba5674f94c62013cf6d3ddd0ad337c8a1c6ddd6c6cdf08cbf I1002 02:25:20.050295 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-fqx86/dns_current.log with fingerprint=7da23f3f47e5c64550b8cb525a66c888abf04565d8ce252837d4da7ffb897af8 I1002 02:25:20.050300 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-fqx86/kube-rbac-proxy_current.log with fingerprint=afdfb153bdd0ad1f5e1a08a676ac635a89b7dade1a715a8146e28709a857c43f I1002 02:25:20.050303 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-qjqjx/dns_current.log with fingerprint=a3b005070877d222886f8f4efbb88b13d61c613941d41d0383af579bedffbef8 I1002 02:25:20.050307 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-qjqjx/kube-rbac-proxy_current.log with fingerprint=df9d5ace6b7c166a2caed0632f92d59674c7bc33f46d56ef2f4caf6dc59bf30e I1002 02:25:20.050311 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-4zkvh/dns-node-resolver_current.log with fingerprint=e57dd1a3b5e9d03e860081e3291a1aed6f94b6f669986df5268914731956ae63 I1002 02:25:20.050315 1 recorder.go:70] Recording config/pod/openshift-dns/logs/node-resolver-9lvtx/dns-node-resolver_current.log with fingerprint=a630d22f9ca78df689eb12ab78821165c51bf76e4c69e0d9024d8f0b9fdeb128 I1002 02:25:20.050347 1 recorder.go:70] Recording config/pod/openshift-cluster-samples-operator/logs/cluster-samples-operator-687f774f9f-fjh95/cluster-samples-operator_current.log with fingerprint=715569ec139fd146e32096c17d5e1d0a3801bc2bf190bd6fbe1d7b6ab28f7af3 I1002 02:25:20.050354 1 recorder.go:70] Recording config/pod/openshift-cluster-samples-operator/logs/cluster-samples-operator-687f774f9f-fjh95/cluster-samples-operator-watch_current.log with fingerprint=791a55f47a7afc863b4cdfb4d7cfeb3d64d715791cadb633ef32e4b328e405ac I1002 02:25:20.050361 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 1.451777003s to process 13 records W1002 02:25:20.628173 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:25:21.069573 1 tasks_processing.go:74] worker 40 stopped. I1002 02:25:21.069677 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=6dad07219ef7ee8e61ed45fe6798d3d13c8fe258cca61ed31bff786aaad8d321 I1002 02:25:21.069717 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I1002 02:25:21.069736 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=713a914d15ae001f25c00445af682894b53428f141214b8ef16164b18088eaaa I1002 02:25:21.069746 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I1002 02:25:21.069764 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=3653da21315651d0771cc559b98e5d5d5d966f25fdb30fe338a5e59e27991951 I1002 02:25:21.069778 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I1002 02:25:21.069795 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=04a4499ade3c888a6e56df492cd681e52bb2362df75c9aca90487f0a8d6c18fe I1002 02:25:21.069814 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=3e867cc32877cfa7b6794a65611ff6202b585726413db30d506075c84f76082f I1002 02:25:21.069834 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=24bb368ef7f0c5ad2b09263aa488e1e65d6d9b24e79b5c45114e4d8d81573900 I1002 02:25:21.069853 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=9b466c6210c6895b24e6904ed7893282e660dcd77fabb32b36ae53345b9a6393 I1002 02:25:21.070076 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=53115369241793ed9009a9a64fe233449820c70e70e2da0b68d5f8e03ffe5cc0 I1002 02:25:21.070090 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=9e35588817be81a177abb7ce3de6f2be0a7409b80a2a84ef3d9703b37f378d59 I1002 02:25:21.070098 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I1002 02:25:21.070109 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=3edecfcb5db65eeb33bd6ca44a57a402eb9492f2bdbcf2c4f9481b18ac1b6777 I1002 02:25:21.070119 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I1002 02:25:21.070129 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=3dc581a62c7eb8c0b13286d98ccb1b51662e59be154c55006ab4e842153c9bf5 I1002 02:25:21.070137 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I1002 02:25:21.070148 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=b3eba92c31b4c465dea28e39fdf4ee6105a98da76550a6942fc02e0dd97c8625 I1002 02:25:21.070157 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I1002 02:25:21.070169 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=f7b2052b2287ccca765dda9bfa77596783e5265380dfa816c3cd57ef495565ee I1002 02:25:21.070224 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=29d0da48e4d370fedea82e6c8ce6133cc6dcfe656220bffcc4e21839b42e58e0 I1002 02:25:21.070243 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I1002 02:25:21.070259 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=6f525a65ea6723313973040d20e157f867fba99d41b973a2fbaf04e06d411ad3 I1002 02:25:21.070274 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=23f2f356b1bc2bcad16eebdb9f1ad4e616ed4fc945160ea8af24821c709cc68f I1002 02:25:21.070282 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I1002 02:25:21.070292 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=31cd2abb774142738d44cad0bd7d3d5aa33cee346362e2cf417466a763b72722 I1002 02:25:21.070300 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I1002 02:25:21.070310 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=68cbff99cbe748c11de150d7eaf52007162778084bc97f0c37a9cc0d3c80660f I1002 02:25:21.070319 1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I1002 02:25:21.070327 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=cf4a94cb190ab9a7fe19f7bccc641b319ee305b4632ce97bae87b775cb61a796 I1002 02:25:21.070338 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=f5208c2d544eb006ef618402af30a30f05165ce1fd703dca1358375c4df9bff9 I1002 02:25:21.070352 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=29b2b4a83ab1b2ac905688ed8b1499ca489d97fd6a3eb54ce2bbb4dbdde36c69 I1002 02:25:21.070369 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=315afd900754f7dc1de883788162735a51166333b0cf03e4726c0e2e1e174760 I1002 02:25:21.070378 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I1002 02:25:21.070395 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=bfa45d663313af5668c83a3b16c30e32552350ba48c05234f4d46d9628403448 I1002 02:25:21.070411 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I1002 02:25:21.070421 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I1002 02:25:21.070428 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.471239374s to process 37 records W1002 02:25:21.627972 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W1002 02:25:22.627831 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W1002 02:25:23.623686 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I1002 02:25:23.623712 1 tasks_processing.go:74] worker 51 stopped. E1002 02:25:23.623720 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I1002 02:25:23.623733 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I1002 02:25:23.623743 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.025729243s to process 1 records I1002 02:25:31.728899 1 tasks_processing.go:74] worker 30 stopped. I1002 02:25:31.728933 1 recorder.go:70] Recording config/installplans with fingerprint=7b887df561a3a9e6ef0dc672845aa5d56e348505006b7496d3a2f83892b0c95b I1002 02:25:31.728947 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.130283762s to process 1 records I1002 02:25:32.411302 1 tasks_processing.go:74] worker 5 stopped. I1002 02:25:32.411657 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=8d7634ec7e79b5bc851f26f32aebd5dad854fd11e42dde9b5852dfaf215bb193 I1002 02:25:32.411678 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.813441824s to process 1 records E1002 02:25:32.411755 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.815s with: function \"machine_healthchecks\" failed with an error, function \"active_alerts\" failed with an error, function \"metrics\" failed with an error, function \"silenced_alerts\" failed with an error, function \"tsdb_status\" failed with an error, function \"machines\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"support_secret\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I1002 02:25:32.412858 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "machine_healthchecks" failed with an error, function "active_alerts" failed with an error, function "metrics" failed with an error, function "silenced_alerts" failed with an error, function "tsdb_status" failed with an error, function "machines" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "support_secret" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I1002 02:25:32.412871 1 periodic.go:212] Running workloads gatherer I1002 02:25:32.412887 1 tasks_processing.go:45] number of workers: 2 I1002 02:25:32.412896 1 tasks_processing.go:69] worker 1 listening for tasks. I1002 02:25:32.412899 1 tasks_processing.go:71] worker 1 working on workload_info task. I1002 02:25:32.412912 1 tasks_processing.go:69] worker 0 listening for tasks. I1002 02:25:32.412987 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I1002 02:25:32.436465 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-171-12.ec2.internal... I1002 02:25:32.436481 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-145-223.ec2.internal... I1002 02:25:32.436497 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-133-218.ec2.internal... I1002 02:25:32.454493 1 tasks_processing.go:74] worker 0 stopped. I1002 02:25:32.454521 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 41.487504ms to process 0 records I1002 02:25:35.434563 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 3s I1002 02:25:35.459154 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 24s for image data I1002 02:25:35.469811 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (12ms) I1002 02:25:35.481114 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (11ms) I1002 02:25:35.502480 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (21ms) I1002 02:25:35.513552 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (11ms) I1002 02:25:35.524199 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (11ms) I1002 02:25:35.534878 1 gather_workloads_info.go:387] No image sha256:214fe579356f36f89874e397dc9f7c0eb2bc333714a605cd5c578910c09520e7 (11ms) I1002 02:25:35.545556 1 gather_workloads_info.go:387] No image sha256:e40bbab1e52f580ab471bd7ab19ae23a4bcbaf1893243a05238af6bede7ba9cc (11ms) I1002 02:25:35.556799 1 gather_workloads_info.go:387] No image sha256:85400a8518d7a034e8e755b396d2c44b38b8a884244caaad4b1de3d3394701f6 (11ms) I1002 02:25:35.567371 1 gather_workloads_info.go:387] No image sha256:00f977c2275f5bf03d423911159a39ca44fabc1862ecb7ae492198ec8c46c6bb (11ms) I1002 02:25:35.578747 1 gather_workloads_info.go:387] No image sha256:527ed405bf66234718321996dacf51f91c64c746de9f1509416ef6ce89c90a50 (11ms) I1002 02:25:35.590596 1 gather_workloads_info.go:387] No image sha256:799f5628c18e77a49c08645c03179046b5200c8cbcfd65737fb59668132f393e (12ms) I1002 02:25:35.670153 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (80ms) I1002 02:25:35.769410 1 gather_workloads_info.go:387] No image sha256:6277dac65decba0ea094146bb99600f479eaf804696842e724de1f1b436f9a38 (99ms) I1002 02:25:35.869808 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (100ms) I1002 02:25:35.970391 1 gather_workloads_info.go:387] No image sha256:5cba745f09f3bd6b8028c6773597cbb30bf3639a84f2b4b6493fe20642339a2c (101ms) I1002 02:25:36.070223 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (100ms) I1002 02:25:36.169562 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (99ms) I1002 02:25:36.269995 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (100ms) I1002 02:25:36.370051 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (100ms) I1002 02:25:36.471063 1 gather_workloads_info.go:387] No image sha256:7854174b4b98e9b10d9c8e9b43113df1217ab21db4b2395d9399af0c3d7911a3 (101ms) I1002 02:25:36.570008 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (99ms) I1002 02:25:36.670638 1 gather_workloads_info.go:387] No image sha256:929a4a9c96a08b57fe4c315deca55c30d1990c83e34b8b5692f7646d29f715c8 (101ms) I1002 02:25:36.770131 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (99ms) I1002 02:25:36.872595 1 gather_workloads_info.go:387] No image sha256:1d471ad866b8564b209214d7dd3a7363c47e9535211d660b63b46abb278af7ab (102ms) I1002 02:25:36.970047 1 gather_workloads_info.go:387] No image sha256:6c3c7f77d7a3815bbb69cad5f6f1742c17d9597bc135ba3d116c9736d98fae33 (97ms) I1002 02:25:37.070833 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (101ms) I1002 02:25:37.170349 1 gather_workloads_info.go:387] No image sha256:1f2aa1e1026570162984f7fbb634635bcf319e408cafa8f9034ee842a2f193ab (99ms) I1002 02:25:37.269353 1 gather_workloads_info.go:387] No image sha256:46c2c396ca651699738c3f26b79b10af2922123dd27c2e32382d2a31a87e92c7 (99ms) I1002 02:25:37.372424 1 gather_workloads_info.go:398] Found image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (103ms) I1002 02:25:37.469874 1 gather_workloads_info.go:387] No image sha256:97fbf0e36c2b82dea812e33e3c54d030c6411c55c277c7e74b372bc1436fd393 (97ms) I1002 02:25:37.569313 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (99ms) I1002 02:25:37.669639 1 gather_workloads_info.go:387] No image sha256:ce3d8211c0bde5788a4fd04c3eff31ae591437ceab2b3168dbbdfe408673c8b1 (100ms) I1002 02:25:37.772370 1 gather_workloads_info.go:387] No image sha256:68d8e92046969bcfcbca2d2b3dcf4dcad5f6edc5fcb44861eb22f8079a43ea4d (103ms) I1002 02:25:37.876005 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (104ms) I1002 02:25:37.970585 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (95ms) I1002 02:25:38.073021 1 gather_workloads_info.go:387] No image sha256:039479f355d6903e1018abf8427fece3465c4348d4de2144ec38114b51bec27e (102ms) I1002 02:25:38.172232 1 gather_workloads_info.go:387] No image sha256:1cc2f3c83068c8c67d9070f67677e1bb6b4feff7ac5744cad08711893e56b55f (99ms) I1002 02:25:38.269579 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (97ms) I1002 02:25:38.370632 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (101ms) I1002 02:25:38.470090 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (99ms) I1002 02:25:38.571173 1 gather_workloads_info.go:387] No image sha256:798001e24f1ed6a5621c442729a840ba2a2abc43433901e8450caa12b4bad5c5 (101ms) I1002 02:25:38.670439 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (99ms) I1002 02:25:38.770047 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (100ms) I1002 02:25:38.870957 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (101ms) I1002 02:25:38.970872 1 gather_workloads_info.go:398] Found image sha256:59db91eadf1e1e5343777be43ff25fb712f300f9341be48ba05f45270944536f (100ms) I1002 02:25:39.070135 1 gather_workloads_info.go:387] No image sha256:a3d34d8f38a540ce79d34a5248b1965346155497db57b72cb4758d659418059c (99ms) I1002 02:25:39.170626 1 gather_workloads_info.go:387] No image sha256:38dd36da63b1f01316a02daf6c18b821318c6ec313712147292d74abf955e0da (100ms) I1002 02:25:39.270199 1 gather_workloads_info.go:387] No image sha256:bcca5c17371caa2dce7e28da4c9fe30163c340fa172187f94db90ea1bd6ab80d (100ms) I1002 02:25:39.270227 1 tasks_processing.go:74] worker 1 stopped. I1002 02:25:39.270444 1 recorder.go:70] Recording config/workload_info with fingerprint=e6b1f0254796b2c124191902b4adcd3e94ce8fb65c513e78ee24c12def622ac4 I1002 02:25:39.270457 1 gather.go:177] gatherer "workloads" function "workload_info" took 6.85732239s to process 1 records I1002 02:25:39.270476 1 periodic.go:259] Periodic gather workloads completed in 6.857s I1002 02:25:39.270486 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I1002 02:25:39.270490 1 periodic.go:212] Running conditional gatherer I1002 02:25:39.281434 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I1002 02:25:39.442885 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer E1002 02:25:39.444956 1 conditional_gatherer.go:322] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.239.20:9091: connect: connection refused I1002 02:25:39.445011 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I1002 02:25:39.456202 1 conditional_gatherer.go:390] cluster version is '4.19.9' E1002 02:25:39.456216 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:25:39.456220 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:25:39.456223 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:25:39.456225 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:25:39.456227 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:25:39.456229 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:25:39.456231 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:25:39.456233 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:25:39.456235 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:25:39.456237 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I1002 02:25:39.456250 1 tasks_processing.go:45] number of workers: 3 I1002 02:25:39.456261 1 tasks_processing.go:69] worker 2 listening for tasks. I1002 02:25:39.456264 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I1002 02:25:39.456272 1 tasks_processing.go:69] worker 0 listening for tasks. I1002 02:25:39.456281 1 tasks_processing.go:69] worker 1 listening for tasks. I1002 02:25:39.456285 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I1002 02:25:39.456289 1 tasks_processing.go:74] worker 1 stopped. I1002 02:25:39.456299 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I1002 02:25:39.456324 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I1002 02:25:39.456331 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 637ns to process 1 records I1002 02:25:39.456355 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I1002 02:25:39.456362 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 724ns to process 1 records I1002 02:25:39.456367 1 tasks_processing.go:74] worker 0 stopped. I1002 02:25:39.456572 1 tasks_processing.go:74] worker 2 stopped. I1002 02:25:39.456584 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 251.517µs to process 0 records I1002 02:25:39.456597 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I1002 02:25:39.456608 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I1002 02:25:39.485437 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=935a8b7be8a1c6df11b3955ae6170bdfa39a35f4497ab34408162ef4a8e7d531 I1002 02:25:39.485555 1 diskrecorder.go:70] Writing 118 records to /var/lib/insights-operator/insights-2026-10-02-022539.tar.gz I1002 02:25:39.491542 1 diskrecorder.go:51] Wrote 118 records to disk in 6ms I1002 02:25:39.491566 1 periodic.go:281] Gathering cluster info every 2h0m0s I1002 02:25:39.491578 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I1002 02:26:48.596710 1 diskrecorder.go:223] Found files to send: insights-2026-10-02-022539.tar.gz I1002 02:26:48.596739 1 insightsuploader.go:150] Checking archives to upload periodically every 15m23.223083646s I1002 02:26:48.596745 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I1002 02:26:48.616609 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I1002 02:26:48.766473 1 requests.go:87] Successfully reported id=2026-10-02T02:26:48Z x-rh-insights-request-id=53cd8c0354e142b4b14dbd7415c15638, wrote=57785 I1002 02:26:48.766546 1 insightsuploader.go:187] Uploaded report successfully in 169.794154ms I1002 02:26:48.766563 1 controller.go:119] Initializing last reported time to 2026-10-02T02:26:48Z I1002 02:26:48.766577 1 insightsreport.go:304] Archive uploaded, starting pulling report... I1002 02:26:48.766588 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I1002 02:26:48.766594 1 insightsreport.go:221] Initial delay for pulling: 1m0s I1002 02:26:48.774232 1 controller.go:481] The operator is healthy I1002 02:27:18.613803 1 controller.go:481] The operator is healthy I1002 02:27:54.230342 1 insightsreport.go:137] Pulling report from smart-proxy I1002 02:27:54.230368 1 insightsreport.go:149] Retrieving report I1002 02:27:54.242684 1 requests.go:110] Retrieving report for cluster: afa81bf2-1160-4bc2-bd26-c69620c4d01c I1002 02:27:54.242695 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/afa81bf2-1160-4bc2-bd26-c69620c4d01c/reports I1002 02:27:54.245449 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/afa81bf2-1160-4bc2-bd26-c69620c4d01c/reports I1002 02:27:54.420234 1 insightsreport.go:184] Report retrieved I1002 02:27:54.473401 1 insightsreport.go:239] Report retrieved correctly I1002 02:29:18.613713 1 controller.go:481] The operator is healthy I1002 02:30:18.588285 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:30:18.595644 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:30:18.595659 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:30:18.601783 1 secretconfigobserver.go:119] support secret does not exist I1002 02:31:18.613931 1 controller.go:481] The operator is healthy I1002 02:33:18.614700 1 controller.go:481] The operator is healthy I1002 02:35:18.579225 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:35:18.602284 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:35:18.610068 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:35:18.610090 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:35:18.616047 1 controller.go:481] The operator is healthy I1002 02:35:18.616622 1 secretconfigobserver.go:119] support secret does not exist I1002 02:37:18.616106 1 controller.go:481] The operator is healthy I1002 02:39:18.617625 1 controller.go:481] The operator is healthy I1002 02:40:18.617317 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:40:18.627846 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:40:18.627863 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:40:18.634554 1 secretconfigobserver.go:119] support secret does not exist I1002 02:41:18.614217 1 controller.go:481] The operator is healthy I1002 02:42:16.990599 1 insightsuploader.go:146] Nothing to report since 2026-10-02T02:26:48Z I1002 02:43:18.617251 1 controller.go:481] The operator is healthy I1002 02:45:18.577064 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:45:18.586763 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:45:18.617143 1 controller.go:481] The operator is healthy I1002 02:45:18.635042 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:45:18.644209 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:45:18.644226 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:45:18.652866 1 secretconfigobserver.go:119] support secret does not exist I1002 02:47:18.614403 1 controller.go:481] The operator is healthy I1002 02:49:18.612982 1 controller.go:481] The operator is healthy I1002 02:50:18.652904 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:50:18.660367 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:50:18.660385 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:50:18.666892 1 secretconfigobserver.go:119] support secret does not exist I1002 02:51:18.613890 1 controller.go:481] The operator is healthy I1002 02:53:18.614173 1 controller.go:481] The operator is healthy I1002 02:55:18.577101 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:55:18.613619 1 controller.go:481] The operator is healthy I1002 02:55:18.667792 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:55:18.674998 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:55:18.675013 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:55:18.681143 1 secretconfigobserver.go:119] support secret does not exist I1002 02:57:18.614325 1 controller.go:481] The operator is healthy I1002 02:57:41.580075 1 insightsuploader.go:146] Nothing to report since 2026-10-02T02:26:48Z I1002 02:59:18.614150 1 controller.go:481] The operator is healthy I1002 03:00:18.681922 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 03:00:18.689403 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 03:00:18.689422 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 03:00:18.696606 1 secretconfigobserver.go:119] support secret does not exist