I1002 02:18:56.629660 1 cmd.go:253] Using service-serving-cert provided certificates I1002 02:18:56.630062 1 observer_polling.go:159] Starting file observer W1002 02:18:56.648053 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I1002 02:18:56.943308 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I1002 02:18:56.943478 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I1002 02:18:56.943909 1 secure_serving.go:57] Forcing use of http/1.1 only W1002 02:18:56.943926 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W1002 02:18:56.943929 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W1002 02:18:56.943933 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W1002 02:18:56.943935 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W1002 02:18:56.943938 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W1002 02:18:56.943939 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I1002 02:18:56.943996 1 simple_featuregate_reader.go:171] Starting feature-gate-detector I1002 02:18:56.948108 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I1002 02:18:56.948124 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} I1002 02:18:56.949887 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I1002 02:18:56.949915 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I1002 02:18:56.949926 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I1002 02:18:56.949926 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I1002 02:18:56.949932 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1002 02:18:56.949940 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1002 02:18:56.950139 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/run/secrets/serving-cert/tls.crt::/var/run/secrets/serving-cert/tls.key" I1002 02:18:56.950161 1 secure_serving.go:213] Serving securely on [::]:8443 I1002 02:18:56.950190 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" E1002 02:18:56.950689 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18da94ea8d5c4d42 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-10-02 02:18:56.94808813 +0000 UTC m=+0.346900034,LastTimestamp:2026-10-02 02:18:56.94808813 +0000 UTC m=+0.346900034,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W1002 02:18:56.953044 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I1002 02:18:56.953063 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1002 02:18:56.953167 1 base_controller.go:76] Waiting for caches to sync for ConfigController I1002 02:18:56.957775 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:18:56.957790 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I1002 02:18:56.964478 1 secretconfigobserver.go:119] support secret does not exist I1002 02:18:56.968896 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:18:56.974517 1 secretconfigobserver.go:119] support secret does not exist I1002 02:18:56.977044 1 recorder.go:156] Pruning old reports every 7h54m36s, max age is 288h0m0s I1002 02:18:56.982531 1 periodic.go:212] Running clusterconfig gatherer I1002 02:18:56.982537 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I1002 02:18:56.982553 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I1002 02:18:56.982572 1 tasks_processing.go:45] number of workers: 64 I1002 02:18:56.982576 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I1002 02:18:56.982579 1 insightsreport.go:296] Starting report retriever I1002 02:18:56.982582 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I1002 02:18:56.982589 1 tasks_processing.go:69] worker 8 listening for tasks. I1002 02:18:56.982589 1 tasks_processing.go:69] worker 2 listening for tasks. I1002 02:18:56.982596 1 tasks_processing.go:69] worker 3 listening for tasks. I1002 02:18:56.982600 1 tasks_processing.go:69] worker 4 listening for tasks. I1002 02:18:56.982601 1 tasks_processing.go:69] worker 1 listening for tasks. I1002 02:18:56.982604 1 tasks_processing.go:69] worker 5 listening for tasks. I1002 02:18:56.982602 1 tasks_processing.go:69] worker 0 listening for tasks. I1002 02:18:56.982609 1 tasks_processing.go:69] worker 7 listening for tasks. I1002 02:18:56.982608 1 tasks_processing.go:69] worker 31 listening for tasks. I1002 02:18:56.982612 1 tasks_processing.go:71] worker 0 working on feature_gates task. I1002 02:18:56.982611 1 tasks_processing.go:71] worker 5 working on sap_datahubs task. I1002 02:18:56.982616 1 tasks_processing.go:69] worker 9 listening for tasks. I1002 02:18:56.982618 1 tasks_processing.go:69] worker 32 listening for tasks. I1002 02:18:56.982623 1 tasks_processing.go:69] worker 10 listening for tasks. I1002 02:18:56.982623 1 tasks_processing.go:69] worker 51 listening for tasks. I1002 02:18:56.982619 1 tasks_processing.go:69] worker 6 listening for tasks. I1002 02:18:56.982628 1 tasks_processing.go:69] worker 11 listening for tasks. I1002 02:18:56.982629 1 tasks_processing.go:69] worker 52 listening for tasks. I1002 02:18:56.982632 1 tasks_processing.go:69] worker 12 listening for tasks. I1002 02:18:56.982634 1 tasks_processing.go:69] worker 60 listening for tasks. I1002 02:18:56.982631 1 tasks_processing.go:69] worker 50 listening for tasks. I1002 02:18:56.982639 1 tasks_processing.go:71] worker 4 working on infrastructures task. I1002 02:18:56.982640 1 tasks_processing.go:69] worker 13 listening for tasks. I1002 02:18:56.982633 1 tasks_processing.go:69] worker 61 listening for tasks. I1002 02:18:56.982636 1 tasks_processing.go:71] worker 3 working on nodenetworkconfigurationpolicies task. I1002 02:18:56.982644 1 tasks_processing.go:69] worker 54 listening for tasks. I1002 02:18:56.982644 1 tasks_processing.go:71] worker 2 working on machine_configs task. I1002 02:18:56.982650 1 tasks_processing.go:69] worker 34 listening for tasks. I1002 02:18:56.982651 1 tasks_processing.go:69] worker 55 listening for tasks. I1002 02:18:56.982655 1 tasks_processing.go:69] worker 35 listening for tasks. I1002 02:18:56.982658 1 tasks_processing.go:69] worker 56 listening for tasks. I1002 02:18:56.982660 1 tasks_processing.go:69] worker 36 listening for tasks. I1002 02:18:56.982664 1 tasks_processing.go:69] worker 37 listening for tasks. I1002 02:18:56.982664 1 tasks_processing.go:69] worker 57 listening for tasks. I1002 02:18:56.982665 1 tasks_processing.go:69] worker 22 listening for tasks. I1002 02:18:56.982673 1 tasks_processing.go:69] worker 38 listening for tasks. I1002 02:18:56.982671 1 tasks_processing.go:69] worker 58 listening for tasks. I1002 02:18:56.982678 1 tasks_processing.go:69] worker 39 listening for tasks. I1002 02:18:56.982678 1 tasks_processing.go:69] worker 59 listening for tasks. I1002 02:18:56.982675 1 tasks_processing.go:69] worker 26 listening for tasks. I1002 02:18:56.982685 1 tasks_processing.go:69] worker 40 listening for tasks. I1002 02:18:56.982680 1 tasks_processing.go:69] worker 14 listening for tasks. I1002 02:18:56.982686 1 tasks_processing.go:69] worker 15 listening for tasks. I1002 02:18:56.982689 1 tasks_processing.go:69] worker 41 listening for tasks. I1002 02:18:56.982685 1 tasks_processing.go:69] worker 23 listening for tasks. I1002 02:18:56.982693 1 tasks_processing.go:69] worker 45 listening for tasks. I1002 02:18:56.982691 1 tasks_processing.go:69] worker 24 listening for tasks. I1002 02:18:56.982694 1 tasks_processing.go:69] worker 46 listening for tasks. I1002 02:18:56.982697 1 tasks_processing.go:69] worker 25 listening for tasks. I1002 02:18:56.982701 1 tasks_processing.go:69] worker 49 listening for tasks. I1002 02:18:56.982697 1 tasks_processing.go:69] worker 47 listening for tasks. I1002 02:18:56.982707 1 tasks_processing.go:69] worker 63 listening for tasks. I1002 02:18:56.982698 1 tasks_processing.go:69] worker 16 listening for tasks. I1002 02:18:56.982708 1 tasks_processing.go:69] worker 44 listening for tasks. I1002 02:18:56.982692 1 tasks_processing.go:71] worker 1 working on jaegers task. I1002 02:18:56.982711 1 tasks_processing.go:69] worker 62 listening for tasks. I1002 02:18:56.982703 1 tasks_processing.go:69] worker 42 listening for tasks. I1002 02:18:56.982715 1 tasks_processing.go:71] worker 8 working on openstack_dataplanenodesets task. I1002 02:18:56.982719 1 tasks_processing.go:69] worker 27 listening for tasks. I1002 02:18:56.982720 1 tasks_processing.go:69] worker 19 listening for tasks. I1002 02:18:56.982724 1 tasks_processing.go:69] worker 20 listening for tasks. I1002 02:18:56.982708 1 tasks_processing.go:69] worker 43 listening for tasks. I1002 02:18:56.982728 1 tasks_processing.go:69] worker 29 listening for tasks. I1002 02:18:56.982712 1 tasks_processing.go:69] worker 18 listening for tasks. I1002 02:18:56.982724 1 tasks_processing.go:69] worker 21 listening for tasks. I1002 02:18:56.982713 1 tasks_processing.go:69] worker 48 listening for tasks. I1002 02:18:56.982738 1 tasks_processing.go:69] worker 28 listening for tasks. I1002 02:18:56.982743 1 tasks_processing.go:69] worker 30 listening for tasks. I1002 02:18:56.982640 1 tasks_processing.go:69] worker 53 listening for tasks. I1002 02:18:56.982706 1 tasks_processing.go:69] worker 17 listening for tasks. I1002 02:18:56.982645 1 tasks_processing.go:69] worker 33 listening for tasks. I1002 02:18:56.982803 1 tasks_processing.go:71] worker 7 working on dvo_metrics task. I1002 02:18:56.982809 1 tasks_processing.go:71] worker 31 working on openshift_machine_api_events task. I1002 02:18:56.982810 1 tasks_processing.go:71] worker 33 working on openstack_controlplanes task. I1002 02:18:56.982817 1 tasks_processing.go:71] worker 15 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. I1002 02:18:56.982826 1 tasks_processing.go:71] worker 9 working on silenced_alerts task. I1002 02:18:56.982858 1 tasks_processing.go:71] worker 42 working on operators_pods_and_events task. I1002 02:18:56.982822 1 tasks_processing.go:71] worker 32 working on oauths task. I1002 02:18:56.982883 1 tasks_processing.go:71] worker 10 working on machine_sets task. I1002 02:18:56.982889 1 tasks_processing.go:71] worker 23 working on aggregated_monitoring_cr_names task. I1002 02:18:56.982892 1 tasks_processing.go:71] worker 29 working on validating_webhook_configurations task. I1002 02:18:56.982899 1 tasks_processing.go:71] worker 6 working on sap_config task. I1002 02:18:56.982902 1 tasks_processing.go:71] worker 20 working on mutating_webhook_configurations task. I1002 02:18:56.982920 1 tasks_processing.go:71] worker 27 working on support_secret task. I1002 02:18:56.982937 1 tasks_processing.go:71] worker 49 working on machine_healthchecks task. I1002 02:18:56.982949 1 tasks_processing.go:71] worker 28 working on crds task. I1002 02:18:56.982960 1 tasks_processing.go:71] worker 24 working on ceph_cluster task. I1002 02:18:56.982963 1 tasks_processing.go:71] worker 53 working on image_pruners task. I1002 02:18:56.982994 1 tasks_processing.go:71] worker 16 working on machine_config_pools task. I1002 02:18:56.982885 1 tasks_processing.go:71] worker 18 working on nodenetworkstates task. I1002 02:18:56.983084 1 tasks_processing.go:71] worker 21 working on ingress_certificates task. I1002 02:18:56.983098 1 tasks_processing.go:71] worker 25 working on install_plans task. I1002 02:18:56.983100 1 tasks_processing.go:71] worker 17 working on service_accounts task. I1002 02:18:56.983109 1 tasks_processing.go:71] worker 11 working on authentication task. I1002 02:18:56.983134 1 tasks_processing.go:71] worker 44 working on monitoring_persistent_volumes task. I1002 02:18:56.983180 1 tasks_processing.go:71] worker 63 working on image task. I1002 02:18:56.982960 1 tasks_processing.go:71] worker 30 working on machine_autoscalers task. I1002 02:18:56.982886 1 tasks_processing.go:71] worker 41 working on node_logs task. I1002 02:18:56.983228 1 tasks_processing.go:71] worker 52 working on networks task. I1002 02:18:56.983232 1 tasks_processing.go:71] worker 19 working on operators task. I1002 02:18:56.983012 1 tasks_processing.go:71] worker 47 working on metrics task. I1002 02:18:56.983288 1 tasks_processing.go:71] worker 36 working on openshift_logging task. I1002 02:18:56.983297 1 tasks_processing.go:71] worker 62 working on certificate_signing_requests task. I1002 02:18:56.983007 1 tasks_processing.go:71] worker 45 working on image_registries task. I1002 02:18:56.983335 1 tasks_processing.go:71] worker 37 working on version task. I1002 02:18:56.983400 1 tasks_processing.go:71] worker 61 working on openstack_dataplanedeployments task. I1002 02:18:56.982806 1 tasks_processing.go:71] worker 51 working on proxies task. I1002 02:18:56.983428 1 tasks_processing.go:71] worker 54 working on clusterroles task. I1002 02:18:56.983450 1 tasks_processing.go:71] worker 48 working on config_maps task. I1002 02:18:56.982889 1 tasks_processing.go:71] worker 43 working on pdbs task. I1002 02:18:56.983093 1 tasks_processing.go:71] worker 46 working on container_images task. I1002 02:18:56.983539 1 tasks_processing.go:71] worker 50 working on lokistack task. I1002 02:18:56.983550 1 tasks_processing.go:71] worker 13 working on container_runtime_configs task. I1002 02:18:56.983647 1 tasks_processing.go:71] worker 39 working on ingress task. I1002 02:18:56.983666 1 tasks_processing.go:71] worker 34 working on storage_classes task. I1002 02:18:56.983679 1 tasks_processing.go:71] worker 22 working on openstack_version task. I1002 02:18:56.983717 1 tasks_processing.go:71] worker 57 working on cost_management_metrics_configs task. I1002 02:18:56.983741 1 tasks_processing.go:71] worker 26 working on active_alerts task. I1002 02:18:56.983787 1 tasks_processing.go:71] worker 12 working on pod_network_connectivity_checks task. I1002 02:18:56.983802 1 tasks_processing.go:71] worker 60 working on tsdb_status task. I1002 02:18:56.983823 1 tasks_processing.go:71] worker 59 working on machines task. I1002 02:18:56.983840 1 tasks_processing.go:71] worker 40 working on cluster_apiserver task. I1002 02:18:56.983854 1 tasks_processing.go:71] worker 14 working on storage_cluster task. I1002 02:18:56.983809 1 tasks_processing.go:71] worker 35 working on sap_pods task. I1002 02:18:56.984433 1 tasks_processing.go:71] worker 38 working on nodes task. I1002 02:18:56.984467 1 tasks_processing.go:71] worker 58 working on overlapping_namespace_uids task. I1002 02:18:56.983815 1 tasks_processing.go:71] worker 56 working on olm_operators task. I1002 02:18:56.984565 1 tasks_processing.go:71] worker 55 working on schedulers task. E1002 02:18:56.986920 1 gather_prometheus_tsdb_status.go:49] Unable to tsdb status: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.241.191:9091: connect: connection refused I1002 02:18:56.986939 1 tasks_processing.go:74] worker 60 stopped. E1002 02:18:56.986940 1 gather_most_recent_metrics.go:87] Unable to retrieve most recent metrics: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.241.191:9091: connect: connection refused E1002 02:18:56.986946 1 gather.go:140] gatherer "clusterconfig" function "tsdb_status" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/status/tsdb": dial tcp 172.30.241.191:9091: connect: connection refused I1002 02:18:56.986958 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 3.112567ms to process 0 records E1002 02:18:56.986959 1 gather_silenced_alerts.go:52] Unable to retrieve silenced alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.19.158:9094: connect: connection refused E1002 02:18:56.986977 1 gather_active_alerts.go:64] Unable to retrieve most recent alerts: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.19.158:9094: connect: connection refused I1002 02:18:56.986985 1 tasks_processing.go:74] worker 47 stopped. E1002 02:18:56.986968 1 gather.go:140] gatherer "clusterconfig" function "metrics" failed with the error: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/federate?match%5B%5D=cluster_installer&match%5B%5D=namespace%3Acontainer_cpu_usage%3Asum&match%5B%5D=namespace%3Acontainer_memory_usage_bytes%3Asum&match%5B%5D=vsphere_node_hw_version_total&match%5B%5D=virt_platform&match%5B%5D=console_helm_installs_total&match%5B%5D=console_helm_upgrades_total&match%5B%5D=console_helm_uninstalls_total&match%5B%5D=openshift_apps_deploymentconfigs_strategy_total&match%5B%5D=etcd_server_slow_apply_total&match%5B%5D=etcd_server_slow_read_indexes_total&match%5B%5D=haproxy_exporter_server_threshold": dial tcp 172.30.241.191:9091: connect: connection refused I1002 02:18:56.986993 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 3.695236ms to process 0 records E1002 02:18:56.987006 1 gather.go:140] gatherer "clusterconfig" function "silenced_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=false&inhibited=false&silenced=true": dial tcp 172.30.19.158:9094: connect: connection refused I1002 02:18:56.987016 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 4.138052ms to process 0 records I1002 02:18:56.987016 1 tasks_processing.go:74] worker 9 stopped. E1002 02:18:56.987022 1 gather.go:140] gatherer "clusterconfig" function "active_alerts" failed with the error: Get "https://alertmanager-main.openshift-monitoring.svc:9094/api/v2/alerts?active=true": dial tcp 172.30.19.158:9094: connect: connection refused I1002 02:18:56.987027 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 3.206769ms to process 0 records I1002 02:18:56.987034 1 tasks_processing.go:74] worker 26 stopped. I1002 02:18:56.990767 1 tasks_processing.go:74] worker 3 stopped. I1002 02:18:56.990779 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 8.117071ms to process 0 records I1002 02:18:56.990788 1 tasks_processing.go:74] worker 1 stopped. I1002 02:18:56.990801 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 8.070744ms to process 0 records I1002 02:18:56.990844 1 tasks_processing.go:74] worker 5 stopped. I1002 02:18:56.990856 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 8.225744ms to process 0 records I1002 02:18:56.990863 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 8.131761ms to process 0 records I1002 02:18:56.990869 1 tasks_processing.go:74] worker 8 stopped. I1002 02:18:56.990888 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I1002 02:18:56.990899 1 controller.go:317] The initial operator extension status is healthy I1002 02:18:56.990905 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1002 02:18:56.990911 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1002 02:18:56.990914 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1002 02:18:56.990925 1 controller.go:458] The operator is still being initialized I1002 02:18:56.990929 1 controller.go:481] The operator is healthy I1002 02:18:56.990931 1 tasks_processing.go:74] worker 0 stopped. I1002 02:18:56.991012 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s I1002 02:18:56.991037 1 recorder.go:70] Recording config/featuregate with fingerprint=ec7b079da69d7b1639b05f18230d8495c13e9208930c4dca1c959c0a099a1b44 I1002 02:18:56.991046 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 8.308816ms to process 1 records W1002 02:18:56.991064 1 operator.go:287] started I1002 02:18:56.991081 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I1002 02:18:56.991010 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I1002 02:18:56.991936 1 tasks_processing.go:74] worker 33 stopped. I1002 02:18:56.991949 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 9.116101ms to process 0 records I1002 02:18:56.992271 1 tasks_processing.go:74] worker 6 stopped. I1002 02:18:56.992281 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 9.362393ms to process 0 records I1002 02:18:56.993754 1 tasks_processing.go:74] worker 4 stopped. I1002 02:18:56.994326 1 recorder.go:70] Recording config/infrastructure with fingerprint=65b08ef57d647812a50fe8260ea33cb002b5cd700c22c5d86aabfd976a2aed62 I1002 02:18:56.994338 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 11.106173ms to process 1 records W1002 02:18:56.994684 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:18:56.996648 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I1002 02:18:56.996657 1 controller.go:203] Source scaController *sca.Controller is not ready I1002 02:18:56.996660 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I1002 02:18:56.996663 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I1002 02:18:56.996665 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I1002 02:18:56.996674 1 controller.go:458] The operator is still being initialized I1002 02:18:56.996680 1 controller.go:481] The operator is healthy I1002 02:18:56.999167 1 tasks_processing.go:74] worker 10 stopped. I1002 02:18:56.999179 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 16.273276ms to process 0 records I1002 02:18:56.999187 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 16.127793ms to process 0 records I1002 02:18:56.999191 1 tasks_processing.go:74] worker 16 stopped. I1002 02:18:56.999259 1 tasks_processing.go:74] worker 18 stopped. I1002 02:18:56.999272 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 16.19498ms to process 0 records I1002 02:18:56.999901 1 tasks_processing.go:74] worker 27 stopped. E1002 02:18:56.999909 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I1002 02:18:56.999914 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 16.966795ms to process 0 records I1002 02:18:57.010431 1 tasks_processing.go:74] worker 30 stopped. I1002 02:18:57.010442 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 27.233867ms to process 0 records I1002 02:18:57.010447 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 27.476216ms to process 0 records I1002 02:18:57.010451 1 tasks_processing.go:74] worker 24 stopped. I1002 02:18:57.010512 1 tasks_processing.go:74] worker 31 stopped. I1002 02:18:57.010520 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 27.696964ms to process 0 records I1002 02:18:57.010837 1 tasks_processing.go:74] worker 63 stopped. I1002 02:18:57.010914 1 recorder.go:70] Recording config/image with fingerprint=94bb31d1404e04854717af3bd8324d0cdaaea8f0df555a93f24056d1e8412aec I1002 02:18:57.010926 1 gather.go:177] gatherer "clusterconfig" function "image" took 27.646166ms to process 1 records I1002 02:18:57.010933 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 27.571573ms to process 0 records E1002 02:18:57.010938 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I1002 02:18:57.010943 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 27.925445ms to process 0 records I1002 02:18:57.010947 1 tasks_processing.go:74] worker 36 stopped. I1002 02:18:57.010958 1 tasks_processing.go:74] worker 49 stopped. I1002 02:18:57.011020 1 tasks_processing.go:74] worker 52 stopped. I1002 02:18:57.011047 1 recorder.go:70] Recording config/network with fingerprint=95ed523503bb0dc9482725ecfba1cda4342d73fa35a91e0972073311a7409dbf I1002 02:18:57.011055 1 gather.go:177] gatherer "clusterconfig" function "networks" took 27.66742ms to process 1 records I1002 02:18:57.011131 1 tasks_processing.go:74] worker 20 stopped. I1002 02:18:57.011155 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=ab72f263bd7c96f9d946479eed5c5e4f09e00fe8de64e7ef775f0a1231452faa I1002 02:18:57.011178 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=ce7a3c92d84a38de267d8b9b337afff3ba2188f3beaf21a1fb7b8dd21e42cba0 I1002 02:18:57.011196 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=9a497ef7f66a402ac160570d096ff0d1009643d8316b70c1aa5df107bdc73c29 I1002 02:18:57.011202 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 28.009941ms to process 3 records I1002 02:18:57.011276 1 tasks_processing.go:74] worker 11 stopped. I1002 02:18:57.011306 1 recorder.go:70] Recording config/authentication with fingerprint=d4e70016ec5bbc4b31b9957a4ee88e70ac4eee6d23682ee8017c8d59e2ba7d8c I1002 02:18:57.011313 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 27.867647ms to process 1 records I1002 02:18:57.011355 1 recorder.go:70] Recording config/validatingwebhookconfigurations/alertmanagerconfigs.openshift.io with fingerprint=2e6ca20a4421e8fd27230b8dc2ea311ba16f4316c2a59e02f6afd1a6b574c7ad I1002 02:18:57.011387 1 tasks_processing.go:74] worker 29 stopped. I1002 02:18:57.011401 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=1bbfa825c6e5a59c6b11b68565b4df7c6b008f9d37c784ffe558f9b875343ea3 I1002 02:18:57.011465 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=5a80fbfba83aa45f39a778fcf3011c8a6429435f4a305372ab81bb5434bc87dd I1002 02:18:57.011500 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=a6e585b797eeddbf1f7210d1fb7c1b249a524899aa6f4dd1d2e144aea79ef353 I1002 02:18:57.011515 1 recorder.go:70] Recording config/validatingwebhookconfigurations/prometheusrules.openshift.io with fingerprint=e4b9855f8cc11fbd9081da53419bc57bba90c56e59cf91910020fd94252963a8 I1002 02:18:57.011532 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=2bf28c6e74e23973b9b06c8649ea3dea3f79aa86d61a20a04f1b42c5c0151061 I1002 02:18:57.011550 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=1c9a35e2dd1dc748eee2fe110f135a78b2677fbc1193d2b88950abd11da2c831 I1002 02:18:57.011566 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=bcf4da79882e9ef0b5901f6da60db23878a3a9ff9d1aa2934bc40af997b79913 I1002 02:18:57.011583 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=f4433aef1d9eaf2258a946ea1e0643ced95109eb6587272c6dd1f394ebc3eaea I1002 02:18:57.011605 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=c8774746837051eed293adb170123470904ce3a17e9c61597696ab94975c5e87 I1002 02:18:57.011621 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=acf73bcc0c83d7c177f59f818f7d2378fc80515c2d0c243f1617d05d378e1f09 I1002 02:18:57.011638 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=4b505d6482be1cea354ed15a0816875fcb7029e5a86000c62d7b92038cbc76e2 I1002 02:18:57.011654 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=e5d8cc051a3497cda2713ef884066aeaca71702461304f751f2558088a6d68c2 I1002 02:18:57.011661 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 28.108834ms to process 13 records I1002 02:18:57.011739 1 tasks_processing.go:74] worker 32 stopped. I1002 02:18:57.011793 1 recorder.go:70] Recording config/oauth with fingerprint=15624ee1ed4054be53c42936e5a39f3506a534089c8e8f1d75847ffce52df41a I1002 02:18:57.011799 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 28.257711ms to process 1 records I1002 02:18:57.016088 1 tasks_processing.go:74] worker 12 stopped. E1002 02:18:57.016098 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I1002 02:18:57.016103 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 32.292609ms to process 0 records I1002 02:18:57.016108 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 32.382074ms to process 0 records I1002 02:18:57.016114 1 tasks_processing.go:74] worker 57 stopped. E1002 02:18:57.016116 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I1002 02:18:57.016123 1 gather.go:177] gatherer "clusterconfig" function "machines" took 32.273149ms to process 0 records I1002 02:18:57.016127 1 tasks_processing.go:74] worker 59 stopped. I1002 02:18:57.016138 1 tasks_processing.go:74] worker 35 stopped. I1002 02:18:57.016149 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 31.914543ms to process 0 records I1002 02:18:57.016234 1 tasks_processing.go:74] worker 51 stopped. I1002 02:18:57.016279 1 recorder.go:70] Recording config/proxy with fingerprint=85c7b4be6f45c80c0777ada7da96c0895ac5b614aff601626e03c7c08297e93b I1002 02:18:57.016288 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 32.809357ms to process 1 records I1002 02:18:57.050571 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I1002 02:18:57.050591 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I1002 02:18:57.050649 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I1002 02:18:57.053852 1 base_controller.go:82] Caches are synced for ConfigController I1002 02:18:57.053864 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I1002 02:18:57.055456 1 tasks_processing.go:74] worker 13 stopped. I1002 02:18:57.055471 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 71.898276ms to process 0 records I1002 02:18:57.055529 1 tasks_processing.go:74] worker 41 stopped. I1002 02:18:57.055539 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 72.304512ms to process 0 records I1002 02:18:57.055780 1 tasks_processing.go:74] worker 22 stopped. I1002 02:18:57.055792 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 72.093397ms to process 0 records I1002 02:18:57.055815 1 tasks_processing.go:74] worker 53 stopped. I1002 02:18:57.056076 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=5e8fadadc362a98ffe95cd56ebf0a6ba223f1c8942417310dec31da4096258e3 I1002 02:18:57.056088 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 72.840279ms to process 1 records I1002 02:18:57.056094 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 72.480354ms to process 0 records I1002 02:18:57.056100 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 72.12214ms to process 0 records I1002 02:18:57.056104 1 tasks_processing.go:74] worker 14 stopped. I1002 02:18:57.056109 1 tasks_processing.go:74] worker 61 stopped. I1002 02:18:57.056160 1 tasks_processing.go:74] worker 2 stopped. E1002 02:18:57.056167 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I1002 02:18:57.056207 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I1002 02:18:57.056217 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 73.508672ms to process 1 records I1002 02:18:57.056222 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 73.07696ms to process 0 records I1002 02:18:57.056225 1 tasks_processing.go:74] worker 44 stopped. I1002 02:18:57.056381 1 tasks_processing.go:74] worker 50 stopped. I1002 02:18:57.056397 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 72.83018ms to process 0 records I1002 02:18:57.056528 1 tasks_processing.go:74] worker 23 stopped. I1002 02:18:57.056550 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 73.628677ms to process 0 records I1002 02:18:57.059169 1 tasks_processing.go:74] worker 62 stopped. I1002 02:18:57.059185 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 75.860613ms to process 0 records I1002 02:18:57.061935 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload I1002 02:18:57.065755 1 tasks_processing.go:74] worker 43 stopped. I1002 02:18:57.065869 1 recorder.go:70] Recording config/pdbs/openshift-console/console with fingerprint=159df55570b6757f1ec65cccd2775b97ec198d93e4736143db9933f8a3881d34 I1002 02:18:57.065893 1 recorder.go:70] Recording config/pdbs/openshift-console/downloads with fingerprint=da86b74a19ac2274ccb629483417d28422b7f1f1a3ce4f7250a4cc650b005e9a I1002 02:18:57.065916 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=b3f398ff6b42c15f4602df179ec066b20bc8e70a2be2db05ffe530be14c68628 I1002 02:18:57.065930 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=b6eabeb03faa6cdeba2d423d38ec81fc0771a31e871424c86ba82a8c12d5afd0 I1002 02:18:57.065945 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/alertmanager-main with fingerprint=f7c241984011a6962a74906fde57c8557333785ff29afa0ed5abcf4a1747f47b I1002 02:18:57.065954 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/monitoring-plugin with fingerprint=75aaaa3b55fb12160dd53fb50fa4f30f20acebcc679b6780ec063a4ef8369b6e I1002 02:18:57.065966 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-k8s with fingerprint=bc9f4d32fd5ab7167926c7c8b34197627a66df99a8b265e2f61ebfc077890edd I1002 02:18:57.065974 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/prometheus-operator-admission-webhook with fingerprint=a4df3fc238e3b09ea2224b5e86cd885441966d0776bea3b0969c06f4b6fbb6e6 I1002 02:18:57.065986 1 recorder.go:70] Recording config/pdbs/openshift-monitoring/thanos-querier-pdb with fingerprint=c56429f30df954405fb2724a092035c6e52cd6828a57c7dc09a3b0d4fe5b39c0 I1002 02:18:57.065995 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=a5b6eaaa53916d644d03a431808e617fb0c7c4a379c1d95d7b96617bc7c2e79e I1002 02:18:57.066002 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 82.286605ms to process 10 records I1002 02:18:57.089721 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:18:57.090072 1 tasks_processing.go:74] worker 15 stopped. I1002 02:18:57.090099 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 107.241777ms to process 0 records I1002 02:18:57.090276 1 tasks_processing.go:74] worker 28 stopped. I1002 02:18:57.091104 1 base_controller.go:82] Caches are synced for LoggingSyncer I1002 02:18:57.091170 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I1002 02:18:57.091264 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=8b7ba690e8e4e924261249592bf85fbbceef94936670db030a2bee995ac27da9 I1002 02:18:57.091709 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=1bfef4915a7a2835c1fd3042a59e708143e9cbbf4374e9b11db2451bf6e68667 I1002 02:18:57.091729 1 gather.go:177] gatherer "clusterconfig" function "crds" took 107.320605ms to process 2 records I1002 02:18:57.091810 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=1331da9e224a285e37b10d44ab46295ce52c51d08fd9530f61423a71b574b609 I1002 02:18:57.091823 1 tasks_processing.go:74] worker 34 stopped. I1002 02:18:57.091828 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=de3894b73b18c39aa12a6b0c764180ec1787dbfe56351d355cee8ddf158993a9 I1002 02:18:57.091835 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 107.029926ms to process 2 records I1002 02:18:57.117927 1 tasks_processing.go:74] worker 39 stopped. I1002 02:18:57.118042 1 recorder.go:70] Recording config/ingress with fingerprint=6cbdac066824c196ac519988ae41dfff44f17704be81a67632be0d7c680b3702 I1002 02:18:57.118052 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 134.265845ms to process 1 records I1002 02:18:57.118135 1 recorder.go:70] Recording config/apiserver with fingerprint=fabcef4473150b4f8fbd5170427823add5a8b59a12bd5a701205e7335a576c5e I1002 02:18:57.118137 1 tasks_processing.go:74] worker 40 stopped. I1002 02:18:57.118143 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 134.186828ms to process 1 records I1002 02:18:57.123174 1 tasks_processing.go:74] worker 38 stopped. I1002 02:18:57.123425 1 recorder.go:70] Recording config/node/ip-10-0-143-80.ec2.internal with fingerprint=9995b39450fb8a1d94df8cb242b66df741eb1cbfe402ff10d700010c2e500084 I1002 02:18:57.123467 1 recorder.go:70] Recording config/node/ip-10-0-154-151.ec2.internal with fingerprint=3697e48125917788187e544659a893bd092e0dd87601de20aad128c1e550efdc I1002 02:18:57.123522 1 recorder.go:70] Recording config/node/ip-10-0-160-65.ec2.internal with fingerprint=bda29a2e00bc09ed24ebd4cee5d40afc899881ba8b728cc3b3dfedae2c98db7a I1002 02:18:57.123530 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 138.721927ms to process 3 records I1002 02:18:57.123546 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I1002 02:18:57.123562 1 tasks_processing.go:74] worker 58 stopped. I1002 02:18:57.123564 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 138.860228ms to process 1 records I1002 02:18:57.123700 1 tasks_processing.go:74] worker 45 stopped. I1002 02:18:57.123877 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=436f6f7e0a746ec6c1ff5fa90a39bd37cc55ea3e37194205952e4e87bad016ac I1002 02:18:57.123894 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 140.195581ms to process 1 records I1002 02:18:57.131901 1 tasks_processing.go:74] worker 55 stopped. I1002 02:18:57.131962 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=2dc28d8360eb7659ada6ffc2f579a3e0757b9a2247aa30bd531497f7e97c8b7c I1002 02:18:57.131977 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 147.301722ms to process 1 records I1002 02:18:57.153804 1 tasks_processing.go:74] worker 54 stopped. I1002 02:18:57.153930 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=50a782bc64626d2f2bd5ea4781110a0feccd422ef59f44dab73c240be24b5c44 I1002 02:18:57.153980 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=d6d1a4d9b3a194c8022ddca40e04b5bfe6d3e256f49559be77d8607274a102c7 I1002 02:18:57.153987 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 170.361687ms to process 2 records I1002 02:18:57.166111 1 tasks_processing.go:74] worker 46 stopped. I1002 02:18:57.167172 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-dxmxm with fingerprint=31284d6904a1567103c9fc678b0538b487c3fef8ebc0ceda92cb8e68e6ab8dd1 I1002 02:18:57.167228 1 recorder.go:70] Recording config/running_containers with fingerprint=2702ec1811c3a5c07b3489563d95699b1ebb6e4391daee146260b49f8d58026c I1002 02:18:57.167236 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 182.634302ms to process 2 records I1002 02:18:57.170277 1 tasks_processing.go:74] worker 37 stopped. I1002 02:18:57.170616 1 recorder.go:70] Recording config/version with fingerprint=d57cb3ea70db41f9101ca683ef7a170537cfc74798e78b91090851c072739f5f I1002 02:18:57.170630 1 recorder.go:70] Recording config/id with fingerprint=7f8ccbfa3a89734ecd3e1362d54761f76690eb53003163dd98a583cb1def1e13 I1002 02:18:57.170642 1 gather.go:177] gatherer "clusterconfig" function "version" took 186.927541ms to process 2 records I1002 02:18:57.170685 1 recorder.go:70] Recording config/olm_operators with fingerprint=67ec2584f173af5f3535cc13077fd2d7b89caa098f9e0e822a04df9df7057885 I1002 02:18:57.170696 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 186.099558ms to process 1 records I1002 02:18:57.170703 1 tasks_processing.go:74] worker 56 stopped. I1002 02:18:57.176757 1 tasks_processing.go:74] worker 48 stopped. E1002 02:18:57.176768 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E1002 02:18:57.176773 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E1002 02:18:57.176776 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I1002 02:18:57.176782 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I1002 02:18:57.176822 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I1002 02:18:57.176829 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I1002 02:18:57.176834 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I1002 02:18:57.176842 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=34cdf5d36d45a9e3ee7c2be31546e3d937ae4ebf144ac07b0210c06a1610a94d I1002 02:18:57.176858 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I1002 02:18:57.176864 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I1002 02:18:57.176868 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 193.291563ms to process 7 records I1002 02:18:57.181328 1 tasks_processing.go:74] worker 21 stopped. E1002 02:18:57.181335 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E1002 02:18:57.181339 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2t6c25vof02v73dn4dgctr08q2msgm0m-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2t6c25vof02v73dn4dgctr08q2msgm0m-primary-cert-bundle-secret" not found I1002 02:18:57.181373 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=ccf6b495e9c325b77a624f36ec2ff6f05f10a5a30187ebba94de064234512891 I1002 02:18:57.181381 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 198.222891ms to process 1 records I1002 02:18:57.237733 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I1002 02:18:57.248320 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress" I1002 02:18:57.252022 1 cluster_transfer.go:102] no available accepted cluster transfer I1002 02:18:57.252033 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=NoClusterTransfer message=no available cluster transfer I1002 02:18:57.324774 1 gather_cluster_operator_pods_and_events.go:121] Found 15 pods with 19 containers I1002 02:18:57.324787 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1324517 bytes I1002 02:18:57.325156 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-85b84f584d-dxmxm pod in namespace openshift-console-operator (previous: true). I1002 02:18:57.345738 1 sca.go:266] etc-pki-entitlement secret successfully created I1002 02:18:57.345750 1 controllerstatus.go:80] name=scaController healthy=true reason=Updated message=SCA certs successfully updated I1002 02:18:57.353326 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console-operator container console-operator-85b84f584d-dxmxm pod in namespace openshift-console-operator (previous: false). I1002 02:18:57.545212 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-5774cdc7f5-5sxf6 pod in namespace openshift-console (previous: false). I1002 02:18:57.737394 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:18:57.737410 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-5774cdc7f5-c7cf5 pod in namespace openshift-console (previous: false). I1002 02:18:57.927599 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I1002 02:18:57.940839 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:18:57.940852 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-6f65856bc-gcwz5 pod in namespace openshift-console (previous: false). W1002 02:18:57.995472 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:18:58.127855 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I1002 02:18:58.145394 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-7fb84c58d4-pf9tx pod in namespace openshift-console (previous: false). I1002 02:18:58.343973 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for console container console-84ccd6577f-98phn pod in namespace openshift-console (previous: false). I1002 02:18:58.543640 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-7b98f8c767-7k4x9 pod in namespace openshift-console (previous: false). I1002 02:18:58.742232 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:18:58.742249 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for download-server container downloads-7b98f8c767-w5hqm pod in namespace openshift-console (previous: false). I1002 02:18:58.944299 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:18:58.944317 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-2d5df pod in namespace openshift-dns (previous: false). W1002 02:18:58.995606 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:18:59.142769 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-2d5df pod in namespace openshift-dns (previous: false). I1002 02:18:59.343206 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-5v7tq pod in namespace openshift-dns (previous: false). I1002 02:18:59.531499 1 tasks_processing.go:74] worker 19 stopped. I1002 02:18:59.531606 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=ece8f44e741d2bf45892fbacdbfcf13de53de6bd2a71a8c4ad3a5210ae8510cf I1002 02:18:59.531646 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/console/cluster with fingerprint=be84fc75c87766f0f4d4e9fb1f9db618d008a21cc463e8239af81a1c296612d1 I1002 02:18:59.531671 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=c966997f9d9a3023b340876d06959fa6b61327f55785aabc72a2828178236ad5 I1002 02:18:59.531681 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I1002 02:18:59.531696 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=ecb537981291ec0975743478a70a51683b606483aa2b5c6342ab9d5be6c76b00 I1002 02:18:59.531711 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I1002 02:18:59.531728 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=e523f0bb17defa84cef929e0c44ceb47bfa360f9108700a4acd84763616e4341 I1002 02:18:59.531751 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=2203c5e316763bb1eb395c0e527065aa12069e7915b884e5d8b35ae0001b74d0 I1002 02:18:59.531772 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=4b817fa88809a739cdc023b18ee337153fa7146cbf979db227ea989ebf54c952 I1002 02:18:59.531792 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=f42894af5812068f4deabfdb780732979e2aad215897d37d7df9c2acf4c56b8e I1002 02:18:59.531990 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=9984d44fe875ffdbb6ba1d9a7ccc419283ee9e0a66a7724ded5ec050d14e234a I1002 02:18:59.532004 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=870d18b81dadad27cb1cb483e66037ae172f8c408b9c43df688336700e2f543a I1002 02:18:59.532013 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I1002 02:18:59.532023 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=c521e5c66bd20af693d8c84c7a6c725b59768b3a6f8871cf915d1f4ad39bd8e5 I1002 02:18:59.532032 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I1002 02:18:59.532043 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=5113fdcf0567bae73389945ee5257b38b1188937cf3a4d6c91ecb2c2344d8a1b I1002 02:18:59.532055 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I1002 02:18:59.532071 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=d0df36744ac407bf039a6cec668d571173097f1bf0d588d9c8d10ba7b86cd0e2 I1002 02:18:59.532080 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I1002 02:18:59.532093 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=bc6fc20b6f52c4f815185bf4bb5637cc47aa449f28c08e8563e49eaa8c696945 I1002 02:18:59.532164 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=3bd09c4ba4d9ba53ab5e9d5c564a71a63b367324bf45fafdb99632c3bdf25c32 I1002 02:18:59.532184 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I1002 02:18:59.532199 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=303351d7d5b001dfa043e8c7f09b58104a29f3eb298c89dc1e1d82368dda2f44 I1002 02:18:59.532222 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=a98d9f01a13278deee7a13581142e06a44f0776d07d3e7e216c4ed1921e3cd3d I1002 02:18:59.532231 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I1002 02:18:59.532241 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=995321d9107274662aee25506c2dc7c6e77f4373c24412db4635afb583148939 I1002 02:18:59.532253 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I1002 02:18:59.532266 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=61a4f0c88594dbedfa9b253cda02fe5f3fbaf30274c5084af7927263dc7812bf I1002 02:18:59.532275 1 recorder.go:70] Recording config/clusteroperator/samples.operator.openshift.io/config/cluster with fingerprint=439a4284281b8dcef0621bb14ba23e2175a28a50613f86b33a171c49689474fd I1002 02:18:59.532288 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=03f4f7ba7d32c24e6893464755cc39ad8fae356c0c23d0abdea118ef1a6144cd I1002 02:18:59.532304 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=4e1c584c71239d530af3089758c93b161cddfb917b9d495395ccd6766058cae4 I1002 02:18:59.532316 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=4483c9fafb00dc40ccf49f573edaf78b95254d62fcee73b7db39e73c6e1199a2 I1002 02:18:59.532332 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=f144a47f17521db4685e5be57082c9f073996c74e5c68427f0ab7fb564ae6279 I1002 02:18:59.532340 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I1002 02:18:59.532357 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=7873d0f5c860ee70b6674d40af3d863e49d74ba481dc2a94c516a91ce6a6d3b4 I1002 02:18:59.532376 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I1002 02:18:59.532385 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I1002 02:18:59.532390 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.548234396s to process 37 records I1002 02:18:59.542698 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-5v7tq pod in namespace openshift-dns (previous: false). I1002 02:18:59.743305 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-szgzg pod in namespace openshift-dns (previous: false). I1002 02:18:59.943414 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-szgzg pod in namespace openshift-dns (previous: false). W1002 02:18:59.994946 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:19:00.143832 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-hlth7 pod in namespace openshift-dns (previous: false). I1002 02:19:00.344116 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:19:00.344133 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-wbkk4 pod in namespace openshift-dns (previous: false). I1002 02:19:00.549746 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:19:00.549763 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-z7wpj pod in namespace openshift-dns (previous: false). I1002 02:19:00.744034 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I1002 02:19:00.744051 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for cluster-samples-operator container cluster-samples-operator-687f774f9f-42sn2 pod in namespace openshift-cluster-samples-operator (previous: false). I1002 02:19:00.945040 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for cluster-samples-operator-watch container cluster-samples-operator-687f774f9f-42sn2 pod in namespace openshift-cluster-samples-operator (previous: false). W1002 02:19:00.995079 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I1002 02:19:01.144566 1 tasks_processing.go:74] worker 42 stopped. I1002 02:19:01.144766 1 recorder.go:70] Recording events/openshift-console-operator with fingerprint=9512b657287b3797d527dbb25834cd0e3f302ae136816bfca754f1bb5a6c88e0 I1002 02:19:01.144840 1 recorder.go:70] Recording events/openshift-console with fingerprint=4526be1628bf4699de10b4d693267556a19a0f21bacf0fe45e84d668d48d301e I1002 02:19:01.144856 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=2ff9734b1df80a56bd2add7b11889e40e5521002ae14fcc9ce8e2c2c9273ceaf I1002 02:19:01.144906 1 recorder.go:70] Recording events/openshift-dns with fingerprint=2a69c9a1c32807b87108b640d1401eb8945d940668f1193e14dbbb3ff7732084 I1002 02:19:01.144927 1 recorder.go:70] Recording events/openshift-cluster-samples-operator with fingerprint=73f54f39b03927e8c81612682afde1f012428b872a5efbb66a5edbbff1f40a74 I1002 02:19:01.145023 1 recorder.go:70] Recording config/pod/openshift-console-operator/console-operator-85b84f584d-dxmxm with fingerprint=31284d6904a1567103c9fc678b0538b487c3fef8ebc0ceda92cb8e68e6ab8dd1 E1002 02:19:01.145037 1 gather.go:161] error recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-85b84f584d-dxmxm.json" because of the error: the record with the same name "config/pod/openshift-console-operator/console-operator-85b84f584d-dxmxm.json" was already recorded and had the fingerprint "31284d6904a1567103c9fc678b0538b487c3fef8ebc0ceda92cb8e68e6ab8dd1", overwriting with the record having fingerprint "31284d6904a1567103c9fc678b0538b487c3fef8ebc0ceda92cb8e68e6ab8dd1" W1002 02:19:01.145048 1 gather.go:155] issue recording gatherer "clusterconfig" function "operators_pods_and_events" result "config/pod/openshift-console-operator/console-operator-85b84f584d-dxmxm.json" because of the warning: warning: the record with the same fingerprint "31284d6904a1567103c9fc678b0538b487c3fef8ebc0ceda92cb8e68e6ab8dd1" was already recorded at path "config/pod/openshift-console-operator/console-operator-85b84f584d-dxmxm.json", recording another one with a different path "config/pod/openshift-console-operator/console-operator-85b84f584d-dxmxm.json" I1002 02:19:01.145057 1 recorder.go:70] Recording config/pod/openshift-console-operator/logs/console-operator-85b84f584d-dxmxm/console-operator_previous.log with fingerprint=0ba3d43181dd1849ee4eeb1dd1bf3c378c939b9e345950466b5e2cca6dd136ec I1002 02:19:01.145124 1 recorder.go:70] Recording config/pod/openshift-console-operator/logs/console-operator-85b84f584d-dxmxm/console-operator_current.log with fingerprint=ac99be54c9f30510bc9922f44f621d041a7d71a41d4215d11bbf8333364f6dcb I1002 02:19:01.145136 1 recorder.go:70] Recording config/pod/openshift-console/logs/console-6f65856bc-gcwz5/console_current.log with fingerprint=d7e3741a1094968f8dcc5768097174cd3ca64fcb3a2ea20479553ed9767308f5 I1002 02:19:01.145144 1 recorder.go:70] Recording config/pod/openshift-console/logs/console-7fb84c58d4-pf9tx/console_current.log with fingerprint=5d69aee6ad15abe857b75b634879271d966631532024e123dd55ee10117a40fe I1002 02:19:01.145152 1 recorder.go:70] Recording config/pod/openshift-console/logs/console-84ccd6577f-98phn/console_current.log with fingerprint=2c9e155193990d5be417898903791e37eca8f3a82f72c159566fd5e0fb90b371 I1002 02:19:01.145157 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-2d5df/dns_current.log with fingerprint=85ba888b6146d05f967468b1137eee75a2d347bb330a39adaeca5aef3ed4e2a0 I1002 02:19:01.145164 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-2d5df/kube-rbac-proxy_current.log with fingerprint=a134477d02e0b82d202a771efe12a69891faee425c8bad0895f7dc2562b63093 I1002 02:19:01.145172 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-5v7tq/dns_current.log with fingerprint=6190060bedbd9bcce1f36de533ddd1a27cb92aec943564cc45ebd19ab8fa9572 I1002 02:19:01.145177 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-5v7tq/kube-rbac-proxy_current.log with fingerprint=56b1b156712c30a47c3792644ecf9fb6f20f6486cbdbe632a42f9afbf689ca5f I1002 02:19:01.145185 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-szgzg/dns_current.log with fingerprint=6296c0bbe0c9058a6d0ea6eb3e3c3af461f234d8d92e28117b993ff382174943 I1002 02:19:01.145189 1 recorder.go:70] Recording config/pod/openshift-dns/logs/dns-default-szgzg/kube-rbac-proxy_current.log with fingerprint=4a22fbce396dab0808b104cb496d9ed082d8b5191f4a75325d2b0eae296c1e5f I1002 02:19:01.145220 1 recorder.go:70] Recording config/pod/openshift-cluster-samples-operator/logs/cluster-samples-operator-687f774f9f-42sn2/cluster-samples-operator_current.log with fingerprint=688cc5c340e3f523648faa4e4849160e6d0660f917532e19d7c9c26a915d7732 I1002 02:19:01.145227 1 recorder.go:70] Recording config/pod/openshift-cluster-samples-operator/logs/cluster-samples-operator-687f774f9f-42sn2/cluster-samples-operator-watch_current.log with fingerprint=5fc2facb5e3eab9424d4c21566c9c91e7a657a014d738f3310328a9525d09e01 I1002 02:19:01.145231 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.161692083s to process 19 records W1002 02:19:01.993119 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I1002 02:19:01.993145 1 tasks_processing.go:74] worker 7 stopped. E1002 02:19:01.993157 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I1002 02:19:01.993170 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I1002 02:19:01.993181 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.010328044s to process 1 records I1002 02:19:10.030305 1 tasks_processing.go:74] worker 25 stopped. I1002 02:19:10.030345 1 recorder.go:70] Recording config/installplans with fingerprint=6f9781df213f917044fe07f29e6836f4c98c6ccf7740910e145b68b90ff5234d I1002 02:19:10.030355 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 13.04719115s to process 1 records I1002 02:19:10.788668 1 tasks_processing.go:74] worker 17 stopped. I1002 02:19:10.788900 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=dabcdda6991bac1666e8c7d62a42c20e4eacf733a346e4ee546090403d855ed3 I1002 02:19:10.788914 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.805552382s to process 1 records E1002 02:19:10.788967 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.806s with: function \"tsdb_status\" failed with an error, function \"metrics\" failed with an error, function \"silenced_alerts\" failed with an error, function \"active_alerts\" failed with an error, function \"support_secret\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, unable to record function \"operators_pods_and_events\" record \"config/pod/openshift-console-operator/console-operator-85b84f584d-dxmxm.json\", function \"dvo_metrics\" failed with an error" I1002 02:19:10.790073 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "tsdb_status" failed with an error, function "metrics" failed with an error, function "silenced_alerts" failed with an error, function "active_alerts" failed with an error, function "support_secret" failed with an error, function "machine_healthchecks" failed with an error, function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, unable to record function "operators_pods_and_events" record "config/pod/openshift-console-operator/console-operator-85b84f584d-dxmxm.json", function "dvo_metrics" failed with an error I1002 02:19:10.790087 1 periodic.go:212] Running workloads gatherer I1002 02:19:10.790106 1 tasks_processing.go:45] number of workers: 2 I1002 02:19:10.790115 1 tasks_processing.go:69] worker 1 listening for tasks. I1002 02:19:10.790119 1 tasks_processing.go:71] worker 1 working on workload_info task. I1002 02:19:10.790128 1 tasks_processing.go:69] worker 0 listening for tasks. I1002 02:19:10.790205 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I1002 02:19:10.795144 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-154-151.ec2.internal... I1002 02:19:10.795153 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-143-80.ec2.internal... I1002 02:19:10.795166 1 gather_workloads_runtime_infos.go:63] Gathering workload runtime info for node ip-10-0-160-65.ec2.internal... I1002 02:19:10.813624 1 tasks_processing.go:74] worker 0 stopped. I1002 02:19:10.813643 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 23.402379ms to process 0 records I1002 02:19:13.630425 1 gather_workloads_runtime_infos.go:84] Gathered workload runtime infos in 3s I1002 02:19:13.649200 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 24s for image data I1002 02:19:13.655557 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (7ms) I1002 02:19:13.662355 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (7ms) I1002 02:19:13.668859 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (6ms) I1002 02:19:13.677257 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (8ms) I1002 02:19:13.683680 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (6ms) I1002 02:19:13.690194 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (6ms) I1002 02:19:13.696577 1 gather_workloads_info.go:387] No image sha256:6c3c7f77d7a3815bbb69cad5f6f1742c17d9597bc135ba3d116c9736d98fae33 (6ms) I1002 02:19:13.703308 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (7ms) I1002 02:19:13.709903 1 gather_workloads_info.go:387] No image sha256:e40bbab1e52f580ab471bd7ab19ae23a4bcbaf1893243a05238af6bede7ba9cc (7ms) I1002 02:19:13.716397 1 gather_workloads_info.go:387] No image sha256:929a4a9c96a08b57fe4c315deca55c30d1990c83e34b8b5692f7646d29f715c8 (6ms) I1002 02:19:13.756315 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (40ms) I1002 02:19:13.857126 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (101ms) I1002 02:19:13.956621 1 gather_workloads_info.go:387] No image sha256:a3d34d8f38a540ce79d34a5248b1965346155497db57b72cb4758d659418059c (99ms) I1002 02:19:14.057501 1 gather_workloads_info.go:387] No image sha256:798001e24f1ed6a5621c442729a840ba2a2abc43433901e8450caa12b4bad5c5 (101ms) I1002 02:19:14.156186 1 gather_workloads_info.go:387] No image sha256:7854174b4b98e9b10d9c8e9b43113df1217ab21db4b2395d9399af0c3d7911a3 (99ms) I1002 02:19:14.258157 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (102ms) I1002 02:19:14.356606 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (98ms) I1002 02:19:14.457939 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (101ms) I1002 02:19:14.560165 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (102ms) I1002 02:19:14.656419 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (96ms) I1002 02:19:14.755653 1 gather_workloads_info.go:387] No image sha256:799f5628c18e77a49c08645c03179046b5200c8cbcfd65737fb59668132f393e (99ms) I1002 02:19:14.856605 1 gather_workloads_info.go:398] Found image sha256:59db91eadf1e1e5343777be43ff25fb712f300f9341be48ba05f45270944536f (101ms) I1002 02:19:14.957124 1 gather_workloads_info.go:387] No image sha256:527ed405bf66234718321996dacf51f91c64c746de9f1509416ef6ce89c90a50 (100ms) I1002 02:19:15.055907 1 gather_workloads_info.go:387] No image sha256:099b3af427b8e1eb44765283a640446c3225151baa06eed789623206151a60cd (99ms) I1002 02:19:15.156729 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (101ms) I1002 02:19:15.256550 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (100ms) I1002 02:19:15.357036 1 gather_workloads_info.go:387] No image sha256:68d8e92046969bcfcbca2d2b3dcf4dcad5f6edc5fcb44861eb22f8079a43ea4d (100ms) I1002 02:19:15.455550 1 gather_workloads_info.go:387] No image sha256:00f977c2275f5bf03d423911159a39ca44fabc1862ecb7ae492198ec8c46c6bb (98ms) I1002 02:19:15.555727 1 gather_workloads_info.go:387] No image sha256:38dd36da63b1f01316a02daf6c18b821318c6ec313712147292d74abf955e0da (100ms) I1002 02:19:15.656088 1 gather_workloads_info.go:387] No image sha256:46c2c396ca651699738c3f26b79b10af2922123dd27c2e32382d2a31a87e92c7 (100ms) I1002 02:19:15.756836 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (101ms) I1002 02:19:15.856069 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (99ms) I1002 02:19:15.955644 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (100ms) I1002 02:19:16.057278 1 gather_workloads_info.go:387] No image sha256:1f2aa1e1026570162984f7fbb634635bcf319e408cafa8f9034ee842a2f193ab (102ms) I1002 02:19:16.155891 1 gather_workloads_info.go:387] No image sha256:bcca5c17371caa2dce7e28da4c9fe30163c340fa172187f94db90ea1bd6ab80d (99ms) I1002 02:19:16.256413 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (101ms) I1002 02:19:16.356510 1 gather_workloads_info.go:387] No image sha256:6277dac65decba0ea094146bb99600f479eaf804696842e724de1f1b436f9a38 (100ms) I1002 02:19:16.456725 1 gather_workloads_info.go:387] No image sha256:270a7bac889ed64d75ce11ae26e8634a6209ff718b83fae2c888cfc758316aa3 (100ms) I1002 02:19:16.556317 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (100ms) I1002 02:19:16.656777 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (100ms) I1002 02:19:16.756581 1 gather_workloads_info.go:387] No image sha256:5cba745f09f3bd6b8028c6773597cbb30bf3639a84f2b4b6493fe20642339a2c (100ms) I1002 02:19:16.859577 1 gather_workloads_info.go:387] No image sha256:ce3d8211c0bde5788a4fd04c3eff31ae591437ceab2b3168dbbdfe408673c8b1 (103ms) I1002 02:19:16.956671 1 gather_workloads_info.go:387] No image sha256:1cc2f3c83068c8c67d9070f67677e1bb6b4feff7ac5744cad08711893e56b55f (97ms) I1002 02:19:17.056217 1 gather_workloads_info.go:387] No image sha256:039479f355d6903e1018abf8427fece3465c4348d4de2144ec38114b51bec27e (100ms) I1002 02:19:17.157910 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (102ms) I1002 02:19:17.257107 1 gather_workloads_info.go:398] Found image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (99ms) I1002 02:19:17.359977 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (103ms) I1002 02:19:17.457663 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (98ms) I1002 02:19:17.556311 1 gather_workloads_info.go:387] No image sha256:1d471ad866b8564b209214d7dd3a7363c47e9535211d660b63b46abb278af7ab (99ms) I1002 02:19:17.556340 1 tasks_processing.go:74] worker 1 stopped. I1002 02:19:17.556579 1 recorder.go:70] Recording config/workload_info with fingerprint=0f38963b2d1b1c9103ccaa64e408ed0de9be273ace320f65ff2acae16825b9d2 I1002 02:19:17.556593 1 gather.go:177] gatherer "workloads" function "workload_info" took 6.76621443s to process 1 records I1002 02:19:17.556604 1 periodic.go:259] Periodic gather workloads completed in 6.766s I1002 02:19:17.556611 1 controllerstatus.go:80] name=periodic-workloads healthy=true reason= message= I1002 02:19:17.556615 1 periodic.go:212] Running conditional gatherer I1002 02:19:17.564553 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I1002 02:19:17.716408 1 conditional_gatherer.go:336] updating alerts cache for conditional gatherer E1002 02:19:17.719159 1 conditional_gatherer.go:322] unable to update alerts cache: Get "https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?match%5B%5D=ALERTS%7Balertstate%3D%22firing%22%7D&query=ALERTS": dial tcp 172.30.241.191:9091: connect: connection refused I1002 02:19:17.719219 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I1002 02:19:17.726711 1 conditional_gatherer.go:390] cluster version is '4.19.9' E1002 02:19:17.726725 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:19:17.726730 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:19:17.726733 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:19:17.726735 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:19:17.726737 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:19:17.726740 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:19:17.726742 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:19:17.726744 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:19:17.726746 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E1002 02:19:17.726749 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I1002 02:19:17.726761 1 tasks_processing.go:45] number of workers: 3 I1002 02:19:17.726773 1 tasks_processing.go:69] worker 2 listening for tasks. I1002 02:19:17.726778 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I1002 02:19:17.726784 1 tasks_processing.go:69] worker 0 listening for tasks. I1002 02:19:17.726797 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I1002 02:19:17.726802 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I1002 02:19:17.726802 1 tasks_processing.go:69] worker 1 listening for tasks. I1002 02:19:17.726815 1 tasks_processing.go:74] worker 1 stopped. I1002 02:19:17.726839 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=9fafdcbf373f1f367f1d69551ea59114592cce1681189be0f3dde774e0530661 I1002 02:19:17.726849 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 942ns to process 1 records I1002 02:19:17.726878 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=5f681cc1442447fd2c1534f876836dff54caf3c545b582a5a8aae894f9203c5d I1002 02:19:17.726884 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 886ns to process 1 records I1002 02:19:17.726889 1 tasks_processing.go:74] worker 0 stopped. I1002 02:19:17.726999 1 tasks_processing.go:74] worker 2 stopped. I1002 02:19:17.727008 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 194.128µs to process 0 records I1002 02:19:17.727027 1 controllerstatus.go:80] name=periodic-conditional healthy=true reason=AsExpected message= I1002 02:19:17.727037 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=363fa5c8fa2573b18bc685faeca9ca9f021a8f80760895b7701f54e3dcd5c85f I1002 02:19:17.749100 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=e9c1d01d1c75eb6b58bd2c6c9f97ebeee4bbf4b407d8076321fa5e1403cc84fa I1002 02:19:17.749198 1 diskrecorder.go:70] Writing 124 records to /var/lib/insights-operator/insights-2026-10-02-021917.tar.gz I1002 02:19:17.756316 1 diskrecorder.go:51] Wrote 124 records to disk in 7ms I1002 02:19:17.756344 1 periodic.go:281] Gathering cluster info every 2h0m0s I1002 02:19:17.756357 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I1002 02:20:26.983504 1 diskrecorder.go:223] Found files to send: insights-2026-10-02-021917.tar.gz I1002 02:20:26.983530 1 insightsuploader.go:150] Checking archives to upload periodically every 15m31.581581002s I1002 02:20:26.983538 1 insightsuploader.go:165] Uploading latest report since 0001-01-01T00:00:00Z I1002 02:20:26.993704 1 requests.go:46] Uploading application/vnd.redhat.openshift.periodic to https://console.redhat.com/api/ingress/v1/upload I1002 02:20:27.124048 1 requests.go:87] Successfully reported id=2026-10-02T02:20:26Z x-rh-insights-request-id=0f05fb7b4bb34b9d9d302e107e8239fa, wrote=68468 I1002 02:20:27.124146 1 insightsuploader.go:187] Uploaded report successfully in 140.604519ms I1002 02:20:27.124167 1 controller.go:119] Initializing last reported time to 2026-10-02T02:20:26Z I1002 02:20:27.124243 1 insightsreport.go:304] Archive uploaded, starting pulling report... I1002 02:20:27.124257 1 insightsreport.go:215] Starting retrieving report from Smart Proxy I1002 02:20:27.124264 1 insightsreport.go:221] Initial delay for pulling: 1m0s I1002 02:20:27.129060 1 controller.go:481] The operator is healthy I1002 02:20:56.997367 1 controller.go:481] The operator is healthy I1002 02:21:28.824945 1 insightsreport.go:137] Pulling report from smart-proxy I1002 02:21:28.824971 1 insightsreport.go:149] Retrieving report I1002 02:21:28.833701 1 requests.go:110] Retrieving report for cluster: 2d4a96ce-85f2-4873-80b0-b390e7062047 I1002 02:21:28.833710 1 requests.go:111] Endpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/2d4a96ce-85f2-4873-80b0-b390e7062047/reports I1002 02:21:28.835566 1 requests.go:121] Retrieving report from https://console.redhat.com/api/insights-results-aggregator/v2/cluster/2d4a96ce-85f2-4873-80b0-b390e7062047/reports I1002 02:21:28.980080 1 insightsreport.go:184] Report retrieved I1002 02:21:29.017500 1 insightsreport.go:239] Report retrieved correctly I1002 02:22:57.000560 1 controller.go:481] The operator is healthy I1002 02:23:56.974952 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:23:56.982542 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:23:56.982559 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:23:56.985747 1 secretconfigobserver.go:119] support secret does not exist I1002 02:24:56.997734 1 controller.go:481] The operator is healthy I1002 02:26:57.000539 1 controller.go:481] The operator is healthy I1002 02:28:56.969235 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:28:56.986360 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:28:56.990130 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:28:56.990143 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:28:56.993667 1 secretconfigobserver.go:119] support secret does not exist I1002 02:28:56.996368 1 controller.go:481] The operator is healthy I1002 02:30:56.997777 1 controller.go:481] The operator is healthy I1002 02:32:56.996256 1 controller.go:481] The operator is healthy I1002 02:33:56.994197 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:33:56.999195 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:33:56.999212 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:33:57.002863 1 secretconfigobserver.go:119] support secret does not exist I1002 02:34:56.997392 1 controller.go:481] The operator is healthy I1002 02:36:03.706990 1 insightsuploader.go:146] Nothing to report since 2026-10-02T02:20:26Z I1002 02:36:56.999613 1 controller.go:481] The operator is healthy I1002 02:38:56.970844 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:38:56.974556 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:38:56.998252 1 controller.go:481] The operator is healthy I1002 02:38:57.003166 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:38:57.014917 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:38:57.014930 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:38:57.021496 1 secretconfigobserver.go:119] support secret does not exist I1002 02:40:57.002682 1 controller.go:481] The operator is healthy I1002 02:42:56.998745 1 controller.go:481] The operator is healthy I1002 02:43:57.021898 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:43:57.026952 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:43:57.026969 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:43:57.030512 1 secretconfigobserver.go:119] support secret does not exist I1002 02:44:56.998821 1 controller.go:481] The operator is healthy I1002 02:46:56.997252 1 controller.go:481] The operator is healthy I1002 02:48:56.971674 1 configmapobserver.go:84] configmaps "insights-config" not found I1002 02:48:56.997210 1 controller.go:481] The operator is healthy I1002 02:48:57.031149 1 secretconfigobserver.go:136] Refreshing configuration from cluster pull secret I1002 02:48:57.035260 1 secretconfigobserver.go:249] Found cloud.openshift.com token I1002 02:48:57.035274 1 secretconfigobserver.go:162] Refreshing configuration from cluster support secret I1002 02:48:57.038723 1 secretconfigobserver.go:119] support secret does not exist I1002 02:50:56.996301 1 controller.go:481] The operator is healthy I1002 02:52:02.428582 1 insightsuploader.go:146] Nothing to report since 2026-10-02T02:20:26Z I1002 02:52:56.997192 1 controller.go:481] The operator is healthy