W0925 21:48:50.692414 1 cmd.go:257] Using insecure, self-signed certificates I0925 21:48:51.060293 1 start.go:138] Unable to read service ca bundle: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0925 21:48:51.060564 1 observer_polling.go:159] Starting file observer W0925 21:48:51.084133 1 builder.go:272] unable to get owner reference (falling back to namespace): replicasets.apps "insights-operator-5ff5cb4f99" is forbidden: User "system:serviceaccount:openshift-insights:operator" cannot get resource "replicasets" in API group "apps" in the namespace "openshift-insights" I0925 21:48:51.395185 1 operator.go:59] Starting insights-operator v0.0.0-master+$Format:%H$ I0925 21:48:51.395391 1 legacy_config.go:327] Current config: {"report":false,"storagePath":"/var/lib/insights-operator","interval":"2h","endpoint":"https://console.redhat.com/api/ingress/v1/upload","conditionalGathererEndpoint":"https://console.redhat.com/api/gathering/v2/%s/gathering_rules","pull_report":{"endpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports","delay":"60s","timeout":"3000s","min_retry":"30s"},"impersonate":"system:serviceaccount:openshift-insights:gather","enableGlobalObfuscation":false,"ocm":{"scaEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates","scaInterval":"8h","scaDisabled":false,"clusterTransferEndpoint":"https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/","clusterTransferInterval":"12h"},"disableInsightsAlerts":false,"processingStatusEndpoint":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status","reportEndpointTechPreview":"https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/report"} I0925 21:48:51.396296 1 secure_serving.go:57] Forcing use of http/1.1 only I0925 21:48:51.396374 1 simple_featuregate_reader.go:171] Starting feature-gate-detector W0925 21:48:51.396850 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256' detected. W0925 21:48:51.397050 1 secure_serving.go:69] Use of insecure cipher 'TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256' detected. W0925 21:48:51.397055 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_GCM_SHA256' detected. W0925 21:48:51.397057 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_GCM_SHA384' detected. W0925 21:48:51.397060 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_128_CBC_SHA' detected. W0925 21:48:51.397077 1 secure_serving.go:69] Use of insecure cipher 'TLS_RSA_WITH_AES_256_CBC_SHA' detected. I0925 21:48:51.401108 1 operator.go:124] FeatureGates initialized: knownFeatureGates=[AWSEFSDriverVolumeMetrics AdditionalRoutingCapabilities AdminNetworkPolicy AlibabaPlatform AzureWorkloadIdentity BareMetalLoadBalancer BuildCSIVolumes CPMSMachineNamePrefix ChunkSizeMiB CloudDualStackNodeIPs ConsolePluginContentSecurityPolicy DisableKubeletCloudCredentialProviders ExternalOIDC GCPLabelsTags GatewayAPI GatewayAPIController HardwareSpeed IngressControllerLBSubnetsAWS KMSv1 ManagedBootImages ManagedBootImagesAWS MetricsCollectionProfiles MultiArchInstallAWS MultiArchInstallGCP NetworkDiagnosticsConfig NetworkLiveMigration NetworkSegmentation NodeDisruptionPolicy OnClusterBuild PersistentIPsForVirtualization PrivateHostedZoneAWS RouteExternalCertificate ServiceAccountTokenNodeBinding SetEIPForNLBIngressController VSphereDriverConfiguration VSphereMultiVCenters ValidatingAdmissionPolicy AWSClusterHostedDNS AutomatedEtcdBackup BootcNodeManagement ClusterAPIInstall ClusterAPIInstallIBMCloud ClusterMonitoringConfig ClusterVersionOperatorConfiguration DNSNameResolver DualReplica DyanmicServiceEndpointIBMCloud DynamicResourceAllocation EtcdBackendQuota EventedPLEG Example Example2 ExternalOIDCWithUIDAndExtraClaimMappings GCPClusterHostedDNS GCPCustomAPIEndpoints HighlyAvailableArbiter ImageStreamImportMode IngressControllerDynamicConfigurationManager InsightsConfig InsightsConfigAPI InsightsOnDemandDataGather InsightsRuntimeExtractor KMSEncryptionProvider MachineAPIMigration MachineAPIOperatorDisableMachineHealthCheckController MachineAPIProviderOpenStack MachineConfigNodes MaxUnavailableStatefulSet MinimumKubeletVersion MixedCPUsAllocation MultiArchInstallAzure NewOLM NewOLMCatalogdAPIV1Metas NewOLMOwnSingleNamespace NewOLMPreflightPermissionChecks NodeSwap NutanixMultiSubnets OVNObservability OpenShiftPodSecurityAdmission PinnedImages PlatformOperators ProcMountType RouteAdvertisements SELinuxChangePolicy SELinuxMount ShortCertRotation SignatureStores SigstoreImageVerification SigstoreImageVerificationPKI TranslateStreamCloseWebsocketRequests UpgradeStatus UserNamespacesPodSecurityStandards UserNamespacesSupport VSphereConfigurableMaxAllowedBlockVolumesPerNode VSphereHostVMGroupZonal VSphereMultiDisk VSphereMultiNetworks VolumeAttributesClass VolumeGroupSnapshot] I0925 21:48:51.401156 1 event.go:377] Event(v1.ObjectReference{Kind:"Namespace", Namespace:"openshift-insights", Name:"openshift-insights", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'FeatureGatesInitialized' FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{"AWSEFSDriverVolumeMetrics", "AdditionalRoutingCapabilities", "AdminNetworkPolicy", "AlibabaPlatform", "AzureWorkloadIdentity", "BareMetalLoadBalancer", "BuildCSIVolumes", "CPMSMachineNamePrefix", "ChunkSizeMiB", "CloudDualStackNodeIPs", "ConsolePluginContentSecurityPolicy", "DisableKubeletCloudCredentialProviders", "ExternalOIDC", "GCPLabelsTags", "GatewayAPI", "GatewayAPIController", "HardwareSpeed", "IngressControllerLBSubnetsAWS", "KMSv1", "ManagedBootImages", "ManagedBootImagesAWS", "MetricsCollectionProfiles", "MultiArchInstallAWS", "MultiArchInstallGCP", "NetworkDiagnosticsConfig", "NetworkLiveMigration", "NetworkSegmentation", "NodeDisruptionPolicy", "OnClusterBuild", "PersistentIPsForVirtualization", "PrivateHostedZoneAWS", "RouteExternalCertificate", "ServiceAccountTokenNodeBinding", "SetEIPForNLBIngressController", "VSphereDriverConfiguration", "VSphereMultiVCenters", "ValidatingAdmissionPolicy"}, Disabled:[]v1.FeatureGateName{"AWSClusterHostedDNS", "AutomatedEtcdBackup", "BootcNodeManagement", "ClusterAPIInstall", "ClusterAPIInstallIBMCloud", "ClusterMonitoringConfig", "ClusterVersionOperatorConfiguration", "DNSNameResolver", "DualReplica", "DyanmicServiceEndpointIBMCloud", "DynamicResourceAllocation", "EtcdBackendQuota", "EventedPLEG", "Example", "Example2", "ExternalOIDCWithUIDAndExtraClaimMappings", "GCPClusterHostedDNS", "GCPCustomAPIEndpoints", "HighlyAvailableArbiter", "ImageStreamImportMode", "IngressControllerDynamicConfigurationManager", "InsightsConfig", "InsightsConfigAPI", "InsightsOnDemandDataGather", "InsightsRuntimeExtractor", "KMSEncryptionProvider", "MachineAPIMigration", "MachineAPIOperatorDisableMachineHealthCheckController", "MachineAPIProviderOpenStack", "MachineConfigNodes", "MaxUnavailableStatefulSet", "MinimumKubeletVersion", "MixedCPUsAllocation", "MultiArchInstallAzure", "NewOLM", "NewOLMCatalogdAPIV1Metas", "NewOLMOwnSingleNamespace", "NewOLMPreflightPermissionChecks", "NodeSwap", "NutanixMultiSubnets", "OVNObservability", "OpenShiftPodSecurityAdmission", "PinnedImages", "PlatformOperators", "ProcMountType", "RouteAdvertisements", "SELinuxChangePolicy", "SELinuxMount", "ShortCertRotation", "SignatureStores", "SigstoreImageVerification", "SigstoreImageVerificationPKI", "TranslateStreamCloseWebsocketRequests", "UpgradeStatus", "UserNamespacesPodSecurityStandards", "UserNamespacesSupport", "VSphereConfigurableMaxAllowedBlockVolumesPerNode", "VSphereHostVMGroupZonal", "VSphereMultiDisk", "VSphereMultiNetworks", "VolumeAttributesClass", "VolumeGroupSnapshot"}} E0925 21:48:51.404318 1 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:serviceaccount:openshift-insights:operator\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-insights\"" event="&Event{ObjectMeta:{openshift-insights.18d8aeb1ffa288a8 openshift-insights 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Namespace,Namespace:openshift-insights,Name:openshift-insights,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:FeatureGatesInitialized,Message:FeatureGates updated to featuregates.Features{Enabled:[]v1.FeatureGateName{\"AWSEFSDriverVolumeMetrics\", \"AdditionalRoutingCapabilities\", \"AdminNetworkPolicy\", \"AlibabaPlatform\", \"AzureWorkloadIdentity\", \"BareMetalLoadBalancer\", \"BuildCSIVolumes\", \"CPMSMachineNamePrefix\", \"ChunkSizeMiB\", \"CloudDualStackNodeIPs\", \"ConsolePluginContentSecurityPolicy\", \"DisableKubeletCloudCredentialProviders\", \"ExternalOIDC\", \"GCPLabelsTags\", \"GatewayAPI\", \"GatewayAPIController\", \"HardwareSpeed\", \"IngressControllerLBSubnetsAWS\", \"KMSv1\", \"ManagedBootImages\", \"ManagedBootImagesAWS\", \"MetricsCollectionProfiles\", \"MultiArchInstallAWS\", \"MultiArchInstallGCP\", \"NetworkDiagnosticsConfig\", \"NetworkLiveMigration\", \"NetworkSegmentation\", \"NodeDisruptionPolicy\", \"OnClusterBuild\", \"PersistentIPsForVirtualization\", \"PrivateHostedZoneAWS\", \"RouteExternalCertificate\", \"ServiceAccountTokenNodeBinding\", \"SetEIPForNLBIngressController\", \"VSphereDriverConfiguration\", \"VSphereMultiVCenters\", \"ValidatingAdmissionPolicy\"}, Disabled:[]v1.FeatureGateName{\"AWSClusterHostedDNS\", \"AutomatedEtcdBackup\", \"BootcNodeManagement\", \"ClusterAPIInstall\", \"ClusterAPIInstallIBMCloud\", \"ClusterMonitoringConfig\", \"ClusterVersionOperatorConfiguration\", \"DNSNameResolver\", \"DualReplica\", \"DyanmicServiceEndpointIBMCloud\", \"DynamicResourceAllocation\", \"EtcdBackendQuota\", \"EventedPLEG\", \"Example\", \"Example2\", \"ExternalOIDCWithUIDAndExtraClaimMappings\", \"GCPClusterHostedDNS\", \"GCPCustomAPIEndpoints\", \"HighlyAvailableArbiter\", \"ImageStreamImportMode\", \"IngressControllerDynamicConfigurationManager\", \"InsightsConfig\", \"InsightsConfigAPI\", \"InsightsOnDemandDataGather\", \"InsightsRuntimeExtractor\", \"KMSEncryptionProvider\", \"MachineAPIMigration\", \"MachineAPIOperatorDisableMachineHealthCheckController\", \"MachineAPIProviderOpenStack\", \"MachineConfigNodes\", \"MaxUnavailableStatefulSet\", \"MinimumKubeletVersion\", \"MixedCPUsAllocation\", \"MultiArchInstallAzure\", \"NewOLM\", \"NewOLMCatalogdAPIV1Metas\", \"NewOLMOwnSingleNamespace\", \"NewOLMPreflightPermissionChecks\", \"NodeSwap\", \"NutanixMultiSubnets\", \"OVNObservability\", \"OpenShiftPodSecurityAdmission\", \"PinnedImages\", \"PlatformOperators\", \"ProcMountType\", \"RouteAdvertisements\", \"SELinuxChangePolicy\", \"SELinuxMount\", \"ShortCertRotation\", \"SignatureStores\", \"SigstoreImageVerification\", \"SigstoreImageVerificationPKI\", \"TranslateStreamCloseWebsocketRequests\", \"UpgradeStatus\", \"UserNamespacesPodSecurityStandards\", \"UserNamespacesSupport\", \"VSphereConfigurableMaxAllowedBlockVolumesPerNode\", \"VSphereHostVMGroupZonal\", \"VSphereMultiDisk\", \"VSphereMultiNetworks\", \"VolumeAttributesClass\", \"VolumeGroupSnapshot\"}},Source:EventSource{Component:openshift-insights-operator,Host:,},FirstTimestamp:2026-09-25 21:48:51.401058472 +0000 UTC m=+0.737882915,LastTimestamp:2026-09-25 21:48:51.401058472 +0000 UTC m=+0.737882915,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:openshift-insights-operator,ReportingInstance:,}" W0925 21:48:51.408457 1 configmapobserver.go:64] Cannot get the configuration config map: configmaps "insights-config" not found. Default configuration is used. I0925 21:48:51.408478 1 secretconfigobserver.go:216] Legacy configuration set: enabled=false endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=false reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0925 21:48:51.408479 1 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController I0925 21:48:51.408488 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController I0925 21:48:51.408510 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" I0925 21:48:51.408520 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0925 21:48:51.408510 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0925 21:48:51.408534 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0925 21:48:51.408602 1 base_controller.go:76] Waiting for caches to sync for ConfigController I0925 21:48:51.408692 1 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/tmp/serving-cert-1618173516/tls.crt::/tmp/serving-cert-1618173516/tls.key" I0925 21:48:51.408792 1 secure_serving.go:213] Serving securely on [::]:8443 I0925 21:48:51.408816 1 tlsconfig.go:243] "Starting DynamicServingCertificateController" I0925 21:48:51.416057 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0925 21:48:51.416083 1 secretconfigobserver.go:204] Legacy configuration updated: enabled=true endpoint=https://console.redhat.com/api/ingress/v1/upload conditional_gatherer_endpoint=https://console.redhat.com/api/gathering/v2/%s/gathering_rules interval=2h0m0s token=true reportEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports initialPollingDelay=1m0s minRetryTime=30s pollingTimeout=50m0s processingStatusEndpoint=https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/request/%s/status I0925 21:48:51.421433 1 secretconfigobserver.go:119] support secret does not exist I0925 21:48:51.428601 1 secretconfigobserver.go:249] Found cloud.openshift.com token I0925 21:48:51.436555 1 secretconfigobserver.go:119] support secret does not exist I0925 21:48:51.441007 1 recorder.go:156] Pruning old reports every 6h3m10s, max age is 288h0m0s I0925 21:48:51.446519 1 periodic.go:212] Running clusterconfig gatherer I0925 21:48:51.446524 1 controllerstatus.go:80] name=insightsuploader healthy=true reason= message= I0925 21:48:51.446540 1 insightsuploader.go:86] Reporting status periodically to https://console.redhat.com/api/ingress/v1/upload every 2h0m0s, starting in 1m30s I0925 21:48:51.446557 1 controllerstatus.go:80] name=insightsreport healthy=true reason= message= I0925 21:48:51.446560 1 tasks_processing.go:45] number of workers: 64 I0925 21:48:51.446561 1 insightsreport.go:296] Starting report retriever I0925 21:48:51.446565 1 insightsreport.go:298] Insights analysis reports will be downloaded from the https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports endpoint with a delay of 1m0s I0925 21:48:51.446582 1 tasks_processing.go:69] worker 6 listening for tasks. I0925 21:48:51.446585 1 tasks_processing.go:69] worker 2 listening for tasks. I0925 21:48:51.446594 1 tasks_processing.go:69] worker 3 listening for tasks. I0925 21:48:51.446595 1 tasks_processing.go:69] worker 21 listening for tasks. I0925 21:48:51.446600 1 tasks_processing.go:69] worker 4 listening for tasks. I0925 21:48:51.446601 1 tasks_processing.go:71] worker 21 working on openstack_dataplanenodesets task. I0925 21:48:51.446602 1 tasks_processing.go:69] worker 1 listening for tasks. I0925 21:48:51.446600 1 tasks_processing.go:71] worker 3 working on pod_network_connectivity_checks task. I0925 21:48:51.446608 1 tasks_processing.go:69] worker 5 listening for tasks. I0925 21:48:51.446612 1 tasks_processing.go:69] worker 45 listening for tasks. I0925 21:48:51.446616 1 tasks_processing.go:69] worker 14 listening for tasks. I0925 21:48:51.446617 1 tasks_processing.go:69] worker 46 listening for tasks. I0925 21:48:51.446621 1 tasks_processing.go:69] worker 47 listening for tasks. I0925 21:48:51.446628 1 tasks_processing.go:69] worker 48 listening for tasks. I0925 21:48:51.446623 1 tasks_processing.go:69] worker 44 listening for tasks. I0925 21:48:51.446633 1 tasks_processing.go:69] worker 49 listening for tasks. I0925 21:48:51.446631 1 tasks_processing.go:69] worker 11 listening for tasks. I0925 21:48:51.446638 1 tasks_processing.go:69] worker 50 listening for tasks. I0925 21:48:51.446632 1 tasks_processing.go:69] worker 10 listening for tasks. I0925 21:48:51.446641 1 tasks_processing.go:69] worker 13 listening for tasks. I0925 21:48:51.446635 1 tasks_processing.go:69] worker 12 listening for tasks. I0925 21:48:51.446643 1 tasks_processing.go:69] worker 7 listening for tasks. I0925 21:48:51.446644 1 tasks_processing.go:69] worker 51 listening for tasks. I0925 21:48:51.446648 1 tasks_processing.go:69] worker 27 listening for tasks. I0925 21:48:51.446648 1 tasks_processing.go:69] worker 34 listening for tasks. I0925 21:48:51.446654 1 tasks_processing.go:69] worker 53 listening for tasks. I0925 21:48:51.446655 1 tasks_processing.go:69] worker 35 listening for tasks. I0925 21:48:51.446658 1 tasks_processing.go:69] worker 26 listening for tasks. I0925 21:48:51.446649 1 tasks_processing.go:69] worker 52 listening for tasks. I0925 21:48:51.446661 1 tasks_processing.go:69] worker 54 listening for tasks. I0925 21:48:51.446664 1 tasks_processing.go:69] worker 40 listening for tasks. I0925 21:48:51.446664 1 tasks_processing.go:69] worker 36 listening for tasks. I0925 21:48:51.446667 1 tasks_processing.go:69] worker 60 listening for tasks. I0925 21:48:51.446665 1 tasks_processing.go:69] worker 33 listening for tasks. I0925 21:48:51.446669 1 tasks_processing.go:69] worker 9 listening for tasks. I0925 21:48:51.446606 1 tasks_processing.go:69] worker 22 listening for tasks. I0925 21:48:51.446662 1 tasks_processing.go:69] worker 8 listening for tasks. I0925 21:48:51.446672 1 tasks_processing.go:69] worker 25 listening for tasks. I0925 21:48:51.446679 1 tasks_processing.go:69] worker 28 listening for tasks. I0925 21:48:51.446680 1 tasks_processing.go:69] worker 42 listening for tasks. I0925 21:48:51.446681 1 tasks_processing.go:69] worker 39 listening for tasks. I0925 21:48:51.446679 1 tasks_processing.go:69] worker 58 listening for tasks. I0925 21:48:51.446686 1 tasks_processing.go:69] worker 24 listening for tasks. I0925 21:48:51.446689 1 tasks_processing.go:71] worker 6 working on proxies task. I0925 21:48:51.446690 1 tasks_processing.go:69] worker 43 listening for tasks. I0925 21:48:51.446691 1 tasks_processing.go:69] worker 29 listening for tasks. I0925 21:48:51.446686 1 tasks_processing.go:69] worker 59 listening for tasks. I0925 21:48:51.446695 1 tasks_processing.go:69] worker 32 listening for tasks. I0925 21:48:51.446697 1 tasks_processing.go:71] worker 2 working on olm_operators task. I0925 21:48:51.446698 1 tasks_processing.go:69] worker 20 listening for tasks. I0925 21:48:51.446674 1 tasks_processing.go:69] worker 41 listening for tasks. I0925 21:48:51.446695 1 tasks_processing.go:69] worker 57 listening for tasks. I0925 21:48:51.446703 1 tasks_processing.go:69] worker 15 listening for tasks. I0925 21:48:51.446702 1 tasks_processing.go:69] worker 16 listening for tasks. I0925 21:48:51.446654 1 tasks_processing.go:69] worker 23 listening for tasks. I0925 21:48:51.446678 1 tasks_processing.go:69] worker 62 listening for tasks. I0925 21:48:51.446713 1 tasks_processing.go:71] worker 45 working on ingress task. I0925 21:48:51.446713 1 tasks_processing.go:71] worker 14 working on nodes task. I0925 21:48:51.446670 1 tasks_processing.go:69] worker 37 listening for tasks. I0925 21:48:51.446715 1 tasks_processing.go:71] worker 44 working on infrastructures task. I0925 21:48:51.446705 1 tasks_processing.go:69] worker 56 listening for tasks. I0925 21:48:51.446721 1 tasks_processing.go:71] worker 37 working on install_plans task. I0925 21:48:51.446725 1 tasks_processing.go:71] worker 9 working on machine_healthchecks task. I0925 21:48:51.446727 1 tasks_processing.go:71] worker 43 working on oauths task. I0925 21:48:51.446723 1 tasks_processing.go:71] worker 11 working on cluster_apiserver task. I0925 21:48:51.446722 1 tasks_processing.go:71] worker 5 working on openstack_version task. I0925 21:48:51.446750 1 tasks_processing.go:71] worker 56 working on image task. I0925 21:48:51.446768 1 tasks_processing.go:71] worker 41 working on image_pruners task. I0925 21:48:51.446770 1 tasks_processing.go:71] worker 28 working on storage_classes task. I0925 21:48:51.446782 1 tasks_processing.go:71] worker 42 working on sap_datahubs task. I0925 21:48:51.446781 1 tasks_processing.go:71] worker 57 working on openshift_logging task. I0925 21:48:51.446790 1 tasks_processing.go:71] worker 16 working on service_accounts task. I0925 21:48:51.446800 1 tasks_processing.go:71] worker 58 working on mutating_webhook_configurations task. I0925 21:48:51.446827 1 tasks_processing.go:71] worker 22 working on nodenetworkstates task. I0925 21:48:51.446836 1 tasks_processing.go:71] worker 53 working on lokistack task. I0925 21:48:51.446855 1 tasks_processing.go:71] worker 39 working on machine_autoscalers task. I0925 21:48:51.446874 1 tasks_processing.go:71] worker 12 working on crds task. I0925 21:48:51.446882 1 tasks_processing.go:71] worker 50 working on silenced_alerts task. I0925 21:48:51.446884 1 tasks_processing.go:71] worker 52 working on support_secret task. I0925 21:48:51.446888 1 tasks_processing.go:71] worker 29 working on validating_webhook_configurations task. W0925 21:48:51.446903 1 gather_silenced_alerts.go:38] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0925 21:48:51.446919 1 tasks_processing.go:71] worker 50 working on image_registries task. I0925 21:48:51.446876 1 tasks_processing.go:71] worker 35 working on operators_pods_and_events task. I0925 21:48:51.446951 1 tasks_processing.go:71] worker 51 working on node_logs task. I0925 21:48:51.446684 1 tasks_processing.go:69] worker 30 listening for tasks. I0925 21:48:51.446670 1 tasks_processing.go:69] worker 61 listening for tasks. I0925 21:48:51.446673 1 tasks_processing.go:69] worker 55 listening for tasks. I0925 21:48:51.446690 1 tasks_processing.go:69] worker 31 listening for tasks. I0925 21:48:51.446698 1 tasks_processing.go:69] worker 18 listening for tasks. I0925 21:48:51.446696 1 tasks_processing.go:69] worker 19 listening for tasks. I0925 21:48:51.446597 1 tasks_processing.go:69] worker 0 listening for tasks. I0925 21:48:51.446702 1 tasks_processing.go:69] worker 17 listening for tasks. I0925 21:48:51.446705 1 tasks_processing.go:71] worker 1 working on sap_pods task. I0925 21:48:51.446982 1 tasks_processing.go:71] worker 8 working on version task. I0925 21:48:51.447007 1 tasks_processing.go:71] worker 7 working on tsdb_status task. I0925 21:48:51.447030 1 gather.go:177] gatherer "clusterconfig" function "silenced_alerts" took 29.423µs to process 0 records I0925 21:48:51.446828 1 tasks_processing.go:71] worker 24 working on container_images task. I0925 21:48:51.447044 1 tasks_processing.go:71] worker 15 working on machine_sets task. W0925 21:48:51.447047 1 gather_prometheus_tsdb_status.go:38] Unable to load metrics client, tsdb status cannot be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0925 21:48:51.447160 1 gather.go:177] gatherer "clusterconfig" function "tsdb_status" took 124.82µs to process 0 records I0925 21:48:51.446677 1 tasks_processing.go:69] worker 38 listening for tasks. I0925 21:48:51.446709 1 tasks_processing.go:71] worker 46 working on feature_gates task. I0925 21:48:51.447249 1 tasks_processing.go:74] worker 38 stopped. I0925 21:48:51.447261 1 tasks_processing.go:71] worker 30 working on openshift_machine_api_events task. I0925 21:48:51.447319 1 tasks_processing.go:71] worker 23 working on machines task. I0925 21:48:51.447367 1 tasks_processing.go:71] worker 25 working on openstack_dataplanedeployments task. I0925 21:48:51.447435 1 tasks_processing.go:71] worker 13 working on networks task. I0925 21:48:51.447457 1 tasks_processing.go:71] worker 59 working on overlapping_namespace_uids task. I0925 21:48:51.447515 1 tasks_processing.go:71] worker 32 working on ceph_cluster task. I0925 21:48:51.447573 1 tasks_processing.go:71] worker 36 working on authentication task. I0925 21:48:51.447608 1 tasks_processing.go:71] worker 33 working on schedulers task. I0925 21:48:51.447656 1 tasks_processing.go:71] worker 20 working on config_maps task. I0925 21:48:51.447701 1 tasks_processing.go:71] worker 54 working on machine_config_pools task. I0925 21:48:51.447708 1 tasks_processing.go:71] worker 60 working on aggregated_monitoring_cr_names task. I0925 21:48:51.446709 1 tasks_processing.go:71] worker 49 working on ingress_certificates task. I0925 21:48:51.446712 1 tasks_processing.go:71] worker 47 working on nodenetworkconfigurationpolicies task. I0925 21:48:51.446719 1 tasks_processing.go:71] worker 62 working on openstack_controlplanes task. I0925 21:48:51.446720 1 tasks_processing.go:71] worker 48 working on certificate_signing_requests task. I0925 21:48:51.446878 1 tasks_processing.go:71] worker 10 working on clusterroles task. I0925 21:48:51.446880 1 tasks_processing.go:71] worker 26 working on operators task. I0925 21:48:51.447015 1 tasks_processing.go:71] worker 27 working on dvo_metrics task. I0925 21:48:51.447021 1 tasks_processing.go:71] worker 34 working on active_alerts task. I0925 21:48:51.446708 1 tasks_processing.go:71] worker 4 working on storage_cluster task. I0925 21:48:51.448413 1 tasks_processing.go:71] worker 40 working on sap_config task. I0925 21:48:51.448471 1 tasks_processing.go:71] worker 18 working on number_of_pods_and_netnamespaces_with_sdn_annotations task. W0925 21:48:51.448385 1 gather_active_alerts.go:54] Unable to load alerts client, no alerts will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0925 21:48:51.448720 1 tasks_processing.go:74] worker 34 stopped. I0925 21:48:51.448730 1 gather.go:177] gatherer "clusterconfig" function "active_alerts" took 347.881µs to process 0 records I0925 21:48:51.448876 1 tasks_processing.go:71] worker 0 working on container_runtime_configs task. I0925 21:48:51.449107 1 tasks_processing.go:71] worker 19 working on metrics task. I0925 21:48:51.449134 1 tasks_processing.go:71] worker 55 working on jaegers task. W0925 21:48:51.449135 1 gather_most_recent_metrics.go:64] Unable to load metrics client, no metrics will be collected: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0925 21:48:51.449146 1 tasks_processing.go:74] worker 19 stopped. I0925 21:48:51.449153 1 tasks_processing.go:71] worker 17 working on cost_management_metrics_configs task. I0925 21:48:51.449154 1 gather.go:177] gatherer "clusterconfig" function "metrics" took 23.858µs to process 0 records I0925 21:48:51.449168 1 tasks_processing.go:71] worker 61 working on monitoring_persistent_volumes task. I0925 21:48:51.449177 1 tasks_processing.go:71] worker 31 working on pdbs task. I0925 21:48:51.446684 1 tasks_processing.go:69] worker 63 listening for tasks. I0925 21:48:51.449190 1 tasks_processing.go:71] worker 7 working on machine_configs task. I0925 21:48:51.449263 1 tasks_processing.go:74] worker 63 stopped. I0925 21:48:51.451167 1 tasks_processing.go:74] worker 21 stopped. I0925 21:48:51.451177 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanenodesets" took 4.558493ms to process 0 records I0925 21:48:51.454965 1 tasks_processing.go:74] worker 6 stopped. I0925 21:48:51.455018 1 controller.go:119] Initializing last reported time to 0001-01-01T00:00:00Z I0925 21:48:51.455040 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0925 21:48:51.455050 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0925 21:48:51.455054 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0925 21:48:51.455081 1 recorder.go:70] Recording config/proxy with fingerprint=6d15cc2c5cc4cb265e4b8196751d9e9f49f4c8f59ac43e49f9adc55790f76fe4 I0925 21:48:51.455086 1 controller.go:458] The operator is still being initialized I0925 21:48:51.455095 1 controller.go:481] The operator is healthy I0925 21:48:51.455095 1 gather.go:177] gatherer "clusterconfig" function "proxies" took 8.264837ms to process 1 records I0925 21:48:51.455206 1 tasks_processing.go:74] worker 45 stopped. I0925 21:48:51.455466 1 recorder.go:70] Recording config/ingress with fingerprint=3f54faaf50eddcbfb1a6a4410f1e3b769874c7dea49612d6784c3fc6f2e9b85e I0925 21:48:51.455478 1 gather.go:177] gatherer "clusterconfig" function "ingress" took 8.480182ms to process 1 records I0925 21:48:51.466873 1 tasks_processing.go:74] worker 3 stopped. E0925 21:48:51.466895 1 gather.go:140] gatherer "clusterconfig" function "pod_network_connectivity_checks" failed with the error: the server could not find the requested resource (get podnetworkconnectivitychecks.controlplane.operator.openshift.io) I0925 21:48:51.466904 1 gather.go:177] gatherer "clusterconfig" function "pod_network_connectivity_checks" took 20.253214ms to process 0 records I0925 21:48:51.466913 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkstates" took 20.028765ms to process 0 records I0925 21:48:51.466918 1 gather.go:177] gatherer "clusterconfig" function "openstack_version" took 20.142802ms to process 0 records I0925 21:48:51.466924 1 gather.go:177] gatherer "clusterconfig" function "sap_datahubs" took 20.101842ms to process 0 records I0925 21:48:51.466924 1 tasks_processing.go:74] worker 22 stopped. I0925 21:48:51.466928 1 gather.go:177] gatherer "clusterconfig" function "lokistack" took 20.066824ms to process 0 records I0925 21:48:51.466933 1 tasks_processing.go:74] worker 53 stopped. I0925 21:48:51.466938 1 tasks_processing.go:74] worker 5 stopped. I0925 21:48:51.466939 1 gather.go:177] gatherer "clusterconfig" function "machine_autoscalers" took 20.049107ms to process 0 records I0925 21:48:51.466941 1 tasks_processing.go:74] worker 42 stopped. I0925 21:48:51.466944 1 gather.go:177] gatherer "clusterconfig" function "ceph_cluster" took 19.393036ms to process 0 records I0925 21:48:51.466946 1 tasks_processing.go:74] worker 39 stopped. E0925 21:48:51.466949 1 gather.go:140] gatherer "clusterconfig" function "machines" failed with the error: machines.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machines" in API group "machine.openshift.io" at the cluster scope I0925 21:48:51.466953 1 tasks_processing.go:74] worker 32 stopped. I0925 21:48:51.466957 1 gather.go:177] gatherer "clusterconfig" function "machines" took 19.606771ms to process 0 records E0925 21:48:51.466962 1 gather.go:140] gatherer "clusterconfig" function "machine_healthchecks" failed with the error: machinehealthchecks.machine.openshift.io is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot list resource "machinehealthchecks" in API group "machine.openshift.io" at the cluster scope I0925 21:48:51.466966 1 gather.go:177] gatherer "clusterconfig" function "machine_healthchecks" took 20.219473ms to process 0 records I0925 21:48:51.466972 1 tasks_processing.go:74] worker 9 stopped. I0925 21:48:51.466973 1 tasks_processing.go:74] worker 23 stopped. I0925 21:48:51.466978 1 tasks_processing.go:74] worker 57 stopped. I0925 21:48:51.466985 1 gather.go:177] gatherer "clusterconfig" function "openshift_logging" took 20.18266ms to process 0 records I0925 21:48:51.467020 1 tasks_processing.go:74] worker 56 stopped. I0925 21:48:51.467113 1 recorder.go:70] Recording config/image with fingerprint=8c71fab97820cbdc5ae8fd0bfe95822bf3866659470f3e555718b71272026c87 I0925 21:48:51.467124 1 gather.go:177] gatherer "clusterconfig" function "image" took 20.251134ms to process 1 records I0925 21:48:51.467199 1 tasks_processing.go:74] worker 44 stopped. I0925 21:48:51.467596 1 recorder.go:70] Recording config/infrastructure with fingerprint=5669b2b86041a91e0890532b5fa4fe1b57a8bb622e0b87d67e8bf25a345151b2 I0925 21:48:51.467604 1 gather.go:177] gatherer "clusterconfig" function "infrastructures" took 20.342156ms to process 1 records I0925 21:48:51.467674 1 tasks_processing.go:74] worker 11 stopped. I0925 21:48:51.467685 1 recorder.go:70] Recording config/apiserver with fingerprint=88b6b9fb79ac6ceab578b4a4f08ce78c276ae0214e14de7097f69262481d942c I0925 21:48:51.467690 1 gather.go:177] gatherer "clusterconfig" function "cluster_apiserver" took 20.401178ms to process 1 records I0925 21:48:51.472293 1 tasks_processing.go:74] worker 52 stopped. E0925 21:48:51.472305 1 gather.go:140] gatherer "clusterconfig" function "support_secret" failed with the error: secrets "support" not found I0925 21:48:51.472310 1 gather.go:177] gatherer "clusterconfig" function "support_secret" took 25.400963ms to process 0 records I0925 21:48:51.472403 1 tasks_processing.go:74] worker 1 stopped. I0925 21:48:51.472414 1 gather.go:177] gatherer "clusterconfig" function "sap_pods" took 25.423285ms to process 0 records I0925 21:48:51.472418 1 gather.go:177] gatherer "clusterconfig" function "sap_config" took 23.9732ms to process 0 records I0925 21:48:51.472422 1 gather.go:177] gatherer "clusterconfig" function "storage_cluster" took 24.005954ms to process 0 records I0925 21:48:51.472429 1 tasks_processing.go:74] worker 4 stopped. I0925 21:48:51.472431 1 tasks_processing.go:74] worker 40 stopped. I0925 21:48:51.472459 1 tasks_processing.go:74] worker 15 stopped. I0925 21:48:51.472474 1 gather.go:177] gatherer "clusterconfig" function "machine_sets" took 25.408697ms to process 0 records I0925 21:48:51.472819 1 tasks_processing.go:74] worker 43 stopped. I0925 21:48:51.473106 1 recorder.go:70] Recording config/oauth with fingerprint=9f5ed9cd73fca5571c24dea85c72f8be51304540924e53f8fcfddd5dc545f97f I0925 21:48:51.473120 1 gather.go:177] gatherer "clusterconfig" function "oauths" took 26.084973ms to process 1 records I0925 21:48:51.473210 1 tasks_processing.go:74] worker 41 stopped. I0925 21:48:51.473319 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/imagepruner/cluster with fingerprint=6211d66292c31bd3bfdd7eef185523761c0c6c97cfab0d2741a4b60cd549204e I0925 21:48:51.473328 1 gather.go:177] gatherer "clusterconfig" function "image_pruners" took 26.199791ms to process 1 records I0925 21:48:51.473405 1 tasks_processing.go:74] worker 36 stopped. I0925 21:48:51.473460 1 recorder.go:70] Recording config/authentication with fingerprint=dcc40f049c2d39f4ec5a9f598878ff3cf72867c31d76450eb1e640a6ef828c79 I0925 21:48:51.473468 1 gather.go:177] gatherer "clusterconfig" function "authentication" took 25.404954ms to process 1 records I0925 21:48:51.473551 1 tasks_processing.go:74] worker 29 stopped. I0925 21:48:51.473582 1 recorder.go:70] Recording config/validatingwebhookconfigurations/multus.openshift.io with fingerprint=625d2d8317c5eedf3f539704c1c7189e1a67cfa5eeea503bb760dd8f84102017 I0925 21:48:51.473624 1 recorder.go:70] Recording config/validatingwebhookconfigurations/network-node-identity.openshift.io with fingerprint=0a6ce7cfd7fc67dd5a073e3cb62f2c5ace09b22f740e83ffddf56dd0f83b7302 I0925 21:48:51.473639 1 recorder.go:70] Recording config/validatingwebhookconfigurations/performance-addon-operator with fingerprint=efa9501790b3ec0e7e3dc7dca3ad965d2f509070d5bf03a01e951481e8423765 I0925 21:48:51.473655 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterrolebindings-validation with fingerprint=637e52020c94536e1bb068714705335c5ac112e6116c15c652dbdfe2c901ecc8 I0925 21:48:51.473670 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-clusterroles-validation with fingerprint=8ada86d4065ec35fd2e0ef4dd5ff0712cee64dd3962941ef2ebfd44e90a93f9d I0925 21:48:51.473684 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-ingress-config-validation with fingerprint=c3fa44ab470fb8d51320ec611cbd3213cff9e06f1ec3bbf195f5e9c6fc3a9b87 I0925 21:48:51.473701 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-network-operator-validation with fingerprint=b336f35f74507222c679b0f82759a1da023bb89620acc37185c39ea9d0369a06 I0925 21:48:51.473721 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-regular-user-validation with fingerprint=9862f3d301fe90d0826ecd6184dfc71f7782a0f62cd85eeafce3006fd2b93ad6 I0925 21:48:51.473735 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-scc-validation with fingerprint=e0c1fe5b768e5ca97c72627cec2fc94ccebd9646fbbb84387af19d9cb65991d5 I0925 21:48:51.473748 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-serviceaccount-validation with fingerprint=c056c51008c42c5c1624c3211bac20e37ce12f833483d8ad126765e077ca5624 I0925 21:48:51.473762 1 recorder.go:70] Recording config/validatingwebhookconfigurations/sre-techpreviewnoupgrade-validation with fingerprint=efcd696926496bf510ae34887ba54692a030e09f4520941b178660f830a4108a I0925 21:48:51.473768 1 gather.go:177] gatherer "clusterconfig" function "validating_webhook_configurations" took 26.467485ms to process 11 records I0925 21:48:51.476227 1 tasks_processing.go:74] worker 62 stopped. I0925 21:48:51.476238 1 gather.go:177] gatherer "clusterconfig" function "openstack_controlplanes" took 27.938385ms to process 0 records I0925 21:48:51.476269 1 tasks_processing.go:74] worker 28 stopped. I0925 21:48:51.476339 1 recorder.go:70] Recording config/storage/storageclasses/gp2-csi with fingerprint=5fcab10e7783bc109d5b62cf9f25a51f84c1cbdd2e88fff64ca4f9c6287e7cf0 I0925 21:48:51.476352 1 recorder.go:70] Recording config/storage/storageclasses/gp3-csi with fingerprint=876495c9a725507e5fe626e2d753099b2bb832edd0a6b5bd1cfd6d2da942e8b4 I0925 21:48:51.476359 1 gather.go:177] gatherer "clusterconfig" function "storage_classes" took 29.484702ms to process 2 records I0925 21:48:51.476368 1 gather.go:177] gatherer "clusterconfig" function "node_logs" took 29.319387ms to process 0 records I0925 21:48:51.476380 1 tasks_processing.go:74] worker 51 stopped. I0925 21:48:51.476415 1 recorder.go:70] Recording config/schedulers/cluster with fingerprint=fca84d9ccbe9f0f3e609c1ebd1d64a313c757e626d21c02af8c894da843b6986 I0925 21:48:51.476422 1 gather.go:177] gatherer "clusterconfig" function "schedulers" took 28.726242ms to process 1 records I0925 21:48:51.476426 1 tasks_processing.go:74] worker 33 stopped. I0925 21:48:51.478706 1 tasks_processing.go:74] worker 17 stopped. I0925 21:48:51.478730 1 gather.go:177] gatherer "clusterconfig" function "cost_management_metrics_configs" took 29.5454ms to process 0 records I0925 21:48:51.478915 1 tasks_processing.go:74] worker 13 stopped. I0925 21:48:51.479034 1 recorder.go:70] Recording config/network with fingerprint=3207c28a7c8345fbad0fc801a3d3a915759c7ff37e4779461172f78b495af0f5 I0925 21:48:51.479045 1 gather.go:177] gatherer "clusterconfig" function "networks" took 31.45935ms to process 1 records I0925 21:48:51.479393 1 tasks_processing.go:74] worker 14 stopped. I0925 21:48:51.479625 1 recorder.go:70] Recording config/node/ip-10-0-138-0.ec2.internal with fingerprint=5613df28d391886f738e6414d056eea475cc99bc33bb42bb419a105d3c1c1157 I0925 21:48:51.479663 1 recorder.go:70] Recording config/node/ip-10-0-153-198.ec2.internal with fingerprint=7cbec6d6e4f3ac8340527d5e9c9362c18f1e0c5439da234c1a79609dc5d887dc I0925 21:48:51.479696 1 recorder.go:70] Recording config/node/ip-10-0-162-217.ec2.internal with fingerprint=d64444ffef3c53fcca971475c3ff6a257481705f56b07b4487a0e456d784a1bc I0925 21:48:51.479703 1 gather.go:177] gatherer "clusterconfig" function "nodes" took 32.665767ms to process 3 records I0925 21:48:51.479787 1 tasks_processing.go:74] worker 50 stopped. I0925 21:48:51.479942 1 recorder.go:70] Recording config/clusteroperator/imageregistry.operator.openshift.io/config/cluster with fingerprint=42ad7332b364a522719e08d6b1d6ca6c39537a59dfb457867b291fadc79dbc64 I0925 21:48:51.479953 1 gather.go:177] gatherer "clusterconfig" function "image_registries" took 32.511131ms to process 1 records I0925 21:48:51.482190 1 tasks_processing.go:74] worker 47 stopped. I0925 21:48:51.482201 1 gather.go:177] gatherer "clusterconfig" function "nodenetworkconfigurationpolicies" took 33.773274ms to process 0 records I0925 21:48:51.482390 1 tasks_processing.go:74] worker 58 stopped. I0925 21:48:51.482473 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/aws-pod-identity with fingerprint=000acb908ba6c9a995205c33b1655f4af4a19940d8f2e135584be977b1c71bc5 I0925 21:48:51.482497 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-podimagespec-mutation with fingerprint=f18a095b09f301691f0eb2ab0f134382be7e28e373e663734fc2385a188e2130 I0925 21:48:51.482706 1 recorder.go:70] Recording config/mutatingwebhookconfigurations/sre-service-mutation with fingerprint=e529b60597b83cc1130dd4f3cdcec9502a597c42614d73ec0295cf560126baf8 I0925 21:48:51.482725 1 gather.go:177] gatherer "clusterconfig" function "mutating_webhook_configurations" took 35.574158ms to process 3 records I0925 21:48:51.482735 1 gather.go:177] gatherer "clusterconfig" function "machine_config_pools" took 34.779682ms to process 0 records I0925 21:48:51.482742 1 tasks_processing.go:74] worker 54 stopped. I0925 21:48:51.485673 1 tasks_processing.go:74] worker 25 stopped. I0925 21:48:51.485689 1 gather.go:177] gatherer "clusterconfig" function "openstack_dataplanedeployments" took 38.288308ms to process 0 records I0925 21:48:51.485699 1 gather.go:177] gatherer "clusterconfig" function "jaegers" took 36.524015ms to process 0 records I0925 21:48:51.485704 1 tasks_processing.go:74] worker 55 stopped. I0925 21:48:51.485840 1 sca.go:136] Pulling SCA certificates from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates. Next check is in 8h0m0s I0925 21:48:51.485843 1 cluster_transfer.go:83] checking the availability of cluster transfer. Next check is in 12h0m0s W0925 21:48:51.485967 1 operator.go:287] started I0925 21:48:51.485990 1 base_controller.go:76] Waiting for caches to sync for LoggingSyncer I0925 21:48:51.486028 1 tasks_processing.go:74] worker 0 stopped. I0925 21:48:51.486039 1 gather.go:177] gatherer "clusterconfig" function "container_runtime_configs" took 37.110337ms to process 0 records I0925 21:48:51.491792 1 tasks_processing.go:74] worker 59 stopped. E0925 21:48:51.491804 1 gather.go:140] gatherer "clusterconfig" function "overlapping_namespace_uids" failed with the error: can't read uid range of the openshift-kube-storage-version-migrator namespace I0925 21:48:51.491825 1 recorder.go:70] Recording config/namespaces_with_overlapping_uids with fingerprint=4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945 I0925 21:48:51.491832 1 gather.go:177] gatherer "clusterconfig" function "overlapping_namespace_uids" took 44.313081ms to process 1 records I0925 21:48:51.498641 1 tasks_processing.go:74] worker 30 stopped. I0925 21:48:51.498656 1 gather.go:177] gatherer "clusterconfig" function "openshift_machine_api_events" took 51.369808ms to process 0 records I0925 21:48:51.498744 1 tasks_processing.go:74] worker 46 stopped. I0925 21:48:51.498834 1 recorder.go:70] Recording config/featuregate with fingerprint=48a61306f04998f9159aa96ed27259f1e55eccde499edb6ea4e2876cd6abf5e5 I0925 21:48:51.498844 1 gather.go:177] gatherer "clusterconfig" function "feature_gates" took 51.566291ms to process 1 records I0925 21:48:51.508821 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0925 21:48:51.508838 1 base_controller.go:82] Caches are synced for ConfigController I0925 21:48:51.508845 1 base_controller.go:119] Starting #1 worker of ConfigController controller ... I0925 21:48:51.508866 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file I0925 21:48:51.508888 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController I0925 21:48:51.515040 1 tasks_processing.go:74] worker 7 stopped. E0925 21:48:51.515057 1 gather.go:140] gatherer "clusterconfig" function "machine_configs" failed with the error: getting MachineConfigPools failed: the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io) I0925 21:48:51.515115 1 recorder.go:70] Recording aggregated/unused_machine_configs_count with fingerprint=4bfc9fa984e5dfcd45848faaf05269de7619bf42edf9f781751af5ee05c1a499 I0925 21:48:51.515127 1 gather.go:177] gatherer "clusterconfig" function "machine_configs" took 65.835388ms to process 1 records I0925 21:48:51.532892 1 tasks_processing.go:74] worker 2 stopped. I0925 21:48:51.532970 1 recorder.go:70] Recording config/olm_operators with fingerprint=dcf12af885ca74ee868fddfe48513a432abe5e8517d9ff1dfb623c4814248ce6 I0925 21:48:51.532983 1 gather.go:177] gatherer "clusterconfig" function "olm_operators" took 86.186394ms to process 1 records I0925 21:48:51.533217 1 controller.go:203] Source scaController *sca.Controller is not ready I0925 21:48:51.533233 1 controller.go:203] Source clusterTransferController *clustertransfer.Controller is not ready I0925 21:48:51.533237 1 controller.go:203] Source periodic-clusterconfig *controllerstatus.Simple is not ready I0925 21:48:51.533242 1 controller.go:203] Source periodic-conditional *controllerstatus.Simple is not ready I0925 21:48:51.533247 1 controller.go:203] Source periodic-workloads *controllerstatus.Simple is not ready I0925 21:48:51.533267 1 controller.go:458] The operator is still being initialized I0925 21:48:51.533279 1 controller.go:481] The operator is healthy I0925 21:48:51.544716 1 prometheus_rules.go:88] Prometheus rules successfully created W0925 21:48:51.553767 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. E0925 21:48:51.553883 1 cluster_transfer.go:95] failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%279e4d42c2-b919-4284-8df0-96133898255f%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.15:50753->172.30.0.10:53: read: connection refused I0925 21:48:51.553895 1 controllerstatus.go:80] name=clusterTransferController healthy=true reason=Disconnected message=failed to pull cluster transfer: unable to retrieve cluster transfer data from https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/: Get "https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/?search=cluster_uuid+is+%279e4d42c2-b919-4284-8df0-96133898255f%27+and+status+is+%27accepted%27": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.15:50753->172.30.0.10:53: read: connection refused I0925 21:48:51.561980 1 tasks_processing.go:74] worker 61 stopped. I0925 21:48:51.561998 1 gather.go:177] gatherer "clusterconfig" function "monitoring_persistent_volumes" took 112.803491ms to process 0 records I0925 21:48:51.575792 1 tasks_processing.go:74] worker 10 stopped. I0925 21:48:51.575951 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/admin with fingerprint=5883e67c5693e7fb8b0dd2506e750b5baea09b5f6199f170e73b7324ab885d97 I0925 21:48:51.576009 1 recorder.go:70] Recording cluster-scoped-resources/rbac.authorization.k8s.io/clusterroles/edit with fingerprint=81f26eae586dda323879b30bab7ff14c4794caa07531d28ab04bf424fdc8ff1e I0925 21:48:51.576018 1 gather.go:177] gatherer "clusterconfig" function "clusterroles" took 127.418797ms to process 2 records I0925 21:48:51.576025 1 gather.go:177] gatherer "clusterconfig" function "aggregated_monitoring_cr_names" took 127.63148ms to process 0 records I0925 21:48:51.576037 1 tasks_processing.go:74] worker 60 stopped. I0925 21:48:51.579656 1 tasks_processing.go:74] worker 24 stopped. I0925 21:48:51.579710 1 recorder.go:70] Recording config/running_containers with fingerprint=40d0fbe9e769c9d465c7fde873f00c35946a2101bdf2af6e5c8e2aa57f0b6e78 I0925 21:48:51.579721 1 gather.go:177] gatherer "clusterconfig" function "container_images" took 132.602924ms to process 1 records I0925 21:48:51.586851 1 base_controller.go:82] Caches are synced for LoggingSyncer I0925 21:48:51.586867 1 base_controller.go:119] Starting #1 worker of LoggingSyncer controller ... I0925 21:48:51.592279 1 configmapobserver.go:84] configmaps "insights-config" not found I0925 21:48:51.592299 1 tasks_processing.go:74] worker 31 stopped. I0925 21:48:51.592382 1 recorder.go:70] Recording config/pdbs/openshift-image-registry/image-registry with fingerprint=123df296b5cf6b44f9e08da62459006d8e6e556be5143b658850d8428d26b396 I0925 21:48:51.592400 1 recorder.go:70] Recording config/pdbs/openshift-ingress/router-default with fingerprint=bc9603c2f127adbb54bf32234b54bf8cadf8fb1e913b683c07fe5fe2ce958dc5 I0925 21:48:51.592411 1 recorder.go:70] Recording config/pdbs/openshift-operator-lifecycle-manager/packageserver-pdb with fingerprint=608476155677c5497b6e923e5cfabce14d93aab40853008848b8ad5ce4ad42f8 I0925 21:48:51.592417 1 gather.go:177] gatherer "clusterconfig" function "pdbs" took 143.114793ms to process 3 records I0925 21:48:51.601962 1 tasks_processing.go:74] worker 8 stopped. I0925 21:48:51.602357 1 recorder.go:70] Recording config/version with fingerprint=1799cd4f7bcfc8308c8258bad9b19d4e97ddd2e3358e83e4963a3bf05f3a4aef I0925 21:48:51.602368 1 recorder.go:70] Recording config/id with fingerprint=887e02fea0ff52709bff65c47ccdcab0b41a4a6e422fc0d35a0792cb18884832 I0925 21:48:51.602373 1 gather.go:177] gatherer "clusterconfig" function "version" took 154.971371ms to process 2 records I0925 21:48:51.602458 1 tasks_processing.go:74] worker 12 stopped. I0925 21:48:51.602717 1 recorder.go:70] Recording config/crd/volumesnapshots.snapshot.storage.k8s.io with fingerprint=32a15665dbe5990f093557c4159d9c492379cf681dd8e1b10ef59765e767136e I0925 21:48:51.602830 1 recorder.go:70] Recording config/crd/volumesnapshotcontents.snapshot.storage.k8s.io with fingerprint=e13a79ae7c011d78a5236adeb84d87f481cd037b3aaf81d94d8bca2ad73214da I0925 21:48:51.602837 1 gather.go:177] gatherer "clusterconfig" function "crds" took 155.214027ms to process 2 records I0925 21:48:51.603190 1 tasks_processing.go:74] worker 48 stopped. I0925 21:48:51.603200 1 gather.go:177] gatherer "clusterconfig" function "certificate_signing_requests" took 154.438609ms to process 0 records I0925 21:48:51.613625 1 tasks_processing.go:74] worker 18 stopped. I0925 21:48:51.613640 1 gather.go:177] gatherer "clusterconfig" function "number_of_pods_and_netnamespaces_with_sdn_annotations" took 165.136069ms to process 0 records I0925 21:48:51.639387 1 tasks_processing.go:74] worker 20 stopped. E0925 21:48:51.639404 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "cluster-monitoring-config" not found E0925 21:48:51.639411 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "gateway-mode-config" not found E0925 21:48:51.639414 1 gather.go:140] gatherer "clusterconfig" function "config_maps" failed with the error: configmaps "insights-config" not found I0925 21:48:51.639420 1 recorder.go:70] Recording config/configmaps/openshift-config/installer-images/images.json with fingerprint=295a2bc7810c628251f1f312c209b5eb4da888326706c635ac0c12aec0969e17 I0925 21:48:51.639443 1 recorder.go:70] Recording config/configmaps/openshift-config/kube-root-ca.crt/ca.crt with fingerprint=f73fcd48d6f9ebbc83253a1b5f23ef59d0683465ec46e474389103c717467dfb I0925 21:48:51.639450 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/invoker with fingerprint=76b482f683cd3ef9da02debac5b26080a5aeb06ff768ee5c21117514dff29d8a I0925 21:48:51.639453 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-install/version with fingerprint=fe7abfa7f7aea852d8bca6b7df9b4d5de32045254ff2774f9bd30f0b6dcb7dc4 I0925 21:48:51.639456 1 recorder.go:70] Recording config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 I0925 21:48:51.639473 1 recorder.go:70] Recording config/configmaps/openshift-config/rosa-brand-logo/rosa-brand-logo.svg with fingerprint=6ed8ca4dd7a8eee7249182bc006e9649ce84d76c551ddfaaa33e55d8c4cc1ed0 I0925 21:48:51.639480 1 recorder.go:70] Recording config/configmaps/kube-system/cluster-config-v1/install-config with fingerprint=ab3811c6b83fd7b8e920094cfa3080d1b4ee3c35ec4c8379437b21d27bd6608d I0925 21:48:51.639484 1 gather.go:177] gatherer "clusterconfig" function "config_maps" took 191.713814ms to process 7 records I0925 21:48:51.641558 1 requests.go:205] Asking for SCA certificate with "{"arch": ["x86_64"]}" payload W0925 21:48:51.644311 1 sca.go:161] Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.15:33202->172.30.0.10:53: read: connection refused I0925 21:48:51.644322 1 controllerstatus.go:80] name=scaController healthy=true reason=NonHTTPError message=Failed to pull SCA certs from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: unable to retrieve SCA certs data from https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates: Post "https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates": dial tcp: lookup api.openshift.com on 172.30.0.10:53: read udp 10.128.0.15:33202->172.30.0.10:53: read: connection refused I0925 21:48:51.707586 1 tasks_processing.go:74] worker 49 stopped. E0925 21:48:51.707596 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret 'router-certs-default' in namespace 'openshift-ingress': secrets "router-certs-default" not found E0925 21:48:51.707601 1 gather.go:140] gatherer "clusterconfig" function "ingress_certificates" failed with the error: failed to get secret '2t29j2aisocsa5jvdea04aojm2a4g8rq-primary-cert-bundle-secret' in namespace 'openshift-ingress-operator': secrets "2t29j2aisocsa5jvdea04aojm2a4g8rq-primary-cert-bundle-secret" not found I0925 21:48:51.707650 1 recorder.go:70] Recording aggregated/ingress_controllers_certs with fingerprint=4d104954fd703fd28196d17377560a2695139f33a1cc8db933cb755de2fb1578 I0925 21:48:51.707660 1 gather.go:177] gatherer "clusterconfig" function "ingress_certificates" took 259.198778ms to process 1 records I0925 21:48:51.716585 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress-operator" I0925 21:48:51.720607 1 gather_cluster_operators.go:184] Unable to get dnsrecords.ingress.operator.openshift.io resource due to: dnsrecords.ingress.operator.openshift.io "default" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "dnsrecords" in API group "ingress.operator.openshift.io" in the namespace "openshift-ingress" I0925 21:48:51.942245 1 gather_cluster_operator_pods_and_events.go:121] Found 16 pods with 18 containers I0925 21:48:51.942259 1 gather_cluster_operator_pods_and_events.go:235] Maximum buffer size: 1398101 bytes I0925 21:48:51.943060 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-4vfcm pod in namespace openshift-dns (previous: false). I0925 21:48:52.189650 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-4vfcm pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-4vfcm\" is waiting to start: ContainerCreating" I0925 21:48:52.189669 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-4vfcm\" is waiting to start: ContainerCreating" I0925 21:48:52.189676 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-4vfcm pod in namespace openshift-dns (previous: false). I0925 21:48:52.218913 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "ovn" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" I0925 21:48:52.350652 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-4vfcm pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-4vfcm\" is waiting to start: ContainerCreating" I0925 21:48:52.350667 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-4vfcm\" is waiting to start: ContainerCreating" I0925 21:48:52.350676 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns container dns-default-zpz99 pod in namespace openshift-dns (previous: false). I0925 21:48:52.420559 1 gather_cluster_operators.go:184] Unable to get operatorpkis.network.operator.openshift.io resource due to: operatorpkis.network.operator.openshift.io "signer" is forbidden: User "system:serviceaccount:openshift-insights:gather" cannot get resource "operatorpkis" in API group "network.operator.openshift.io" in the namespace "openshift-ovn-kubernetes" W0925 21:48:52.554597 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0925 21:48:52.600492 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-zpz99 pod in namespace openshift-dns for failing operator dns (previous: false): "container \"dns\" in pod \"dns-default-zpz99\" is waiting to start: ContainerCreating" I0925 21:48:52.600504 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"dns\" in pod \"dns-default-zpz99\" is waiting to start: ContainerCreating" I0925 21:48:52.600512 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for kube-rbac-proxy container dns-default-zpz99 pod in namespace openshift-dns (previous: false). I0925 21:48:52.747284 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for dns-default-zpz99 pod in namespace openshift-dns for failing operator kube-rbac-proxy (previous: false): "container \"kube-rbac-proxy\" in pod \"dns-default-zpz99\" is waiting to start: ContainerCreating" I0925 21:48:52.747307 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"kube-rbac-proxy\" in pod \"dns-default-zpz99\" is waiting to start: ContainerCreating" I0925 21:48:52.747315 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-5m5wq pod in namespace openshift-dns (previous: false). I0925 21:48:52.946154 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0925 21:48:52.946171 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-l845x pod in namespace openshift-dns (previous: false). I0925 21:48:53.146341 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0925 21:48:53.146358 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for dns-node-resolver container node-resolver-xknx9 pod in namespace openshift-dns (previous: false). I0925 21:48:53.220941 1 gather_cluster_operators.go:184] Unable to get configs.samples.operator.openshift.io resource due to: configs.samples.operator.openshift.io "cluster" not found I0925 21:48:53.368655 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0925 21:48:53.368711 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-745c6dbf9c-99kjt pod in namespace openshift-image-registry (previous: false). I0925 21:48:53.550523 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-745c6dbf9c-99kjt pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-745c6dbf9c-99kjt\" is waiting to start: ContainerCreating" I0925 21:48:53.550541 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-745c6dbf9c-99kjt\" is waiting to start: ContainerCreating" I0925 21:48:53.550608 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-745c6dbf9c-f7hbr pod in namespace openshift-image-registry (previous: false). W0925 21:48:53.554248 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0925 21:48:53.741473 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0925 21:48:53.741541 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for registry container image-registry-8f9d54874-z6xpg pod in namespace openshift-image-registry (previous: false). I0925 21:48:53.823466 1 tasks_processing.go:74] worker 26 stopped. I0925 21:48:53.823517 1 recorder.go:70] Recording config/clusteroperator/console with fingerprint=52f120d17f27056456e43edff3ed20fd6e0fb0337bc057bf48e0e8fe93da1634 I0925 21:48:53.823549 1 recorder.go:70] Recording config/clusteroperator/csi-snapshot-controller with fingerprint=bca2292f51bffa831057578cf71c311622da04cf06d082ad730de35530277b8e I0925 21:48:53.823581 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/csisnapshotcontroller/cluster with fingerprint=5adc514f4b63e2f1ecc68bf6f9c0af70c5eea04522a49524e102721b1c41f80e I0925 21:48:53.823607 1 recorder.go:70] Recording config/clusteroperator/dns with fingerprint=b89fe02828c07a5ac25bc8fec113887c193a6007e1c81038e5b3a47cdac0a33c I0925 21:48:53.823626 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/dns/default with fingerprint=9e7b4ce029030d3d8c3b49af92c556acdcc415000b40d3f969dbdc42c432b47f I0925 21:48:53.823648 1 recorder.go:70] Recording config/clusteroperator/image-registry with fingerprint=f94d4062585c888c823de6f0abdecc8de0181fbb9afb58cdc099dd3920a2e922 I0925 21:48:53.823670 1 recorder.go:70] Recording config/clusteroperator/ingress with fingerprint=1e5642a03505e01ad7128d338a1affde2a45885a6497f2863038b553e1ac107a I0925 21:48:53.823692 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/ingresscontroller/openshift-ingress-operator/default with fingerprint=ca2f9d411f3a9a75b3c33627d82e4b5ff34fdc07fc181b215076e299014513e9 I0925 21:48:53.823719 1 recorder.go:70] Recording config/clusteroperator/insights with fingerprint=b0331af439ea7ec0cf3635692e91e99ecb5acfb3c2d5c7ba3ee44c70a01e25f2 I0925 21:48:53.823729 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/insightsoperator/cluster with fingerprint=e5ff11d57817f84a678f6fa9565af55bd1120227c16a21933637ab62675a6d70 I0925 21:48:53.823742 1 recorder.go:70] Recording config/clusteroperator/kube-apiserver with fingerprint=69f8342e2ce05818a863d3944d3a97b701742947c4310fe8d1599e641cc5477b I0925 21:48:53.823749 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubeapiserver/cluster with fingerprint=51503bf0b784fcf65ea46bcaf1f72ac1a5c4d5dc211934f18f27871efed05762 I0925 21:48:53.823760 1 recorder.go:70] Recording config/clusteroperator/kube-controller-manager with fingerprint=92f157ca0720448846540188072e3bc87d45f9ddf36628f3e8636ab88665acaa I0925 21:48:53.823770 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubecontrollermanager/cluster with fingerprint=ce90c0d4f367d7da085074268031798382ae7c54fdcb0a21f15a4818fe308c11 I0925 21:48:53.823782 1 recorder.go:70] Recording config/clusteroperator/kube-scheduler with fingerprint=d999014f244afcd73a2fab15a02e188b6ac0fe14a3a4ac9ec65691e803fc8250 I0925 21:48:53.823795 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubescheduler/cluster with fingerprint=f2940fb9fd20c19951dfc295eb363b7fba0c505f5ae61f01967a063099e6b60a I0925 21:48:53.823812 1 recorder.go:70] Recording config/clusteroperator/kube-storage-version-migrator with fingerprint=b3ffa5bf2a8145c9ec66c69ae1ec2d8bcf73ae6fbf9019821a0f8200f591a224 I0925 21:48:53.823830 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/kubestorageversionmigrator/cluster with fingerprint=9351181aa7e6ada41ef581ab31e13516c6b934cc95710154bafb2eb222cb58db I0925 21:48:53.823843 1 recorder.go:70] Recording config/clusteroperator/monitoring with fingerprint=e4c736166275e7cbe865e7be31b6c358f906ae76f43f1bcdc59d0d0732784e87 I0925 21:48:53.823922 1 recorder.go:70] Recording config/clusteroperator/network with fingerprint=b5b7146e2776b7a751d59c4f638d3646932c5849d2c0b873d9d2bee4d08c90e5 I0925 21:48:53.823947 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/network/cluster with fingerprint=a93d15eaecb455a0e40ecb2826eeecc1533899204ddd3c3921d15ab70af7ae75 I0925 21:48:53.823964 1 recorder.go:70] Recording config/clusteroperator/node-tuning with fingerprint=2a089ffa77baf67d1f659e403e9ed6e9e856fda8d44a376bf13715c3a0855e2e I0925 21:48:53.823979 1 recorder.go:70] Recording config/clusteroperator/openshift-apiserver with fingerprint=ba018cbb592bc1a9a1306d53d87c63e1d3ade94d4d53e434bb361f4b6458e6e1 I0925 21:48:53.823987 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftapiserver/cluster with fingerprint=e712e6cf27339b441e4ed1f4cde91dbde7e952698ba93407e4457db63a4a4c76 I0925 21:48:53.823997 1 recorder.go:70] Recording config/clusteroperator/openshift-controller-manager with fingerprint=da2d067aa2f0fdd55982f1236b948754c9511d9b0d755c8ba0549baad0f16860 I0925 21:48:53.824006 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/openshiftcontrollermanager/cluster with fingerprint=d71a0f4672f9b45d9fc8293bf1687afc650fd28d32e2e30de27523fe7b4eadf7 I0925 21:48:53.824016 1 recorder.go:70] Recording config/clusteroperator/openshift-samples with fingerprint=84fe76b50ed2ff6a6a18e6f169046b0aace4207dd243a2234bf11e33c1030cbf I0925 21:48:53.824040 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager with fingerprint=497fb1c80cae51912be57fd5fcf942efd7873ebb4d9eff6cecfd018756128362 I0925 21:48:53.824053 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-catalog with fingerprint=85a67d8c5a9142a0a0e7eae719bcd444e83636cfd2aa81448c2bc333bbb46e5b I0925 21:48:53.824084 1 recorder.go:70] Recording config/clusteroperator/operator-lifecycle-manager-packageserver with fingerprint=23aaecb2c1c43d032cd1e57fe8f95e97145ac11587cf068ae3ff13e82eb5d0bf I0925 21:48:53.824100 1 recorder.go:70] Recording config/clusteroperator/service-ca with fingerprint=511c437fecd3692ad246862e7e9607fafbf9f56ff3dc10066569206e2357aa06 I0925 21:48:53.824109 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/serviceca/cluster with fingerprint=812f7edc2cdb30e61e7f2b29454357a40b1a507a4b0c2b7729193b67f0e3b4aa I0925 21:48:53.824124 1 recorder.go:70] Recording config/clusteroperator/storage with fingerprint=4f577976405acf181b663ef841d23d760ca14487d60b5842c5441fb124a2e5fe I0925 21:48:53.824138 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/clustercsidriver/ebs.csi.aws.com with fingerprint=510064d6f6bcced87ab5bd2ddaff3d0edd7f93f4a4f7af2641f29fc53ffab21e I0925 21:48:53.824147 1 recorder.go:70] Recording config/clusteroperator/operator.openshift.io/storage/cluster with fingerprint=8e480f8c1ce1b39baac42d8ec780c57c2592929ae0c801b61ffad49ba13f33ad I0925 21:48:53.824154 1 gather.go:177] gatherer "clusterconfig" function "operators" took 2.375059766s to process 35 records I0925 21:48:53.946001 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for image-registry-8f9d54874-z6xpg pod in namespace openshift-image-registry for failing operator registry (previous: false): "container \"registry\" in pod \"image-registry-8f9d54874-z6xpg\" is waiting to start: ContainerCreating" I0925 21:48:53.946019 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"registry\" in pod \"image-registry-8f9d54874-z6xpg\" is waiting to start: ContainerCreating" I0925 21:48:53.946030 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-fgkgc pod in namespace openshift-image-registry (previous: false). I0925 21:48:54.148850 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0925 21:48:54.148870 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-gqhm6 pod in namespace openshift-image-registry (previous: false). I0925 21:48:54.348098 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0925 21:48:54.348119 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for node-ca container node-ca-rx654 pod in namespace openshift-image-registry (previous: false). I0925 21:48:54.546497 1 gather_cluster_operator_pods_and_events.go:280] Error: "log buffer is empty" I0925 21:48:54.546517 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-75b48897d9-vznd6 pod in namespace openshift-ingress (previous: false). W0925 21:48:54.554453 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0925 21:48:54.747849 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-75b48897d9-vznd6 pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-75b48897d9-vznd6\" is waiting to start: ContainerCreating" I0925 21:48:54.747867 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-75b48897d9-vznd6\" is waiting to start: ContainerCreating" I0925 21:48:54.747878 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f985b5c64-g7zmz pod in namespace openshift-ingress (previous: false). I0925 21:48:54.950139 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f985b5c64-g7zmz pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f985b5c64-g7zmz\" is waiting to start: ContainerCreating" I0925 21:48:54.950155 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f985b5c64-g7zmz\" is waiting to start: ContainerCreating" I0925 21:48:54.950164 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for router container router-default-f985b5c64-tbnkb pod in namespace openshift-ingress (previous: false). I0925 21:48:55.152949 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for router-default-f985b5c64-tbnkb pod in namespace openshift-ingress for failing operator router (previous: false): "container \"router\" in pod \"router-default-f985b5c64-tbnkb\" is waiting to start: ContainerCreating" I0925 21:48:55.152967 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"router\" in pod \"router-default-f985b5c64-tbnkb\" is waiting to start: ContainerCreating" I0925 21:48:55.152994 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-glxgf pod in namespace openshift-ingress-canary (previous: false). I0925 21:48:55.347043 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-glxgf pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-glxgf\" is waiting to start: ContainerCreating" I0925 21:48:55.347076 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-glxgf\" is waiting to start: ContainerCreating" I0925 21:48:55.347088 1 gather_cluster_operator_pods_and_events.go:365] Fetching logs for serve-healthcheck-canary container ingress-canary-vhcc4 pod in namespace openshift-ingress-canary (previous: false). W0925 21:48:55.554698 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. I0925 21:48:55.560350 1 gather_cluster_operator_pods_and_events.go:408] Failed to fetch log for ingress-canary-vhcc4 pod in namespace openshift-ingress-canary for failing operator serve-healthcheck-canary (previous: false): "container \"serve-healthcheck-canary\" in pod \"ingress-canary-vhcc4\" is waiting to start: ContainerCreating" I0925 21:48:55.560368 1 gather_cluster_operator_pods_and_events.go:280] Error: "container \"serve-healthcheck-canary\" in pod \"ingress-canary-vhcc4\" is waiting to start: ContainerCreating" I0925 21:48:55.560384 1 tasks_processing.go:74] worker 35 stopped. I0925 21:48:55.560453 1 recorder.go:70] Recording events/openshift-dns-operator with fingerprint=510328e4531afb7ecd98578246bedff9d40d4da72cde784b10be829aecbc1ea2 I0925 21:48:55.560487 1 recorder.go:70] Recording events/openshift-dns with fingerprint=22c037a186922a8a04c32bdac8486f5c13cb5b617cffb09480cad67cabbc69a4 I0925 21:48:55.560544 1 recorder.go:70] Recording events/openshift-image-registry with fingerprint=b38e44503159e78340958f080292146efc52017e69c9ebd5274ead420cacd455 I0925 21:48:55.560561 1 recorder.go:70] Recording events/openshift-ingress-operator with fingerprint=4ec61231bf4c6721847b48d8a1dc1a7be157d5a80056b8fe936c21bbefb3cdf7 I0925 21:48:55.560588 1 recorder.go:70] Recording events/openshift-ingress with fingerprint=36399c6833d94f56a36e571fbd8be57c04a01d940a9bf2f6786e932aafa244fe I0925 21:48:55.560602 1 recorder.go:70] Recording events/openshift-ingress-canary with fingerprint=d1a066e60cf0f24fb5944786f6fd778abe98c0f35f7cfa018b8dfc24a22a3487 I0925 21:48:55.561821 1 recorder.go:70] Recording config/pod/openshift-dns/dns-default-4vfcm with fingerprint=c7abd6cb7010c94fa3fa50bee38172e22520971a2b2c16271712858d9a0df948 I0925 21:48:55.561941 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-745c6dbf9c-99kjt with fingerprint=a52e71ba862391c502cc05a21e87b15ab6029a56674437932194d42ad0c79990 I0925 21:48:55.561996 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-745c6dbf9c-f7hbr with fingerprint=edfd92e78fb43e2b5aa25ed1dc43e00d1c223f95caa58cca65657c934e5d0084 I0925 21:48:55.562052 1 recorder.go:70] Recording config/pod/openshift-image-registry/image-registry-8f9d54874-z6xpg with fingerprint=ec80fa177edf23b8155a0067a65257b8498d3030efd3fb0b114d16434d888101 I0925 21:48:55.562112 1 recorder.go:70] Recording config/pod/openshift-ingress-canary/ingress-canary-glxgf with fingerprint=a389169d7a34e35f70afed71518806e7534fa604de5ef2fda8342f8890ca1aa1 I0925 21:48:55.562121 1 gather.go:177] gatherer "clusterconfig" function "operators_pods_and_events" took 4.113450061s to process 11 records W0925 21:48:56.553738 1 gather_dvo_metrics.go:210] Failed to read the DVO metrics. Trying again. W0925 21:48:56.553763 1 gather_dvo_metrics.go:117] Unable to read metrics from endpoint "http://deployment-validation-operator-metrics.openshift-deployment-validation-operator.svc:8383": DVO metrics service was not available within the 5s timeout: context deadline exceeded I0925 21:48:56.553774 1 tasks_processing.go:74] worker 27 stopped. E0925 21:48:56.553783 1 gather.go:140] gatherer "clusterconfig" function "dvo_metrics" failed with the error: DVO metrics service was not available within the 5s timeout: context deadline exceeded I0925 21:48:56.553792 1 recorder.go:70] Recording config/dvo_metrics with fingerprint=e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 W0925 21:48:56.553804 1 gather.go:155] issue recording gatherer "clusterconfig" function "dvo_metrics" result "config/dvo_metrics" because of the warning: warning: the record with the same fingerprint "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855" was already recorded at path "config/configmaps/openshift-config/openshift-service-ca.crt/service-ca.crt", recording another one with a different path "config/dvo_metrics" I0925 21:48:56.553812 1 gather.go:177] gatherer "clusterconfig" function "dvo_metrics" took 5.105847601s to process 1 records I0925 21:49:03.726869 1 configmapobserver.go:84] configmaps "insights-config" not found I0925 21:49:04.079200 1 tasks_processing.go:74] worker 37 stopped. I0925 21:49:04.079240 1 recorder.go:70] Recording config/installplans with fingerprint=6f9781df213f917044fe07f29e6836f4c98c6ccf7740910e145b68b90ff5234d I0925 21:49:04.079251 1 gather.go:177] gatherer "clusterconfig" function "install_plans" took 12.632462565s to process 1 records I0925 21:49:04.253246 1 configmapobserver.go:84] configmaps "insights-config" not found I0925 21:49:04.450787 1 configmapobserver.go:84] configmaps "insights-config" not found I0925 21:49:04.853730 1 tasks_processing.go:74] worker 16 stopped. I0925 21:49:04.854025 1 recorder.go:70] Recording config/serviceaccounts with fingerprint=cf9c12fe8737f3a6d4cb9da132f43361fa8e8d22eb1cc0d002bd7e06234de064 I0925 21:49:04.854043 1 gather.go:177] gatherer "clusterconfig" function "service_accounts" took 13.406919851s to process 1 records E0925 21:49:04.854135 1 periodic.go:250] "Unhandled Error" err="clusterconfig failed after 13.407s with: function \"pod_network_connectivity_checks\" failed with an error, function \"machines\" failed with an error, function \"machine_healthchecks\" failed with an error, function \"support_secret\" failed with an error, function \"overlapping_namespace_uids\" failed with an error, function \"machine_configs\" failed with an error, function \"config_maps\" failed with an error, function \"ingress_certificates\" failed with an error, function \"dvo_metrics\" failed with an error" I0925 21:49:04.855248 1 controllerstatus.go:89] name=periodic-clusterconfig healthy=false reason=PeriodicGatherFailed message=Source clusterconfig could not be retrieved: function "pod_network_connectivity_checks" failed with an error, function "machines" failed with an error, function "machine_healthchecks" failed with an error, function "support_secret" failed with an error, function "overlapping_namespace_uids" failed with an error, function "machine_configs" failed with an error, function "config_maps" failed with an error, function "ingress_certificates" failed with an error, function "dvo_metrics" failed with an error I0925 21:49:04.855263 1 periodic.go:212] Running workloads gatherer I0925 21:49:04.855286 1 tasks_processing.go:45] number of workers: 2 I0925 21:49:04.855295 1 tasks_processing.go:69] worker 1 listening for tasks. I0925 21:49:04.855299 1 tasks_processing.go:71] worker 1 working on workload_info task. I0925 21:49:04.855307 1 tasks_processing.go:69] worker 0 listening for tasks. I0925 21:49:04.855384 1 tasks_processing.go:71] worker 0 working on helmchart_info task. I0925 21:49:04.884505 1 gather_workloads_info.go:278] Loaded pods in 0s, will wait 21s for image data I0925 21:49:04.888635 1 tasks_processing.go:74] worker 0 stopped. I0925 21:49:04.888651 1 gather.go:177] gatherer "workloads" function "helmchart_info" took 33.23175ms to process 0 records I0925 21:49:04.898424 1 gather_workloads_info.go:387] No image sha256:420c12f61c53e54eab2d99476759c0de339fca98ce0a3a782bc6545cc0e97a9c (14ms) I0925 21:49:04.908679 1 gather_workloads_info.go:387] No image sha256:bae7a33f8db8a3d4b3c4c05498aba85a0ce463f85322067c48e79663710e616e (10ms) I0925 21:49:04.917996 1 gather_workloads_info.go:387] No image sha256:a7c71f3c9714cf1717c45e12ec817be6d6209f00989e6a31d634e527f0c8147d (9ms) I0925 21:49:04.927589 1 gather_workloads_info.go:387] No image sha256:824a3b8f78e19aa21a9f6444aefe8e0b624886cca18fe828b13acbab55e6e868 (10ms) I0925 21:49:04.936855 1 gather_workloads_info.go:387] No image sha256:0a92dd43975f972e3dc707fb37854e046813531553038147e9c90d54a8d9df73 (9ms) I0925 21:49:04.946200 1 gather_workloads_info.go:387] No image sha256:2d077e73dd76873ee2a1583aa3b3e76a1b408737f0af2e22b2aa055604d89e81 (9ms) I0925 21:49:04.956785 1 gather_workloads_info.go:387] No image sha256:0a8a0473029ace3adbb66f490dbe560f0e7782a38cdf32c1f7dd3e092e1d191e (11ms) I0925 21:49:04.970837 1 gather_workloads_info.go:387] No image sha256:6e67c980b7300e769fb4b2adaaf006d0f8274e43b10586701b204ea5153f15fc (14ms) I0925 21:49:04.979981 1 gather_workloads_info.go:387] No image sha256:87efe06afd1f04426fca7f86c0f74c4ee75c311ba199ddabd5b849b877bc59fa (9ms) I0925 21:49:04.989185 1 gather_workloads_info.go:387] No image sha256:f2c46054a8f64a0e949cbf30295f31b4a35a0203c6ad03fa7ec922b4101dcbf8 (9ms) I0925 21:49:04.998446 1 gather_workloads_info.go:387] No image sha256:76f820bd9bd138d29305d545d7d49bfe63e2923f1fb1ec2e8eac81a388359024 (9ms) I0925 21:49:05.095006 1 gather_workloads_info.go:387] No image sha256:373614619b9420b110d1508c5f17e066ce69c4c226fd04d02fbb959d9ba41eb6 (97ms) I0925 21:49:05.194278 1 gather_workloads_info.go:387] No image sha256:752be69b2262be713df12c47f4bac8c2dafed272c401e9a89f8060f053d68054 (99ms) I0925 21:49:05.295623 1 gather_workloads_info.go:387] No image sha256:f6e156f39b06d196b46d8ed3a03ca337e939dba0060e40de4455b4e77b90929e (101ms) I0925 21:49:05.395479 1 gather_workloads_info.go:387] No image sha256:23c4fe84047a4e6cbe7f75f470e7d6fe0e61e7910dd17945b1b61bc4b72f3f2a (100ms) I0925 21:49:05.496035 1 gather_workloads_info.go:387] No image sha256:a9e885d6f0456a2cc10f9e5da71fe9403f5e4c639b9b7ea15bd403b272ccb824 (101ms) I0925 21:49:05.594282 1 gather_workloads_info.go:387] No image sha256:ceab8a8c340801fcebf800620d3fef5493d8a443077a21c6e56984051bd3abde (98ms) I0925 21:49:05.695099 1 gather_workloads_info.go:387] No image sha256:7941b5d9a758b8667e99cd9236f7f96ec036af61df5cbc96e16077d36700d7c7 (101ms) I0925 21:49:05.802717 1 gather_workloads_info.go:387] No image sha256:48404bd61d05dc738ccce4d22e36b30dbcdc6015b06b4afb604fd1baeee35bf2 (108ms) I0925 21:49:05.900644 1 gather_workloads_info.go:387] No image sha256:944d9261ba7a143131fe8267c172defc5f37acc1cea3d4d373ec6fc5d8bfcc31 (98ms) I0925 21:49:06.001137 1 gather_workloads_info.go:387] No image sha256:14703f73bb1ca69ea03b726e340b3b68f8e294e1f22c80d1a16666ea3d4a88a3 (100ms) I0925 21:49:06.098568 1 gather_workloads_info.go:387] No image sha256:8ef4bdf07dda423fab73484dbc66d527ce8ba8cc2d4f99210bc1bc24ea08c0cb (97ms) I0925 21:49:06.200395 1 gather_workloads_info.go:387] No image sha256:798001e24f1ed6a5621c442729a840ba2a2abc43433901e8450caa12b4bad5c5 (102ms) I0925 21:49:06.298449 1 gather_workloads_info.go:387] No image sha256:3d0634fe58641d5242649c44ddba70ed67fdd6d2dcb5c2261df5cee8b33de9fd (98ms) I0925 21:49:06.399486 1 gather_workloads_info.go:387] No image sha256:9697bc2258bdfa9ae8c1866cc7eb0b3b46851998db827b121bdf77417a881eb3 (101ms) I0925 21:49:06.499665 1 gather_workloads_info.go:387] No image sha256:2fac754deaeade3456361eed52e344318ff16d04819384432759f0ea35530114 (100ms) I0925 21:49:06.595904 1 gather_workloads_info.go:387] No image sha256:099b3af427b8e1eb44765283a640446c3225151baa06eed789623206151a60cd (96ms) I0925 21:49:06.696009 1 gather_workloads_info.go:387] No image sha256:6d6ebff54b8adac74f4d1b12ac8aa0f16cd7b28370e0d6aa847d1c457e03a5b6 (100ms) I0925 21:49:06.794981 1 gather_workloads_info.go:387] No image sha256:18956d5fbc8d0369a26cb1e00eb5c3aff1973ae8cbd3983920a0cf2851f05358 (99ms) I0925 21:49:06.895698 1 gather_workloads_info.go:387] No image sha256:8b1e32ce43eb1247b0558230b6e0baa85ac62f1a5e2a2089d40b4fea90538529 (101ms) I0925 21:49:06.995390 1 gather_workloads_info.go:387] No image sha256:d28734effaadd66434e77a1a5fbe2e8a4ca2066cd9f8868c22ade9475539bfd7 (100ms) I0925 21:49:07.096885 1 gather_workloads_info.go:387] No image sha256:d93441b88bd020cae0a819977b23ca7be19e037d9bf634c16710864a08a4929f (101ms) I0925 21:49:07.193951 1 gather_workloads_info.go:387] No image sha256:ccdda82b4adfa8ee4a84b3bad19693be6a42a9881a7b83788d835912129c49a4 (97ms) I0925 21:49:07.296831 1 gather_workloads_info.go:387] No image sha256:4f175ee49f51dc4379e9993fecd1657c7a9c4c3dc096772cb198d0212b9eea47 (103ms) I0925 21:49:07.296864 1 tasks_processing.go:74] worker 1 stopped. E0925 21:49:07.296874 1 gather.go:140] gatherer "workloads" function "workload_info" failed with the error: no running pods found for the insights-runtime-extractor statefulset I0925 21:49:07.297134 1 recorder.go:70] Recording config/workload_info with fingerprint=2c91bdac6bcbeb6d06c86ca76442e77e69f943842b15d5daf33463dcfbac4f89 I0925 21:49:07.297147 1 gather.go:177] gatherer "workloads" function "workload_info" took 2.441558356s to process 1 records E0925 21:49:07.297186 1 periodic.go:250] "Unhandled Error" err="workloads failed after 2.441s with: function \"workload_info\" failed with an error" I0925 21:49:07.298286 1 controllerstatus.go:89] name=periodic-workloads healthy=false reason=PeriodicGatherFailed message=Source workloads could not be retrieved: function "workload_info" failed with an error I0925 21:49:07.298301 1 periodic.go:212] Running conditional gatherer I0925 21:49:07.308392 1 requests.go:294] Making HTTP GET request at: https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules I0925 21:49:07.313650 1 conditional_gatherer.go:107] Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.15:57274->172.30.0.10:53: read: connection refused E0925 21:49:07.313888 1 conditional_gatherer.go:320] unable to update alerts cache: open /var/run/configmaps/service-ca-bundle/service-ca.crt: no such file or directory I0925 21:49:07.313938 1 conditional_gatherer.go:382] updating version cache for conditional gatherer I0925 21:49:07.324713 1 conditional_gatherer.go:390] cluster version is '4.19.9' E0925 21:49:07.324726 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0925 21:49:07.324729 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0925 21:49:07.324732 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0925 21:49:07.324735 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0925 21:49:07.324737 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0925 21:49:07.324739 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0925 21:49:07.324741 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0925 21:49:07.324743 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing E0925 21:49:07.324745 1 conditional_gatherer.go:207] error checking conditions for a gathering rule: alerts cache is missing I0925 21:49:07.324757 1 tasks_processing.go:45] number of workers: 3 I0925 21:49:07.324766 1 tasks_processing.go:69] worker 2 listening for tasks. I0925 21:49:07.324769 1 tasks_processing.go:71] worker 2 working on conditional_gatherer_rules task. I0925 21:49:07.324775 1 tasks_processing.go:69] worker 0 listening for tasks. I0925 21:49:07.324788 1 tasks_processing.go:69] worker 1 listening for tasks. I0925 21:49:07.324791 1 tasks_processing.go:71] worker 0 working on remote_configuration task. I0925 21:49:07.324795 1 tasks_processing.go:74] worker 1 stopped. I0925 21:49:07.324796 1 tasks_processing.go:71] worker 2 working on rapid_container_logs task. I0925 21:49:07.324845 1 recorder.go:70] Recording insights-operator/conditional-gatherer-rules with fingerprint=7034af97e7e41c22e4b775abdd4b9066c8ebb19da33eb7f69f39bfd2eb5f6406 I0925 21:49:07.324856 1 gather.go:177] gatherer "conditional" function "conditional_gatherer_rules" took 733ns to process 1 records I0925 21:49:07.324879 1 recorder.go:70] Recording insights-operator/remote-configuration with fingerprint=0394430c431eec4d48bb1811a90918e95161d2282c59af26f2473613cc0959db I0925 21:49:07.324886 1 gather.go:177] gatherer "conditional" function "remote_configuration" took 796ns to process 1 records I0925 21:49:07.324890 1 tasks_processing.go:74] worker 0 stopped. I0925 21:49:07.325002 1 tasks_processing.go:74] worker 2 stopped. I0925 21:49:07.325012 1 gather.go:177] gatherer "conditional" function "rapid_container_logs" took 202.151µs to process 0 records I0925 21:49:07.325030 1 controllerstatus.go:89] name=periodic-conditional healthy=false reason=NotAvailable message=Get "https://console.redhat.com/api/gathering/v2/4.19.9/gathering_rules": dial tcp: lookup console.redhat.com on 172.30.0.10:53: read udp 10.128.0.15:57274->172.30.0.10:53: read: connection refused I0925 21:49:07.325041 1 recorder.go:70] Recording insights-operator/remote-configuration.json with fingerprint=359de9c990c741675cec72fda96b5c3682221efdb4799f5eaa6e9805bcd3b5c1 I0925 21:49:07.348544 1 recorder.go:70] Recording insights-operator/gathers with fingerprint=d5475d1bdbf00defe78f0a95b10cf21c82bcef6ab94938e6f0591f775f627a9c I0925 21:49:07.348674 1 diskrecorder.go:70] Writing 105 records to /var/lib/insights-operator/insights-2026-09-25-214907.tar.gz I0925 21:49:07.355443 1 diskrecorder.go:51] Wrote 105 records to disk in 6ms I0925 21:49:07.355480 1 periodic.go:281] Gathering cluster info every 2h0m0s I0925 21:49:07.355502 1 periodic.go:282] Configuration is dataReporting: interval: 2h0m0s, uploadEndpoint: https://console.redhat.com/api/ingress/v1/upload, storagePath: /var/lib/insights-operator, downloadEndpoint: https://console.redhat.com/api/insights-results-aggregator/v2/cluster/%s/reports, conditionalGathererEndpoint: https://console.redhat.com/api/gathering/v2/%s/gathering_rules, obfuscation: [] sca: disabled: false, endpoint: https://api.openshift.com/api/accounts_mgmt/v1/entitlement_certificates, interval: 8h0m0s alerting: disabled: false clusterTransfer: endpoint: https://api.openshift.com/api/accounts_mgmt/v1/cluster_transfers/, interval: 12h0m0s proxy: httpProxy: , httpsProxy: , noProxy: I0925 21:49:15.735537 1 configmapobserver.go:84] configmaps "insights-config" not found I0925 21:50:11.061571 1 observer_polling.go:111] Observed file "/var/run/configmaps/service-ca-bundle/service-ca.crt" has been created (hash="ecca983562634d036e831efd2303d1db065a157a2074db0e3ae4ba352c5c2dcc") W0925 21:50:11.061614 1 builder.go:160] Restart triggered because of file /var/run/configmaps/service-ca-bundle/service-ca.crt was created I0925 21:50:11.061660 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.crt" has been created (hash="75d19a21fcffd84239da7a06d89c3c0faa18715a066143aaa5f41dee49beebc3") I0925 21:50:11.061693 1 observer_polling.go:111] Observed file "/var/run/secrets/serving-cert/tls.key" has been created (hash="65f12c22dfcfe473101a03242635071acadbac8fd51088a0d91b4bc65b82e4f1")